[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:25:40.146971  2676 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.62:46275
I20260709 12:25:40.148602  2676 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:25:40.149713  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:40.167578  2683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:40.167591  2685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:40.167623  2682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:40.168638  2676 server_base.cc:1061] running on GCE node
I20260709 12:25:41.409292  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:41.409597  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:41.409816  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783599941409794 us; error 0 us; skew 500 ppm
I20260709 12:25:41.410743  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:41.417316  2676 webserver.cc:533] Webserver started at http://127.2.157.62:38699/ using document root <none> and password file <none>
I20260709 12:25:41.418274  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:41.418524  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:41.419001  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:41.424937  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/master-0-root/instance:
uuid: "b6a8a95e882f407f9accdaccdb9c8f5d"
format_stamp: "Formatted at 2026-07-09 12:25:41 on dist-test-slave-0768"
I20260709 12:25:41.433156  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.001s
I20260709 12:25:41.438786  2691 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:41.440205  2676 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:25:41.440629  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/master-0-root
uuid: "b6a8a95e882f407f9accdaccdb9c8f5d"
format_stamp: "Formatted at 2026-07-09 12:25:41 on dist-test-slave-0768"
I20260709 12:25:41.441038  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:41.496727  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:41.498633  2676 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:25:41.499210  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:41.579277  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.62:46275
I20260709 12:25:41.579326  2742 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.62:46275 every 8 connection(s)
I20260709 12:25:41.588241  2743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:41.613287  2743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d: Bootstrap starting.
I20260709 12:25:41.619445  2743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.621399  2743 log.cc:826] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d: Log is configured to *not* fsync() on all Append() calls
I20260709 12:25:41.626247  2743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d: No bootstrap required, opened a new log
I20260709 12:25:41.648190  2743 raft_consensus.cc:359] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6a8a95e882f407f9accdaccdb9c8f5d" member_type: VOTER }
I20260709 12:25:41.648809  2743 raft_consensus.cc:385] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.649091  2743 raft_consensus.cc:740] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6a8a95e882f407f9accdaccdb9c8f5d, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.650174  2743 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6a8a95e882f407f9accdaccdb9c8f5d" member_type: VOTER }
I20260709 12:25:41.650688  2743 raft_consensus.cc:399] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:41.651010  2743 raft_consensus.cc:493] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:41.651376  2743 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.655680  2743 raft_consensus.cc:515] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6a8a95e882f407f9accdaccdb9c8f5d" member_type: VOTER }
I20260709 12:25:41.656478  2743 leader_election.cc:304] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6a8a95e882f407f9accdaccdb9c8f5d; no voters: 
I20260709 12:25:41.659017  2743 leader_election.cc:290] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:41.659400  2746 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:41.662051  2746 raft_consensus.cc:697] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [term 1 LEADER]: Becoming Leader. State: Replica: b6a8a95e882f407f9accdaccdb9c8f5d, State: Running, Role: LEADER
I20260709 12:25:41.663024  2746 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6a8a95e882f407f9accdaccdb9c8f5d" member_type: VOTER }
I20260709 12:25:41.664145  2743 sys_catalog.cc:565] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:41.673591  2747 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6a8a95e882f407f9accdaccdb9c8f5d. Latest consensus state: current_term: 1 leader_uuid: "b6a8a95e882f407f9accdaccdb9c8f5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6a8a95e882f407f9accdaccdb9c8f5d" member_type: VOTER } }
I20260709 12:25:41.673909  2748 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6a8a95e882f407f9accdaccdb9c8f5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6a8a95e882f407f9accdaccdb9c8f5d" member_type: VOTER } }
I20260709 12:25:41.674397  2747 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:41.674836  2748 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:41.678493  2754 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:41.692452  2754 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:41.694882  2676 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:41.710489  2754 catalog_manager.cc:1383] Generated new cluster ID: ebbab8a0cfb645a6b83f036cfedf58f6
I20260709 12:25:41.710856  2754 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:41.732754  2754 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:41.734531  2754 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:41.751634  2754 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d: Generated new TSK 0
I20260709 12:25:41.752717  2754 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:41.761521  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:41.770006  2765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:41.771560  2766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:41.775995  2676 server_base.cc:1061] running on GCE node
W20260709 12:25:41.776404  2768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:41.777436  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:41.777729  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:41.777990  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783599941777961 us; error 0 us; skew 500 ppm
I20260709 12:25:41.778646  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:41.783694  2676 webserver.cc:533] Webserver started at http://127.2.157.1:37983/ using document root <none> and password file <none>
I20260709 12:25:41.784327  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:41.784583  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:41.784914  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:41.786666  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-0-root/instance:
uuid: "b8940e3feb884892a95310f0dc1c2418"
format_stamp: "Formatted at 2026-07-09 12:25:41 on dist-test-slave-0768"
I20260709 12:25:41.793143  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.005s
I20260709 12:25:41.797837  2773 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:41.798774  2676 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:25:41.799077  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-0-root
uuid: "b8940e3feb884892a95310f0dc1c2418"
format_stamp: "Formatted at 2026-07-09 12:25:41 on dist-test-slave-0768"
I20260709 12:25:41.799391  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:41.827904  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:41.829244  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:41.832072  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:41.836798  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:41.837021  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:41.837348  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:41.837504  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:41.943742  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.1:45835
I20260709 12:25:41.943866  2835 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.1:45835 every 8 connection(s)
I20260709 12:25:41.954826  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:41.970970  2840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:41.975570  2841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:41.984050  2843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:41.987241  2676 server_base.cc:1061] running on GCE node
I20260709 12:25:41.988072  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:41.988286  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:41.988485  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783599941988440 us; error 0 us; skew 500 ppm
I20260709 12:25:41.989110  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:41.992322  2676 webserver.cc:533] Webserver started at http://127.2.157.2:35851/ using document root <none> and password file <none>
I20260709 12:25:41.992877  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:41.993135  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:41.993432  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:41.994693  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-1-root/instance:
uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
format_stamp: "Formatted at 2026-07-09 12:25:41 on dist-test-slave-0768"
I20260709 12:25:41.998903  2836 heartbeater.cc:344] Connected to a master server at 127.2.157.62:46275
I20260709 12:25:41.999418  2836 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:42.000980  2836 heartbeater.cc:507] Master 127.2.157.62:46275 requested a full tablet report, sending...
I20260709 12:25:42.002533  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:42.004894  2708 ts_manager.cc:194] Registered new tserver with Master: b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835)
I20260709 12:25:42.007333  2848 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:42.008315  2676 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:25:42.008616  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-1-root
uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
format_stamp: "Formatted at 2026-07-09 12:25:41 on dist-test-slave-0768"
I20260709 12:25:42.008584  2708 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52146
I20260709 12:25:42.009033  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:42.037364  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:42.038882  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:42.041548  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:42.045110  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:42.045351  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:42.045605  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:42.045794  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:42.150777  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.2:45771
I20260709 12:25:42.150887  2910 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.2:45771 every 8 connection(s)
I20260709 12:25:42.157596  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:42.165619  2914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:42.168939  2915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:42.172555  2917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:42.176328  2911 heartbeater.cc:344] Connected to a master server at 127.2.157.62:46275
I20260709 12:25:42.176783  2911 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:42.177330  2676 server_base.cc:1061] running on GCE node
I20260709 12:25:42.177989  2911 heartbeater.cc:507] Master 127.2.157.62:46275 requested a full tablet report, sending...
I20260709 12:25:42.178611  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:42.178903  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:42.179188  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783599942179163 us; error 0 us; skew 500 ppm
I20260709 12:25:42.180034  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:42.181022  2708 ts_manager.cc:194] Registered new tserver with Master: ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:42.183111  2708 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52158
I20260709 12:25:42.183293  2676 webserver.cc:533] Webserver started at http://127.2.157.3:45857/ using document root <none> and password file <none>
I20260709 12:25:42.184053  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:42.184335  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:42.184686  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:42.186314  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-2-root/instance:
uuid: "abea949f3dba4f89b5007600f8519d4a"
format_stamp: "Formatted at 2026-07-09 12:25:42 on dist-test-slave-0768"
I20260709 12:25:42.191368  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:42.195199  2922 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:42.196262  2676 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:42.196623  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-2-root
uuid: "abea949f3dba4f89b5007600f8519d4a"
format_stamp: "Formatted at 2026-07-09 12:25:42 on dist-test-slave-0768"
I20260709 12:25:42.196996  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599939977835-2676-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:42.224481  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:42.226164  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:42.228185  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:42.231927  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:42.232187  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:42.232462  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:42.232702  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:42.320092  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.3:37397
I20260709 12:25:42.320160  2984 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.3:37397 every 8 connection(s)
I20260709 12:25:42.337924  2985 heartbeater.cc:344] Connected to a master server at 127.2.157.62:46275
I20260709 12:25:42.338411  2985 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:42.339301  2985 heartbeater.cc:507] Master 127.2.157.62:46275 requested a full tablet report, sending...
I20260709 12:25:42.341961  2708 ts_manager.cc:194] Registered new tserver with Master: abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:42.342128  2676 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016381854s
I20260709 12:25:42.343626  2708 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52164
I20260709 12:25:42.399910  2708 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52178:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:42.403870  2708 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:42.535631  2950 tablet_service.cc:1511] Processing CreateTablet for tablet 43b673e0da91404d9c974f5e04655e1c (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:42.537619  2950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b673e0da91404d9c974f5e04655e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.537976  2946 tablet_service.cc:1511] Processing CreateTablet for tablet c9d2dfc6e6314c27bcd91ab1da0da380 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:42.544371  2945 tablet_service.cc:1511] Processing CreateTablet for tablet bc6c1d29e56d45f18131dad906770b95 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:42.547206  2944 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1f815ecf1149cbba9c8797a4a77e18 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:42.551401  2946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d2dfc6e6314c27bcd91ab1da0da380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.554658  2947 tablet_service.cc:1511] Processing CreateTablet for tablet 92ba5e0c526a48ad99e079e1b6d538b1 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:42.558218  2801 tablet_service.cc:1511] Processing CreateTablet for tablet 43b673e0da91404d9c974f5e04655e1c (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:42.550413  2948 tablet_service.cc:1511] Processing CreateTablet for tablet 65de8546427c4a7382c5805646ddd60d (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:42.561108  2942 tablet_service.cc:1511] Processing CreateTablet for tablet e67d23e756e64e69915da508fd3adea8 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:42.567464  2796 tablet_service.cc:1511] Processing CreateTablet for tablet bc6c1d29e56d45f18131dad906770b95 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:42.568969  2945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc6c1d29e56d45f18131dad906770b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.558255  2798 tablet_service.cc:1511] Processing CreateTablet for tablet 92ba5e0c526a48ad99e079e1b6d538b1 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:42.572748  2876 tablet_service.cc:1511] Processing CreateTablet for tablet 43b673e0da91404d9c974f5e04655e1c (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:42.562439  2797 tablet_service.cc:1511] Processing CreateTablet for tablet c9d2dfc6e6314c27bcd91ab1da0da380 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:42.577569  2942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e67d23e756e64e69915da508fd3adea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.575476  2801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b673e0da91404d9c974f5e04655e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.564632  2943 tablet_service.cc:1511] Processing CreateTablet for tablet 6edda213b896400e92a8a69471b30b6a (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:42.574620  2800 tablet_service.cc:1511] Processing CreateTablet for tablet 74248b35b6804c6b88efe1b29473e3b8 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:42.581133  2876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b673e0da91404d9c974f5e04655e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.583563  2944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1f815ecf1149cbba9c8797a4a77e18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.569947  2949 tablet_service.cc:1511] Processing CreateTablet for tablet 74248b35b6804c6b88efe1b29473e3b8 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:42.578907  2799 tablet_service.cc:1511] Processing CreateTablet for tablet 65de8546427c4a7382c5805646ddd60d (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:42.587042  2793 tablet_service.cc:1511] Processing CreateTablet for tablet e67d23e756e64e69915da508fd3adea8 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:42.584872  2874 tablet_service.cc:1511] Processing CreateTablet for tablet 65de8546427c4a7382c5805646ddd60d (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:42.580247  2875 tablet_service.cc:1511] Processing CreateTablet for tablet 74248b35b6804c6b88efe1b29473e3b8 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:42.588152  2794 tablet_service.cc:1511] Processing CreateTablet for tablet 6edda213b896400e92a8a69471b30b6a (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:42.588760  2797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d2dfc6e6314c27bcd91ab1da0da380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.589321  2795 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1f815ecf1149cbba9c8797a4a77e18 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:42.592010  2948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65de8546427c4a7382c5805646ddd60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.593626  2873 tablet_service.cc:1511] Processing CreateTablet for tablet 92ba5e0c526a48ad99e079e1b6d538b1 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:42.599977  2949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74248b35b6804c6b88efe1b29473e3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.599864  2872 tablet_service.cc:1511] Processing CreateTablet for tablet c9d2dfc6e6314c27bcd91ab1da0da380 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:42.601908  2874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65de8546427c4a7382c5805646ddd60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.608664  2871 tablet_service.cc:1511] Processing CreateTablet for tablet bc6c1d29e56d45f18131dad906770b95 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:42.614312  2943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6edda213b896400e92a8a69471b30b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.618286  2798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ba5e0c526a48ad99e079e1b6d538b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.619529  2875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74248b35b6804c6b88efe1b29473e3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.623298  2870 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1f815ecf1149cbba9c8797a4a77e18 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:42.629963  2871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc6c1d29e56d45f18131dad906770b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.633980  2869 tablet_service.cc:1511] Processing CreateTablet for tablet 6edda213b896400e92a8a69471b30b6a (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:42.640403  2799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65de8546427c4a7382c5805646ddd60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.643656  2869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6edda213b896400e92a8a69471b30b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.643827  2947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ba5e0c526a48ad99e079e1b6d538b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.649144  2870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1f815ecf1149cbba9c8797a4a77e18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.651343  2793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e67d23e756e64e69915da508fd3adea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.654130  2868 tablet_service.cc:1511] Processing CreateTablet for tablet e67d23e756e64e69915da508fd3adea8 (DEFAULT_TABLE table=test-workload [id=a508a6b8083c4aacb3165a790d923ae2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:42.658996  2872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d2dfc6e6314c27bcd91ab1da0da380. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:42.711652  2756 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:42.712540  2868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e67d23e756e64e69915da508fd3adea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.709758  2796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc6c1d29e56d45f18131dad906770b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.732151  2800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74248b35b6804c6b88efe1b29473e3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.733340  2795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1f815ecf1149cbba9c8797a4a77e18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.730019  2873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ba5e0c526a48ad99e079e1b6d538b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.764691  2794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6edda213b896400e92a8a69471b30b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:42.894596  3004 tablet_bootstrap.cc:492] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a: Bootstrap starting.
I20260709 12:25:42.908681  3003 tablet_bootstrap.cc:492] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd: Bootstrap starting.
I20260709 12:25:42.947445  3004 tablet_bootstrap.cc:654] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.008364  3003 tablet_bootstrap.cc:654] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.010735  3004 tablet_bootstrap.cc:492] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a: No bootstrap required, opened a new log
I20260709 12:25:43.011574  3004 ts_tablet_manager.cc:1403] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.023s
I20260709 12:25:43.013048  2836 heartbeater.cc:499] Master 127.2.157.62:46275 was elected leader, sending a full tablet report...
I20260709 12:25:43.019629  3005 tablet_bootstrap.cc:492] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418: Bootstrap starting.
I20260709 12:25:43.027369  3004 raft_consensus.cc:359] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:43.028234  3004 raft_consensus.cc:385] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.028550  3004 raft_consensus.cc:740] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.029440  3004 consensus_queue.cc:260] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:43.032437  3005 tablet_bootstrap.cc:654] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.039520  3003 tablet_bootstrap.cc:492] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd: No bootstrap required, opened a new log
I20260709 12:25:43.039795  2985 heartbeater.cc:499] Master 127.2.157.62:46275 was elected leader, sending a full tablet report...
I20260709 12:25:43.040088  3003 ts_tablet_manager.cc:1403] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent bootstrapping tablet: real 0.133s	user 0.010s	sys 0.023s
I20260709 12:25:43.041108  3005 tablet_bootstrap.cc:492] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418: No bootstrap required, opened a new log
I20260709 12:25:43.041538  3005 ts_tablet_manager.cc:1403] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.003s
I20260709 12:25:43.042937  3003 raft_consensus.cc:359] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:43.043650  3003 raft_consensus.cc:385] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.043735  3004 ts_tablet_manager.cc:1434] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a: Time spent starting tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 12:25:43.044010  3003 raft_consensus.cc:740] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.044787  3004 tablet_bootstrap.cc:492] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a: Bootstrap starting.
I20260709 12:25:43.044847  3003 consensus_queue.cc:260] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:43.053306  2911 heartbeater.cc:499] Master 127.2.157.62:46275 was elected leader, sending a full tablet report...
I20260709 12:25:43.055766  3003 ts_tablet_manager.cc:1434] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.011s
I20260709 12:25:43.056844  3003 tablet_bootstrap.cc:492] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd: Bootstrap starting.
I20260709 12:25:43.057966  3005 raft_consensus.cc:359] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.058807  3005 raft_consensus.cc:385] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.059171  3005 raft_consensus.cc:740] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.060164  3005 consensus_queue.cc:260] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.061301  3004 tablet_bootstrap.cc:654] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.063349  3003 tablet_bootstrap.cc:654] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.053318  3010 raft_consensus.cc:493] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.065687  3010 raft_consensus.cc:515] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:43.068817  3010 leader_election.cc:290] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397), b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835)
I20260709 12:25:43.078485  3003 tablet_bootstrap.cc:492] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd: No bootstrap required, opened a new log
I20260709 12:25:43.079020  3003 ts_tablet_manager.cc:1403] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
W20260709 12:25:43.079922  2986 tablet.cc:2406] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:43.082257  3003 raft_consensus.cc:359] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.082985  3003 raft_consensus.cc:385] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.083280  3003 raft_consensus.cc:740] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.084002  3003 consensus_queue.cc:260] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.088581  3003 ts_tablet_manager.cc:1434] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:25:43.089684  3003 tablet_bootstrap.cc:492] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd: Bootstrap starting.
I20260709 12:25:43.094615  3004 tablet_bootstrap.cc:492] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a: No bootstrap required, opened a new log
I20260709 12:25:43.095101  3004 ts_tablet_manager.cc:1403] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a: Time spent bootstrapping tablet: real 0.051s	user 0.005s	sys 0.009s
I20260709 12:25:43.096203  3003 tablet_bootstrap.cc:654] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.106056  3005 ts_tablet_manager.cc:1434] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.008s
I20260709 12:25:43.107228  3005 tablet_bootstrap.cc:492] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418: Bootstrap starting.
I20260709 12:25:43.114885  3004 raft_consensus.cc:359] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.116605  3004 raft_consensus.cc:385] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.117071  3004 raft_consensus.cc:740] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.119393  3004 consensus_queue.cc:260] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.122751  3004 ts_tablet_manager.cc:1434] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.005s
I20260709 12:25:43.123658  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b673e0da91404d9c974f5e04655e1c" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418" is_pre_election: true
I20260709 12:25:43.124320  3004 tablet_bootstrap.cc:492] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a: Bootstrap starting.
W20260709 12:25:43.126096  2851 leader_election.cc:343] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.130990  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b673e0da91404d9c974f5e04655e1c" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abea949f3dba4f89b5007600f8519d4a" is_pre_election: true
I20260709 12:25:43.131719  2960 raft_consensus.cc:2468] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 0.
I20260709 12:25:43.132622  3004 tablet_bootstrap.cc:654] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.133246  2850 leader_election.cc:304] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: b8940e3feb884892a95310f0dc1c2418
I20260709 12:25:43.134145  3010 raft_consensus.cc:2804] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.134533  3010 raft_consensus.cc:493] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.134886  3010 raft_consensus.cc:3060] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.141291  3005 tablet_bootstrap.cc:654] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.145514  3004 tablet_bootstrap.cc:492] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a: No bootstrap required, opened a new log
I20260709 12:25:43.146414  3004 ts_tablet_manager.cc:1403] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.015s
I20260709 12:25:43.149849  3010 raft_consensus.cc:515] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:43.153014  3004 raft_consensus.cc:359] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.154021  3004 raft_consensus.cc:385] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.154779  3004 raft_consensus.cc:740] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.156404  3004 consensus_queue.cc:260] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.160945  3004 ts_tablet_manager.cc:1434] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.007s
I20260709 12:25:43.162165  3004 tablet_bootstrap.cc:492] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a: Bootstrap starting.
I20260709 12:25:43.162791  3012 raft_consensus.cc:493] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.163432  3012 raft_consensus.cc:515] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.168560  3012 leader_election.cc:290] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:43.174875  3003 tablet_bootstrap.cc:492] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd: No bootstrap required, opened a new log
I20260709 12:25:43.180913  3003 ts_tablet_manager.cc:1403] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent bootstrapping tablet: real 0.091s	user 0.031s	sys 0.013s
I20260709 12:25:43.188158  3005 tablet_bootstrap.cc:492] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418: No bootstrap required, opened a new log
I20260709 12:25:43.188812  3005 ts_tablet_manager.cc:1403] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418: Time spent bootstrapping tablet: real 0.082s	user 0.006s	sys 0.017s
I20260709 12:25:43.189496  3010 leader_election.cc:290] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 election: Requested vote from peers abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397), b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835)
I20260709 12:25:43.188278  3003 raft_consensus.cc:359] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.190775  3003 raft_consensus.cc:385] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.190910  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b673e0da91404d9c974f5e04655e1c" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:43.191108  3003 raft_consensus.cc:740] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.191619  2960 raft_consensus.cc:3060] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.192467  3005 raft_consensus.cc:359] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.193342  3005 raft_consensus.cc:385] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.192041  3003 consensus_queue.cc:260] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.193622  3005 raft_consensus.cc:740] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.197724  3005 consensus_queue.cc:260] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.201030  3005 ts_tablet_manager.cc:1434] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:25:43.201071  3003 ts_tablet_manager.cc:1434] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:25:43.203464  3003 tablet_bootstrap.cc:492] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd: Bootstrap starting.
I20260709 12:25:43.203874  3005 tablet_bootstrap.cc:492] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418: Bootstrap starting.
I20260709 12:25:43.206238  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b673e0da91404d9c974f5e04655e1c" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:43.211339  2960 raft_consensus.cc:2468] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 1.
W20260709 12:25:43.212345  2851 leader_election.cc:343] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.208448  3004 tablet_bootstrap.cc:654] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.220558  2850 leader_election.cc:304] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: b8940e3feb884892a95310f0dc1c2418
I20260709 12:25:43.221386  3010 raft_consensus.cc:2804] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.222007  3010 raft_consensus.cc:697] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 LEADER]: Becoming Leader. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:25:43.222959  3010 consensus_queue.cc:237] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:43.224855  3003 tablet_bootstrap.cc:654] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.229802  3005 tablet_bootstrap.cc:654] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.232872  2886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" is_pre_election: true
W20260709 12:25:43.234803  2776 leader_election.cc:343] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.240443  2707 catalog_manager.cc:5697] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd reported cstate change: term changed from 0 to 1, leader changed from <none> to ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2). New cstate: current_term: 1 leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:43.246977  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abea949f3dba4f89b5007600f8519d4a" is_pre_election: true
W20260709 12:25:43.248509  2775 leader_election.cc:343] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.248929  2775 leader_election.cc:304] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8940e3feb884892a95310f0dc1c2418; no voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:43.249724  3012 raft_consensus.cc:2749] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.256034  3005 tablet_bootstrap.cc:492] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418: No bootstrap required, opened a new log
I20260709 12:25:43.257500  3005 ts_tablet_manager.cc:1403] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.004s
I20260709 12:25:43.256656  3003 tablet_bootstrap.cc:492] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd: No bootstrap required, opened a new log
I20260709 12:25:43.258934  3003 ts_tablet_manager.cc:1403] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.000s
I20260709 12:25:43.264575  3004 tablet_bootstrap.cc:492] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a: No bootstrap required, opened a new log
I20260709 12:25:43.264986  3004 ts_tablet_manager.cc:1403] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a: Time spent bootstrapping tablet: real 0.103s	user 0.006s	sys 0.012s
I20260709 12:25:43.268033  3003 raft_consensus.cc:359] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.268659  3010 raft_consensus.cc:493] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.268939  3003 raft_consensus.cc:385] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.269323  3003 raft_consensus.cc:740] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.269205  3010 raft_consensus.cc:515] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.270205  3003 consensus_queue.cc:260] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.271853  3010 leader_election.cc:290] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:43.272680  3003 ts_tablet_manager.cc:1434] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:25:43.273062  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edda213b896400e92a8a69471b30b6a" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418" is_pre_election: true
I20260709 12:25:43.273435  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edda213b896400e92a8a69471b30b6a" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abea949f3dba4f89b5007600f8519d4a" is_pre_election: true
W20260709 12:25:43.274587  2851 leader_election.cc:343] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:43.275045  2850 leader_election.cc:343] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.274977  3005 raft_consensus.cc:359] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.275602  2850 leader_election.cc:304] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca61502f80cc47e09f103fdc7b3bcdcd; no voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418
I20260709 12:25:43.275884  3005 raft_consensus.cc:385] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.276211  3005 raft_consensus.cc:740] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.276783  3010 raft_consensus.cc:2749] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.276996  3005 consensus_queue.cc:260] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.279013  3004 raft_consensus.cc:359] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.279736  3005 ts_tablet_manager.cc:1434] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:25:43.279884  3004 raft_consensus.cc:385] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.280545  3004 raft_consensus.cc:740] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.280807  3005 tablet_bootstrap.cc:492] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418: Bootstrap starting.
I20260709 12:25:43.281462  3004 consensus_queue.cc:260] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.284264  3004 ts_tablet_manager.cc:1434] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.005s
I20260709 12:25:43.285442  3004 tablet_bootstrap.cc:492] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a: Bootstrap starting.
I20260709 12:25:43.289459  3005 tablet_bootstrap.cc:654] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.273733  3003 tablet_bootstrap.cc:492] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd: Bootstrap starting.
I20260709 12:25:43.297341  3008 raft_consensus.cc:493] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.297976  3008 raft_consensus.cc:515] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.301306  3008 leader_election.cc:290] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:43.301869  3004 tablet_bootstrap.cc:654] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.309234  3003 tablet_bootstrap.cc:654] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.320174  3004 tablet_bootstrap.cc:492] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a: No bootstrap required, opened a new log
I20260709 12:25:43.320745  3004 ts_tablet_manager.cc:1403] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.008s
I20260709 12:25:43.323836  3004 raft_consensus.cc:359] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.324649  3004 raft_consensus.cc:385] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.324955  3004 raft_consensus.cc:740] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.325659  3004 consensus_queue.cc:260] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.338266  3004 ts_tablet_manager.cc:1434] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:25:43.339275  3004 tablet_bootstrap.cc:492] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a: Bootstrap starting.
I20260709 12:25:43.354811  3004 tablet_bootstrap.cc:654] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.358913  3003 tablet_bootstrap.cc:492] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd: No bootstrap required, opened a new log
I20260709 12:25:43.359405  3003 ts_tablet_manager.cc:1403] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent bootstrapping tablet: real 0.086s	user 0.027s	sys 0.019s
I20260709 12:25:43.366103  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edda213b896400e92a8a69471b30b6a" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418" is_pre_election: true
W20260709 12:25:43.367897  2925 leader_election.cc:343] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.368994  3005 tablet_bootstrap.cc:492] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418: No bootstrap required, opened a new log
I20260709 12:25:43.369705  3005 ts_tablet_manager.cc:1403] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418: Time spent bootstrapping tablet: real 0.089s	user 0.045s	sys 0.031s
I20260709 12:25:43.371656  2886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edda213b896400e92a8a69471b30b6a" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" is_pre_election: true
I20260709 12:25:43.372310  2886 raft_consensus.cc:2468] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 0.
I20260709 12:25:43.373528  2925 leader_election.cc:304] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: b8940e3feb884892a95310f0dc1c2418
I20260709 12:25:43.374462  3008 raft_consensus.cc:2804] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.374995  3008 raft_consensus.cc:493] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.375483  3008 raft_consensus.cc:3060] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.374089  3005 raft_consensus.cc:359] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.378790  3005 raft_consensus.cc:385] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.379262  3005 raft_consensus.cc:740] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.378757  3003 raft_consensus.cc:359] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.379752  3003 raft_consensus.cc:385] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.380080  3003 raft_consensus.cc:740] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.380103  3005 consensus_queue.cc:260] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.381714  3003 consensus_queue.cc:260] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.383147  3005 ts_tablet_manager.cc:1434] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:25:43.384218  3005 tablet_bootstrap.cc:492] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418: Bootstrap starting.
I20260709 12:25:43.384434  3003 ts_tablet_manager.cc:1434] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:25:43.385484  3003 tablet_bootstrap.cc:492] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd: Bootstrap starting.
I20260709 12:25:43.392714  3003 tablet_bootstrap.cc:654] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.393102  3005 tablet_bootstrap.cc:654] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.409086  3003 tablet_bootstrap.cc:492] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd: No bootstrap required, opened a new log
I20260709 12:25:43.409744  3003 ts_tablet_manager.cc:1403] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.013s
I20260709 12:25:43.410631  3005 tablet_bootstrap.cc:492] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418: No bootstrap required, opened a new log
I20260709 12:25:43.411151  3005 ts_tablet_manager.cc:1403] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.014s
I20260709 12:25:43.411609  3008 raft_consensus.cc:515] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.412138  3004 tablet_bootstrap.cc:492] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a: No bootstrap required, opened a new log
I20260709 12:25:43.412688  3004 ts_tablet_manager.cc:1403] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a: Time spent bootstrapping tablet: real 0.074s	user 0.023s	sys 0.007s
I20260709 12:25:43.414592  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edda213b896400e92a8a69471b30b6a" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:43.414469  3005 raft_consensus.cc:359] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.415211  2811 raft_consensus.cc:3060] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.415328  3005 raft_consensus.cc:385] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.415731  3005 raft_consensus.cc:740] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.415861  3004 raft_consensus.cc:359] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.416625  3004 raft_consensus.cc:385] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.417109  3004 raft_consensus.cc:740] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.416615  3005 consensus_queue.cc:260] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.417968  3004 consensus_queue.cc:260] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.419730  3005 ts_tablet_manager.cc:1434] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 12:25:43.422998  3005 tablet_bootstrap.cc:492] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418: Bootstrap starting.
I20260709 12:25:43.424412  3003 raft_consensus.cc:359] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.425215  3003 raft_consensus.cc:385] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.425531  3003 raft_consensus.cc:740] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.426433  3003 consensus_queue.cc:260] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.429174  3003 ts_tablet_manager.cc:1434] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:25:43.430272  3003 tablet_bootstrap.cc:492] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd: Bootstrap starting.
I20260709 12:25:43.431043  3005 tablet_bootstrap.cc:654] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.431195  3040 raft_consensus.cc:493] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.431735  3040 raft_consensus.cc:515] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.434134  3040 leader_election.cc:290] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:43.435833  3004 ts_tablet_manager.cc:1434] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.005s
I20260709 12:25:43.437321  3004 tablet_bootstrap.cc:492] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a: Bootstrap starting.
I20260709 12:25:43.439505  2886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2dfc6e6314c27bcd91ab1da0da380" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" is_pre_election: true
W20260709 12:25:43.441442  2925 leader_election.cc:343] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.441723  2810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2dfc6e6314c27bcd91ab1da0da380" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418" is_pre_election: true
I20260709 12:25:43.443981  3005 tablet_bootstrap.cc:492] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418: No bootstrap required, opened a new log
I20260709 12:25:43.444537  3005 ts_tablet_manager.cc:1403] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:25:43.446491  2811 raft_consensus.cc:2468] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 1.
I20260709 12:25:43.447513  3004 tablet_bootstrap.cc:654] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.448591  3005 raft_consensus.cc:359] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:43.449455  3005 raft_consensus.cc:385] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.449811  3005 raft_consensus.cc:740] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.450577  3040 raft_consensus.cc:493] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.450742  3005 consensus_queue.cc:260] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:43.451036  3040 raft_consensus.cc:515] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.452622  3003 tablet_bootstrap.cc:654] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.453101  3040 leader_election.cc:290] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:43.453716  3005 ts_tablet_manager.cc:1434] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.005s
I20260709 12:25:43.454164  3008 leader_election.cc:290] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:43.454859  3005 tablet_bootstrap.cc:492] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418: Bootstrap starting.
W20260709 12:25:43.457165  2925 leader_election.cc:343] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.457686  2925 leader_election.cc:304] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a; no voters: b8940e3feb884892a95310f0dc1c2418, ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:43.453576  3040 raft_consensus.cc:493] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.459728  3008 raft_consensus.cc:2749] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.460736  3010 raft_consensus.cc:493] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.460668  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edda213b896400e92a8a69471b30b6a" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:25:43.462016  3010 raft_consensus.cc:515] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.462738  2885 raft_consensus.cc:3060] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.465183  3010 leader_election.cc:290] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:43.459827  3040 raft_consensus.cc:515] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.470790  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418" is_pre_election: true
I20260709 12:25:43.472520  3040 leader_election.cc:290] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:43.471984  2810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418" is_pre_election: true
W20260709 12:25:43.476845  2851 leader_election.cc:343] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.466984  2886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" is_pre_election: true
I20260709 12:25:43.472698  2811 raft_consensus.cc:2468] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 0.
I20260709 12:25:43.479651  2886 raft_consensus.cc:2468] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 0.
I20260709 12:25:43.483556  2925 leader_election.cc:304] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:25:43.485683  3040 raft_consensus.cc:2804] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.486274  3040 raft_consensus.cc:697] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Becoming Leader. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:43.487558  3040 consensus_queue.cc:237] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.490893  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418" is_pre_election: true
I20260709 12:25:43.497524  2885 raft_consensus.cc:2468] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 1.
I20260709 12:25:43.499161  2886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" is_pre_election: true
I20260709 12:25:43.500658  2886 raft_consensus.cc:2468] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 0.
I20260709 12:25:43.502987  2925 leader_election.cc:304] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:25:43.510072  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abea949f3dba4f89b5007600f8519d4a" is_pre_election: true
I20260709 12:25:43.510823  2960 raft_consensus.cc:2468] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 0.
I20260709 12:25:43.511124  3004 tablet_bootstrap.cc:492] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a: No bootstrap required, opened a new log
I20260709 12:25:43.511631  3004 ts_tablet_manager.cc:1403] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a: Time spent bootstrapping tablet: real 0.075s	user 0.017s	sys 0.011s
I20260709 12:25:43.511988  2850 leader_election.cc:304] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: b8940e3feb884892a95310f0dc1c2418
I20260709 12:25:43.513474  3010 raft_consensus.cc:2804] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.513972  3010 raft_consensus.cc:493] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:43.514214  2925 leader_election.cc:343] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.514465  3010 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.515553  2925 leader_election.cc:304] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: b8940e3feb884892a95310f0dc1c2418
I20260709 12:25:43.517251  3005 tablet_bootstrap.cc:654] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.518038  3008 raft_consensus.cc:2804] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.518388  3008 raft_consensus.cc:493] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.518718  3008 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.518579  3004 raft_consensus.cc:359] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.519327  3004 raft_consensus.cc:385] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.519626  3004 raft_consensus.cc:740] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.520368  3004 consensus_queue.cc:260] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.523264  3041 raft_consensus.cc:2804] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.523854  3041 raft_consensus.cc:493] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.524252  3041 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.528149  3008 raft_consensus.cc:515] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.530782  3008 leader_election.cc:290] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:43.528995  2707 catalog_manager.cc:5697] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a reported cstate change: term changed from 0 to 1, leader changed from <none> to abea949f3dba4f89b5007600f8519d4a (127.2.157.3). New cstate: current_term: 1 leader_uuid: "abea949f3dba4f89b5007600f8519d4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:43.533849  3003 tablet_bootstrap.cc:492] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd: No bootstrap required, opened a new log
I20260709 12:25:43.534338  3003 ts_tablet_manager.cc:1403] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent bootstrapping tablet: real 0.104s	user 0.015s	sys 0.009s
I20260709 12:25:43.536926  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:43.534929  3010 raft_consensus.cc:515] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.542061  3010 leader_election.cc:290] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:43.542783  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:43.544047  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
W20260709 12:25:43.544523  2851 leader_election.cc:343] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.544929  2960 raft_consensus.cc:2393] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca61502f80cc47e09f103fdc7b3bcdcd in current term 1: Already voted for candidate abea949f3dba4f89b5007600f8519d4a in this term.
I20260709 12:25:43.546940  2850 leader_election.cc:304] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca61502f80cc47e09f103fdc7b3bcdcd; no voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418
I20260709 12:25:43.548213  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:25:43.549381  2885 raft_consensus.cc:2393] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate abea949f3dba4f89b5007600f8519d4a in current term 1: Already voted for candidate ca61502f80cc47e09f103fdc7b3bcdcd in this term.
I20260709 12:25:43.551664  3010 raft_consensus.cc:2749] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.548599  3003 raft_consensus.cc:359] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.554513  3003 raft_consensus.cc:385] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.554919  3003 raft_consensus.cc:740] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.555888  3003 consensus_queue.cc:260] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
W20260709 12:25:43.558461  2925 leader_election.cc:343] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.559875  2925 leader_election.cc:304] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a; no voters: b8940e3feb884892a95310f0dc1c2418, ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:43.561376  3003 ts_tablet_manager.cc:1434] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.005s
I20260709 12:25:43.562409  3003 tablet_bootstrap.cc:492] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd: Bootstrap starting.
I20260709 12:25:43.563481  3041 raft_consensus.cc:515] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.564842  3046 raft_consensus.cc:2749] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.568436  3005 tablet_bootstrap.cc:492] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418: No bootstrap required, opened a new log
I20260709 12:25:43.569135  3005 ts_tablet_manager.cc:1403] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418: Time spent bootstrapping tablet: real 0.114s	user 0.010s	sys 0.008s
I20260709 12:25:43.570912  3008 raft_consensus.cc:493] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.571400  3008 raft_consensus.cc:515] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.572093  3003 tablet_bootstrap.cc:654] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.570925  3004 ts_tablet_manager.cc:1434] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a: Time spent starting tablet: real 0.059s	user 0.020s	sys 0.018s
I20260709 12:25:43.575784  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418" is_pre_election: true
I20260709 12:25:43.575670  3005 raft_consensus.cc:359] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.576442  3005 raft_consensus.cc:385] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.576444  2811 raft_consensus.cc:2468] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 0.
I20260709 12:25:43.576815  3005 raft_consensus.cc:740] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.577011  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" is_pre_election: true
I20260709 12:25:43.577751  2925 leader_election.cc:304] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:25:43.577009  3004 tablet_bootstrap.cc:492] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a: Bootstrap starting.
I20260709 12:25:43.578583  3040 raft_consensus.cc:2804] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:25:43.578730  2925 leader_election.cc:343] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.578980  3040 raft_consensus.cc:493] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.579355  3040 raft_consensus.cc:3060] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.579331  3008 leader_election.cc:290] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:43.584465  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:43.581851  3005 consensus_queue.cc:260] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.586383  2811 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.583334  3041 leader_election.cc:290] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:43.591059  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:25:43.591637  2885 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.594807  3040 raft_consensus.cc:515] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.597527  2811 raft_consensus.cc:2468] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 1.
I20260709 12:25:43.598524  2885 raft_consensus.cc:2468] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 1.
I20260709 12:25:43.598570  2810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:43.599675  2810 raft_consensus.cc:3060] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.601351  2925 leader_election.cc:304] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:43.605193  3041 raft_consensus.cc:2804] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.603955  3040 leader_election.cc:290] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:43.605759  3041 raft_consensus.cc:697] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Becoming Leader. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:43.607439  3041 consensus_queue.cc:237] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.606593  3005 ts_tablet_manager.cc:1434] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.007s
I20260709 12:25:43.611205  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:25:43.611584  3005 tablet_bootstrap.cc:492] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418: Bootstrap starting.
W20260709 12:25:43.612725  2925 leader_election.cc:343] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.616019  3003 tablet_bootstrap.cc:492] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd: No bootstrap required, opened a new log
I20260709 12:25:43.616477  3003 ts_tablet_manager.cc:1403] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.009s
I20260709 12:25:43.617112  2810 raft_consensus.cc:2468] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 1.
I20260709 12:25:43.621111  2925 leader_election.cc:304] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:43.622236  3040 raft_consensus.cc:2804] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.622778  3040 raft_consensus.cc:697] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Becoming Leader. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:43.623831  3040 consensus_queue.cc:237] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.630950  3046 raft_consensus.cc:493] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.631589  3046 raft_consensus.cc:515] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.635656  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e67d23e756e64e69915da508fd3adea8" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" is_pre_election: true
I20260709 12:25:43.633656  3046 leader_election.cc:290] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:43.636451  2885 raft_consensus.cc:2468] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 0.
I20260709 12:25:43.640045  2925 leader_election.cc:304] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:43.641176  3041 raft_consensus.cc:2804] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.641759  3041 raft_consensus.cc:493] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.642293  3041 raft_consensus.cc:3060] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.665876  3004 tablet_bootstrap.cc:654] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.680716  3003 raft_consensus.cc:359] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.681579  3003 raft_consensus.cc:385] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.683027  3012 raft_consensus.cc:493] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.667220  2705 catalog_manager.cc:5697] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a reported cstate change: term changed from 0 to 1, leader changed from <none> to abea949f3dba4f89b5007600f8519d4a (127.2.157.3). New cstate: current_term: 1 leader_uuid: "abea949f3dba4f89b5007600f8519d4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:43.683364  3003 raft_consensus.cc:740] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.683787  3012 raft_consensus.cc:515] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.685863  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e67d23e756e64e69915da508fd3adea8" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418" is_pre_election: true
I20260709 12:25:43.690066  3003 consensus_queue.cc:260] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.691373  2810 raft_consensus.cc:3060] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.691745  3003 ts_tablet_manager.cc:1434] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent starting tablet: real 0.075s	user 0.026s	sys 0.029s
I20260709 12:25:43.691807  3012 leader_election.cc:290] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:43.692710  3003 tablet_bootstrap.cc:492] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd: Bootstrap starting.
I20260709 12:25:43.693786  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba5e0c526a48ad99e079e1b6d538b1" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" is_pre_election: true
I20260709 12:25:43.688903  2811 raft_consensus.cc:2468] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 0.
I20260709 12:25:43.704370  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba5e0c526a48ad99e079e1b6d538b1" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abea949f3dba4f89b5007600f8519d4a" is_pre_election: true
W20260709 12:25:43.706975  2775 leader_election.cc:343] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.703936  2885 raft_consensus.cc:2468] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 0.
I20260709 12:25:43.702652  3010 consensus_queue.cc:1048] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:25:43.709100  2776 leader_election.cc:304] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8940e3feb884892a95310f0dc1c2418, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: abea949f3dba4f89b5007600f8519d4a
I20260709 12:25:43.711678  3012 raft_consensus.cc:2804] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.712121  3012 raft_consensus.cc:493] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.712472  3012 raft_consensus.cc:3060] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:43.721453  2756 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:43.719480  3041 raft_consensus.cc:515] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.725306  3004 tablet_bootstrap.cc:492] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a: No bootstrap required, opened a new log
I20260709 12:25:43.725682  3004 ts_tablet_manager.cc:1403] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a: Time spent bootstrapping tablet: real 0.149s	user 0.008s	sys 0.010s
I20260709 12:25:43.727670  3003 tablet_bootstrap.cc:654] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.727782  3004 raft_consensus.cc:359] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.728308  3004 raft_consensus.cc:385] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.728495  3004 raft_consensus.cc:740] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.730068  3004 consensus_queue.cc:260] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.736392  3005 tablet_bootstrap.cc:654] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.735366  3041 leader_election.cc:290] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:43.750293  3004 ts_tablet_manager.cc:1434] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:25:43.751456  3004 tablet_bootstrap.cc:492] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a: Bootstrap starting.
I20260709 12:25:43.751844  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e67d23e756e64e69915da508fd3adea8" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:25:43.748644  3010 consensus_queue.cc:1048] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:25:43.750589  2810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e67d23e756e64e69915da508fd3adea8" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:43.755932  2885 raft_consensus.cc:3060] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.756572  2810 raft_consensus.cc:3060] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.772739  3004 tablet_bootstrap.cc:654] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.785646  3005 tablet_bootstrap.cc:492] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418: No bootstrap required, opened a new log
I20260709 12:25:43.786007  3003 tablet_bootstrap.cc:492] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd: No bootstrap required, opened a new log
I20260709 12:25:43.786373  3005 ts_tablet_manager.cc:1403] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418: Time spent bootstrapping tablet: real 0.175s	user 0.023s	sys 0.002s
I20260709 12:25:43.786417  3003 ts_tablet_manager.cc:1403] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.000s
I20260709 12:25:43.810523  3003 raft_consensus.cc:359] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.811542  3003 raft_consensus.cc:385] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.811872  3003 raft_consensus.cc:740] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.811836  2885 raft_consensus.cc:2468] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 1.
I20260709 12:25:43.818445  3004 tablet_bootstrap.cc:492] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a: No bootstrap required, opened a new log
I20260709 12:25:43.819855  3004 ts_tablet_manager.cc:1403] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.014s
I20260709 12:25:43.813460  3003 consensus_queue.cc:260] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.818238  2810 raft_consensus.cc:2468] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 1.
I20260709 12:25:43.813328  2925 leader_election.cc:304] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:43.822118  3003 ts_tablet_manager.cc:1434] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.004s
I20260709 12:25:43.821385  2705 catalog_manager.cc:5697] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a reported cstate change: term changed from 0 to 1, leader changed from <none> to abea949f3dba4f89b5007600f8519d4a (127.2.157.3). New cstate: current_term: 1 leader_uuid: "abea949f3dba4f89b5007600f8519d4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:43.822822  3004 raft_consensus.cc:359] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.827150  3004 raft_consensus.cc:385] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.827435  3004 raft_consensus.cc:740] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.825733  3041 raft_consensus.cc:2804] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.826406  3005 raft_consensus.cc:359] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.828227  3005 raft_consensus.cc:385] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.828447  3041 raft_consensus.cc:697] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Becoming Leader. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:43.828549  3005 raft_consensus.cc:740] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.829582  3005 consensus_queue.cc:260] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.829751  3041 consensus_queue.cc:237] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.814913  3012 raft_consensus.cc:515] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.833259  3005 ts_tablet_manager.cc:1434] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
I20260709 12:25:43.834147  3005 tablet_bootstrap.cc:492] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418: Bootstrap starting.
I20260709 12:25:43.834909  3004 consensus_queue.cc:260] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.837026  3058 raft_consensus.cc:493] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.838438  3004 ts_tablet_manager.cc:1434] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:25:43.837699  3058 raft_consensus.cc:515] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.841017  3058 leader_election.cc:290] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:43.842840  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2dfc6e6314c27bcd91ab1da0da380" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" is_pre_election: true
I20260709 12:25:43.843614  2885 raft_consensus.cc:2468] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 0.
I20260709 12:25:43.845242  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2dfc6e6314c27bcd91ab1da0da380" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abea949f3dba4f89b5007600f8519d4a" is_pre_election: true
I20260709 12:25:43.846025  2960 raft_consensus.cc:2468] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 0.
I20260709 12:25:43.847440  2775 leader_election.cc:304] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:25:43.854890  3005 tablet_bootstrap.cc:654] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.852015  3058 raft_consensus.cc:2804] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.855561  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba5e0c526a48ad99e079e1b6d538b1" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:25:43.859673  3058 raft_consensus.cc:493] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.861002  2885 raft_consensus.cc:3060] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.861219  3012 leader_election.cc:290] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 election: Requested vote from peers ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:43.863198  3058 raft_consensus.cc:3060] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.865444  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba5e0c526a48ad99e079e1b6d538b1" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:43.870221  2960 raft_consensus.cc:3060] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.885485  3011 raft_consensus.cc:493] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.886690  3011 raft_consensus.cc:515] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.894719  3011 leader_election.cc:290] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:43.894742  3041 consensus_queue.cc:1048] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:43.896297  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abea949f3dba4f89b5007600f8519d4a" is_pre_election: true
I20260709 12:25:43.899736  2885 raft_consensus.cc:2468] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 1.
I20260709 12:25:43.901471  2776 leader_election.cc:304] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8940e3feb884892a95310f0dc1c2418, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:43.895978  2810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418" is_pre_election: true
I20260709 12:25:43.902698  3012 raft_consensus.cc:2804] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.903158  2810 raft_consensus.cc:2393] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca61502f80cc47e09f103fdc7b3bcdcd in current term 1: Already voted for candidate abea949f3dba4f89b5007600f8519d4a in this term.
I20260709 12:25:43.903190  3012 raft_consensus.cc:697] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 1 LEADER]: Becoming Leader. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Running, Role: LEADER
I20260709 12:25:43.904464  3012 consensus_queue.cc:237] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.905055  2851 leader_election.cc:304] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca61502f80cc47e09f103fdc7b3bcdcd; no voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418
I20260709 12:25:43.906241  3011 raft_consensus.cc:3060] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.911994  2707 catalog_manager.cc:5697] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a reported cstate change: term changed from 0 to 1, leader changed from <none> to abea949f3dba4f89b5007600f8519d4a (127.2.157.3). New cstate: current_term: 1 leader_uuid: "abea949f3dba4f89b5007600f8519d4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:43.922891  3058 raft_consensus.cc:515] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.931008  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2dfc6e6314c27bcd91ab1da0da380" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:43.931667  2959 raft_consensus.cc:3060] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.931857  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2dfc6e6314c27bcd91ab1da0da380" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:25:43.932466  2885 raft_consensus.cc:3060] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.937968  3041 consensus_queue.cc:1048] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:43.940714  2885 raft_consensus.cc:2468] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 1.
I20260709 12:25:43.925577  2960 raft_consensus.cc:2468] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 1.
I20260709 12:25:43.917445  3011 raft_consensus.cc:2749] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.947079  2959 raft_consensus.cc:2468] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 1.
I20260709 12:25:43.948685  2775 leader_election.cc:304] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:25:43.949831  3065 raft_consensus.cc:2804] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.950604  3065 raft_consensus.cc:697] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 1 LEADER]: Becoming Leader. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Running, Role: LEADER
I20260709 12:25:43.952157  3058 leader_election.cc:290] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 election: Requested vote from peers ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:43.952296  3065 consensus_queue.cc:237] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.956632  3005 tablet_bootstrap.cc:492] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418: No bootstrap required, opened a new log
I20260709 12:25:43.957126  3005 ts_tablet_manager.cc:1403] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418: Time spent bootstrapping tablet: real 0.123s	user 0.022s	sys 0.039s
I20260709 12:25:43.960153  3005 raft_consensus.cc:359] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.960886  3005 raft_consensus.cc:385] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.961179  3005 raft_consensus.cc:740] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.962004  3005 consensus_queue.cc:260] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:43.964612  3005 ts_tablet_manager.cc:1434] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:25:43.972280  2706 catalog_manager.cc:5697] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8940e3feb884892a95310f0dc1c2418 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "b8940e3feb884892a95310f0dc1c2418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:43.974423  2706 catalog_manager.cc:5697] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8940e3feb884892a95310f0dc1c2418 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "b8940e3feb884892a95310f0dc1c2418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.137738  3008 raft_consensus.cc:493] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.138296  3008 raft_consensus.cc:515] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:44.140362  3008 leader_election.cc:290] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:44.141345  2809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6c1d29e56d45f18131dad906770b95" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418" is_pre_election: true
I20260709 12:25:44.141474  2886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6c1d29e56d45f18131dad906770b95" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" is_pre_election: true
I20260709 12:25:44.142091  2809 raft_consensus.cc:2468] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 0.
I20260709 12:25:44.142187  2886 raft_consensus.cc:2468] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 0.
I20260709 12:25:44.143347  2925 leader_election.cc:304] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:25:44.144523  3008 raft_consensus.cc:2804] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:44.144969  3008 raft_consensus.cc:493] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.145388  3008 raft_consensus.cc:3060] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.150651  3008 raft_consensus.cc:515] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:44.152645  3008 leader_election.cc:290] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:44.153522  2809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6c1d29e56d45f18131dad906770b95" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:44.153807  2886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6c1d29e56d45f18131dad906770b95" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:25:44.154217  2809 raft_consensus.cc:3060] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.154433  2886 raft_consensus.cc:3060] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.161917  2886 raft_consensus.cc:2468] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 1.
I20260709 12:25:44.161917  2809 raft_consensus.cc:2468] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 1.
I20260709 12:25:44.163319  2925 leader_election.cc:304] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:25:44.164050  3008 raft_consensus.cc:2804] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:44.164525  3008 raft_consensus.cc:697] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Becoming Leader. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:44.165330  3008 consensus_queue.cc:237] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:44.170686  3046 consensus_queue.cc:1048] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.175359  2705 catalog_manager.cc:5697] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a reported cstate change: term changed from 0 to 1, leader changed from <none> to abea949f3dba4f89b5007600f8519d4a (127.2.157.3). New cstate: current_term: 1 leader_uuid: "abea949f3dba4f89b5007600f8519d4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:44.182060  3046 consensus_queue.cc:1048] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.194509  3041 consensus_queue.cc:1048] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.215757  3041 consensus_queue.cc:1048] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.279940  3040 consensus_queue.cc:1048] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.293913  3008 consensus_queue.cc:1048] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.295682  3065 raft_consensus.cc:493] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.296160  3065 raft_consensus.cc:515] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:44.298203  3065 leader_election.cc:290] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:44.300499  2886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" is_pre_election: true
I20260709 12:25:44.300559  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abea949f3dba4f89b5007600f8519d4a" is_pre_election: true
I20260709 12:25:44.301401  2886 raft_consensus.cc:2393] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8940e3feb884892a95310f0dc1c2418 in current term 1: Already voted for candidate ca61502f80cc47e09f103fdc7b3bcdcd in this term.
I20260709 12:25:44.301568  2959 raft_consensus.cc:2393] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8940e3feb884892a95310f0dc1c2418 in current term 1: Already voted for candidate abea949f3dba4f89b5007600f8519d4a in this term.
I20260709 12:25:44.302997  2775 leader_election.cc:304] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8940e3feb884892a95310f0dc1c2418; no voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:44.306918  3065 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.314677  3065 raft_consensus.cc:2749] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:44.379855  3065 consensus_queue.cc:1048] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.391543  3063 consensus_queue.cc:1048] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:44.475790  3063 consensus_queue.cc:1048] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:44.488916  3012 consensus_queue.cc:1048] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.698424  3046 consensus_queue.cc:1048] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.710333  3041 consensus_queue.cc:1048] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:44.724341  2756 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:45.536149  3008 raft_consensus.cc:493] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.536652  3008 raft_consensus.cc:515] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:45.538591  3008 leader_election.cc:290] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:45.539448  2809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418" is_pre_election: true
I20260709 12:25:45.539803  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" is_pre_election: true
I20260709 12:25:45.540249  2809 raft_consensus.cc:2468] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 1.
I20260709 12:25:45.540431  2885 raft_consensus.cc:2468] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 1.
I20260709 12:25:45.541584  2925 leader_election.cc:304] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:25:45.542270  3008 raft_consensus.cc:2804] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:45.542575  3008 raft_consensus.cc:493] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.542950  3008 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:45.547760  3008 raft_consensus.cc:515] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:45.549413  3008 leader_election.cc:290] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 2 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:45.550424  2809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:45.550617  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:25:45.550954  2809 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:45.551210  2885 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:45.556042  2809 raft_consensus.cc:2468] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 2.
I20260709 12:25:45.556061  2885 raft_consensus.cc:2468] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 2.
I20260709 12:25:45.557273  2925 leader_election.cc:304] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:25:45.558239  3008 raft_consensus.cc:2804] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:45.558707  3008 raft_consensus.cc:697] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 2 LEADER]: Becoming Leader. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:45.559463  3008 consensus_queue.cc:237] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:45.567222  2707 catalog_manager.cc:5697] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a reported cstate change: term changed from 0 to 2, leader changed from <none> to abea949f3dba4f89b5007600f8519d4a (127.2.157.3). New cstate: current_term: 2 leader_uuid: "abea949f3dba4f89b5007600f8519d4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:46.062979  2886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43b673e0da91404d9c974f5e04655e1c"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
mode: GRACEFUL
new_leader_uuid: "b8940e3feb884892a95310f0dc1c2418"
 from {username='slave'} at 127.0.0.1:32880
I20260709 12:25:46.063529  2886 raft_consensus.cc:606] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 LEADER]: Received request to transfer leadership to TS b8940e3feb884892a95310f0dc1c2418
I20260709 12:25:46.077230  2959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8"
dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
mode: GRACEFUL
new_leader_uuid: "b8940e3feb884892a95310f0dc1c2418"
 from {username='slave'} at 127.0.0.1:34660
I20260709 12:25:46.077740  2959 raft_consensus.cc:606] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 2 LEADER]: Received request to transfer leadership to TS b8940e3feb884892a95310f0dc1c2418
I20260709 12:25:46.083201  2959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d"
dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
mode: GRACEFUL
new_leader_uuid: "b8940e3feb884892a95310f0dc1c2418"
 from {username='slave'} at 127.0.0.1:34660
I20260709 12:25:46.083731  2959 raft_consensus.cc:606] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Received request to transfer leadership to TS b8940e3feb884892a95310f0dc1c2418
I20260709 12:25:46.099562  2809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9d2dfc6e6314c27bcd91ab1da0da380"
dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
mode: GRACEFUL
new_leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:60616
I20260709 12:25:46.100107  2809 raft_consensus.cc:606] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 1 LEADER]: Received request to transfer leadership to TS ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:46.105122  2959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc6c1d29e56d45f18131dad906770b95"
dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
mode: GRACEFUL
new_leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:34660
I20260709 12:25:46.105692  2959 raft_consensus.cc:606] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Received request to transfer leadership to TS ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:46.106629  2809 raft_consensus.cc:1275] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Refusing update from remote peer abea949f3dba4f89b5007600f8519d4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:46.107925  3040 consensus_queue.cc:1048] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:46.111093  2959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18"
dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
mode: GRACEFUL
new_leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:34660
I20260709 12:25:46.111717  2959 raft_consensus.cc:606] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Received request to transfer leadership to TS ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:46.114354  3008 raft_consensus.cc:993] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a: : Instructing follower b8940e3feb884892a95310f0dc1c2418 to start an election
I20260709 12:25:46.115551  3094 raft_consensus.cc:1081] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 2 LEADER]: Signalling peer b8940e3feb884892a95310f0dc1c2418 to start an election
I20260709 12:25:46.119642  2959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6edda213b896400e92a8a69471b30b6a"
dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
mode: GRACEFUL
new_leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:34660
I20260709 12:25:46.120223  2959 raft_consensus.cc:606] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Received request to transfer leadership to TS ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:46.120081  2809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8"
dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
 from {username='slave'} at 127.0.0.1:60602
I20260709 12:25:46.121018  2809 raft_consensus.cc:493] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:46.121398  2809 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:46.126365  2886 raft_consensus.cc:1275] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Refusing update from remote peer abea949f3dba4f89b5007600f8519d4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:46.127656  3094 consensus_queue.cc:1048] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:46.132282  2809 raft_consensus.cc:515] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.135111  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:25:46.136628  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:46.137118  2959 raft_consensus.cc:3055] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:46.137379  2959 raft_consensus.cc:740] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:46.138082  2809 leader_election.cc:290] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 3 election: Requested vote from peers ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:46.138140  2959 consensus_queue.cc:260] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.139178  2959 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:46.144932  2959 raft_consensus.cc:2468] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 3.
I20260709 12:25:46.146099  2775 leader_election.cc:304] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:46.146795  3063 raft_consensus.cc:2804] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:46.150404  3063 raft_consensus.cc:697] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 3 LEADER]: Becoming Leader. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Running, Role: LEADER
I20260709 12:25:46.151149  3063 consensus_queue.cc:237] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.157034  2707 catalog_manager.cc:5697] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 reported cstate change: term changed from 2 to 3, leader changed from abea949f3dba4f89b5007600f8519d4a (127.2.157.3) to b8940e3feb884892a95310f0dc1c2418 (127.2.157.1). New cstate: current_term: 3 leader_uuid: "b8940e3feb884892a95310f0dc1c2418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.183620  3040 raft_consensus.cc:993] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a: : Instructing follower ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:46.184048  3094 raft_consensus.cc:1081] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Signalling peer ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:46.185487  2886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc6c1d29e56d45f18131dad906770b95"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:32866
I20260709 12:25:46.186224  2886 raft_consensus.cc:493] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:46.186630  2886 raft_consensus.cc:3060] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.194126  2886 raft_consensus.cc:515] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.195763  2886 leader_election.cc:290] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 2 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:46.196671  2809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6c1d29e56d45f18131dad906770b95" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:46.196817  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6c1d29e56d45f18131dad906770b95" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:46.197279  2809 raft_consensus.cc:3060] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.197389  2959 raft_consensus.cc:3055] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:46.197777  2959 raft_consensus.cc:740] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:46.198499  2959 consensus_queue.cc:260] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.199435  2959 raft_consensus.cc:3060] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.202301  2809 raft_consensus.cc:2468] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 2.
I20260709 12:25:46.203262  2851 leader_election.cc:304] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8940e3feb884892a95310f0dc1c2418, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:46.203938  3077 raft_consensus.cc:2804] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:46.204492  2959 raft_consensus.cc:2468] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 2.
I20260709 12:25:46.205128  3077 raft_consensus.cc:697] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Becoming Leader. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:25:46.205861  3077 consensus_queue.cc:237] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.213265  2707 catalog_manager.cc:5697] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd reported cstate change: term changed from 1 to 2, leader changed from abea949f3dba4f89b5007600f8519d4a (127.2.157.3) to ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2). New cstate: current_term: 2 leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.283819  3103 raft_consensus.cc:993] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd: : Instructing follower b8940e3feb884892a95310f0dc1c2418 to start an election
I20260709 12:25:46.284281  3077 raft_consensus.cc:1081] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 LEADER]: Signalling peer b8940e3feb884892a95310f0dc1c2418 to start an election
I20260709 12:25:46.285789  2809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43b673e0da91404d9c974f5e04655e1c"
dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
 from {username='slave'} at 127.0.0.1:60594
I20260709 12:25:46.286351  2809 raft_consensus.cc:493] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:46.286614  2809 raft_consensus.cc:3060] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.290881  2809 raft_consensus.cc:515] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:46.292443  2809 leader_election.cc:290] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 2 election: Requested vote from peers abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:46.293311  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b673e0da91404d9c974f5e04655e1c" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:46.293819  2959 raft_consensus.cc:3060] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.293685  2886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b673e0da91404d9c974f5e04655e1c" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:25:46.294412  2886 raft_consensus.cc:3055] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:46.294739  2886 raft_consensus.cc:740] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:25:46.295531  2886 consensus_queue.cc:260] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:46.296860  2886 raft_consensus.cc:3060] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.300763  2959 raft_consensus.cc:2468] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 2.
I20260709 12:25:46.302026  2775 leader_election.cc:304] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:25:46.302738  3063 raft_consensus.cc:2804] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:46.303229  3063 raft_consensus.cc:697] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 2 LEADER]: Becoming Leader. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Running, Role: LEADER
I20260709 12:25:46.303251  2886 raft_consensus.cc:2468] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 2.
I20260709 12:25:46.304206  3063 consensus_queue.cc:237] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:46.311672  2707 catalog_manager.cc:5697] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 reported cstate change: term changed from 1 to 2, leader changed from ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2) to b8940e3feb884892a95310f0dc1c2418 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "b8940e3feb884892a95310f0dc1c2418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.329357  3040 raft_consensus.cc:993] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a: : Instructing follower b8940e3feb884892a95310f0dc1c2418 to start an election
I20260709 12:25:46.329819  3094 raft_consensus.cc:1081] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Signalling peer b8940e3feb884892a95310f0dc1c2418 to start an election
I20260709 12:25:46.331418  2809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d"
dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
 from {username='slave'} at 127.0.0.1:60602
I20260709 12:25:46.331881  2809 raft_consensus.cc:493] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:46.332167  2809 raft_consensus.cc:3060] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.336562  2809 raft_consensus.cc:515] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.338310  2809 leader_election.cc:290] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 2 election: Requested vote from peers ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:46.339080  2886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:25:46.339283  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:46.339632  2886 raft_consensus.cc:3060] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.339807  2959 raft_consensus.cc:3055] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:46.340188  2959 raft_consensus.cc:740] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:46.340852  2959 consensus_queue.cc:260] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.341725  2959 raft_consensus.cc:3060] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.345110  2886 raft_consensus.cc:2468] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 2.
I20260709 12:25:46.346273  2776 leader_election.cc:304] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8940e3feb884892a95310f0dc1c2418, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:46.346998  3063 raft_consensus.cc:2804] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:46.347530  3063 raft_consensus.cc:697] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 2 LEADER]: Becoming Leader. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Running, Role: LEADER
I20260709 12:25:46.347849  2959 raft_consensus.cc:2468] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 2.
I20260709 12:25:46.348461  3063 consensus_queue.cc:237] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.357002  2707 catalog_manager.cc:5697] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 reported cstate change: term changed from 1 to 2, leader changed from abea949f3dba4f89b5007600f8519d4a (127.2.157.3) to b8940e3feb884892a95310f0dc1c2418 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "b8940e3feb884892a95310f0dc1c2418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.461308  3063 raft_consensus.cc:993] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418: : Instructing follower ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:46.461799  3099 raft_consensus.cc:1081] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 1 LEADER]: Signalling peer ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:46.463323  2886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9d2dfc6e6314c27bcd91ab1da0da380"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:32852
I20260709 12:25:46.463879  2886 raft_consensus.cc:493] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:46.464139  2886 raft_consensus.cc:3060] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.468706  2886 raft_consensus.cc:515] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.470292  2886 leader_election.cc:290] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 2 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:46.471324  2809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2dfc6e6314c27bcd91ab1da0da380" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:46.471377  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2dfc6e6314c27bcd91ab1da0da380" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:46.472044  2809 raft_consensus.cc:3055] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:46.472189  2959 raft_consensus.cc:3060] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.472349  2809 raft_consensus.cc:740] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Running, Role: LEADER
I20260709 12:25:46.473186  2809 consensus_queue.cc:260] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.474193  2809 raft_consensus.cc:3060] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.477612  2959 raft_consensus.cc:2468] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 2.
I20260709 12:25:46.478957  2850 leader_election.cc:304] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:46.479383  2809 raft_consensus.cc:2468] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 2.
I20260709 12:25:46.479888  3077 raft_consensus.cc:2804] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:46.480373  3077 raft_consensus.cc:697] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Becoming Leader. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:25:46.481252  3077 consensus_queue.cc:237] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.482519  3008 raft_consensus.cc:993] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a: : Instructing follower ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:46.482971  3040 raft_consensus.cc:1081] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Signalling peer ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:46.484580  2886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:32866
I20260709 12:25:46.485973  2886 raft_consensus.cc:493] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:46.486435  2886 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.488811  3008 raft_consensus.cc:993] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a: : Instructing follower ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:46.489243  3040 raft_consensus.cc:1081] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Signalling peer ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:46.489777  2707 catalog_manager.cc:5697] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd reported cstate change: term changed from 1 to 2, leader changed from b8940e3feb884892a95310f0dc1c2418 (127.2.157.1) to ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2). New cstate: current_term: 2 leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.490844  2885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6edda213b896400e92a8a69471b30b6a"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:32866
I20260709 12:25:46.491379  2885 raft_consensus.cc:493] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:46.491752  2885 raft_consensus.cc:3060] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.492830  2886 raft_consensus.cc:515] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.494961  2886 leader_election.cc:290] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 2 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:46.495705  2809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:46.496253  2809 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.497157  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:46.497726  2959 raft_consensus.cc:3055] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:46.498060  2959 raft_consensus.cc:740] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:46.498435  2885 raft_consensus.cc:515] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.498884  2959 consensus_queue.cc:260] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.500147  2959 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.500882  2885 leader_election.cc:290] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 2 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:46.501624  2960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edda213b896400e92a8a69471b30b6a" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:46.502220  2960 raft_consensus.cc:3055] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:46.502534  2960 raft_consensus.cc:740] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:46.503577  2809 raft_consensus.cc:2468] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 2.
I20260709 12:25:46.503312  2960 consensus_queue.cc:260] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.504580  2960 raft_consensus.cc:3060] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.504659  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edda213b896400e92a8a69471b30b6a" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:46.504904  2851 leader_election.cc:304] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8940e3feb884892a95310f0dc1c2418, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:46.505268  2811 raft_consensus.cc:3060] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:46.505793  3077 raft_consensus.cc:2804] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:46.505743  2959 raft_consensus.cc:2468] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 2.
I20260709 12:25:46.506425  3077 raft_consensus.cc:697] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Becoming Leader. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:25:46.507282  3077 consensus_queue.cc:237] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.511938  2811 raft_consensus.cc:2468] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 2.
I20260709 12:25:46.513226  2851 leader_election.cc:304] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8940e3feb884892a95310f0dc1c2418, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:46.513316  2960 raft_consensus.cc:2468] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 2.
I20260709 12:25:46.513994  3077 raft_consensus.cc:2804] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:46.514556  3077 raft_consensus.cc:697] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Becoming Leader. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:25:46.515232  3077 consensus_queue.cc:237] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:46.515671  2707 catalog_manager.cc:5697] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd reported cstate change: term changed from 1 to 2, leader changed from abea949f3dba4f89b5007600f8519d4a (127.2.157.3) to ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2). New cstate: current_term: 2 leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.527436  2707 catalog_manager.cc:5697] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd reported cstate change: term changed from 1 to 2, leader changed from abea949f3dba4f89b5007600f8519d4a (127.2.157.3) to ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2). New cstate: current_term: 2 leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.557196  2960 raft_consensus.cc:1275] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Refusing update from remote peer b8940e3feb884892a95310f0dc1c2418: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:46.558487  3099 consensus_queue.cc:1048] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:46.566171  2885 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:46.573040  2885 raft_consensus.cc:1275] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Refusing update from remote peer b8940e3feb884892a95310f0dc1c2418: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:46.574472  3099 consensus_queue.cc:1048] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:46.673372  2960 raft_consensus.cc:1275] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:46.674685  3077 consensus_queue.cc:1048] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:46.684747  2811 raft_consensus.cc:1275] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:46.686405  3103 consensus_queue.cc:1048] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:46.708847  2885 raft_consensus.cc:1275] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Refusing update from remote peer b8940e3feb884892a95310f0dc1c2418: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:46.710115  3099 consensus_queue.cc:1048] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:46.718850  2960 raft_consensus.cc:1275] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Refusing update from remote peer b8940e3feb884892a95310f0dc1c2418: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:46.720257  3063 consensus_queue.cc:1048] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:46.830832  2885 raft_consensus.cc:1275] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Refusing update from remote peer b8940e3feb884892a95310f0dc1c2418: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:46.832085  3063 consensus_queue.cc:1048] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:46.841213  2960 raft_consensus.cc:1275] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Refusing update from remote peer b8940e3feb884892a95310f0dc1c2418: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:46.842968  3106 consensus_queue.cc:1048] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:46.952667  2960 raft_consensus.cc:1275] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:46.954007  3103 consensus_queue.cc:1048] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:46.963275  2811 raft_consensus.cc:1275] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:46.965173  3112 consensus_queue.cc:1048] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:47.034188  2811 raft_consensus.cc:1275] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:47.035461  3112 consensus_queue.cc:1048] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:47.044380  2960 raft_consensus.cc:1275] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:47.046427  3077 consensus_queue.cc:1048] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:47.090029  2960 raft_consensus.cc:1275] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:47.091389  3077 consensus_queue.cc:1048] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:47.100695  2811 raft_consensus.cc:1275] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:47.104185  3112 consensus_queue.cc:1048] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:49.155897  2676 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:25:49.156677  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:49.178229  2886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
mode: GRACEFUL
new_leader_uuid: "abea949f3dba4f89b5007600f8519d4a"
 from {username='slave'} at 127.0.0.1:44872
I20260709 12:25:49.178783  2886 raft_consensus.cc:606] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Received request to transfer leadership to TS abea949f3dba4f89b5007600f8519d4a
I20260709 12:25:49.190193  2811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8"
dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
mode: GRACEFUL
new_leader_uuid: "abea949f3dba4f89b5007600f8519d4a"
 from {username='slave'} at 127.0.0.1:52370
I20260709 12:25:49.190729  2811 raft_consensus.cc:606] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 3 LEADER]: Received request to transfer leadership to TS abea949f3dba4f89b5007600f8519d4a
I20260709 12:25:49.191968  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:49.192394  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:49.464134  3124 raft_consensus.cc:993] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418: : Instructing follower abea949f3dba4f89b5007600f8519d4a to start an election
I20260709 12:25:49.464602  3128 raft_consensus.cc:1081] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 3 LEADER]: Signalling peer abea949f3dba4f89b5007600f8519d4a to start an election
I20260709 12:25:49.466285  2960 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8"
dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
 from {username='slave'} at 127.0.0.1:34652
I20260709 12:25:49.466797  2960 raft_consensus.cc:493] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:49.467142  2960 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:49.471946  2960 raft_consensus.cc:515] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:49.473803  2960 leader_election.cc:290] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 4 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:49.474754  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:49.474941  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:25:49.475425  2811 raft_consensus.cc:3055] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:49.475507  2885 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:49.475896  2811 raft_consensus.cc:740] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Running, Role: LEADER
I20260709 12:25:49.476791  2811 consensus_queue.cc:260] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:49.478147  2811 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:49.482627  2885 raft_consensus.cc:2468] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 4.
I20260709 12:25:49.484020  2925 leader_election.cc:304] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:49.484792  3040 raft_consensus.cc:2804] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:49.485000  2811 raft_consensus.cc:2468] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 4.
I20260709 12:25:49.486289  3040 raft_consensus.cc:697] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 4 LEADER]: Becoming Leader. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:49.487141  3040 consensus_queue.cc:237] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:49.494294  2705 catalog_manager.cc:5697] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a reported cstate change: term changed from 3 to 4, leader changed from b8940e3feb884892a95310f0dc1c2418 (127.2.157.1) to abea949f3dba4f89b5007600f8519d4a (127.2.157.3). New cstate: current_term: 4 leader_uuid: "abea949f3dba4f89b5007600f8519d4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.517740  3103 raft_consensus.cc:993] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd: : Instructing follower abea949f3dba4f89b5007600f8519d4a to start an election
I20260709 12:25:49.518358  3103 raft_consensus.cc:1081] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Signalling peer abea949f3dba4f89b5007600f8519d4a to start an election
I20260709 12:25:49.519976  2960 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18"
dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
 from {username='slave'} at 127.0.0.1:34640
I20260709 12:25:49.520483  2960 raft_consensus.cc:493] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:49.520797  2960 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:49.525336  2960 raft_consensus.cc:515] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:49.526942  2960 leader_election.cc:290] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 3 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:25:49.527887  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:49.528023  2885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:25:49.528486  2811 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:49.528506  2885 raft_consensus.cc:3055] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:49.529026  2885 raft_consensus.cc:740] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:25:49.529773  2885 consensus_queue.cc:260] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:49.530895  2885 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:49.535269  2811 raft_consensus.cc:2468] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 3.
I20260709 12:25:49.536540  2925 leader_election.cc:304] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:25:49.536943  2885 raft_consensus.cc:2468] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 3.
I20260709 12:25:49.537387  3040 raft_consensus.cc:2804] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:49.537926  3040 raft_consensus.cc:697] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 3 LEADER]: Becoming Leader. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:49.538625  3040 consensus_queue.cc:237] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:49.545660  2705 catalog_manager.cc:5697] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a reported cstate change: term changed from 2 to 3, leader changed from ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2) to abea949f3dba4f89b5007600f8519d4a (127.2.157.3). New cstate: current_term: 3 leader_uuid: "abea949f3dba4f89b5007600f8519d4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.897075  2885 raft_consensus.cc:1275] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 4 FOLLOWER]: Refusing update from remote peer abea949f3dba4f89b5007600f8519d4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:49.898298  3040 consensus_queue.cc:1048] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:49.908650  2811 raft_consensus.cc:1275] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 4 FOLLOWER]: Refusing update from remote peer abea949f3dba4f89b5007600f8519d4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:49.910732  3139 consensus_queue.cc:1048] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:50.019764  2885 raft_consensus.cc:1275] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Refusing update from remote peer abea949f3dba4f89b5007600f8519d4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:50.021016  3139 consensus_queue.cc:1048] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:50.030025  2811 raft_consensus.cc:1275] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Refusing update from remote peer abea949f3dba4f89b5007600f8519d4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:50.032436  3040 consensus_queue.cc:1048] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:50.194372  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:50.202551  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:50.202965  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:51.203979  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:51.208644  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:51.208983  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:52.209792  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:52.214392  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:52.214742  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:53.215622  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:53.220225  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:53.220580  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:54.221673  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:54.229478  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:54.230223  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:55.231477  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:55.236887  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:55.237360  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:56.238418  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:56.243522  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:56.244055  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:57.244918  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:57.249868  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:57.250350  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:58.251344  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:58.256079  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:58.256498  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:59.285172  2676 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:25:59.290132  2809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43b673e0da91404d9c974f5e04655e1c"
dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
mode: GRACEFUL
new_leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:60616
I20260709 12:25:59.291075  2809 raft_consensus.cc:606] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 2 LEADER]: Received request to transfer leadership to TS ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:59.297204  2959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8"
dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
mode: GRACEFUL
new_leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:34660
I20260709 12:25:59.297740  2959 raft_consensus.cc:606] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 4 LEADER]: Received request to transfer leadership to TS ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:59.303222  2809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d"
dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
mode: GRACEFUL
new_leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:60616
I20260709 12:25:59.303736  2809 raft_consensus.cc:606] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 2 LEADER]: Received request to transfer leadership to TS ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:59.308678  2809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92ba5e0c526a48ad99e079e1b6d538b1"
dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
mode: GRACEFUL
new_leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:60616
I20260709 12:25:59.309151  2809 raft_consensus.cc:606] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 1 LEADER]: Received request to transfer leadership to TS ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:59.319121  2959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18"
dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
mode: GRACEFUL
new_leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:34660
I20260709 12:25:59.319655  2959 raft_consensus.cc:606] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 3 LEADER]: Received request to transfer leadership to TS ca61502f80cc47e09f103fdc7b3bcdcd
I20260709 12:25:59.370414  3155 raft_consensus.cc:993] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a: : Instructing follower ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:59.371078  3139 raft_consensus.cc:1081] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 3 LEADER]: Signalling peer ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:59.372794  2884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:32866
I20260709 12:25:59.373356  2884 raft_consensus.cc:493] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:59.373749  2884 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:59.379372  2884 raft_consensus.cc:515] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:59.382232  2884 leader_election.cc:290] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 4 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:59.383301  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:59.383105  2809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:59.383957  2959 raft_consensus.cc:3055] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:59.384023  2809 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:59.384454  2959 raft_consensus.cc:740] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:59.385345  2959 consensus_queue.cc:260] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:59.386710  2959 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:59.391314  2809 raft_consensus.cc:2468] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 4.
I20260709 12:25:59.392567  2851 leader_election.cc:304] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8940e3feb884892a95310f0dc1c2418, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:59.393219  2959 raft_consensus.cc:2468] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 4.
I20260709 12:25:59.393422  3151 raft_consensus.cc:2804] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:59.394821  3151 raft_consensus.cc:697] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 4 LEADER]: Becoming Leader. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:25:59.395596  3151 consensus_queue.cc:237] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:59.402522  2705 catalog_manager.cc:5697] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd reported cstate change: term changed from 3 to 4, leader changed from abea949f3dba4f89b5007600f8519d4a (127.2.157.3) to ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2). New cstate: current_term: 4 leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.662762  3150 raft_consensus.cc:993] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418: : Instructing follower ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:59.663359  3162 raft_consensus.cc:1081] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 2 LEADER]: Signalling peer ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:59.664824  2884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43b673e0da91404d9c974f5e04655e1c"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:32852
I20260709 12:25:59.665354  2884 raft_consensus.cc:493] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:59.665709  2884 raft_consensus.cc:3060] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:59.670761  2884 raft_consensus.cc:515] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:59.672511  2884 leader_election.cc:290] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 3 election: Requested vote from peers abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397), b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835)
I20260709 12:25:59.673281  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b673e0da91404d9c974f5e04655e1c" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:59.673517  2809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b673e0da91404d9c974f5e04655e1c" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:59.673902  2959 raft_consensus.cc:3060] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:59.674095  2809 raft_consensus.cc:3055] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:59.674444  2809 raft_consensus.cc:740] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Running, Role: LEADER
I20260709 12:25:59.675081  2809 consensus_queue.cc:260] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:59.676173  2809 raft_consensus.cc:3060] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:59.679345  2959 raft_consensus.cc:2468] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 3.
I20260709 12:25:59.680536  2850 leader_election.cc:304] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:59.680661  2809 raft_consensus.cc:2468] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 3.
I20260709 12:25:59.681483  3151 raft_consensus.cc:2804] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:59.682011  3151 raft_consensus.cc:697] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 LEADER]: Becoming Leader. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:25:59.682667  3151 consensus_queue.cc:237] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } }
I20260709 12:25:59.690131  2705 catalog_manager.cc:5697] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd reported cstate change: term changed from 2 to 3, leader changed from b8940e3feb884892a95310f0dc1c2418 (127.2.157.1) to ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2). New cstate: current_term: 3 leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.714681  3150 raft_consensus.cc:993] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418: : Instructing follower ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:59.715117  3162 raft_consensus.cc:1081] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 1 LEADER]: Signalling peer ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:59.716444  2884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92ba5e0c526a48ad99e079e1b6d538b1"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:32852
I20260709 12:25:59.716969  2884 raft_consensus.cc:493] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:59.717319  2884 raft_consensus.cc:3060] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.722546  2884 raft_consensus.cc:515] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:59.724303  2884 leader_election.cc:290] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 2 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:59.725170  2809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba5e0c526a48ad99e079e1b6d538b1" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:59.725347  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba5e0c526a48ad99e079e1b6d538b1" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:59.725687  2809 raft_consensus.cc:3055] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:59.725915  2959 raft_consensus.cc:3060] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.726029  2809 raft_consensus.cc:740] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Running, Role: LEADER
I20260709 12:25:59.726722  2809 consensus_queue.cc:260] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:59.727600  2809 raft_consensus.cc:3060] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.730631  2959 raft_consensus.cc:2468] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 2.
I20260709 12:25:59.731623  2850 leader_election.cc:304] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:59.731760  2809 raft_consensus.cc:2468] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 2.
I20260709 12:25:59.732398  3151 raft_consensus.cc:2804] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:59.732964  3151 raft_consensus.cc:697] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Becoming Leader. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:25:59.734089  3151 consensus_queue.cc:237] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:59.741540  2705 catalog_manager.cc:5697] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd reported cstate change: term changed from 1 to 2, leader changed from b8940e3feb884892a95310f0dc1c2418 (127.2.157.1) to ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2). New cstate: current_term: 2 leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.755218  3150 raft_consensus.cc:993] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418: : Instructing follower ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:59.755681  3162 raft_consensus.cc:1081] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 2 LEADER]: Signalling peer ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:59.757091  2884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:32852
I20260709 12:25:59.757567  2884 raft_consensus.cc:493] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:59.757859  2884 raft_consensus.cc:3060] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:59.762996  2884 raft_consensus.cc:515] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:59.764564  2884 leader_election.cc:290] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 3 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:59.765455  2809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:59.765690  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de8546427c4a7382c5805646ddd60d" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:59.766113  2809 raft_consensus.cc:3055] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:59.766218  2959 raft_consensus.cc:3060] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:59.766522  2809 raft_consensus.cc:740] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Running, Role: LEADER
I20260709 12:25:59.767339  2809 consensus_queue.cc:260] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:59.768528  2809 raft_consensus.cc:3060] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:59.772753  2959 raft_consensus.cc:2468] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 3.
I20260709 12:25:59.773926  2850 leader_election.cc:304] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:59.774585  3151 raft_consensus.cc:2804] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:59.774550  2809 raft_consensus.cc:2468] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 3.
I20260709 12:25:59.775138  3151 raft_consensus.cc:697] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 LEADER]: Becoming Leader. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:25:59.776086  3151 consensus_queue.cc:237] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:59.782994  2705 catalog_manager.cc:5697] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd reported cstate change: term changed from 2 to 3, leader changed from b8940e3feb884892a95310f0dc1c2418 (127.2.157.1) to ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2). New cstate: current_term: 3 leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.786993  3155 raft_consensus.cc:993] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a: : Instructing follower ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:59.787570  3139 raft_consensus.cc:1081] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 4 LEADER]: Signalling peer ca61502f80cc47e09f103fdc7b3bcdcd to start an election
I20260709 12:25:59.789101  2884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
 from {username='slave'} at 127.0.0.1:32866
I20260709 12:25:59.789572  2884 raft_consensus.cc:493] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:59.789942  2884 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:59.795545  2884 raft_consensus.cc:515] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:59.797174  2884 leader_election.cc:290] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 5 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:25:59.797982  2809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:25:59.798162  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:25:59.798607  2809 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:59.798811  2959 raft_consensus.cc:3055] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:59.799196  2959 raft_consensus.cc:740] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:25:59.799995  2959 consensus_queue.cc:260] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:59.800937  2959 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:59.803575  2809 raft_consensus.cc:2468] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 5.
I20260709 12:25:59.804630  2851 leader_election.cc:304] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8940e3feb884892a95310f0dc1c2418, ca61502f80cc47e09f103fdc7b3bcdcd; no voters: 
I20260709 12:25:59.805413  3151 raft_consensus.cc:2804] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:59.805857  2959 raft_consensus.cc:2468] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca61502f80cc47e09f103fdc7b3bcdcd in term 5.
I20260709 12:25:59.805866  3151 raft_consensus.cc:697] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 5 LEADER]: Becoming Leader. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:25:59.807102  3151 consensus_queue.cc:237] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:25:59.814132  2705 catalog_manager.cc:5697] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd reported cstate change: term changed from 4 to 5, leader changed from abea949f3dba4f89b5007600f8519d4a (127.2.157.3) to ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2). New cstate: current_term: 5 leader_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.833803  2809 raft_consensus.cc:1275] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 4 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:59.835081  3151 consensus_queue.cc:1048] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:59.845232  2959 raft_consensus.cc:1275] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 4 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:59.847713  3156 consensus_queue.cc:1048] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:00.122226  2959 raft_consensus.cc:1275] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:00.123477  3156 consensus_queue.cc:1048] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:00.132572  2809 raft_consensus.cc:1275] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:00.134442  3169 consensus_queue.cc:1048] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:00.234623  2959 raft_consensus.cc:1275] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:00.236585  3169 consensus_queue.cc:1048] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:00.238102  2959 raft_consensus.cc:1275] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:00.239542  3169 consensus_queue.cc:1048] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:00.254976  2809 raft_consensus.cc:1275] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:00.257951  3169 consensus_queue.cc:1048] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:00.270406  2811 raft_consensus.cc:1275] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:00.272624  3151 consensus_queue.cc:1048] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:00.291051  2811 raft_consensus.cc:1275] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 5 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:00.292183  3151 consensus_queue.cc:1048] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:00.302110  2960 raft_consensus.cc:1275] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 5 FOLLOWER]: Refusing update from remote peer ca61502f80cc47e09f103fdc7b3bcdcd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:00.303490  3156 consensus_queue.cc:1048] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:02.356474  2676 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:26:02.357296  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:02.364391  2884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
mode: GRACEFUL
new_leader_uuid: "abea949f3dba4f89b5007600f8519d4a"
 from {username='slave'} at 127.0.0.1:44872
I20260709 12:26:02.365038  2884 raft_consensus.cc:606] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 4 LEADER]: Received request to transfer leadership to TS abea949f3dba4f89b5007600f8519d4a
I20260709 12:26:02.368949  2884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6edda213b896400e92a8a69471b30b6a"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
mode: GRACEFUL
new_leader_uuid: "b8940e3feb884892a95310f0dc1c2418"
 from {username='slave'} at 127.0.0.1:44872
I20260709 12:26:02.369449  2884 raft_consensus.cc:606] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Received request to transfer leadership to TS b8940e3feb884892a95310f0dc1c2418
I20260709 12:26:02.371948  2884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
mode: GRACEFUL
new_leader_uuid: "b8940e3feb884892a95310f0dc1c2418"
 from {username='slave'} at 127.0.0.1:44872
I20260709 12:26:02.372376  2884 raft_consensus.cc:606] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 5 LEADER]: Received request to transfer leadership to TS b8940e3feb884892a95310f0dc1c2418
I20260709 12:26:02.374673  2884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92ba5e0c526a48ad99e079e1b6d538b1"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
mode: GRACEFUL
new_leader_uuid: "abea949f3dba4f89b5007600f8519d4a"
 from {username='slave'} at 127.0.0.1:44872
I20260709 12:26:02.375108  2884 raft_consensus.cc:606] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Received request to transfer leadership to TS abea949f3dba4f89b5007600f8519d4a
I20260709 12:26:02.377321  2884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9d2dfc6e6314c27bcd91ab1da0da380"
dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
mode: GRACEFUL
new_leader_uuid: "b8940e3feb884892a95310f0dc1c2418"
 from {username='slave'} at 127.0.0.1:44872
I20260709 12:26:02.377728  2884 raft_consensus.cc:606] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Received request to transfer leadership to TS b8940e3feb884892a95310f0dc1c2418
I20260709 12:26:02.378719  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:02.379206  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:02.497318  3184 raft_consensus.cc:993] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd: : Instructing follower b8940e3feb884892a95310f0dc1c2418 to start an election
I20260709 12:26:02.497975  3151 raft_consensus.cc:1081] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Signalling peer b8940e3feb884892a95310f0dc1c2418 to start an election
I20260709 12:26:02.499564  2811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9d2dfc6e6314c27bcd91ab1da0da380"
dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
 from {username='slave'} at 127.0.0.1:60594
I20260709 12:26:02.500211  2811 raft_consensus.cc:493] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:02.500540  2811 raft_consensus.cc:3060] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:02.505718  2811 raft_consensus.cc:515] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.507834  2811 leader_election.cc:290] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 3 election: Requested vote from peers ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:26:02.508687  2884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2dfc6e6314c27bcd91ab1da0da380" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:26:02.509126  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d2dfc6e6314c27bcd91ab1da0da380" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:26:02.509361  2884 raft_consensus.cc:3055] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:02.509656  2884 raft_consensus.cc:740] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:26:02.509686  2959 raft_consensus.cc:3060] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:02.510447  2884 consensus_queue.cc:260] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.511453  2884 raft_consensus.cc:3060] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:02.514792  2959 raft_consensus.cc:2468] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 3.
I20260709 12:26:02.516083  2775 leader_election.cc:304] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:26:02.516335  2884 raft_consensus.cc:2468] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 3.
I20260709 12:26:02.517814  3185 raft_consensus.cc:2804] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:02.518752  3185 raft_consensus.cc:697] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 3 LEADER]: Becoming Leader. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Running, Role: LEADER
I20260709 12:26:02.519665  3185 consensus_queue.cc:237] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.526849  2706 catalog_manager.cc:5697] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 reported cstate change: term changed from 2 to 3, leader changed from ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2) to b8940e3feb884892a95310f0dc1c2418 (127.2.157.1). New cstate: current_term: 3 leader_uuid: "b8940e3feb884892a95310f0dc1c2418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.646427  3184 raft_consensus.cc:993] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd: : Instructing follower abea949f3dba4f89b5007600f8519d4a to start an election
I20260709 12:26:02.646872  3151 raft_consensus.cc:1081] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Signalling peer abea949f3dba4f89b5007600f8519d4a to start an election
I20260709 12:26:02.648250  2959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92ba5e0c526a48ad99e079e1b6d538b1"
dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
 from {username='slave'} at 127.0.0.1:34640
I20260709 12:26:02.648644  2959 raft_consensus.cc:493] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:02.648859  2959 raft_consensus.cc:3060] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:02.654148  2959 raft_consensus.cc:515] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.656020  2959 leader_election.cc:290] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 3 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:26:02.656850  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba5e0c526a48ad99e079e1b6d538b1" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:26:02.656955  2884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba5e0c526a48ad99e079e1b6d538b1" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:26:02.657475  2811 raft_consensus.cc:3060] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:02.657578  2884 raft_consensus.cc:3055] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:02.658053  2884 raft_consensus.cc:740] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:26:02.658826  2884 consensus_queue.cc:260] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.659667  2884 raft_consensus.cc:3060] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:02.662171  2811 raft_consensus.cc:2468] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 3.
I20260709 12:26:02.663321  2925 leader_election.cc:304] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:26:02.663941  2884 raft_consensus.cc:2468] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 3.
I20260709 12:26:02.664100  3139 raft_consensus.cc:2804] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:02.665230  3139 raft_consensus.cc:697] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 3 LEADER]: Becoming Leader. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:26:02.665856  3139 consensus_queue.cc:237] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.672420  2706 catalog_manager.cc:5697] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a reported cstate change: term changed from 2 to 3, leader changed from ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2) to abea949f3dba4f89b5007600f8519d4a (127.2.157.3). New cstate: current_term: 3 leader_uuid: "abea949f3dba4f89b5007600f8519d4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:02.690984  3184 raft_consensus.cc:993] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd: : Instructing follower b8940e3feb884892a95310f0dc1c2418 to start an election
I20260709 12:26:02.691452  3151 raft_consensus.cc:1081] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Signalling peer b8940e3feb884892a95310f0dc1c2418 to start an election
I20260709 12:26:02.692870  2811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6edda213b896400e92a8a69471b30b6a"
dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
 from {username='slave'} at 127.0.0.1:60594
I20260709 12:26:02.693272  2811 raft_consensus.cc:493] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:02.693495  2811 raft_consensus.cc:3060] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:02.697645  2811 raft_consensus.cc:515] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.699277  2811 leader_election.cc:290] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 3 election: Requested vote from peers ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:26:02.700064  2884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edda213b896400e92a8a69471b30b6a" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:26:02.700541  2884 raft_consensus.cc:3055] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:02.700570  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6edda213b896400e92a8a69471b30b6a" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:26:02.700874  2884 raft_consensus.cc:740] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:26:02.701121  2959 raft_consensus.cc:3060] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:02.701840  2884 consensus_queue.cc:260] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.702800  2884 raft_consensus.cc:3060] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:02.705487  2959 raft_consensus.cc:2468] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 3.
I20260709 12:26:02.706478  2775 leader_election.cc:304] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:26:02.707088  2884 raft_consensus.cc:2468] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 3.
I20260709 12:26:02.707213  3185 raft_consensus.cc:2804] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:02.707700  3185 raft_consensus.cc:697] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 3 LEADER]: Becoming Leader. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Running, Role: LEADER
I20260709 12:26:02.708495  3185 consensus_queue.cc:237] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.714937  2706 catalog_manager.cc:5697] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 reported cstate change: term changed from 2 to 3, leader changed from ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2) to b8940e3feb884892a95310f0dc1c2418 (127.2.157.1). New cstate: current_term: 3 leader_uuid: "b8940e3feb884892a95310f0dc1c2418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.858623  3151 raft_consensus.cc:993] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd: : Instructing follower b8940e3feb884892a95310f0dc1c2418 to start an election
I20260709 12:26:02.859076  3184 raft_consensus.cc:1081] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 5 LEADER]: Signalling peer b8940e3feb884892a95310f0dc1c2418 to start an election
I20260709 12:26:02.860469  2811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8"
dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
 from {username='slave'} at 127.0.0.1:60594
I20260709 12:26:02.860939  2811 raft_consensus.cc:493] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:02.861243  2811 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:02.865789  2811 raft_consensus.cc:515] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.867414  2811 leader_election.cc:290] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 6 election: Requested vote from peers ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771), abea949f3dba4f89b5007600f8519d4a (127.2.157.3:37397)
I20260709 12:26:02.868196  2884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:26:02.868793  2884 raft_consensus.cc:3055] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:02.868848  2959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74248b35b6804c6b88efe1b29473e3b8" candidate_uuid: "b8940e3feb884892a95310f0dc1c2418" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
I20260709 12:26:02.869104  2884 raft_consensus.cc:740] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:26:02.869448  2959 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:02.870054  2884 consensus_queue.cc:260] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.871263  2884 raft_consensus.cc:3060] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:02.874879  2959 raft_consensus.cc:2468] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 6.
I20260709 12:26:02.875885  2775 leader_election.cc:304] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:26:02.876660  3185 raft_consensus.cc:2804] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:02.877168  3185 raft_consensus.cc:697] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 6 LEADER]: Becoming Leader. State: Replica: b8940e3feb884892a95310f0dc1c2418, State: Running, Role: LEADER
I20260709 12:26:02.877322  2884 raft_consensus.cc:2468] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8940e3feb884892a95310f0dc1c2418 in term 6.
I20260709 12:26:02.878161  3185 consensus_queue.cc:237] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.879300  3151 raft_consensus.cc:993] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd: : Instructing follower abea949f3dba4f89b5007600f8519d4a to start an election
I20260709 12:26:02.879750  3184 raft_consensus.cc:1081] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 4 LEADER]: Signalling peer abea949f3dba4f89b5007600f8519d4a to start an election
I20260709 12:26:02.881644  2959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18"
dest_uuid: "abea949f3dba4f89b5007600f8519d4a"
 from {username='slave'} at 127.0.0.1:34640
I20260709 12:26:02.882200  2959 raft_consensus.cc:493] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:02.882522  2959 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:02.887391  2959 raft_consensus.cc:515] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.887142  2706 catalog_manager.cc:5697] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 reported cstate change: term changed from 5 to 6, leader changed from ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2) to b8940e3feb884892a95310f0dc1c2418 (127.2.157.1). New cstate: current_term: 6 leader_uuid: "b8940e3feb884892a95310f0dc1c2418" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.889150  2959 leader_election.cc:290] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 5 election: Requested vote from peers b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835), ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771)
I20260709 12:26:02.890151  2811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b8940e3feb884892a95310f0dc1c2418"
I20260709 12:26:02.890285  2884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1f815ecf1149cbba9c8797a4a77e18" candidate_uuid: "abea949f3dba4f89b5007600f8519d4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd"
I20260709 12:26:02.890764  2811 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:02.890853  2884 raft_consensus.cc:3055] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:02.891261  2884 raft_consensus.cc:740] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca61502f80cc47e09f103fdc7b3bcdcd, State: Running, Role: LEADER
I20260709 12:26:02.892089  2884 consensus_queue.cc:260] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.893105  2884 raft_consensus.cc:3060] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:02.898169  2811 raft_consensus.cc:2468] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 5.
I20260709 12:26:02.898387  2884 raft_consensus.cc:2468] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abea949f3dba4f89b5007600f8519d4a in term 5.
I20260709 12:26:02.899251  2925 leader_election.cc:304] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abea949f3dba4f89b5007600f8519d4a, b8940e3feb884892a95310f0dc1c2418; no voters: 
I20260709 12:26:02.900094  3139 raft_consensus.cc:2804] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:02.900517  3139 raft_consensus.cc:697] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 5 LEADER]: Becoming Leader. State: Replica: abea949f3dba4f89b5007600f8519d4a, State: Running, Role: LEADER
I20260709 12:26:02.901383  3139 consensus_queue.cc:237] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } }
I20260709 12:26:02.910115  2706 catalog_manager.cc:5697] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a reported cstate change: term changed from 4 to 5, leader changed from ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2) to abea949f3dba4f89b5007600f8519d4a (127.2.157.3). New cstate: current_term: 5 leader_uuid: "abea949f3dba4f89b5007600f8519d4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:02.977299  2884 raft_consensus.cc:1275] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Refusing update from remote peer b8940e3feb884892a95310f0dc1c2418: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:02.978664  3185 consensus_queue.cc:1048] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:02.990381  2959 raft_consensus.cc:1275] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Refusing update from remote peer b8940e3feb884892a95310f0dc1c2418: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:02.992038  3186 consensus_queue.cc:1048] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.130231  2811 raft_consensus.cc:1275] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Refusing update from remote peer abea949f3dba4f89b5007600f8519d4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:03.131505  3139 consensus_queue.cc:1048] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.140805  2884 raft_consensus.cc:1275] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Refusing update from remote peer abea949f3dba4f89b5007600f8519d4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:03.142390  3192 consensus_queue.cc:1048] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:03.184885  2959 raft_consensus.cc:1275] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Refusing update from remote peer b8940e3feb884892a95310f0dc1c2418: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:03.186000  3186 consensus_queue.cc:1048] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.194904  2884 raft_consensus.cc:1275] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Refusing update from remote peer b8940e3feb884892a95310f0dc1c2418: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:03.196241  3186 consensus_queue.cc:1048] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.328661  2959 raft_consensus.cc:1275] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 6 FOLLOWER]: Refusing update from remote peer b8940e3feb884892a95310f0dc1c2418: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:03.330374  3186 consensus_queue.cc:1048] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abea949f3dba4f89b5007600f8519d4a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 37397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:03.340448  2884 raft_consensus.cc:1275] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 6 FOLLOWER]: Refusing update from remote peer b8940e3feb884892a95310f0dc1c2418: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:03.345934  3185 consensus_queue.cc:1048] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:03.380538  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:03.385694  2811 raft_consensus.cc:1275] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 5 FOLLOWER]: Refusing update from remote peer abea949f3dba4f89b5007600f8519d4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:03.385993  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:03.386530  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:03.387308  3139 consensus_queue.cc:1048] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8940e3feb884892a95310f0dc1c2418" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 45835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:03.398825  2884 raft_consensus.cc:1275] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 5 FOLLOWER]: Refusing update from remote peer abea949f3dba4f89b5007600f8519d4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:03.400116  3139 consensus_queue.cc:1048] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca61502f80cc47e09f103fdc7b3bcdcd" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 45771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:04.387730  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:04.392513  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:04.392910  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:05.393992  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:05.398895  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:05.399307  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:06.400449  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:06.405519  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:06.406044  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:07.407217  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:07.413026  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:07.413520  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:08.414552  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:08.419269  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:08.419685  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:09.420688  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:09.425558  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:09.426007  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:10.427626  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:10.433457  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:10.433923  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:11.435106  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:11.441689  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:11.442167  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:12.472489  2676 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:26:12.473109  2676 tablet_server.cc:179] TabletServer@127.2.157.1:0 shutting down...
I20260709 12:26:12.503065  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:12.503929  2676 tablet_replica.cc:333] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418: stopping tablet replica
I20260709 12:26:12.505056  2676 raft_consensus.cc:2243] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.505831  2676 raft_consensus.cc:2272] T bc6c1d29e56d45f18131dad906770b95 P b8940e3feb884892a95310f0dc1c2418 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.508443  2676 tablet_replica.cc:333] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418: stopping tablet replica
I20260709 12:26:12.508944  2676 raft_consensus.cc:2243] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.509320  2676 raft_consensus.cc:2272] T 43b673e0da91404d9c974f5e04655e1c P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.511072  2676 tablet_replica.cc:333] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418: stopping tablet replica
I20260709 12:26:12.511541  2676 raft_consensus.cc:2243] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.512274  2676 raft_consensus.cc:2272] T c9d2dfc6e6314c27bcd91ab1da0da380 P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.513937  2676 tablet_replica.cc:333] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418: stopping tablet replica
I20260709 12:26:12.514454  2676 raft_consensus.cc:2243] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.515189  2676 raft_consensus.cc:2272] T 74248b35b6804c6b88efe1b29473e3b8 P b8940e3feb884892a95310f0dc1c2418 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.516712  2676 tablet_replica.cc:333] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418: stopping tablet replica
I20260709 12:26:12.517238  2676 raft_consensus.cc:2243] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.517700  2676 raft_consensus.cc:2272] T 65de8546427c4a7382c5805646ddd60d P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.519374  2676 tablet_replica.cc:333] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418: stopping tablet replica
I20260709 12:26:12.519788  2676 raft_consensus.cc:2243] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.520182  2676 raft_consensus.cc:2272] T 5a1f815ecf1149cbba9c8797a4a77e18 P b8940e3feb884892a95310f0dc1c2418 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.521751  2676 tablet_replica.cc:333] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418: stopping tablet replica
I20260709 12:26:12.522243  2676 raft_consensus.cc:2243] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.522603  2676 raft_consensus.cc:2272] T e67d23e756e64e69915da508fd3adea8 P b8940e3feb884892a95310f0dc1c2418 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.524188  2676 tablet_replica.cc:333] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418: stopping tablet replica
I20260709 12:26:12.524578  2676 raft_consensus.cc:2243] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.524927  2676 raft_consensus.cc:2272] T 92ba5e0c526a48ad99e079e1b6d538b1 P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.526449  2676 tablet_replica.cc:333] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418: stopping tablet replica
I20260709 12:26:12.526829  2676 raft_consensus.cc:2243] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.527478  2676 raft_consensus.cc:2272] T 6edda213b896400e92a8a69471b30b6a P b8940e3feb884892a95310f0dc1c2418 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.621322  2676 tablet_server.cc:196] TabletServer@127.2.157.1:0 shutdown complete.
W20260709 12:26:12.622749  2925 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.157.1:45835: connect: Connection refused (error 111)
W20260709 12:26:12.622745  2851 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.157.1:45835: connect: Connection refused (error 111)
W20260709 12:26:12.628429  2851 consensus_peers.cc:597] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd -> Peer b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835): Couldn't send request to peer b8940e3feb884892a95310f0dc1c2418. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:45835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:12.628414  2925 consensus_peers.cc:597] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a -> Peer b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835): Couldn't send request to peer b8940e3feb884892a95310f0dc1c2418. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:45835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:12.639364  2925 consensus_peers.cc:597] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a -> Peer b8940e3feb884892a95310f0dc1c2418 (127.2.157.1:45835): Couldn't send request to peer b8940e3feb884892a95310f0dc1c2418. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:45835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.645041  2676 tablet_server.cc:179] TabletServer@127.2.157.2:0 shutting down...
I20260709 12:26:12.672492  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:12.673173  2676 tablet_replica.cc:333] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd: stopping tablet replica
I20260709 12:26:12.674172  2676 raft_consensus.cc:2243] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.674835  2676 raft_consensus.cc:2272] T c9d2dfc6e6314c27bcd91ab1da0da380 P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.676671  2676 tablet_replica.cc:333] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd: stopping tablet replica
I20260709 12:26:12.677141  2676 raft_consensus.cc:2243] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.677484  2676 raft_consensus.cc:2272] T e67d23e756e64e69915da508fd3adea8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.679077  2676 tablet_replica.cc:333] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd: stopping tablet replica
I20260709 12:26:12.679519  2676 raft_consensus.cc:2243] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.679884  2676 raft_consensus.cc:2272] T 92ba5e0c526a48ad99e079e1b6d538b1 P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.681710  2676 tablet_replica.cc:333] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd: stopping tablet replica
I20260709 12:26:12.682217  2676 raft_consensus.cc:2243] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.682931  2676 raft_consensus.cc:2272] T 65de8546427c4a7382c5805646ddd60d P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.684571  2676 tablet_replica.cc:333] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd: stopping tablet replica
I20260709 12:26:12.685022  2676 raft_consensus.cc:2243] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.685385  2676 raft_consensus.cc:2272] T 74248b35b6804c6b88efe1b29473e3b8 P ca61502f80cc47e09f103fdc7b3bcdcd [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.686961  2676 tablet_replica.cc:333] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd: stopping tablet replica
I20260709 12:26:12.687402  2676 raft_consensus.cc:2243] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.687752  2676 raft_consensus.cc:2272] T 5a1f815ecf1149cbba9c8797a4a77e18 P ca61502f80cc47e09f103fdc7b3bcdcd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.689293  2676 tablet_replica.cc:333] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd: stopping tablet replica
I20260709 12:26:12.689702  2676 raft_consensus.cc:2243] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.690125  2676 raft_consensus.cc:2272] T 6edda213b896400e92a8a69471b30b6a P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.691658  2676 tablet_replica.cc:333] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd: stopping tablet replica
I20260709 12:26:12.692065  2676 raft_consensus.cc:2243] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.692782  2676 raft_consensus.cc:2272] T bc6c1d29e56d45f18131dad906770b95 P ca61502f80cc47e09f103fdc7b3bcdcd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.694344  2676 tablet_replica.cc:333] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd: stopping tablet replica
I20260709 12:26:12.694726  2676 raft_consensus.cc:2243] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.695410  2676 raft_consensus.cc:2272] T 43b673e0da91404d9c974f5e04655e1c P ca61502f80cc47e09f103fdc7b3bcdcd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.723414  2676 tablet_server.cc:196] TabletServer@127.2.157.2:0 shutdown complete.
I20260709 12:26:12.741546  2676 tablet_server.cc:179] TabletServer@127.2.157.3:0 shutting down...
W20260709 12:26:12.766239  2925 consensus_peers.cc:597] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a -> Peer ca61502f80cc47e09f103fdc7b3bcdcd (127.2.157.2:45771): Couldn't send request to peer ca61502f80cc47e09f103fdc7b3bcdcd. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:45771: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.768904  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:12.769579  2676 tablet_replica.cc:333] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a: stopping tablet replica
I20260709 12:26:12.770288  2676 raft_consensus.cc:2243] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.771067  2676 raft_consensus.cc:2272] T 92ba5e0c526a48ad99e079e1b6d538b1 P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.773099  2676 tablet_replica.cc:333] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a: stopping tablet replica
I20260709 12:26:12.773530  2676 raft_consensus.cc:2243] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.774299  2676 raft_consensus.cc:2272] T e67d23e756e64e69915da508fd3adea8 P abea949f3dba4f89b5007600f8519d4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.775974  2676 tablet_replica.cc:333] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a: stopping tablet replica
I20260709 12:26:12.776430  2676 raft_consensus.cc:2243] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.777115  2676 raft_consensus.cc:2272] T 5a1f815ecf1149cbba9c8797a4a77e18 P abea949f3dba4f89b5007600f8519d4a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.778779  2676 tablet_replica.cc:333] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a: stopping tablet replica
I20260709 12:26:12.779232  2676 raft_consensus.cc:2243] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.779606  2676 raft_consensus.cc:2272] T 74248b35b6804c6b88efe1b29473e3b8 P abea949f3dba4f89b5007600f8519d4a [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.781436  2676 tablet_replica.cc:333] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a: stopping tablet replica
I20260709 12:26:12.781949  2676 raft_consensus.cc:2243] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.782392  2676 raft_consensus.cc:2272] T 65de8546427c4a7382c5805646ddd60d P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.784298  2676 tablet_replica.cc:333] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a: stopping tablet replica
I20260709 12:26:12.785022  2676 raft_consensus.cc:2243] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.785610  2676 raft_consensus.cc:2272] T 6edda213b896400e92a8a69471b30b6a P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.787519  2676 tablet_replica.cc:333] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a: stopping tablet replica
I20260709 12:26:12.787927  2676 raft_consensus.cc:2243] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.788259  2676 raft_consensus.cc:2272] T c9d2dfc6e6314c27bcd91ab1da0da380 P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.789709  2676 tablet_replica.cc:333] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a: stopping tablet replica
I20260709 12:26:12.790186  2676 raft_consensus.cc:2243] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.790522  2676 raft_consensus.cc:2272] T bc6c1d29e56d45f18131dad906770b95 P abea949f3dba4f89b5007600f8519d4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.791898  2676 tablet_replica.cc:333] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a: stopping tablet replica
I20260709 12:26:12.792294  2676 raft_consensus.cc:2243] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.792644  2676 raft_consensus.cc:2272] T 43b673e0da91404d9c974f5e04655e1c P abea949f3dba4f89b5007600f8519d4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.820533  2676 tablet_server.cc:196] TabletServer@127.2.157.3:0 shutdown complete.
I20260709 12:26:12.837733  2676 master.cc:562] Master@127.2.157.62:46275 shutting down...
I20260709 12:26:12.967279  2676 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:12.967937  2676 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.968287  2676 tablet_replica.cc:333] T 00000000000000000000000000000000 P b6a8a95e882f407f9accdaccdb9c8f5d: stopping tablet replica
I20260709 12:26:12.987939  2676 master.cc:584] Master@127.2.157.62:46275 shutdown complete.
abea949f3dba4f89b5007600f8519d4a  1
b8940e3feb884892a95310f0dc1c2418  4
ca61502f80cc47e09f103fdc7b3bcdcd  4
abea949f3dba4f89b5007600f8519d4a  3
b8940e3feb884892a95310f0dc1c2418  3
ca61502f80cc47e09f103fdc7b3bcdcd  3
abea949f3dba4f89b5007600f8519d4a  1
b8940e3feb884892a95310f0dc1c2418  0
ca61502f80cc47e09f103fdc7b3bcdcd  8
abea949f3dba4f89b5007600f8519d4a  3
b8940e3feb884892a95310f0dc1c2418  3
ca61502f80cc47e09f103fdc7b3bcdcd  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (32887 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:26:13.031772  2676 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.62:41389
I20260709 12:26:13.032915  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:13.038582  3223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:13.038751  3224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:13.039816  3226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:13.039976  2676 server_base.cc:1061] running on GCE node
I20260709 12:26:13.041008  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:13.041208  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:13.041383  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783599973041348 us; error 0 us; skew 500 ppm
I20260709 12:26:13.041997  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:13.044446  2676 webserver.cc:533] Webserver started at http://127.2.157.62:34849/ using document root <none> and password file <none>
I20260709 12:26:13.044950  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:13.045140  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:13.045437  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:13.046646  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/master-0-root/instance:
uuid: "687a1d41ddd84ad8893e60eedd0481e9"
format_stamp: "Formatted at 2026-07-09 12:26:13 on dist-test-slave-0768"
I20260709 12:26:13.051347  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:26:13.054663  3231 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:13.055377  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:26:13.055660  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/master-0-root
uuid: "687a1d41ddd84ad8893e60eedd0481e9"
format_stamp: "Formatted at 2026-07-09 12:26:13 on dist-test-slave-0768"
I20260709 12:26:13.055927  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:13.066597  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:13.067939  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:13.108412  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.62:41389
I20260709 12:26:13.108525  3282 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.62:41389 every 8 connection(s)
I20260709 12:26:13.112306  3283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.121850  3283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9: Bootstrap starting.
I20260709 12:26:13.126533  3283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.130677  3283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9: No bootstrap required, opened a new log
I20260709 12:26:13.132773  3283 raft_consensus.cc:359] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "687a1d41ddd84ad8893e60eedd0481e9" member_type: VOTER }
I20260709 12:26:13.133198  3283 raft_consensus.cc:385] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.133375  3283 raft_consensus.cc:740] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 687a1d41ddd84ad8893e60eedd0481e9, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.133955  3283 consensus_queue.cc:260] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "687a1d41ddd84ad8893e60eedd0481e9" member_type: VOTER }
I20260709 12:26:13.134403  3283 raft_consensus.cc:399] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:13.134594  3283 raft_consensus.cc:493] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:13.134801  3283 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:13.138830  3283 raft_consensus.cc:515] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "687a1d41ddd84ad8893e60eedd0481e9" member_type: VOTER }
I20260709 12:26:13.139340  3283 leader_election.cc:304] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 687a1d41ddd84ad8893e60eedd0481e9; no voters: 
I20260709 12:26:13.140444  3283 leader_election.cc:290] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:13.140866  3286 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:13.142207  3286 raft_consensus.cc:697] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [term 1 LEADER]: Becoming Leader. State: Replica: 687a1d41ddd84ad8893e60eedd0481e9, State: Running, Role: LEADER
I20260709 12:26:13.142863  3286 consensus_queue.cc:237] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "687a1d41ddd84ad8893e60eedd0481e9" member_type: VOTER }
I20260709 12:26:13.143432  3283 sys_catalog.cc:565] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:13.148707  3288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 687a1d41ddd84ad8893e60eedd0481e9. Latest consensus state: current_term: 1 leader_uuid: "687a1d41ddd84ad8893e60eedd0481e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "687a1d41ddd84ad8893e60eedd0481e9" member_type: VOTER } }
I20260709 12:26:13.149514  3288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:13.154410  3287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "687a1d41ddd84ad8893e60eedd0481e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "687a1d41ddd84ad8893e60eedd0481e9" member_type: VOTER } }
I20260709 12:26:13.155185  3287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:13.159360  2676 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
W20260709 12:26:13.163069  3302 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260709 12:26:13.163340  3302 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260709 12:26:13.163815  3296 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:13.168720  3296 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:13.178262  3296 catalog_manager.cc:1383] Generated new cluster ID: 1ca2db82b3b841848d86ab54f420ebbf
I20260709 12:26:13.178555  3296 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:13.202507  3296 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:13.203774  3296 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:13.220508  3296 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9: Generated new TSK 0
I20260709 12:26:13.221076  3296 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:13.226404  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:13.232259  3304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:13.233529  3305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:13.235168  3307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:13.235575  2676 server_base.cc:1061] running on GCE node
I20260709 12:26:13.236449  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:13.236665  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:13.236858  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783599973236826 us; error 0 us; skew 500 ppm
I20260709 12:26:13.237417  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:13.239800  2676 webserver.cc:533] Webserver started at http://127.2.157.1:36489/ using document root <none> and password file <none>
I20260709 12:26:13.240331  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:13.240535  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:13.240841  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:13.242038  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-0-root/instance:
uuid: "94f2f1c5017545e6bd73655a3762e867"
format_stamp: "Formatted at 2026-07-09 12:26:13 on dist-test-slave-0768"
I20260709 12:26:13.247280  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:26:13.250811  3312 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:13.251595  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:26:13.251929  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-0-root
uuid: "94f2f1c5017545e6bd73655a3762e867"
format_stamp: "Formatted at 2026-07-09 12:26:13 on dist-test-slave-0768"
I20260709 12:26:13.252310  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:13.281296  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:13.282717  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:13.284368  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:13.286787  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:13.287034  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:13.287307  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:13.287519  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:13.330286  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.1:42499
I20260709 12:26:13.330368  3374 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.1:42499 every 8 connection(s)
I20260709 12:26:13.335198  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:13.344338  3379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:13.345992  3380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:13.347394  2676 server_base.cc:1061] running on GCE node
I20260709 12:26:13.348198  3375 heartbeater.cc:344] Connected to a master server at 127.2.157.62:41389
I20260709 12:26:13.348613  3375 heartbeater.cc:461] Registering TS with master...
W20260709 12:26:13.349038  3382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:13.349401  3375 heartbeater.cc:507] Master 127.2.157.62:41389 requested a full tablet report, sending...
I20260709 12:26:13.350147  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:13.350395  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:13.350593  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783599973350573 us; error 0 us; skew 500 ppm
I20260709 12:26:13.351218  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:13.351575  3248 ts_manager.cc:194] Registered new tserver with Master: 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499)
I20260709 12:26:13.353732  3248 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52036
I20260709 12:26:13.354032  2676 webserver.cc:533] Webserver started at http://127.2.157.2:41373/ using document root <none> and password file <none>
I20260709 12:26:13.354522  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:13.354702  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:13.355014  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:13.356110  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-1-root/instance:
uuid: "ce8ac360b4944ac78fc2401b20fa940b"
format_stamp: "Formatted at 2026-07-09 12:26:13 on dist-test-slave-0768"
I20260709 12:26:13.360358  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:13.363610  3387 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:13.364460  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:26:13.364771  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-1-root
uuid: "ce8ac360b4944ac78fc2401b20fa940b"
format_stamp: "Formatted at 2026-07-09 12:26:13 on dist-test-slave-0768"
I20260709 12:26:13.365098  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:13.383432  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:13.385776  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:13.388389  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:13.392234  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:13.392822  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260709 12:26:13.393154  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:13.393402  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:13.445214  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.2:42953
I20260709 12:26:13.445399  3449 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.2:42953 every 8 connection(s)
I20260709 12:26:13.449913  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:13.457983  3453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:13.462097  3454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:13.463783  2676 server_base.cc:1061] running on GCE node
W20260709 12:26:13.464155  3456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:13.465107  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:13.465348  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:13.465571  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783599973465545 us; error 0 us; skew 500 ppm
I20260709 12:26:13.466298  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:13.466511  3450 heartbeater.cc:344] Connected to a master server at 127.2.157.62:41389
I20260709 12:26:13.466959  3450 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:13.467689  3450 heartbeater.cc:507] Master 127.2.157.62:41389 requested a full tablet report, sending...
I20260709 12:26:13.469007  2676 webserver.cc:533] Webserver started at http://127.2.157.3:38773/ using document root <none> and password file <none>
I20260709 12:26:13.469584  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:13.469771  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:13.469717  3248 ts_manager.cc:194] Registered new tserver with Master: ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953)
I20260709 12:26:13.470219  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:13.471220  3248 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52052
I20260709 12:26:13.471330  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-2-root/instance:
uuid: "946bb0d09af343498b7e84c16cbcdd62"
format_stamp: "Formatted at 2026-07-09 12:26:13 on dist-test-slave-0768"
I20260709 12:26:13.475821  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:26:13.478904  3461 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:13.479689  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:26:13.480085  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-2-root
uuid: "946bb0d09af343498b7e84c16cbcdd62"
format_stamp: "Formatted at 2026-07-09 12:26:13 on dist-test-slave-0768"
I20260709 12:26:13.480412  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599939977835-2676-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:13.515518  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:13.516839  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:13.518529  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:13.521064  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:13.521315  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:13.521617  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:13.521821  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:13.563604  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.3:41241
I20260709 12:26:13.563670  3523 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.3:41241 every 8 connection(s)
I20260709 12:26:13.577769  3524 heartbeater.cc:344] Connected to a master server at 127.2.157.62:41389
I20260709 12:26:13.578178  3524 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:13.578868  3524 heartbeater.cc:507] Master 127.2.157.62:41389 requested a full tablet report, sending...
I20260709 12:26:13.580904  3248 ts_manager.cc:194] Registered new tserver with Master: 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:13.581607  2676 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014517035s
I20260709 12:26:13.582480  3248 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52062
I20260709 12:26:13.608181  3248 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52078:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:13.611194  3248 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:13.683241  3415 tablet_service.cc:1511] Processing CreateTablet for tablet c4188b19345044b6b8f86b5397198171 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:26:13.683411  3414 tablet_service.cc:1511] Processing CreateTablet for tablet 3019a0331f094fb5be682e843969de64 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:26:13.684891  3415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4188b19345044b6b8f86b5397198171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.687165  3340 tablet_service.cc:1511] Processing CreateTablet for tablet c4188b19345044b6b8f86b5397198171 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:26:13.688961  3340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4188b19345044b6b8f86b5397198171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.691195  3339 tablet_service.cc:1511] Processing CreateTablet for tablet 3019a0331f094fb5be682e843969de64 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:26:13.692622  3339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3019a0331f094fb5be682e843969de64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.693019  3338 tablet_service.cc:1511] Processing CreateTablet for tablet 7167b0853ae34ad581ebf0df54b4032a (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:26:13.694365  3338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7167b0853ae34ad581ebf0df54b4032a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.695299  3413 tablet_service.cc:1511] Processing CreateTablet for tablet 7167b0853ae34ad581ebf0df54b4032a (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:26:13.698582  3413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7167b0853ae34ad581ebf0df54b4032a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.702073  3337 tablet_service.cc:1511] Processing CreateTablet for tablet ab1e9019cef34fcbaf43b0fb83efc14c (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:26:13.702555  3414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3019a0331f094fb5be682e843969de64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.703537  3337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab1e9019cef34fcbaf43b0fb83efc14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.714630  3412 tablet_service.cc:1511] Processing CreateTablet for tablet ab1e9019cef34fcbaf43b0fb83efc14c (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:26:13.716136  3412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab1e9019cef34fcbaf43b0fb83efc14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.727031  3336 tablet_service.cc:1511] Processing CreateTablet for tablet 5056ee8dda5d47ee9bb62c5c079f4b05 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:26:13.728811  3336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5056ee8dda5d47ee9bb62c5c079f4b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.748090  3489 tablet_service.cc:1511] Processing CreateTablet for tablet c4188b19345044b6b8f86b5397198171 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:26:13.749503  3489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4188b19345044b6b8f86b5397198171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.751139  3488 tablet_service.cc:1511] Processing CreateTablet for tablet 3019a0331f094fb5be682e843969de64 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:26:13.752475  3488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3019a0331f094fb5be682e843969de64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.755040  3487 tablet_service.cc:1511] Processing CreateTablet for tablet 7167b0853ae34ad581ebf0df54b4032a (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:26:13.756343  3487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7167b0853ae34ad581ebf0df54b4032a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.759341  3486 tablet_service.cc:1511] Processing CreateTablet for tablet ab1e9019cef34fcbaf43b0fb83efc14c (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:26:13.760648  3486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab1e9019cef34fcbaf43b0fb83efc14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.760748  3411 tablet_service.cc:1511] Processing CreateTablet for tablet 5056ee8dda5d47ee9bb62c5c079f4b05 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:26:13.762593  3411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5056ee8dda5d47ee9bb62c5c079f4b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.775465  3540 tablet_bootstrap.cc:492] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867: Bootstrap starting.
I20260709 12:26:13.780421  3485 tablet_service.cc:1511] Processing CreateTablet for tablet 5056ee8dda5d47ee9bb62c5c079f4b05 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:26:13.782316  3485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5056ee8dda5d47ee9bb62c5c079f4b05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.794181  3340 tablet_service.cc:1511] Processing CreateTablet for tablet 065bdad34e5f4cc696adf14866147acc (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:26:13.795539  3340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065bdad34e5f4cc696adf14866147acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.799490  3410 tablet_service.cc:1511] Processing CreateTablet for tablet 065bdad34e5f4cc696adf14866147acc (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:26:13.800858  3410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065bdad34e5f4cc696adf14866147acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.815088  3484 tablet_service.cc:1511] Processing CreateTablet for tablet 065bdad34e5f4cc696adf14866147acc (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:26:13.817046  3484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065bdad34e5f4cc696adf14866147acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.819051  3539 tablet_bootstrap.cc:492] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b: Bootstrap starting.
I20260709 12:26:13.822903  3541 tablet_bootstrap.cc:492] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62: Bootstrap starting.
I20260709 12:26:13.829666  3541 tablet_bootstrap.cc:654] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.835340  3336 tablet_service.cc:1511] Processing CreateTablet for tablet e6535b05ad364aad91eeec06b149d559 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:26:13.845093  3486 tablet_service.cc:1511] Processing CreateTablet for tablet e6535b05ad364aad91eeec06b149d559 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:26:13.846536  3340 tablet_service.cc:1511] Processing CreateTablet for tablet 72685a6f0f6e49ac9c40ecb656f0ce84 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:26:13.849256  3488 tablet_service.cc:1511] Processing CreateTablet for tablet 72685a6f0f6e49ac9c40ecb656f0ce84 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:26:13.849942  3339 tablet_service.cc:1511] Processing CreateTablet for tablet 1c139debaa01460ca2b940d4faef6b11 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:26:13.852735  3414 tablet_service.cc:1511] Processing CreateTablet for tablet 1c139debaa01460ca2b940d4faef6b11 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:26:13.853188  3489 tablet_service.cc:1511] Processing CreateTablet for tablet 1c139debaa01460ca2b940d4faef6b11 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:26:13.856211  3414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c139debaa01460ca2b940d4faef6b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.840844  3540 tablet_bootstrap.cc:654] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.857339  3413 tablet_service.cc:1511] Processing CreateTablet for tablet 563563e5d21241b38fd03c4af3aa717f (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:26:13.857421  3487 tablet_service.cc:1511] Processing CreateTablet for tablet 563563e5d21241b38fd03c4af3aa717f (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:26:13.862314  3413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563563e5d21241b38fd03c4af3aa717f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.860322  3486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6535b05ad364aad91eeec06b149d559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.863628  3489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c139debaa01460ca2b940d4faef6b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.840510  3539 tablet_bootstrap.cc:654] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.855845  3338 tablet_service.cc:1511] Processing CreateTablet for tablet 563563e5d21241b38fd03c4af3aa717f (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:26:13.840426  3411 tablet_service.cc:1511] Processing CreateTablet for tablet e6535b05ad364aad91eeec06b149d559 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:26:13.865258  3487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563563e5d21241b38fd03c4af3aa717f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.865983  3340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72685a6f0f6e49ac9c40ecb656f0ce84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.866639  3338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563563e5d21241b38fd03c4af3aa717f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.867272  3488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72685a6f0f6e49ac9c40ecb656f0ce84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.874573  3339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c139debaa01460ca2b940d4faef6b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.877705  3410 tablet_service.cc:1511] Processing CreateTablet for tablet 72685a6f0f6e49ac9c40ecb656f0ce84 (DEFAULT_TABLE table=test-workload [id=01cc10bf6f844ddeab0ba86d7ef444ee]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:26:13.882174  3336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6535b05ad364aad91eeec06b149d559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.883953  3540 tablet_bootstrap.cc:492] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867: No bootstrap required, opened a new log
I20260709 12:26:13.884441  3540 ts_tablet_manager.cc:1403] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.000s
I20260709 12:26:13.884763  3411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6535b05ad364aad91eeec06b149d559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.887429  3540 raft_consensus.cc:359] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:13.888145  3540 raft_consensus.cc:385] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.888433  3540 raft_consensus.cc:740] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.890499  3410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72685a6f0f6e49ac9c40ecb656f0ce84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.890209  3540 consensus_queue.cc:260] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:13.916072  3541 tablet_bootstrap.cc:492] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62: No bootstrap required, opened a new log
I20260709 12:26:13.916561  3541 ts_tablet_manager.cc:1403] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62: Time spent bootstrapping tablet: real 0.094s	user 0.049s	sys 0.027s
I20260709 12:26:13.920706  3541 raft_consensus.cc:359] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:13.921521  3541 raft_consensus.cc:385] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.921900  3541 raft_consensus.cc:740] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.922830  3541 consensus_queue.cc:260] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:13.939471  3539 tablet_bootstrap.cc:492] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b: No bootstrap required, opened a new log
I20260709 12:26:13.939963  3539 ts_tablet_manager.cc:1403] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b: Time spent bootstrapping tablet: real 0.121s	user 0.008s	sys 0.018s
I20260709 12:26:13.940248  3375 heartbeater.cc:499] Master 127.2.157.62:41389 was elected leader, sending a full tablet report...
I20260709 12:26:13.941143  3540 ts_tablet_manager.cc:1434] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.004s
I20260709 12:26:13.942101  3540 tablet_bootstrap.cc:492] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867: Bootstrap starting.
I20260709 12:26:13.942866  3539 raft_consensus.cc:359] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:13.943567  3539 raft_consensus.cc:385] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:13.943876  3539 raft_consensus.cc:740] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Initialized, Role: FOLLOWER
I20260709 12:26:13.944639  3539 consensus_queue.cc:260] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:13.962968  3540 tablet_bootstrap.cc:654] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.969991  3524 heartbeater.cc:499] Master 127.2.157.62:41389 was elected leader, sending a full tablet report...
I20260709 12:26:13.974637  3541 ts_tablet_manager.cc:1434] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62: Time spent starting tablet: real 0.058s	user 0.020s	sys 0.029s
I20260709 12:26:13.975679  3541 tablet_bootstrap.cc:492] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62: Bootstrap starting.
I20260709 12:26:13.982101  3541 tablet_bootstrap.cc:654] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:13.997784  3450 heartbeater.cc:499] Master 127.2.157.62:41389 was elected leader, sending a full tablet report...
I20260709 12:26:13.998368  3539 ts_tablet_manager.cc:1434] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b: Time spent starting tablet: real 0.058s	user 0.024s	sys 0.033s
I20260709 12:26:13.999343  3539 tablet_bootstrap.cc:492] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b: Bootstrap starting.
I20260709 12:26:14.006031  3539 tablet_bootstrap.cc:654] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.009498  3541 tablet_bootstrap.cc:492] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62: No bootstrap required, opened a new log
I20260709 12:26:14.010018  3541 ts_tablet_manager.cc:1403] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.024s
I20260709 12:26:14.012748  3540 tablet_bootstrap.cc:492] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867: No bootstrap required, opened a new log
I20260709 12:26:14.013236  3539 tablet_bootstrap.cc:492] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b: No bootstrap required, opened a new log
I20260709 12:26:14.013252  3541 raft_consensus.cc:359] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.013900  3539 ts_tablet_manager.cc:1403] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 12:26:14.014120  3541 raft_consensus.cc:385] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.014443  3541 raft_consensus.cc:740] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.015220  3541 consensus_queue.cc:260] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.017117  3539 raft_consensus.cc:359] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.017554  3541 ts_tablet_manager.cc:1434] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:14.013242  3540 ts_tablet_manager.cc:1403] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.017s
I20260709 12:26:14.018024  3539 raft_consensus.cc:385] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.018396  3539 raft_consensus.cc:740] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.018612  3541 tablet_bootstrap.cc:492] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62: Bootstrap starting.
I20260709 12:26:14.019268  3539 consensus_queue.cc:260] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.020784  3540 raft_consensus.cc:359] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.021493  3540 raft_consensus.cc:385] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.021814  3540 raft_consensus.cc:740] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.022188  3539 ts_tablet_manager.cc:1434] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:26:14.022558  3540 consensus_queue.cc:260] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.023231  3539 tablet_bootstrap.cc:492] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b: Bootstrap starting.
I20260709 12:26:14.025347  3541 tablet_bootstrap.cc:654] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.031219  3539 tablet_bootstrap.cc:654] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.031839  3540 ts_tablet_manager.cc:1434] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:26:14.032861  3540 tablet_bootstrap.cc:492] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867: Bootstrap starting.
I20260709 12:26:14.035215  3545 raft_consensus.cc:493] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.035573  3541 tablet_bootstrap.cc:492] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62: No bootstrap required, opened a new log
I20260709 12:26:14.035723  3545 raft_consensus.cc:515] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.036309  3541 ts_tablet_manager.cc:1403] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 12:26:14.039383  3540 tablet_bootstrap.cc:654] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.040254  3541 raft_consensus.cc:359] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.041318  3541 raft_consensus.cc:385] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.045151  3541 raft_consensus.cc:740] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.046432  3541 consensus_queue.cc:260] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.051717  3547 raft_consensus.cc:493] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.052211  3547 raft_consensus.cc:515] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.057147  3541 ts_tablet_manager.cc:1434] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62: Time spent starting tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 12:26:14.059121  3547 leader_election.cc:290] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:14.062652  3545 leader_election.cc:290] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953)
W20260709 12:26:14.067951  3525 tablet.cc:2406] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:14.072865  3541 tablet_bootstrap.cc:492] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62: Bootstrap starting.
I20260709 12:26:14.080924  3540 tablet_bootstrap.cc:492] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867: No bootstrap required, opened a new log
I20260709 12:26:14.081228  3545 raft_consensus.cc:493] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.081461  3540 ts_tablet_manager.cc:1403] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867: Time spent bootstrapping tablet: real 0.049s	user 0.005s	sys 0.014s
I20260709 12:26:14.081791  3545 raft_consensus.cc:515] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.082635  3541 tablet_bootstrap.cc:654] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.085230  3545 leader_election.cc:290] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953)
I20260709 12:26:14.089116  3540 raft_consensus.cc:359] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.092267  3540 raft_consensus.cc:385] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.092657  3540 raft_consensus.cc:740] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.093528  3540 consensus_queue.cc:260] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.099014  3540 ts_tablet_manager.cc:1434] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 12:26:14.100200  3540 tablet_bootstrap.cc:492] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867: Bootstrap starting.
I20260709 12:26:14.116133  3540 tablet_bootstrap.cc:654] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.128261  3540 tablet_bootstrap.cc:492] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867: No bootstrap required, opened a new log
I20260709 12:26:14.128773  3540 ts_tablet_manager.cc:1403] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.011s
I20260709 12:26:14.131636  3350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867" is_pre_election: true
I20260709 12:26:14.132268  3425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b" is_pre_election: true
I20260709 12:26:14.132901  3425 raft_consensus.cc:2468] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 0.
I20260709 12:26:14.133476  3350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7167b0853ae34ad581ebf0df54b4032a" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867" is_pre_election: true
I20260709 12:26:14.134081  3350 raft_consensus.cc:2468] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 0.
I20260709 12:26:14.134730  3465 leader_election.cc:304] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:14.134095  3424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7167b0853ae34ad581ebf0df54b4032a" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b" is_pre_election: true
I20260709 12:26:14.136214  3545 raft_consensus.cc:2804] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:14.136627  3545 raft_consensus.cc:493] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.136562  3540 raft_consensus.cc:359] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.137104  3545 raft_consensus.cc:3060] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.137382  3540 raft_consensus.cc:385] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.137705  3540 raft_consensus.cc:740] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Initialized, Role: FOLLOWER
W20260709 12:26:14.138567  3465 leader_election.cc:343] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:14.139288  3540 consensus_queue.cc:260] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.141736  3540 ts_tablet_manager.cc:1434] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:26:14.142730  3540 tablet_bootstrap.cc:492] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867: Bootstrap starting.
W20260709 12:26:14.142577  3462 leader_election.cc:343] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:14.143595  3462 leader_election.cc:304] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867; no voters: ce8ac360b4944ac78fc2401b20fa940b
I20260709 12:26:14.144603  3554 raft_consensus.cc:2804] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:14.145056  3554 raft_consensus.cc:493] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.145493  3554 raft_consensus.cc:3060] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.149148  3545 raft_consensus.cc:515] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
W20260709 12:26:14.152870  3295 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:14.159086  3554 raft_consensus.cc:515] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.162176  3350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4188b19345044b6b8f86b5397198171" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867" is_pre_election: true
I20260709 12:26:14.162866  3350 raft_consensus.cc:2468] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 0.
I20260709 12:26:14.164284  3545 leader_election.cc:290] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953)
I20260709 12:26:14.165032  3541 tablet_bootstrap.cc:492] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62: No bootstrap required, opened a new log
I20260709 12:26:14.164914  3388 leader_election.cc:304] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94f2f1c5017545e6bd73655a3762e867, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:14.165576  3541 ts_tablet_manager.cc:1403] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62: Time spent bootstrapping tablet: real 0.093s	user 0.031s	sys 0.035s
I20260709 12:26:14.165743  3424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7167b0853ae34ad581ebf0df54b4032a" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:14.165918  3547 raft_consensus.cc:2804] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:14.166285  3539 tablet_bootstrap.cc:492] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b: No bootstrap required, opened a new log
I20260709 12:26:14.166313  3547 raft_consensus.cc:493] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.166800  3539 ts_tablet_manager.cc:1403] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b: Time spent bootstrapping tablet: real 0.144s	user 0.047s	sys 0.092s
I20260709 12:26:14.166777  3547 raft_consensus.cc:3060] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.166916  3425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:14.167636  3425 raft_consensus.cc:3060] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.168571  3541 raft_consensus.cc:359] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.169297  3541 raft_consensus.cc:385] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.169565  3541 raft_consensus.cc:740] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.170022  3539 raft_consensus.cc:359] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.170315  3541 consensus_queue.cc:260] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.156868  3540 tablet_bootstrap.cc:654] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.171624  3350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:14.172197  3350 raft_consensus.cc:3060] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.170740  3539 raft_consensus.cc:385] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:26:14.170644  3465 leader_election.cc:343] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:14.175617  3539 raft_consensus.cc:740] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.175994  3349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7167b0853ae34ad581ebf0df54b4032a" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:14.176577  3349 raft_consensus.cc:3060] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.176455  3539 consensus_queue.cc:260] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.177734  3425 raft_consensus.cc:2468] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 1.
I20260709 12:26:14.178879  3465 leader_election.cc:304] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:14.179628  3545 raft_consensus.cc:2804] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:14.179736  3554 leader_election.cc:290] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953)
I20260709 12:26:14.182885  3541 ts_tablet_manager.cc:1434] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:26:14.183915  3541 tablet_bootstrap.cc:492] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62: Bootstrap starting.
I20260709 12:26:14.184588  3540 tablet_bootstrap.cc:492] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867: No bootstrap required, opened a new log
I20260709 12:26:14.185105  3540 ts_tablet_manager.cc:1403] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.001s
I20260709 12:26:14.187605  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4188b19345044b6b8f86b5397198171" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946bb0d09af343498b7e84c16cbcdd62" is_pre_election: true
I20260709 12:26:14.188264  3499 raft_consensus.cc:2468] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 0.
I20260709 12:26:14.188560  3539 ts_tablet_manager.cc:1434] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.001s
I20260709 12:26:14.190064  3545 raft_consensus.cc:697] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Becoming Leader. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Running, Role: LEADER
I20260709 12:26:14.190039  3539 tablet_bootstrap.cc:492] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b: Bootstrap starting.
I20260709 12:26:14.193483  3540 raft_consensus.cc:359] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.194332  3540 raft_consensus.cc:385] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.194638  3540 raft_consensus.cc:740] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.195415  3540 consensus_queue.cc:260] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.196040  3350 raft_consensus.cc:2468] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 1.
I20260709 12:26:14.197690  3540 ts_tablet_manager.cc:1434] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:26:14.198714  3540 tablet_bootstrap.cc:492] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867: Bootstrap starting.
I20260709 12:26:14.198621  3547 raft_consensus.cc:515] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.200708  3541 tablet_bootstrap.cc:654] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.204648  3539 tablet_bootstrap.cc:654] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.206110  3540 tablet_bootstrap.cc:654] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.206764  3545 consensus_queue.cc:237] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.213020  3541 tablet_bootstrap.cc:492] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62: No bootstrap required, opened a new log
I20260709 12:26:14.213748  3541 ts_tablet_manager.cc:1403] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.009s
I20260709 12:26:14.217710  3541 raft_consensus.cc:359] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.222328  3541 raft_consensus.cc:385] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.222824  3541 raft_consensus.cc:740] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.225232  3541 consensus_queue.cc:260] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.226938  3540 tablet_bootstrap.cc:492] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867: No bootstrap required, opened a new log
I20260709 12:26:14.227449  3540 ts_tablet_manager.cc:1403] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.020s
I20260709 12:26:14.227975  3248 catalog_manager.cc:5697] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "946bb0d09af343498b7e84c16cbcdd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.229235  3541 ts_tablet_manager.cc:1434] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:26:14.230100  3539 tablet_bootstrap.cc:492] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b: No bootstrap required, opened a new log
I20260709 12:26:14.230235  3541 tablet_bootstrap.cc:492] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62: Bootstrap starting.
I20260709 12:26:14.230583  3539 ts_tablet_manager.cc:1403] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.013s
I20260709 12:26:14.230417  3540 raft_consensus.cc:359] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.231199  3540 raft_consensus.cc:385] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.231508  3540 raft_consensus.cc:740] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.232378  3349 raft_consensus.cc:2468] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 1.
I20260709 12:26:14.232290  3540 consensus_queue.cc:260] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.233657  3462 leader_election.cc:304] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867; no voters: ce8ac360b4944ac78fc2401b20fa940b
I20260709 12:26:14.233536  3539 raft_consensus.cc:359] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.234287  3539 raft_consensus.cc:385] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.234576  3539 raft_consensus.cc:740] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.234844  3545 raft_consensus.cc:2804] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:14.235320  3545 raft_consensus.cc:697] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Becoming Leader. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Running, Role: LEADER
I20260709 12:26:14.235322  3539 consensus_queue.cc:260] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.236244  3545 consensus_queue.cc:237] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.238147  3541 tablet_bootstrap.cc:654] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.239507  3539 ts_tablet_manager.cc:1434] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:26:14.240465  3539 tablet_bootstrap.cc:492] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b: Bootstrap starting.
I20260709 12:26:14.241822  3540 ts_tablet_manager.cc:1434] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:26:14.246738  3539 tablet_bootstrap.cc:654] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.254233  3540 tablet_bootstrap.cc:492] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867: Bootstrap starting.
I20260709 12:26:14.254822  3349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4188b19345044b6b8f86b5397198171" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:14.255717  3349 raft_consensus.cc:3060] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.260401  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4188b19345044b6b8f86b5397198171" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:14.261250  3499 raft_consensus.cc:3060] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.267436  3540 tablet_bootstrap.cc:654] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.271373  3499 raft_consensus.cc:2468] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 1.
I20260709 12:26:14.273306  3389 leader_election.cc:304] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:14.274557  3562 raft_consensus.cc:2804] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:14.275799  3547 leader_election.cc:290] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:14.283382  3540 tablet_bootstrap.cc:492] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867: No bootstrap required, opened a new log
I20260709 12:26:14.284034  3540 ts_tablet_manager.cc:1403] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.011s
I20260709 12:26:14.288823  3562 raft_consensus.cc:697] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Becoming Leader. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:14.288410  3540 raft_consensus.cc:359] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.289413  3540 raft_consensus.cc:385] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.289808  3540 raft_consensus.cc:740] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.289738  3562 consensus_queue.cc:237] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.291076  3540 consensus_queue.cc:260] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.300849  3349 raft_consensus.cc:2468] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 1.
I20260709 12:26:14.305246  3540 ts_tablet_manager.cc:1434] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 12:26:14.305605  3539 tablet_bootstrap.cc:492] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b: No bootstrap required, opened a new log
I20260709 12:26:14.306228  3539 ts_tablet_manager.cc:1403] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b: Time spent bootstrapping tablet: real 0.066s	user 0.028s	sys 0.015s
I20260709 12:26:14.306566  3541 tablet_bootstrap.cc:492] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62: No bootstrap required, opened a new log
I20260709 12:26:14.307083  3541 ts_tablet_manager.cc:1403] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62: Time spent bootstrapping tablet: real 0.077s	user 0.024s	sys 0.049s
I20260709 12:26:14.309931  3540 tablet_bootstrap.cc:492] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867: Bootstrap starting.
I20260709 12:26:14.309484  3539 raft_consensus.cc:359] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.310258  3541 raft_consensus.cc:359] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.310928  3539 raft_consensus.cc:385] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.311093  3541 raft_consensus.cc:385] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.311313  3539 raft_consensus.cc:740] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.311560  3541 raft_consensus.cc:740] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.312625  3541 consensus_queue.cc:260] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.315335  3541 ts_tablet_manager.cc:1434] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:26:14.316378  3541 tablet_bootstrap.cc:492] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62: Bootstrap starting.
I20260709 12:26:14.315980  3539 consensus_queue.cc:260] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.317253  3540 tablet_bootstrap.cc:654] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.317596  3562 raft_consensus.cc:493] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.318099  3562 raft_consensus.cc:515] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.321653  3562 leader_election.cc:290] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:14.322264  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3019a0331f094fb5be682e843969de64" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946bb0d09af343498b7e84c16cbcdd62" is_pre_election: true
I20260709 12:26:14.322911  3499 raft_consensus.cc:2468] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 0.
I20260709 12:26:14.323252  3539 ts_tablet_manager.cc:1434] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 12:26:14.324280  3539 tablet_bootstrap.cc:492] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b: Bootstrap starting.
I20260709 12:26:14.324201  3389 leader_election.cc:304] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:14.324932  3349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3019a0331f094fb5be682e843969de64" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867" is_pre_election: true
I20260709 12:26:14.325314  3562 raft_consensus.cc:2804] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:14.325572  3349 raft_consensus.cc:2468] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 0.
I20260709 12:26:14.326054  3562 raft_consensus.cc:493] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.326565  3562 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.331265  3539 tablet_bootstrap.cc:654] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.331501  3540 tablet_bootstrap.cc:492] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867: No bootstrap required, opened a new log
I20260709 12:26:14.324175  3541 tablet_bootstrap.cc:654] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.332041  3540 ts_tablet_manager.cc:1403] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.007s
I20260709 12:26:14.332490  3247 catalog_manager.cc:5697] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "946bb0d09af343498b7e84c16cbcdd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.334713  3540 raft_consensus.cc:359] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.335372  3540 raft_consensus.cc:385] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.335659  3540 raft_consensus.cc:740] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.336546  3540 consensus_queue.cc:260] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.338379  3540 ts_tablet_manager.cc:1434] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:26:14.339252  3540 tablet_bootstrap.cc:492] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867: Bootstrap starting.
I20260709 12:26:14.338972  3562 raft_consensus.cc:515] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.343549  3248 catalog_manager.cc:5697] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2). New cstate: current_term: 1 leader_uuid: "ce8ac360b4944ac78fc2401b20fa940b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.351795  3540 tablet_bootstrap.cc:654] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.356216  3349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3019a0331f094fb5be682e843969de64" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:14.356725  3349 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.358825  3562 leader_election.cc:290] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:14.359965  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3019a0331f094fb5be682e843969de64" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:14.360536  3499 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.364859  3349 raft_consensus.cc:2468] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 1.
I20260709 12:26:14.366128  3388 leader_election.cc:304] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94f2f1c5017545e6bd73655a3762e867, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:14.372491  3562 raft_consensus.cc:2804] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:14.372684  3545 raft_consensus.cc:493] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.373297  3562 raft_consensus.cc:697] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Becoming Leader. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:14.373183  3545 raft_consensus.cc:515] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.374184  3562 consensus_queue.cc:237] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.375365  3545 leader_election.cc:290] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953)
I20260709 12:26:14.378489  3425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c139debaa01460ca2b940d4faef6b11" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b" is_pre_election: true
I20260709 12:26:14.380105  3539 tablet_bootstrap.cc:492] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b: No bootstrap required, opened a new log
I20260709 12:26:14.380589  3539 ts_tablet_manager.cc:1403] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.023s
W20260709 12:26:14.381048  3465 leader_election.cc:343] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:14.382200  3499 raft_consensus.cc:2468] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 1.
I20260709 12:26:14.379247  3349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c139debaa01460ca2b940d4faef6b11" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867" is_pre_election: true
I20260709 12:26:14.383664  3349 raft_consensus.cc:2468] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 0.
I20260709 12:26:14.383879  3539 raft_consensus.cc:359] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.384594  3539 raft_consensus.cc:385] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.384902  3539 raft_consensus.cc:740] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.385085  3462 leader_election.cc:304] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867; no voters: ce8ac360b4944ac78fc2401b20fa940b
I20260709 12:26:14.385676  3539 consensus_queue.cc:260] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.386714  3545 raft_consensus.cc:2804] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:14.387081  3545 raft_consensus.cc:493] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.387408  3545 raft_consensus.cc:3060] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.387837  3541 tablet_bootstrap.cc:492] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62: No bootstrap required, opened a new log
I20260709 12:26:14.388055  3539 ts_tablet_manager.cc:1434] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:26:14.388168  3541 ts_tablet_manager.cc:1403] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.006s
I20260709 12:26:14.389045  3539 tablet_bootstrap.cc:492] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b: Bootstrap starting.
I20260709 12:26:14.392302  3541 raft_consensus.cc:359] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.393266  3541 raft_consensus.cc:385] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.393639  3541 raft_consensus.cc:740] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.394817  3541 consensus_queue.cc:260] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.397030  3541 ts_tablet_manager.cc:1434] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:26:14.398044  3541 tablet_bootstrap.cc:492] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62: Bootstrap starting.
I20260709 12:26:14.402565  3545 raft_consensus.cc:515] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.404112  3539 tablet_bootstrap.cc:654] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.404457  3541 tablet_bootstrap.cc:654] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.405145  3573 raft_consensus.cc:493] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.405503  3349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c139debaa01460ca2b940d4faef6b11" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:14.405612  3573 raft_consensus.cc:515] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.406272  3349 raft_consensus.cc:3060] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.407621  3540 tablet_bootstrap.cc:492] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867: No bootstrap required, opened a new log
I20260709 12:26:14.408110  3540 ts_tablet_manager.cc:1403] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.018s
I20260709 12:26:14.410832  3540 raft_consensus.cc:359] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.411553  3540 raft_consensus.cc:385] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.413544  3350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5056ee8dda5d47ee9bb62c5c079f4b05" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867" is_pre_election: true
I20260709 12:26:14.413717  3573 leader_election.cc:290] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:14.414219  3350 raft_consensus.cc:2468] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 0.
I20260709 12:26:14.411880  3540 raft_consensus.cc:740] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.415010  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5056ee8dda5d47ee9bb62c5c079f4b05" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946bb0d09af343498b7e84c16cbcdd62" is_pre_election: true
I20260709 12:26:14.415275  3349 raft_consensus.cc:2468] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 1.
I20260709 12:26:14.415521  3388 leader_election.cc:304] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94f2f1c5017545e6bd73655a3762e867, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:14.415619  3499 raft_consensus.cc:2468] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 0.
I20260709 12:26:14.415485  3540 consensus_queue.cc:260] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.416740  3562 raft_consensus.cc:2804] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:14.417124  3562 raft_consensus.cc:493] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.417474  3562 raft_consensus.cc:3060] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.417651  3547 raft_consensus.cc:493] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.418367  3540 ts_tablet_manager.cc:1434] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:14.418112  3547 raft_consensus.cc:515] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.419610  3540 tablet_bootstrap.cc:492] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867: Bootstrap starting.
I20260709 12:26:14.420218  3547 leader_election.cc:290] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:14.421818  3350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7167b0853ae34ad581ebf0df54b4032a" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867" is_pre_election: true
I20260709 12:26:14.422680  3350 raft_consensus.cc:2393] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce8ac360b4944ac78fc2401b20fa940b in current term 1: Already voted for candidate 946bb0d09af343498b7e84c16cbcdd62 in this term.
I20260709 12:26:14.428606  3540 tablet_bootstrap.cc:654] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.428392  3425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c139debaa01460ca2b940d4faef6b11" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:14.429042  3539 tablet_bootstrap.cc:492] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b: No bootstrap required, opened a new log
I20260709 12:26:14.429518  3539 ts_tablet_manager.cc:1403] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
W20260709 12:26:14.430135  3465 leader_election.cc:343] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:14.431021  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7167b0853ae34ad581ebf0df54b4032a" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946bb0d09af343498b7e84c16cbcdd62" is_pre_election: true
I20260709 12:26:14.432473  3389 leader_election.cc:304] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8ac360b4944ac78fc2401b20fa940b; no voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867
I20260709 12:26:14.432713  3539 raft_consensus.cc:359] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.433321  3573 raft_consensus.cc:3060] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.433447  3539 raft_consensus.cc:385] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.433800  3539 raft_consensus.cc:740] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.434360  3462 leader_election.cc:304] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867; no voters: ce8ac360b4944ac78fc2401b20fa940b
I20260709 12:26:14.435187  3540 tablet_bootstrap.cc:492] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867: No bootstrap required, opened a new log
I20260709 12:26:14.435317  3563 raft_consensus.cc:2804] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:14.435101  3562 raft_consensus.cc:515] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.435798  3540 ts_tablet_manager.cc:1403] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 12:26:14.435978  3563 raft_consensus.cc:697] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Becoming Leader. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Running, Role: LEADER
I20260709 12:26:14.437150  3563 consensus_queue.cc:237] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.438683  3540 raft_consensus.cc:359] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.439322  3540 raft_consensus.cc:385] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.439579  3540 raft_consensus.cc:740] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.439911  3539 consensus_queue.cc:260] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.440219  3540 consensus_queue.cc:260] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.443603  3562 leader_election.cc:290] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:14.443853  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5056ee8dda5d47ee9bb62c5c079f4b05" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:14.444412  3499 raft_consensus.cc:3060] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.445461  3540 ts_tablet_manager.cc:1434] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:26:14.445745  3539 ts_tablet_manager.cc:1434] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:26:14.446843  3539 tablet_bootstrap.cc:492] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b: Bootstrap starting.
I20260709 12:26:14.443490  3247 catalog_manager.cc:5697] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2). New cstate: current_term: 1 leader_uuid: "ce8ac360b4944ac78fc2401b20fa940b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.452672  3545 leader_election.cc:290] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953)
I20260709 12:26:14.455754  3573 raft_consensus.cc:2749] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:14.456326  3499 raft_consensus.cc:2468] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 1.
I20260709 12:26:14.457631  3389 leader_election.cc:304] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:14.458639  3562 raft_consensus.cc:2804] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:14.459116  3562 raft_consensus.cc:697] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Becoming Leader. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:14.459308  3539 tablet_bootstrap.cc:654] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.459728  3541 tablet_bootstrap.cc:492] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62: No bootstrap required, opened a new log
I20260709 12:26:14.460150  3541 ts_tablet_manager.cc:1403] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.004s
I20260709 12:26:14.459909  3562 consensus_queue.cc:237] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.463200  3541 raft_consensus.cc:359] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.464123  3541 raft_consensus.cc:385] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.464473  3541 raft_consensus.cc:740] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.465514  3541 consensus_queue.cc:260] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.466550  3248 catalog_manager.cc:5697] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "946bb0d09af343498b7e84c16cbcdd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.468626  3541 ts_tablet_manager.cc:1434] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:14.469841  3541 tablet_bootstrap.cc:492] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62: Bootstrap starting.
I20260709 12:26:14.443526  3349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5056ee8dda5d47ee9bb62c5c079f4b05" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:14.473829  3349 raft_consensus.cc:3060] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.480484  3539 tablet_bootstrap.cc:492] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b: No bootstrap required, opened a new log
I20260709 12:26:14.480865  3541 tablet_bootstrap.cc:654] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.480968  3539 ts_tablet_manager.cc:1403] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.011s
I20260709 12:26:14.480965  3349 raft_consensus.cc:2468] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 1.
I20260709 12:26:14.481388  3247 catalog_manager.cc:5697] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2). New cstate: current_term: 1 leader_uuid: "ce8ac360b4944ac78fc2401b20fa940b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.484797  3539 raft_consensus.cc:359] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.485718  3539 raft_consensus.cc:385] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.486083  3539 raft_consensus.cc:740] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.487119  3539 consensus_queue.cc:260] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.489800  3539 ts_tablet_manager.cc:1434] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:26:14.490981  3539 tablet_bootstrap.cc:492] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b: Bootstrap starting.
I20260709 12:26:14.492408  3541 tablet_bootstrap.cc:492] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62: No bootstrap required, opened a new log
I20260709 12:26:14.492820  3541 ts_tablet_manager.cc:1403] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 12:26:14.495414  3541 raft_consensus.cc:359] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.496079  3541 raft_consensus.cc:385] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.496348  3541 raft_consensus.cc:740] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.496752  3539 tablet_bootstrap.cc:654] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.497004  3541 consensus_queue.cc:260] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.499084  3541 ts_tablet_manager.cc:1434] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:14.501077  3541 tablet_bootstrap.cc:492] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62: Bootstrap starting.
I20260709 12:26:14.502529  3539 tablet_bootstrap.cc:492] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b: No bootstrap required, opened a new log
I20260709 12:26:14.502976  3539 ts_tablet_manager.cc:1403] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:26:14.505574  3539 raft_consensus.cc:359] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.506260  3539 raft_consensus.cc:385] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.506512  3539 raft_consensus.cc:740] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.506772  3541 tablet_bootstrap.cc:654] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.507190  3539 consensus_queue.cc:260] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.511368  3539 ts_tablet_manager.cc:1434] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:14.512097  3541 tablet_bootstrap.cc:492] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62: No bootstrap required, opened a new log
I20260709 12:26:14.512301  3539 tablet_bootstrap.cc:492] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b: Bootstrap starting.
I20260709 12:26:14.512579  3541 ts_tablet_manager.cc:1403] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:26:14.514605  3541 raft_consensus.cc:359] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.515231  3541 raft_consensus.cc:385] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.515465  3541 raft_consensus.cc:740] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.515965  3541 consensus_queue.cc:260] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.517572  3541 ts_tablet_manager.cc:1434] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:26:14.520073  3539 tablet_bootstrap.cc:654] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:14.524502  3539 tablet_bootstrap.cc:492] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b: No bootstrap required, opened a new log
I20260709 12:26:14.524953  3539 ts_tablet_manager.cc:1403] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 12:26:14.526889  3539 raft_consensus.cc:359] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.527348  3539 raft_consensus.cc:385] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:14.527626  3539 raft_consensus.cc:740] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Initialized, Role: FOLLOWER
I20260709 12:26:14.528287  3539 consensus_queue.cc:260] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.530026  3539 ts_tablet_manager.cc:1434] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:26:14.622166  3563 raft_consensus.cc:493] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.622702  3563 raft_consensus.cc:515] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.624366  3563 leader_election.cc:290] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953)
I20260709 12:26:14.625283  3349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563563e5d21241b38fd03c4af3aa717f" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867" is_pre_election: true
I20260709 12:26:14.625384  3425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563563e5d21241b38fd03c4af3aa717f" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b" is_pre_election: true
I20260709 12:26:14.625859  3349 raft_consensus.cc:2468] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 0.
I20260709 12:26:14.626027  3425 raft_consensus.cc:2468] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 0.
I20260709 12:26:14.626927  3462 leader_election.cc:304] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867; no voters: 
I20260709 12:26:14.627614  3563 raft_consensus.cc:2804] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:14.627942  3563 raft_consensus.cc:493] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.628167  3563 raft_consensus.cc:3060] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.632985  3563 raft_consensus.cc:515] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.634886  3563 leader_election.cc:290] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953)
I20260709 12:26:14.635746  3350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563563e5d21241b38fd03c4af3aa717f" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:14.635975  3425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563563e5d21241b38fd03c4af3aa717f" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:14.636387  3350 raft_consensus.cc:3060] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.636580  3425 raft_consensus.cc:3060] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.636677  3563 consensus_queue.cc:1048] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:14.643040  3350 raft_consensus.cc:2468] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 1.
I20260709 12:26:14.643411  3425 raft_consensus.cc:2468] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 1.
I20260709 12:26:14.644518  3462 leader_election.cc:304] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867; no voters: 
I20260709 12:26:14.645255  3563 raft_consensus.cc:2804] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:14.645745  3563 raft_consensus.cc:697] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Becoming Leader. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Running, Role: LEADER
I20260709 12:26:14.646576  3563 consensus_queue.cc:237] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.656239  3597 consensus_queue.cc:1048] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:14.656383  3554 consensus_queue.cc:1048] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.655922  3248 catalog_manager.cc:5697] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "946bb0d09af343498b7e84c16cbcdd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.660346  3562 raft_consensus.cc:493] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.660831  3562 raft_consensus.cc:515] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.662921  3562 leader_election.cc:290] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:14.664068  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065bdad34e5f4cc696adf14866147acc" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946bb0d09af343498b7e84c16cbcdd62" is_pre_election: true
I20260709 12:26:14.664372  3350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065bdad34e5f4cc696adf14866147acc" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867" is_pre_election: true
I20260709 12:26:14.664757  3499 raft_consensus.cc:2468] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 0.
I20260709 12:26:14.664929  3350 raft_consensus.cc:2468] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 0.
I20260709 12:26:14.666002  3389 leader_election.cc:304] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:14.667371  3573 raft_consensus.cc:2804] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:14.667829  3573 raft_consensus.cc:493] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.668234  3573 raft_consensus.cc:3060] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.677388  3573 raft_consensus.cc:515] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.680891  3573 leader_election.cc:290] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:14.681545  3562 raft_consensus.cc:493] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.682086  3562 raft_consensus.cc:515] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.682387  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065bdad34e5f4cc696adf14866147acc" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:14.682919  3499 raft_consensus.cc:3060] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.684273  3562 leader_election.cc:290] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:14.687708  3498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6535b05ad364aad91eeec06b149d559" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946bb0d09af343498b7e84c16cbcdd62" is_pre_election: true
I20260709 12:26:14.688390  3498 raft_consensus.cc:2468] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 0.
I20260709 12:26:14.688324  3563 consensus_queue.cc:1048] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.689739  3349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065bdad34e5f4cc696adf14866147acc" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:14.689749  3389 leader_election.cc:304] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:14.690476  3349 raft_consensus.cc:3060] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.691200  3562 raft_consensus.cc:2804] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:14.691597  3562 raft_consensus.cc:493] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.691802  3499 raft_consensus.cc:2468] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 1.
I20260709 12:26:14.691972  3562 raft_consensus.cc:3060] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.692968  3389 leader_election.cc:304] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:14.693288  3348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6535b05ad364aad91eeec06b149d559" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867" is_pre_election: true
I20260709 12:26:14.693969  3348 raft_consensus.cc:2468] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 0.
I20260709 12:26:14.693969  3573 raft_consensus.cc:2804] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:14.695250  3573 raft_consensus.cc:697] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Becoming Leader. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:14.696116  3573 consensus_queue.cc:237] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.697300  3349 raft_consensus.cc:2468] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 1.
I20260709 12:26:14.702188  3562 raft_consensus.cc:515] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.704370  3562 leader_election.cc:290] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:14.705524  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6535b05ad364aad91eeec06b149d559" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:14.706247  3499 raft_consensus.cc:3060] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.706984  3349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6535b05ad364aad91eeec06b149d559" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:14.707552  3349 raft_consensus.cc:3060] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.714447  3349 raft_consensus.cc:2468] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 1.
I20260709 12:26:14.715502  3388 leader_election.cc:304] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94f2f1c5017545e6bd73655a3762e867, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:14.715679  3499 raft_consensus.cc:2468] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 1.
I20260709 12:26:14.716267  3573 raft_consensus.cc:2804] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:14.716766  3573 raft_consensus.cc:697] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Becoming Leader. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:14.717427  3573 consensus_queue.cc:237] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.717926  3246 catalog_manager.cc:5697] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2). New cstate: current_term: 1 leader_uuid: "ce8ac360b4944ac78fc2401b20fa940b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.731611  3246 catalog_manager.cc:5697] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b reported cstate change: term changed from 0 to 1, leader changed from <none> to ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2). New cstate: current_term: 1 leader_uuid: "ce8ac360b4944ac78fc2401b20fa940b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.737864  3573 consensus_queue.cc:1048] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.746147  3547 raft_consensus.cc:493] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.746650  3547 raft_consensus.cc:515] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.748705  3547 leader_election.cc:290] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:14.748978  3562 consensus_queue.cc:1048] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.749814  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c139debaa01460ca2b940d4faef6b11" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946bb0d09af343498b7e84c16cbcdd62" is_pre_election: true
I20260709 12:26:14.751227  3349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c139debaa01460ca2b940d4faef6b11" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94f2f1c5017545e6bd73655a3762e867" is_pre_election: true
I20260709 12:26:14.752033  3349 raft_consensus.cc:2393] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce8ac360b4944ac78fc2401b20fa940b in current term 1: Already voted for candidate 946bb0d09af343498b7e84c16cbcdd62 in this term.
I20260709 12:26:14.753054  3388 leader_election.cc:304] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8ac360b4944ac78fc2401b20fa940b; no voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867
I20260709 12:26:14.754189  3562 raft_consensus.cc:3060] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.761184  3562 raft_consensus.cc:2749] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:14.768240  3546 raft_consensus.cc:493] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.768661  3546 raft_consensus.cc:515] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.770646  3546 leader_election.cc:290] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:14.795145  3424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b" is_pre_election: true
I20260709 12:26:14.795856  3424 raft_consensus.cc:2468] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 0.
I20260709 12:26:14.796414  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946bb0d09af343498b7e84c16cbcdd62" is_pre_election: true
I20260709 12:26:14.796833  3316 leader_election.cc:304] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94f2f1c5017545e6bd73655a3762e867, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:14.797024  3499 raft_consensus.cc:2468] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 0.
I20260709 12:26:14.797581  3546 raft_consensus.cc:2804] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:14.797936  3546 raft_consensus.cc:493] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.798220  3546 raft_consensus.cc:3060] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.803531  3546 raft_consensus.cc:515] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.805271  3546 leader_election.cc:290] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 1 election: Requested vote from peers ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:14.805989  3424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:14.806214  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:14.806566  3424 raft_consensus.cc:3060] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.806689  3499 raft_consensus.cc:3060] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:14.813478  3499 raft_consensus.cc:2468] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 1.
I20260709 12:26:14.813478  3424 raft_consensus.cc:2468] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 1.
I20260709 12:26:14.814828  3314 leader_election.cc:304] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867; no voters: 
I20260709 12:26:14.815986  3546 raft_consensus.cc:2804] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:14.816771  3546 raft_consensus.cc:697] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 1 LEADER]: Becoming Leader. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:14.817443  3546 consensus_queue.cc:237] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:14.824859  3247 catalog_manager.cc:5697] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "94f2f1c5017545e6bd73655a3762e867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.949954  3563 consensus_queue.cc:1048] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.967175  3563 consensus_queue.cc:1048] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.989312  3562 consensus_queue.cc:1048] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:14.993017  3562 consensus_queue.cc:1048] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:15.001861  3573 consensus_queue.cc:1048] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:15.012630  3562 consensus_queue.cc:1048] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:15.049212  3563 consensus_queue.cc:1048] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:15.059916  3597 consensus_queue.cc:1048] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:15.089075  3424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4188b19345044b6b8f86b5397198171"
dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
mode: GRACEFUL
new_leader_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56206
I20260709 12:26:15.089682  3424 raft_consensus.cc:606] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Received request to transfer leadership to TS 94f2f1c5017545e6bd73655a3762e867
I20260709 12:26:15.095440  3424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3019a0331f094fb5be682e843969de64"
dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
mode: GRACEFUL
new_leader_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56206
I20260709 12:26:15.096000  3424 raft_consensus.cc:606] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Received request to transfer leadership to TS 94f2f1c5017545e6bd73655a3762e867
I20260709 12:26:15.109398  3499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7167b0853ae34ad581ebf0df54b4032a"
dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
mode: GRACEFUL
new_leader_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:38996
I20260709 12:26:15.109967  3499 raft_consensus.cc:606] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Received request to transfer leadership to TS 94f2f1c5017545e6bd73655a3762e867
I20260709 12:26:15.115164  3499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c"
dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
mode: GRACEFUL
new_leader_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:38996
I20260709 12:26:15.115720  3499 raft_consensus.cc:606] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Received request to transfer leadership to TS 94f2f1c5017545e6bd73655a3762e867
I20260709 12:26:15.117856  3573 consensus_queue.cc:1048] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:15.121762  3424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5056ee8dda5d47ee9bb62c5c079f4b05"
dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
mode: GRACEFUL
new_leader_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56206
I20260709 12:26:15.122589  3424 raft_consensus.cc:606] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Received request to transfer leadership to TS 94f2f1c5017545e6bd73655a3762e867
I20260709 12:26:15.129560  3547 consensus_queue.cc:1048] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:15.152367  3547 consensus_queue.cc:1048] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:15.154122  3349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
mode: GRACEFUL
new_leader_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
 from {username='slave'} at 127.0.0.1:56260
I20260709 12:26:15.154704  3349 raft_consensus.cc:606] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 1 LEADER]: Received request to transfer leadership to TS ce8ac360b4944ac78fc2401b20fa940b
I20260709 12:26:15.160578  3499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c139debaa01460ca2b940d4faef6b11"
dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
mode: GRACEFUL
new_leader_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
 from {username='slave'} at 127.0.0.1:38996
I20260709 12:26:15.161248  3499 raft_consensus.cc:606] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Received request to transfer leadership to TS ce8ac360b4944ac78fc2401b20fa940b
I20260709 12:26:15.165823  3547 consensus_queue.cc:1048] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:15.237313  3547 raft_consensus.cc:993] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b: : Instructing follower 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:15.237778  3573 raft_consensus.cc:1081] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Signalling peer 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:15.239425  3349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4188b19345044b6b8f86b5397198171"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56258
I20260709 12:26:15.240013  3349 raft_consensus.cc:493] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:15.240437  3349 raft_consensus.cc:3060] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.245374  3349 raft_consensus.cc:515] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.247644  3349 leader_election.cc:290] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 2 election: Requested vote from peers ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:15.249024  3425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4188b19345044b6b8f86b5397198171" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:15.249907  3425 raft_consensus.cc:3055] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:15.250325  3425 raft_consensus.cc:740] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:15.248255  3498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4188b19345044b6b8f86b5397198171" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:15.250958  3498 raft_consensus.cc:3060] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.251178  3425 consensus_queue.cc:260] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.252640  3425 raft_consensus.cc:3060] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.257717  3597 raft_consensus.cc:993] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62: : Instructing follower 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:15.258285  3545 raft_consensus.cc:1081] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Signalling peer 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:15.259024  3498 raft_consensus.cc:2468] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 2.
I20260709 12:26:15.259893  3349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56252
I20260709 12:26:15.260159  3314 leader_election.cc:304] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867; no voters: 
I20260709 12:26:15.260341  3425 raft_consensus.cc:2468] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 2.
I20260709 12:26:15.260494  3349 raft_consensus.cc:493] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:15.260954  3349 raft_consensus.cc:3060] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.260977  3546 raft_consensus.cc:2804] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:15.261642  3546 raft_consensus.cc:697] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Becoming Leader. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:15.262542  3546 consensus_queue.cc:237] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.266590  3349 raft_consensus.cc:515] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.268603  3349 leader_election.cc:290] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 2 election: Requested vote from peers ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:15.269448  3425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:15.270227  3425 raft_consensus.cc:3060] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.270274  3498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:15.271145  3498 raft_consensus.cc:3055] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:15.271253  3597 raft_consensus.cc:993] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62: : Instructing follower 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:15.271580  3498 raft_consensus.cc:740] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Running, Role: LEADER
I20260709 12:26:15.271783  3545 raft_consensus.cc:1081] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Signalling peer 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:15.272397  3498 consensus_queue.cc:260] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.270227  3246 catalog_manager.cc:5697] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 reported cstate change: term changed from 1 to 2, leader changed from ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2) to 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "94f2f1c5017545e6bd73655a3762e867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:15.273620  3498 raft_consensus.cc:3060] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.273592  3348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7167b0853ae34ad581ebf0df54b4032a"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56252
I20260709 12:26:15.274281  3348 raft_consensus.cc:493] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:15.274663  3348 raft_consensus.cc:3060] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.278620  3425 raft_consensus.cc:2468] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 2.
I20260709 12:26:15.280037  3316 leader_election.cc:304] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94f2f1c5017545e6bd73655a3762e867, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:15.280727  3498 raft_consensus.cc:2468] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 2.
I20260709 12:26:15.281383  3348 raft_consensus.cc:515] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.281908  3546 raft_consensus.cc:2804] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:15.282732  3546 raft_consensus.cc:697] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Becoming Leader. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:15.284323  3348 leader_election.cc:290] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 2 election: Requested vote from peers ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:15.284523  3425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7167b0853ae34ad581ebf0df54b4032a" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:15.283749  3546 consensus_queue.cc:237] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.285177  3425 raft_consensus.cc:3060] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.286293  3498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7167b0853ae34ad581ebf0df54b4032a" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:15.286791  3498 raft_consensus.cc:3055] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:15.287120  3498 raft_consensus.cc:740] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Running, Role: LEADER
I20260709 12:26:15.287837  3498 consensus_queue.cc:260] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.288869  3498 raft_consensus.cc:3060] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.291357  3425 raft_consensus.cc:2468] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 2.
I20260709 12:26:15.292552  3316 leader_election.cc:304] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94f2f1c5017545e6bd73655a3762e867, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:15.293296  3546 raft_consensus.cc:2804] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:15.294041  3546 raft_consensus.cc:697] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Becoming Leader. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:15.293710  3246 catalog_manager.cc:5697] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 reported cstate change: term changed from 1 to 2, leader changed from 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3) to 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "94f2f1c5017545e6bd73655a3762e867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:15.294970  3546 consensus_queue.cc:237] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.295629  3498 raft_consensus.cc:2468] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 2.
I20260709 12:26:15.305756  3246 catalog_manager.cc:5697] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 reported cstate change: term changed from 1 to 2, leader changed from 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3) to 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "94f2f1c5017545e6bd73655a3762e867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:15.312966  3546 consensus_queue.cc:1048] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:15.324967  3611 consensus_queue.cc:1048] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:15.332366  3546 raft_consensus.cc:993] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867: : Instructing follower ce8ac360b4944ac78fc2401b20fa940b to start an election
I20260709 12:26:15.332846  3611 raft_consensus.cc:1081] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 1 LEADER]: Signalling peer ce8ac360b4944ac78fc2401b20fa940b to start an election
I20260709 12:26:15.334488  3425 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84"
dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
 from {username='slave'} at 127.0.0.1:56202
I20260709 12:26:15.335021  3425 raft_consensus.cc:493] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:15.335371  3425 raft_consensus.cc:3060] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.341761  3425 raft_consensus.cc:515] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.343577  3425 leader_election.cc:290] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 2 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:15.344520  3348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:15.344844  3498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:15.345162  3348 raft_consensus.cc:3055] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:15.345379  3498 raft_consensus.cc:3060] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.345549  3348 raft_consensus.cc:740] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:15.346400  3348 consensus_queue.cc:260] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.347698  3348 raft_consensus.cc:3060] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.350631  3498 raft_consensus.cc:2468] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 2.
I20260709 12:26:15.351797  3389 leader_election.cc:304] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:15.352638  3573 raft_consensus.cc:2804] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:15.353116  3573 raft_consensus.cc:697] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 2 LEADER]: Becoming Leader. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:15.353227  3348 raft_consensus.cc:2468] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 2.
I20260709 12:26:15.354090  3573 consensus_queue.cc:237] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.358860  3563 raft_consensus.cc:993] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62: : Instructing follower ce8ac360b4944ac78fc2401b20fa940b to start an election
I20260709 12:26:15.359391  3545 raft_consensus.cc:1081] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Signalling peer ce8ac360b4944ac78fc2401b20fa940b to start an election
I20260709 12:26:15.361392  3425 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c139debaa01460ca2b940d4faef6b11"
dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
 from {username='slave'} at 127.0.0.1:56194
I20260709 12:26:15.361806  3425 raft_consensus.cc:493] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:15.362162  3425 raft_consensus.cc:3060] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.362301  3246 catalog_manager.cc:5697] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b reported cstate change: term changed from 1 to 2, leader changed from 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1) to ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2). New cstate: current_term: 2 leader_uuid: "ce8ac360b4944ac78fc2401b20fa940b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:15.366804  3425 raft_consensus.cc:515] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.370033  3425 leader_election.cc:290] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 2 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:15.370201  3348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c139debaa01460ca2b940d4faef6b11" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:15.370889  3348 raft_consensus.cc:3060] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.370085  3498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c139debaa01460ca2b940d4faef6b11" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:15.371758  3498 raft_consensus.cc:3055] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:15.372092  3498 raft_consensus.cc:740] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Running, Role: LEADER
I20260709 12:26:15.372905  3498 consensus_queue.cc:260] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.374154  3498 raft_consensus.cc:3060] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.377928  3348 raft_consensus.cc:2468] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 2.
I20260709 12:26:15.379262  3388 leader_election.cc:304] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94f2f1c5017545e6bd73655a3762e867, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:15.379984  3573 raft_consensus.cc:2804] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:15.380396  3573 raft_consensus.cc:697] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [term 2 LEADER]: Becoming Leader. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:15.380528  3498 raft_consensus.cc:2468] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 2.
I20260709 12:26:15.381201  3573 consensus_queue.cc:237] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.387125  3246 catalog_manager.cc:5697] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b reported cstate change: term changed from 1 to 2, leader changed from 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3) to ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2). New cstate: current_term: 2 leader_uuid: "ce8ac360b4944ac78fc2401b20fa940b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:15.430681  3547 raft_consensus.cc:993] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b: : Instructing follower 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:15.431167  3573 raft_consensus.cc:1081] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Signalling peer 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:15.432672  3348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3019a0331f094fb5be682e843969de64"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56258
I20260709 12:26:15.433185  3348 raft_consensus.cc:493] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:15.433496  3348 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.437956  3348 raft_consensus.cc:515] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.439502  3348 leader_election.cc:290] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 2 election: Requested vote from peers ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:15.440377  3425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3019a0331f094fb5be682e843969de64" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:15.440631  3498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3019a0331f094fb5be682e843969de64" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:15.441006  3425 raft_consensus.cc:3055] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:15.441185  3498 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.441359  3425 raft_consensus.cc:740] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:15.442250  3425 consensus_queue.cc:260] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.443434  3425 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.448382  3498 raft_consensus.cc:2468] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 2.
I20260709 12:26:15.449635  3314 leader_election.cc:304] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867; no voters: 
I20260709 12:26:15.450009  3425 raft_consensus.cc:2468] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 2.
I20260709 12:26:15.450387  3611 raft_consensus.cc:2804] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:15.450860  3611 raft_consensus.cc:697] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Becoming Leader. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:15.451653  3611 consensus_queue.cc:237] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.460049  3247 catalog_manager.cc:5697] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 reported cstate change: term changed from 1 to 2, leader changed from ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2) to 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "94f2f1c5017545e6bd73655a3762e867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:15.500198  3562 raft_consensus.cc:993] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b: : Instructing follower 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:15.500691  3573 raft_consensus.cc:1081] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Signalling peer 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:15.502210  3348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5056ee8dda5d47ee9bb62c5c079f4b05"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56258
I20260709 12:26:15.502740  3348 raft_consensus.cc:493] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:15.503106  3348 raft_consensus.cc:3060] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.507754  3348 raft_consensus.cc:515] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.509317  3348 leader_election.cc:290] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 2 election: Requested vote from peers ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:15.510175  3425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5056ee8dda5d47ee9bb62c5c079f4b05" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:15.510505  3498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5056ee8dda5d47ee9bb62c5c079f4b05" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:15.510799  3425 raft_consensus.cc:3055] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:15.511040  3498 raft_consensus.cc:3060] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.511137  3425 raft_consensus.cc:740] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:15.511991  3425 consensus_queue.cc:260] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.513197  3425 raft_consensus.cc:3060] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:15.518023  3498 raft_consensus.cc:2468] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 2.
I20260709 12:26:15.519228  3314 leader_election.cc:304] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867; no voters: 
I20260709 12:26:15.520035  3611 raft_consensus.cc:2804] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:15.520084  3425 raft_consensus.cc:2468] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 2.
I20260709 12:26:15.520582  3611 raft_consensus.cc:697] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Becoming Leader. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:15.521394  3611 consensus_queue.cc:237] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:15.527101  3247 catalog_manager.cc:5697] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 reported cstate change: term changed from 1 to 2, leader changed from ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2) to 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "94f2f1c5017545e6bd73655a3762e867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:15.683395  3425 raft_consensus.cc:1275] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.684659  3611 consensus_queue.cc:1048] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.692988  3498 raft_consensus.cc:1275] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.694880  3611 consensus_queue.cc:1048] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.723768  3425 raft_consensus.cc:1275] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.725011  3611 consensus_queue.cc:1048] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.738471  3498 raft_consensus.cc:1275] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.739846  3631 consensus_queue.cc:1048] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.810118  3499 raft_consensus.cc:1275] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Refusing update from remote peer ce8ac360b4944ac78fc2401b20fa940b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.811453  3562 consensus_queue.cc:1048] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.818499  3348 raft_consensus.cc:1275] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Refusing update from remote peer ce8ac360b4944ac78fc2401b20fa940b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.820410  3573 consensus_queue.cc:1048] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.838306  3499 raft_consensus.cc:1275] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.839164  3348 raft_consensus.cc:1275] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Refusing update from remote peer ce8ac360b4944ac78fc2401b20fa940b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.839809  3631 consensus_queue.cc:1048] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.840699  3573 consensus_queue.cc:1048] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.851701  3425 raft_consensus.cc:1275] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.853451  3631 consensus_queue.cc:1048] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.854516  3499 raft_consensus.cc:1275] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Refusing update from remote peer ce8ac360b4944ac78fc2401b20fa940b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.855988  3573 consensus_queue.cc:1048] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.903218  3425 raft_consensus.cc:1275] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.904547  3631 consensus_queue.cc:1048] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.912401  3499 raft_consensus.cc:1275] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.913831  3631 consensus_queue.cc:1048] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:16.103886  3425 raft_consensus.cc:1275] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:16.105219  3631 consensus_queue.cc:1048] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:16.113808  3498 raft_consensus.cc:1275] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:16.115923  3611 consensus_queue.cc:1048] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:18.200299  2676 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:26:18.200924  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:18.218994  3348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3019a0331f094fb5be682e843969de64"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
mode: GRACEFUL
new_leader_uuid: "946bb0d09af343498b7e84c16cbcdd62"
 from {username='slave'} at 127.0.0.1:56276
I20260709 12:26:18.219568  3348 raft_consensus.cc:606] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Received request to transfer leadership to TS 946bb0d09af343498b7e84c16cbcdd62
I20260709 12:26:18.222172  3348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
mode: GRACEFUL
new_leader_uuid: "946bb0d09af343498b7e84c16cbcdd62"
 from {username='slave'} at 127.0.0.1:56276
I20260709 12:26:18.222687  3348 raft_consensus.cc:606] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Received request to transfer leadership to TS 946bb0d09af343498b7e84c16cbcdd62
I20260709 12:26:18.223742  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:18.224174  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:18.512930  3546 raft_consensus.cc:993] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867: : Instructing follower 946bb0d09af343498b7e84c16cbcdd62 to start an election
I20260709 12:26:18.513406  3640 raft_consensus.cc:1081] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Signalling peer 946bb0d09af343498b7e84c16cbcdd62 to start an election
I20260709 12:26:18.514993  3498 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c"
dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
 from {username='slave'} at 127.0.0.1:38982
I20260709 12:26:18.515466  3498 raft_consensus.cc:493] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.515774  3498 raft_consensus.cc:3060] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:18.520677  3498 raft_consensus.cc:515] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:18.522284  3498 leader_election.cc:290] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 3 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953)
I20260709 12:26:18.523156  3348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:18.523468  3425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:18.523842  3348 raft_consensus.cc:3055] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:18.524061  3425 raft_consensus.cc:3060] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:18.524209  3348 raft_consensus.cc:740] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:18.524951  3348 consensus_queue.cc:260] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:18.525861  3348 raft_consensus.cc:3060] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:18.529340  3425 raft_consensus.cc:2468] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 3.
I20260709 12:26:18.530498  3348 raft_consensus.cc:2468] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 3.
I20260709 12:26:18.530552  3465 leader_election.cc:304] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:18.531402  3545 raft_consensus.cc:2804] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:18.532320  3545 raft_consensus.cc:697] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 3 LEADER]: Becoming Leader. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Running, Role: LEADER
I20260709 12:26:18.533110  3545 consensus_queue.cc:237] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:18.540202  3546 raft_consensus.cc:993] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867: : Instructing follower 946bb0d09af343498b7e84c16cbcdd62 to start an election
I20260709 12:26:18.539783  3247 catalog_manager.cc:5697] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 reported cstate change: term changed from 2 to 3, leader changed from 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1) to 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3). New cstate: current_term: 3 leader_uuid: "946bb0d09af343498b7e84c16cbcdd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.540670  3546 raft_consensus.cc:1081] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Signalling peer 946bb0d09af343498b7e84c16cbcdd62 to start an election
I20260709 12:26:18.542368  3498 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3019a0331f094fb5be682e843969de64"
dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
 from {username='slave'} at 127.0.0.1:38982
I20260709 12:26:18.542870  3498 raft_consensus.cc:493] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.543197  3498 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:18.548014  3498 raft_consensus.cc:515] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:18.550057  3498 leader_election.cc:290] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 3 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953)
I20260709 12:26:18.551131  3348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3019a0331f094fb5be682e843969de64" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:18.551381  3425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3019a0331f094fb5be682e843969de64" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:18.551644  3348 raft_consensus.cc:3055] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:18.551963  3425 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:18.552124  3348 raft_consensus.cc:740] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:18.553093  3348 consensus_queue.cc:260] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:18.554432  3348 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:18.557281  3425 raft_consensus.cc:2468] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 3.
I20260709 12:26:18.558352  3465 leader_election.cc:304] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:18.559062  3545 raft_consensus.cc:2804] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:18.559463  3545 raft_consensus.cc:697] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 LEADER]: Becoming Leader. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Running, Role: LEADER
I20260709 12:26:18.560087  3348 raft_consensus.cc:2468] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 3.
I20260709 12:26:18.560250  3545 consensus_queue.cc:237] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:18.567408  3247 catalog_manager.cc:5697] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 reported cstate change: term changed from 2 to 3, leader changed from 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1) to 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3). New cstate: current_term: 3 leader_uuid: "946bb0d09af343498b7e84c16cbcdd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.987295  3425 raft_consensus.cc:1275] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Refusing update from remote peer 946bb0d09af343498b7e84c16cbcdd62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:18.988471  3545 consensus_queue.cc:1048] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:18.990830  3348 raft_consensus.cc:1275] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Refusing update from remote peer 946bb0d09af343498b7e84c16cbcdd62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:18.992337  3545 consensus_queue.cc:1048] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:18.998896  3349 raft_consensus.cc:1275] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Refusing update from remote peer 946bb0d09af343498b7e84c16cbcdd62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:19.002604  3545 consensus_queue.cc:1048] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:19.024480  3425 raft_consensus.cc:1275] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Refusing update from remote peer 946bb0d09af343498b7e84c16cbcdd62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:19.026024  3650 consensus_queue.cc:1048] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.225140  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:19.231585  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:19.232084  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:20.232995  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:20.239115  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:20.239559  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:21.240840  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:21.250161  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:21.250790  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:22.252291  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:22.257572  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:22.258157  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:23.259074  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:23.264638  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:23.265071  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:24.266144  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:24.271848  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:24.272338  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:25.273319  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:25.280783  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:25.281231  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:26.282389  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:26.287844  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:26.288268  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:27.289162  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:27.294996  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:27.295456  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:28.327009  2676 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:26:28.335784  3498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3019a0331f094fb5be682e843969de64"
dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
mode: GRACEFUL
new_leader_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:38996
I20260709 12:26:28.336445  3498 raft_consensus.cc:606] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 LEADER]: Received request to transfer leadership to TS 94f2f1c5017545e6bd73655a3762e867
I20260709 12:26:28.344445  3498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c"
dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
mode: GRACEFUL
new_leader_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:38996
I20260709 12:26:28.344997  3498 raft_consensus.cc:606] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 3 LEADER]: Received request to transfer leadership to TS 94f2f1c5017545e6bd73655a3762e867
I20260709 12:26:28.353178  3424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "065bdad34e5f4cc696adf14866147acc"
dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
mode: GRACEFUL
new_leader_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56206
I20260709 12:26:28.353698  3424 raft_consensus.cc:606] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Received request to transfer leadership to TS 94f2f1c5017545e6bd73655a3762e867
I20260709 12:26:28.358852  3424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6535b05ad364aad91eeec06b149d559"
dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
mode: GRACEFUL
new_leader_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56206
I20260709 12:26:28.359383  3424 raft_consensus.cc:606] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Received request to transfer leadership to TS 94f2f1c5017545e6bd73655a3762e867
I20260709 12:26:28.363821  3424 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84"
dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
mode: GRACEFUL
new_leader_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56206
I20260709 12:26:28.364336  3424 raft_consensus.cc:606] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 2 LEADER]: Received request to transfer leadership to TS 94f2f1c5017545e6bd73655a3762e867
I20260709 12:26:28.472812  3545 raft_consensus.cc:993] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62: : Instructing follower 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:28.473439  3661 raft_consensus.cc:1081] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 3 LEADER]: Signalling peer 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:28.475112  3348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56252
I20260709 12:26:28.475610  3348 raft_consensus.cc:493] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.475956  3348 raft_consensus.cc:3060] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.481076  3348 raft_consensus.cc:515] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.482839  3348 leader_election.cc:290] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 4 election: Requested vote from peers ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:28.483856  3498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:28.483662  3424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab1e9019cef34fcbaf43b0fb83efc14c" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:28.484474  3498 raft_consensus.cc:3055] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:28.484567  3424 raft_consensus.cc:3060] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.484762  3498 raft_consensus.cc:740] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Running, Role: LEADER
I20260709 12:26:28.485642  3498 consensus_queue.cc:260] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.486788  3498 raft_consensus.cc:3060] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.489419  3424 raft_consensus.cc:2468] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 4.
I20260709 12:26:28.490593  3316 leader_election.cc:304] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94f2f1c5017545e6bd73655a3762e867, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:28.491465  3657 raft_consensus.cc:2804] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:28.491703  3498 raft_consensus.cc:2468] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 4.
I20260709 12:26:28.492512  3657 raft_consensus.cc:697] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 4 LEADER]: Becoming Leader. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:28.493451  3657 consensus_queue.cc:237] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.501464  3247 catalog_manager.cc:5697] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 reported cstate change: term changed from 3 to 4, leader changed from 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3) to 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1). New cstate: current_term: 4 leader_uuid: "94f2f1c5017545e6bd73655a3762e867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.512431  3667 raft_consensus.cc:993] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b: : Instructing follower 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:28.513130  3660 raft_consensus.cc:1081] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Signalling peer 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:28.515498  3348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "065bdad34e5f4cc696adf14866147acc"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56258
I20260709 12:26:28.516058  3348 raft_consensus.cc:493] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.516414  3348 raft_consensus.cc:3060] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.521013  3348 raft_consensus.cc:515] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.522563  3348 leader_election.cc:290] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 2 election: Requested vote from peers ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:28.523655  3424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065bdad34e5f4cc696adf14866147acc" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:28.524032  3498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065bdad34e5f4cc696adf14866147acc" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:28.524259  3424 raft_consensus.cc:3055] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:28.524556  3498 raft_consensus.cc:3060] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.524626  3424 raft_consensus.cc:740] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:28.525396  3424 consensus_queue.cc:260] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.526386  3424 raft_consensus.cc:3060] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.529299  3498 raft_consensus.cc:2468] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 2.
I20260709 12:26:28.530355  3314 leader_election.cc:304] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867; no voters: 
I20260709 12:26:28.531064  3657 raft_consensus.cc:2804] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:28.531548  3657 raft_consensus.cc:697] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Becoming Leader. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:28.532330  3424 raft_consensus.cc:2468] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 2.
I20260709 12:26:28.532541  3657 consensus_queue.cc:237] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.540115  3247 catalog_manager.cc:5697] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 reported cstate change: term changed from 1 to 2, leader changed from ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2) to 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "94f2f1c5017545e6bd73655a3762e867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.781903  3545 raft_consensus.cc:993] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62: : Instructing follower 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:28.782356  3545 raft_consensus.cc:1081] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 LEADER]: Signalling peer 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:28.783815  3348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3019a0331f094fb5be682e843969de64"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56252
I20260709 12:26:28.784224  3348 raft_consensus.cc:493] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.784453  3348 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.789067  3348 raft_consensus.cc:515] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.790570  3348 leader_election.cc:290] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 4 election: Requested vote from peers ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:28.791460  3424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3019a0331f094fb5be682e843969de64" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:28.791599  3498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3019a0331f094fb5be682e843969de64" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:28.792060  3424 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.792126  3498 raft_consensus.cc:3055] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:28.792481  3498 raft_consensus.cc:740] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Running, Role: LEADER
I20260709 12:26:28.793085  3498 consensus_queue.cc:260] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.793977  3498 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.797083  3424 raft_consensus.cc:2468] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 4.
I20260709 12:26:28.798079  3316 leader_election.cc:304] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94f2f1c5017545e6bd73655a3762e867, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:28.798734  3498 raft_consensus.cc:2468] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 4.
I20260709 12:26:28.798789  3657 raft_consensus.cc:2804] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:28.799299  3657 raft_consensus.cc:697] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 4 LEADER]: Becoming Leader. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:28.800179  3657 consensus_queue.cc:237] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.807307  3247 catalog_manager.cc:5697] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 reported cstate change: term changed from 3 to 4, leader changed from 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3) to 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1). New cstate: current_term: 4 leader_uuid: "94f2f1c5017545e6bd73655a3762e867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.818630  3667 raft_consensus.cc:993] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b: : Instructing follower 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:28.819120  3669 raft_consensus.cc:1081] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 2 LEADER]: Signalling peer 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:28.820453  3348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56258
I20260709 12:26:28.820894  3348 raft_consensus.cc:493] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.821166  3348 raft_consensus.cc:3060] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.825867  3348 raft_consensus.cc:515] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.827584  3348 leader_election.cc:290] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 3 election: Requested vote from peers ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:28.827759  3669 raft_consensus.cc:993] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b: : Instructing follower 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:28.828245  3667 raft_consensus.cc:1081] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Signalling peer 94f2f1c5017545e6bd73655a3762e867 to start an election
I20260709 12:26:28.828538  3498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:28.828735  3424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:28.829079  3498 raft_consensus.cc:3060] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.829317  3424 raft_consensus.cc:3055] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:28.829598  3424 raft_consensus.cc:740] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:28.829916  3348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6535b05ad364aad91eeec06b149d559"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
 from {username='slave'} at 127.0.0.1:56258
I20260709 12:26:28.830438  3348 raft_consensus.cc:493] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.830339  3424 consensus_queue.cc:260] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.830809  3348 raft_consensus.cc:3060] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.831525  3424 raft_consensus.cc:3060] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.834036  3498 raft_consensus.cc:2468] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 3.
I20260709 12:26:28.835220  3314 leader_election.cc:304] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867; no voters: 
I20260709 12:26:28.836951  3662 raft_consensus.cc:2804] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:28.837399  3662 raft_consensus.cc:697] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 3 LEADER]: Becoming Leader. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:28.837464  3424 raft_consensus.cc:2468] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 3.
I20260709 12:26:28.837399  3348 raft_consensus.cc:515] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.838426  3662 consensus_queue.cc:237] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.839733  3348 leader_election.cc:290] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 2 election: Requested vote from peers ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:28.840867  3424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6535b05ad364aad91eeec06b149d559" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:28.841137  3498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6535b05ad364aad91eeec06b149d559" candidate_uuid: "94f2f1c5017545e6bd73655a3762e867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:28.841416  3424 raft_consensus.cc:3055] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:28.841660  3498 raft_consensus.cc:3060] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.841755  3424 raft_consensus.cc:740] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:28.843359  3424 consensus_queue.cc:260] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.844555  3424 raft_consensus.cc:3060] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.849421  3498 raft_consensus.cc:2468] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 2.
I20260709 12:26:28.850756  3424 raft_consensus.cc:2468] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f2f1c5017545e6bd73655a3762e867 in term 2.
I20260709 12:26:28.850652  3314 leader_election.cc:304] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, 94f2f1c5017545e6bd73655a3762e867; no voters: 
I20260709 12:26:28.851752  3657 raft_consensus.cc:2804] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:28.853425  3657 raft_consensus.cc:697] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Becoming Leader. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:28.854529  3657 consensus_queue.cc:237] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:28.854773  3247 catalog_manager.cc:5697] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 reported cstate change: term changed from 2 to 3, leader changed from ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2) to 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1). New cstate: current_term: 3 leader_uuid: "94f2f1c5017545e6bd73655a3762e867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.866364  3247 catalog_manager.cc:5697] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 reported cstate change: term changed from 1 to 2, leader changed from ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2) to 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "94f2f1c5017545e6bd73655a3762e867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.948585  3424 raft_consensus.cc:1275] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:28.950002  3657 consensus_queue.cc:1048] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:28.961771  3499 raft_consensus.cc:1275] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 4 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:28.964272  3498 raft_consensus.cc:1275] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:28.964761  3673 consensus_queue.cc:1048] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:28.965580  3657 consensus_queue.cc:1048] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:28.968910  3424 raft_consensus.cc:1275] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 4 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:28.970259  3657 consensus_queue.cc:1048] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:29.236277  3499 raft_consensus.cc:1275] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:29.237668  3657 consensus_queue.cc:1048] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:29.247828  3424 raft_consensus.cc:1275] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:29.249656  3673 consensus_queue.cc:1048] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:29.280682  3499 raft_consensus.cc:1275] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:29.281968  3657 consensus_queue.cc:1048] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:29.291424  3424 raft_consensus.cc:1275] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:29.293145  3673 consensus_queue.cc:1048] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:29.308786  3499 raft_consensus.cc:1275] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 4 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:29.310010  3673 consensus_queue.cc:1048] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:29.318676  3424 raft_consensus.cc:1275] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 4 FOLLOWER]: Refusing update from remote peer 94f2f1c5017545e6bd73655a3762e867: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:29.320353  3684 consensus_queue.cc:1048] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:31.403201  2676 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:26:31.404037  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:31.411512  3348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "065bdad34e5f4cc696adf14866147acc"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
mode: GRACEFUL
new_leader_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
 from {username='slave'} at 127.0.0.1:56276
I20260709 12:26:31.412313  3348 raft_consensus.cc:606] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Received request to transfer leadership to TS ce8ac360b4944ac78fc2401b20fa940b
I20260709 12:26:31.415002  3348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3019a0331f094fb5be682e843969de64"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
mode: GRACEFUL
new_leader_uuid: "946bb0d09af343498b7e84c16cbcdd62"
 from {username='slave'} at 127.0.0.1:56276
I20260709 12:26:31.415457  3348 raft_consensus.cc:606] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 4 LEADER]: Received request to transfer leadership to TS 946bb0d09af343498b7e84c16cbcdd62
I20260709 12:26:31.418005  3348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
mode: GRACEFUL
new_leader_uuid: "946bb0d09af343498b7e84c16cbcdd62"
 from {username='slave'} at 127.0.0.1:56276
I20260709 12:26:31.418573  3348 raft_consensus.cc:606] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 3 LEADER]: Received request to transfer leadership to TS 946bb0d09af343498b7e84c16cbcdd62
I20260709 12:26:31.420958  3348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4188b19345044b6b8f86b5397198171"
dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
mode: GRACEFUL
new_leader_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
 from {username='slave'} at 127.0.0.1:56276
I20260709 12:26:31.421427  3348 raft_consensus.cc:606] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Received request to transfer leadership to TS ce8ac360b4944ac78fc2401b20fa940b
I20260709 12:26:31.422354  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:31.422804  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:31.430186  3684 raft_consensus.cc:993] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867: : Instructing follower ce8ac360b4944ac78fc2401b20fa940b to start an election
I20260709 12:26:31.430819  3673 raft_consensus.cc:1081] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Signalling peer ce8ac360b4944ac78fc2401b20fa940b to start an election
I20260709 12:26:31.432372  3424 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4188b19345044b6b8f86b5397198171"
dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
 from {username='slave'} at 127.0.0.1:56202
I20260709 12:26:31.432798  3424 raft_consensus.cc:493] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.433108  3424 raft_consensus.cc:3060] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.439404  3424 raft_consensus.cc:515] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:31.441382  3424 leader_election.cc:290] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 3 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:31.442739  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4188b19345044b6b8f86b5397198171" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:31.442498  3348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4188b19345044b6b8f86b5397198171" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:31.443392  3499 raft_consensus.cc:3060] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.443456  3348 raft_consensus.cc:3055] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:31.443913  3348 raft_consensus.cc:740] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:31.444972  3348 consensus_queue.cc:260] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:31.446596  3348 raft_consensus.cc:3060] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.452032  3499 raft_consensus.cc:2468] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 3.
I20260709 12:26:31.453567  3389 leader_election.cc:304] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:31.454541  3690 raft_consensus.cc:2804] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:31.454769  3348 raft_consensus.cc:2468] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 3.
I20260709 12:26:31.455710  3690 raft_consensus.cc:697] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 3 LEADER]: Becoming Leader. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:31.456703  3690 consensus_queue.cc:237] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:31.463586  3247 catalog_manager.cc:5697] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b reported cstate change: term changed from 2 to 3, leader changed from 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1) to ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2). New cstate: current_term: 3 leader_uuid: "ce8ac360b4944ac78fc2401b20fa940b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.481289  3684 raft_consensus.cc:993] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867: : Instructing follower 946bb0d09af343498b7e84c16cbcdd62 to start an election
I20260709 12:26:31.481779  3684 raft_consensus.cc:1081] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 4 LEADER]: Signalling peer 946bb0d09af343498b7e84c16cbcdd62 to start an election
I20260709 12:26:31.483223  3499 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3019a0331f094fb5be682e843969de64"
dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
 from {username='slave'} at 127.0.0.1:38982
I20260709 12:26:31.483654  3499 raft_consensus.cc:493] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.483933  3499 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:31.488449  3499 raft_consensus.cc:515] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:31.490391  3499 leader_election.cc:290] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 5 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953)
I20260709 12:26:31.491080  3348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3019a0331f094fb5be682e843969de64" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:31.491304  3424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3019a0331f094fb5be682e843969de64" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:31.491657  3348 raft_consensus.cc:3055] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:31.491918  3424 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:31.491984  3348 raft_consensus.cc:740] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:31.492854  3348 consensus_queue.cc:260] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:31.498021  3424 raft_consensus.cc:2468] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 5.
I20260709 12:26:31.499022  3425 raft_consensus.cc:1240] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 5 FOLLOWER]: Rejecting Update request from peer 94f2f1c5017545e6bd73655a3762e867 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:31.499603  3465 leader_election.cc:304] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:31.499565  3348 raft_consensus.cc:3060] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:31.500607  3545 raft_consensus.cc:2804] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:31.501853  3545 raft_consensus.cc:697] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 5 LEADER]: Becoming Leader. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Running, Role: LEADER
I20260709 12:26:31.502655  3545 consensus_queue.cc:237] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:31.505496  3348 raft_consensus.cc:2468] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 5.
I20260709 12:26:31.509681  3247 catalog_manager.cc:5697] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 reported cstate change: term changed from 4 to 5, leader changed from 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1) to 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3). New cstate: current_term: 5 leader_uuid: "946bb0d09af343498b7e84c16cbcdd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:31.731208  3684 raft_consensus.cc:993] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867: : Instructing follower ce8ac360b4944ac78fc2401b20fa940b to start an election
I20260709 12:26:31.731664  3684 raft_consensus.cc:1081] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Signalling peer ce8ac360b4944ac78fc2401b20fa940b to start an election
I20260709 12:26:31.733206  3425 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "065bdad34e5f4cc696adf14866147acc"
dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
 from {username='slave'} at 127.0.0.1:56202
I20260709 12:26:31.733692  3425 raft_consensus.cc:493] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.734040  3425 raft_consensus.cc:3060] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.738499  3425 raft_consensus.cc:515] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:31.740099  3425 leader_election.cc:290] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 3 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3:41241)
I20260709 12:26:31.740828  3348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065bdad34e5f4cc696adf14866147acc" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:31.741117  3499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065bdad34e5f4cc696adf14866147acc" candidate_uuid: "ce8ac360b4944ac78fc2401b20fa940b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
I20260709 12:26:31.741335  3348 raft_consensus.cc:3055] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:31.741631  3499 raft_consensus.cc:3060] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.741676  3348 raft_consensus.cc:740] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:31.742501  3348 consensus_queue.cc:260] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:31.743577  3348 raft_consensus.cc:3060] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.746857  3499 raft_consensus.cc:2468] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 3.
I20260709 12:26:31.747999  3389 leader_election.cc:304] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:31.748319  3348 raft_consensus.cc:2468] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8ac360b4944ac78fc2401b20fa940b in term 3.
I20260709 12:26:31.748984  3690 raft_consensus.cc:2804] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:31.749460  3690 raft_consensus.cc:697] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 3 LEADER]: Becoming Leader. State: Replica: ce8ac360b4944ac78fc2401b20fa940b, State: Running, Role: LEADER
I20260709 12:26:31.750298  3690 consensus_queue.cc:237] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:31.757717  3247 catalog_manager.cc:5697] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b reported cstate change: term changed from 2 to 3, leader changed from 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1) to ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2). New cstate: current_term: 3 leader_uuid: "ce8ac360b4944ac78fc2401b20fa940b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.889963  3348 raft_consensus.cc:1275] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 5 FOLLOWER]: Refusing update from remote peer 946bb0d09af343498b7e84c16cbcdd62: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:31.891198  3545 consensus_queue.cc:1048] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:31.903105  3425 raft_consensus.cc:1275] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 5 FOLLOWER]: Refusing update from remote peer 946bb0d09af343498b7e84c16cbcdd62: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:31.904253  3545 consensus_queue.cc:1048] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:31.930096  3499 raft_consensus.cc:1275] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Refusing update from remote peer ce8ac360b4944ac78fc2401b20fa940b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:31.931200  3692 consensus_queue.cc:1048] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:31.941828  3348 raft_consensus.cc:1275] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Refusing update from remote peer ce8ac360b4944ac78fc2401b20fa940b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:31.943115  3690 consensus_queue.cc:1048] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:31.946231  3673 raft_consensus.cc:993] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867: : Instructing follower 946bb0d09af343498b7e84c16cbcdd62 to start an election
I20260709 12:26:31.947075  3673 raft_consensus.cc:1081] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 3 LEADER]: Signalling peer 946bb0d09af343498b7e84c16cbcdd62 to start an election
I20260709 12:26:31.949434  3498 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84"
dest_uuid: "946bb0d09af343498b7e84c16cbcdd62"
 from {username='slave'} at 127.0.0.1:38982
I20260709 12:26:31.950068  3498 raft_consensus.cc:493] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.950495  3498 raft_consensus.cc:3060] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.956960  3498 raft_consensus.cc:515] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:31.959151  3498 leader_election.cc:290] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 4 election: Requested vote from peers 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499), ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953)
I20260709 12:26:31.959600  3425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ce8ac360b4944ac78fc2401b20fa940b"
I20260709 12:26:31.960167  3425 raft_consensus.cc:3060] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.962159  3348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72685a6f0f6e49ac9c40ecb656f0ce84" candidate_uuid: "946bb0d09af343498b7e84c16cbcdd62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "94f2f1c5017545e6bd73655a3762e867"
I20260709 12:26:31.962626  3348 raft_consensus.cc:3055] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:31.962863  3348 raft_consensus.cc:740] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 94f2f1c5017545e6bd73655a3762e867, State: Running, Role: LEADER
I20260709 12:26:31.963495  3348 consensus_queue.cc:260] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:31.964648  3348 raft_consensus.cc:3060] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.965725  3425 raft_consensus.cc:2468] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 4.
I20260709 12:26:31.966688  3465 leader_election.cc:304] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946bb0d09af343498b7e84c16cbcdd62, ce8ac360b4944ac78fc2401b20fa940b; no voters: 
I20260709 12:26:31.967427  3545 raft_consensus.cc:2804] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:31.967871  3545 raft_consensus.cc:697] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 4 LEADER]: Becoming Leader. State: Replica: 946bb0d09af343498b7e84c16cbcdd62, State: Running, Role: LEADER
I20260709 12:26:31.968725  3545 consensus_queue.cc:237] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } }
I20260709 12:26:31.969839  3348 raft_consensus.cc:2468] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946bb0d09af343498b7e84c16cbcdd62 in term 4.
I20260709 12:26:31.975805  3248 catalog_manager.cc:5697] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 reported cstate change: term changed from 3 to 4, leader changed from 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1) to 946bb0d09af343498b7e84c16cbcdd62 (127.2.157.3). New cstate: current_term: 4 leader_uuid: "946bb0d09af343498b7e84c16cbcdd62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:32.155978  3498 raft_consensus.cc:1275] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Refusing update from remote peer ce8ac360b4944ac78fc2401b20fa940b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:32.157287  3692 consensus_queue.cc:1048] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "946bb0d09af343498b7e84c16cbcdd62" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:32.166054  3348 raft_consensus.cc:1275] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Refusing update from remote peer ce8ac360b4944ac78fc2401b20fa940b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:32.168083  3708 consensus_queue.cc:1048] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:32.423750  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:32.427384  3348 raft_consensus.cc:1275] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 4 FOLLOWER]: Refusing update from remote peer 946bb0d09af343498b7e84c16cbcdd62: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:32.428579  3545 consensus_queue.cc:1048] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94f2f1c5017545e6bd73655a3762e867" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:32.430136  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:32.430706  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:32.437341  3424 raft_consensus.cc:1275] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 4 FOLLOWER]: Refusing update from remote peer 946bb0d09af343498b7e84c16cbcdd62: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:32.438786  3545 consensus_queue.cc:1048] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8ac360b4944ac78fc2401b20fa940b" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:33.431865  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:33.439059  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:33.439509  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:34.440475  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:34.446768  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:34.447247  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:35.448189  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:35.453927  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:35.454380  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:36.455406  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:36.462101  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:36.462633  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:37.463687  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:37.470551  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:37.470939  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:38.471796  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:38.477243  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:38.477710  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:39.478655  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:39.484196  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:39.484645  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:40.485790  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:40.493072  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:40.493628  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:41.527047  2676 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:26:41.527612  2676 tablet_server.cc:179] TabletServer@127.2.157.1:0 shutting down...
I20260709 12:26:41.561015  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:41.562041  2676 tablet_replica.cc:333] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867: stopping tablet replica
I20260709 12:26:41.563216  2676 raft_consensus.cc:2243] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.563932  2676 raft_consensus.cc:2272] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 94f2f1c5017545e6bd73655a3762e867 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.566256  2676 tablet_replica.cc:333] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867: stopping tablet replica
I20260709 12:26:41.567242  2676 raft_consensus.cc:2243] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.567866  2676 raft_consensus.cc:2272] T 1c139debaa01460ca2b940d4faef6b11 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.570115  2676 tablet_replica.cc:333] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867: stopping tablet replica
I20260709 12:26:41.570669  2676 raft_consensus.cc:2243] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.571184  2676 raft_consensus.cc:2272] T 065bdad34e5f4cc696adf14866147acc P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.573107  2676 tablet_replica.cc:333] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867: stopping tablet replica
I20260709 12:26:41.573670  2676 raft_consensus.cc:2243] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.574561  2676 raft_consensus.cc:2272] T e6535b05ad364aad91eeec06b149d559 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.576859  2676 tablet_replica.cc:333] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867: stopping tablet replica
I20260709 12:26:41.577481  2676 raft_consensus.cc:2243] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:26:41.578106  3462 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 12:26:41.578650  2676 raft_consensus.cc:2272] T ab1e9019cef34fcbaf43b0fb83efc14c P 94f2f1c5017545e6bd73655a3762e867 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.581099  2676 tablet_replica.cc:333] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867: stopping tablet replica
W20260709 12:26:41.581724  3462 consensus_peers.cc:597] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 -> Peer 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499): Couldn't send request to peer 94f2f1c5017545e6bd73655a3762e867. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:41.581730  2676 raft_consensus.cc:2243] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.582584  2676 raft_consensus.cc:2272] T c4188b19345044b6b8f86b5397198171 P 94f2f1c5017545e6bd73655a3762e867 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.584780  2676 tablet_replica.cc:333] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867: stopping tablet replica
I20260709 12:26:41.585469  2676 raft_consensus.cc:2243] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.586050  2676 raft_consensus.cc:2272] T 3019a0331f094fb5be682e843969de64 P 94f2f1c5017545e6bd73655a3762e867 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.588402  2676 tablet_replica.cc:333] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867: stopping tablet replica
I20260709 12:26:41.588958  2676 raft_consensus.cc:2243] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.589398  2676 raft_consensus.cc:2272] T 563563e5d21241b38fd03c4af3aa717f P 94f2f1c5017545e6bd73655a3762e867 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.591650  2676 tablet_replica.cc:333] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867: stopping tablet replica
I20260709 12:26:41.592180  2676 raft_consensus.cc:2243] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.593127  2676 raft_consensus.cc:2272] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.595140  2676 tablet_replica.cc:333] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867: stopping tablet replica
I20260709 12:26:41.595697  2676 raft_consensus.cc:2243] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.596498  2676 raft_consensus.cc:2272] T 7167b0853ae34ad581ebf0df54b4032a P 94f2f1c5017545e6bd73655a3762e867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.619340  2676 tablet_server.cc:196] TabletServer@127.2.157.1:0 shutdown complete.
I20260709 12:26:41.641185  2676 tablet_server.cc:179] TabletServer@127.2.157.2:0 shutting down...
I20260709 12:26:41.668931  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:41.669574  2676 tablet_replica.cc:333] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b: stopping tablet replica
I20260709 12:26:41.670199  2676 raft_consensus.cc:2243] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.670672  2676 raft_consensus.cc:2272] T 72685a6f0f6e49ac9c40ecb656f0ce84 P ce8ac360b4944ac78fc2401b20fa940b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.672572  2676 tablet_replica.cc:333] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b: stopping tablet replica
I20260709 12:26:41.673095  2676 raft_consensus.cc:2243] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.673826  2676 raft_consensus.cc:2272] T 1c139debaa01460ca2b940d4faef6b11 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.676013  2676 tablet_replica.cc:333] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b: stopping tablet replica
I20260709 12:26:41.676517  2676 raft_consensus.cc:2243] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.677219  2676 raft_consensus.cc:2272] T 065bdad34e5f4cc696adf14866147acc P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.678996  2676 tablet_replica.cc:333] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b: stopping tablet replica
I20260709 12:26:41.679523  2676 raft_consensus.cc:2243] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.680500  2676 raft_consensus.cc:2272] T c4188b19345044b6b8f86b5397198171 P ce8ac360b4944ac78fc2401b20fa940b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.682381  2676 tablet_replica.cc:333] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b: stopping tablet replica
I20260709 12:26:41.682976  2676 raft_consensus.cc:2243] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.683470  2676 raft_consensus.cc:2272] T 3019a0331f094fb5be682e843969de64 P ce8ac360b4944ac78fc2401b20fa940b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.685160  2676 tablet_replica.cc:333] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b: stopping tablet replica
I20260709 12:26:41.685688  2676 raft_consensus.cc:2243] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.686244  2676 raft_consensus.cc:2272] T e6535b05ad364aad91eeec06b149d559 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.687984  2676 tablet_replica.cc:333] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b: stopping tablet replica
I20260709 12:26:41.688485  2676 raft_consensus.cc:2243] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.689062  2676 raft_consensus.cc:2272] T ab1e9019cef34fcbaf43b0fb83efc14c P ce8ac360b4944ac78fc2401b20fa940b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.691306  2676 tablet_replica.cc:333] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b: stopping tablet replica
I20260709 12:26:41.691872  2676 raft_consensus.cc:2243] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.692325  2676 raft_consensus.cc:2272] T 563563e5d21241b38fd03c4af3aa717f P ce8ac360b4944ac78fc2401b20fa940b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.694567  2676 tablet_replica.cc:333] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b: stopping tablet replica
I20260709 12:26:41.695083  2676 raft_consensus.cc:2243] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:41.695070  3462 consensus_peers.cc:597] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 -> Peer 94f2f1c5017545e6bd73655a3762e867 (127.2.157.1:42499): Couldn't send request to peer 94f2f1c5017545e6bd73655a3762e867. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:41.695736  2676 raft_consensus.cc:2272] T 5056ee8dda5d47ee9bb62c5c079f4b05 P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.697482  2676 tablet_replica.cc:333] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b: stopping tablet replica
I20260709 12:26:41.698004  2676 raft_consensus.cc:2243] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.698426  2676 raft_consensus.cc:2272] T 7167b0853ae34ad581ebf0df54b4032a P ce8ac360b4944ac78fc2401b20fa940b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:41.706003  3465 consensus_peers.cc:597] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 -> Peer ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953): Couldn't send request to peer ce8ac360b4944ac78fc2401b20fa940b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:41.725356  3465 consensus_peers.cc:597] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 -> Peer ce8ac360b4944ac78fc2401b20fa940b (127.2.157.2:42953): Couldn't send request to peer ce8ac360b4944ac78fc2401b20fa940b. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:41.728842  2676 tablet_server.cc:196] TabletServer@127.2.157.2:0 shutdown complete.
I20260709 12:26:41.747653  2676 tablet_server.cc:179] TabletServer@127.2.157.3:0 shutting down...
I20260709 12:26:41.773070  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:41.773789  2676 tablet_replica.cc:333] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62: stopping tablet replica
I20260709 12:26:41.774480  2676 raft_consensus.cc:2243] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.774935  2676 raft_consensus.cc:2272] T 065bdad34e5f4cc696adf14866147acc P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.776865  2676 tablet_replica.cc:333] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62: stopping tablet replica
I20260709 12:26:41.777420  2676 raft_consensus.cc:2243] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.778301  2676 raft_consensus.cc:2272] T 72685a6f0f6e49ac9c40ecb656f0ce84 P 946bb0d09af343498b7e84c16cbcdd62 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.780143  2676 tablet_replica.cc:333] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62: stopping tablet replica
I20260709 12:26:41.780623  2676 raft_consensus.cc:2243] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.781011  2676 raft_consensus.cc:2272] T 1c139debaa01460ca2b940d4faef6b11 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.782908  2676 tablet_replica.cc:333] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62: stopping tablet replica
I20260709 12:26:41.783383  2676 raft_consensus.cc:2243] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.784165  2676 raft_consensus.cc:2272] T 563563e5d21241b38fd03c4af3aa717f P 946bb0d09af343498b7e84c16cbcdd62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.786085  2676 tablet_replica.cc:333] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62: stopping tablet replica
I20260709 12:26:41.786581  2676 raft_consensus.cc:2243] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.786986  2676 raft_consensus.cc:2272] T 5056ee8dda5d47ee9bb62c5c079f4b05 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.788805  2676 tablet_replica.cc:333] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62: stopping tablet replica
I20260709 12:26:41.789372  2676 raft_consensus.cc:2243] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.790282  2676 raft_consensus.cc:2272] T 3019a0331f094fb5be682e843969de64 P 946bb0d09af343498b7e84c16cbcdd62 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.792028  2676 tablet_replica.cc:333] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62: stopping tablet replica
I20260709 12:26:41.792484  2676 raft_consensus.cc:2243] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.792922  2676 raft_consensus.cc:2272] T c4188b19345044b6b8f86b5397198171 P 946bb0d09af343498b7e84c16cbcdd62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.794691  2676 tablet_replica.cc:333] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62: stopping tablet replica
I20260709 12:26:41.795137  2676 raft_consensus.cc:2243] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.795580  2676 raft_consensus.cc:2272] T 7167b0853ae34ad581ebf0df54b4032a P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.797356  2676 tablet_replica.cc:333] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62: stopping tablet replica
I20260709 12:26:41.797822  2676 raft_consensus.cc:2243] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.798333  2676 raft_consensus.cc:2272] T e6535b05ad364aad91eeec06b149d559 P 946bb0d09af343498b7e84c16cbcdd62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.800113  2676 tablet_replica.cc:333] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62: stopping tablet replica
I20260709 12:26:41.800531  2676 raft_consensus.cc:2243] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.800942  2676 raft_consensus.cc:2272] T ab1e9019cef34fcbaf43b0fb83efc14c P 946bb0d09af343498b7e84c16cbcdd62 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.831067  2676 tablet_server.cc:196] TabletServer@127.2.157.3:0 shutdown complete.
I20260709 12:26:41.853091  2676 master.cc:562] Master@127.2.157.62:41389 shutting down...
I20260709 12:26:41.878144  2676 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.878816  2676 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.879194  2676 tablet_replica.cc:333] T 00000000000000000000000000000000 P 687a1d41ddd84ad8893e60eedd0481e9: stopping tablet replica
I20260709 12:26:41.899437  2676 master.cc:584] Master@127.2.157.62:41389 shutdown complete.
946bb0d09af343498b7e84c16cbcdd62  1
94f2f1c5017545e6bd73655a3762e867  5
ce8ac360b4944ac78fc2401b20fa940b  4
946bb0d09af343498b7e84c16cbcdd62  3
94f2f1c5017545e6bd73655a3762e867  3
ce8ac360b4944ac78fc2401b20fa940b  4
946bb0d09af343498b7e84c16cbcdd62  1
94f2f1c5017545e6bd73655a3762e867  8
ce8ac360b4944ac78fc2401b20fa940b  1
946bb0d09af343498b7e84c16cbcdd62  3
94f2f1c5017545e6bd73655a3762e867  4
ce8ac360b4944ac78fc2401b20fa940b  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28911 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:26:41.943878  2676 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.62:44099
I20260709 12:26:41.945011  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:41.951598  3731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:41.951617  3730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:41.952647  3733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:41.952826  2676 server_base.cc:1061] running on GCE node
I20260709 12:26:41.953859  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:41.954103  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:41.954229  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600001954218 us; error 0 us; skew 500 ppm
I20260709 12:26:41.954694  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:41.957115  2676 webserver.cc:533] Webserver started at http://127.2.157.62:41447/ using document root <none> and password file <none>
I20260709 12:26:41.957587  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:41.957744  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:41.958034  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:41.959151  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/master-0-root/instance:
uuid: "a21ae62b873f4aa28d9c28a3b1bc7936"
format_stamp: "Formatted at 2026-07-09 12:26:41 on dist-test-slave-0768"
I20260709 12:26:41.963753  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:26:41.967201  3738 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:41.967957  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:26:41.968318  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/master-0-root
uuid: "a21ae62b873f4aa28d9c28a3b1bc7936"
format_stamp: "Formatted at 2026-07-09 12:26:41 on dist-test-slave-0768"
I20260709 12:26:41.968609  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:42.007169  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:42.008486  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:42.049001  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.62:44099
I20260709 12:26:42.049144  3789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.62:44099 every 8 connection(s)
I20260709 12:26:42.053015  3790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.062983  3790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Bootstrap starting.
I20260709 12:26:42.067773  3790 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.072016  3790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: No bootstrap required, opened a new log
I20260709 12:26:42.074297  3790 raft_consensus.cc:359] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a21ae62b873f4aa28d9c28a3b1bc7936" member_type: VOTER }
I20260709 12:26:42.074725  3790 raft_consensus.cc:385] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.074973  3790 raft_consensus.cc:740] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a21ae62b873f4aa28d9c28a3b1bc7936, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.075568  3790 consensus_queue.cc:260] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a21ae62b873f4aa28d9c28a3b1bc7936" member_type: VOTER }
I20260709 12:26:42.076056  3790 raft_consensus.cc:399] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:42.076285  3790 raft_consensus.cc:493] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:42.076574  3790 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.081607  3790 raft_consensus.cc:515] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a21ae62b873f4aa28d9c28a3b1bc7936" member_type: VOTER }
I20260709 12:26:42.082224  3790 leader_election.cc:304] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a21ae62b873f4aa28d9c28a3b1bc7936; no voters: 
I20260709 12:26:42.083482  3790 leader_election.cc:290] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:42.084160  3793 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.085758  3793 raft_consensus.cc:697] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [term 1 LEADER]: Becoming Leader. State: Replica: a21ae62b873f4aa28d9c28a3b1bc7936, State: Running, Role: LEADER
I20260709 12:26:42.086588  3793 consensus_queue.cc:237] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a21ae62b873f4aa28d9c28a3b1bc7936" member_type: VOTER }
I20260709 12:26:42.086927  3790 sys_catalog.cc:565] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:42.092379  3794 sys_catalog.cc:455] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a21ae62b873f4aa28d9c28a3b1bc7936" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a21ae62b873f4aa28d9c28a3b1bc7936" member_type: VOTER } }
I20260709 12:26:42.093569  3795 sys_catalog.cc:455] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a21ae62b873f4aa28d9c28a3b1bc7936. Latest consensus state: current_term: 1 leader_uuid: "a21ae62b873f4aa28d9c28a3b1bc7936" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a21ae62b873f4aa28d9c28a3b1bc7936" member_type: VOTER } }
I20260709 12:26:42.094092  3794 sys_catalog.cc:458] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:42.094359  3795 sys_catalog.cc:458] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:42.096104  3803 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:42.101701  3803 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:42.102859  2676 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:42.110673  3803 catalog_manager.cc:1383] Generated new cluster ID: d7f3483ecd314edcb37079a4c56be0b3
I20260709 12:26:42.110967  3803 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:42.130101  3803 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:42.131402  3803 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:42.148281  3803 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Generated new TSK 0
I20260709 12:26:42.148909  3803 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:42.169840  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:42.176645  3811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:42.177502  3812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:42.179262  3814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:42.180133  2676 server_base.cc:1061] running on GCE node
I20260709 12:26:42.181381  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:42.181663  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:42.181854  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600002181831 us; error 0 us; skew 500 ppm
I20260709 12:26:42.182463  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:42.184868  2676 webserver.cc:533] Webserver started at http://127.2.157.1:44833/ using document root <none> and password file <none>
I20260709 12:26:42.185379  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:42.185593  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:42.185871  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:42.187018  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/instance:
uuid: "4eedd844c09d456ca0b3614490dd1dbb"
format_stamp: "Formatted at 2026-07-09 12:26:42 on dist-test-slave-0768"
I20260709 12:26:42.191632  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:26:42.195065  3819 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:42.195809  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:26:42.196117  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root
uuid: "4eedd844c09d456ca0b3614490dd1dbb"
format_stamp: "Formatted at 2026-07-09 12:26:42 on dist-test-slave-0768"
I20260709 12:26:42.196513  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:42.208695  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:42.210151  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:42.211619  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:42.213872  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:42.214155  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:42.214393  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:42.214586  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:42.255715  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.1:32843
I20260709 12:26:42.255820  3881 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.1:32843 every 8 connection(s)
I20260709 12:26:42.260630  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:42.268985  3886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:42.269685  3887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:42.272791  3890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:42.273530  2676 server_base.cc:1061] running on GCE node
I20260709 12:26:42.275004  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:42.275224  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:42.275431  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600002275412 us; error 0 us; skew 500 ppm
I20260709 12:26:42.275974  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:42.278903  2676 webserver.cc:533] Webserver started at http://127.2.157.2:37703/ using document root <none> and password file <none>
I20260709 12:26:42.279480  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:42.279680  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:42.279968  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:42.280534  3882 heartbeater.cc:344] Connected to a master server at 127.2.157.62:44099
I20260709 12:26:42.280915  3882 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:42.281356  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/instance:
uuid: "073f84fcc295417f9bcc1eea29d2bb58"
format_stamp: "Formatted at 2026-07-09 12:26:42 on dist-test-slave-0768"
I20260709 12:26:42.281635  3882 heartbeater.cc:507] Master 127.2.157.62:44099 requested a full tablet report, sending...
I20260709 12:26:42.283761  3755 ts_manager.cc:194] Registered new tserver with Master: 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:26:42.285445  3755 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51798
I20260709 12:26:42.286482  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:26:42.290298  3894 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:42.291095  2676 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:26:42.291363  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root
uuid: "073f84fcc295417f9bcc1eea29d2bb58"
format_stamp: "Formatted at 2026-07-09 12:26:42 on dist-test-slave-0768"
I20260709 12:26:42.291606  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:42.317500  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:42.318751  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:42.320104  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:42.322289  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:42.322461  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:42.322751  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:42.322911  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:42.364337  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.2:42279
I20260709 12:26:42.364459  3956 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.2:42279 every 8 connection(s)
I20260709 12:26:42.369177  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:42.376744  3960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:42.378610  3961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:42.380091  3963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:42.381124  2676 server_base.cc:1061] running on GCE node
I20260709 12:26:42.382117  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:42.382360  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:42.382457  3957 heartbeater.cc:344] Connected to a master server at 127.2.157.62:44099
I20260709 12:26:42.382608  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600002382585 us; error 0 us; skew 500 ppm
I20260709 12:26:42.382839  3957 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:42.383348  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:42.383718  3957 heartbeater.cc:507] Master 127.2.157.62:44099 requested a full tablet report, sending...
I20260709 12:26:42.386267  2676 webserver.cc:533] Webserver started at http://127.2.157.3:41221/ using document root <none> and password file <none>
I20260709 12:26:42.386581  3755 ts_manager.cc:194] Registered new tserver with Master: 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:42.386790  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:42.387086  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:42.387357  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:42.388307  3755 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51802
I20260709 12:26:42.388542  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/instance:
uuid: "34711da9380944d2969a2bc3e203db3d"
format_stamp: "Formatted at 2026-07-09 12:26:42 on dist-test-slave-0768"
I20260709 12:26:42.393313  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:26:42.396982  3968 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:42.397940  2676 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:26:42.398304  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root
uuid: "34711da9380944d2969a2bc3e203db3d"
format_stamp: "Formatted at 2026-07-09 12:26:42 on dist-test-slave-0768"
I20260709 12:26:42.398612  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:42.413844  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:42.415283  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:42.416869  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:42.419348  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:42.419581  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:42.419867  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:42.420059  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:42.462858  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.3:33709
I20260709 12:26:42.462960  4030 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.3:33709 every 8 connection(s)
I20260709 12:26:42.478219  4031 heartbeater.cc:344] Connected to a master server at 127.2.157.62:44099
I20260709 12:26:42.478619  4031 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:42.479416  4031 heartbeater.cc:507] Master 127.2.157.62:44099 requested a full tablet report, sending...
I20260709 12:26:42.481755  3755 ts_manager.cc:194] Registered new tserver with Master: 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:42.482748  2676 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01619518s
I20260709 12:26:42.483289  3755 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51804
I20260709 12:26:42.513439  3755 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51808:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:26:42.519584  3755 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:26:42.723474  3996 tablet_service.cc:1511] Processing CreateTablet for tablet ba2105a333194a478762048de8b5853c (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:42.725149  3996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2105a333194a478762048de8b5853c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.725071  3922 tablet_service.cc:1511] Processing CreateTablet for tablet ba2105a333194a478762048de8b5853c (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:42.726707  3922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2105a333194a478762048de8b5853c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.728042  3921 tablet_service.cc:1511] Processing CreateTablet for tablet 2c8fdf36221e4313b4289cb50019ec4f (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:42.729621  3921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c8fdf36221e4313b4289cb50019ec4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.735847  3920 tablet_service.cc:1511] Processing CreateTablet for tablet 781f4e626c2b4af0af08871cfde2d83e (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:42.737440  3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 781f4e626c2b4af0af08871cfde2d83e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.739285  3847 tablet_service.cc:1511] Processing CreateTablet for tablet ba2105a333194a478762048de8b5853c (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:42.740797  3847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2105a333194a478762048de8b5853c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.743093  3919 tablet_service.cc:1511] Processing CreateTablet for tablet 008722eae8ea40db92fea0a5f70961f3 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:42.744606  3919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008722eae8ea40db92fea0a5f70961f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.746858  3918 tablet_service.cc:1511] Processing CreateTablet for tablet d1e53a5bcc4f45a3a3ba300b44b04925 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:42.751639  3995 tablet_service.cc:1511] Processing CreateTablet for tablet 2c8fdf36221e4313b4289cb50019ec4f (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:42.756168  3840 tablet_service.cc:1511] Processing CreateTablet for tablet 8abf2cd47e3c44d995fbbb863bf3d5ac (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:42.755767  3846 tablet_service.cc:1511] Processing CreateTablet for tablet 2c8fdf36221e4313b4289cb50019ec4f (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:42.758441  3916 tablet_service.cc:1511] Processing CreateTablet for tablet 20fdebd7b9154e47beb5e08a62175fe5 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:42.759899  3916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fdebd7b9154e47beb5e08a62175fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.760365  3915 tablet_service.cc:1511] Processing CreateTablet for tablet 8abf2cd47e3c44d995fbbb863bf3d5ac (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:42.761379  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 20fdebd7b9154e47beb5e08a62175fe5 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:42.762614  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8abf2cd47e3c44d995fbbb863bf3d5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.763688  3842 tablet_service.cc:1511] Processing CreateTablet for tablet 415f89d9faf145eba38570ddee93ff31 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:42.765956  3843 tablet_service.cc:1511] Processing CreateTablet for tablet d1e53a5bcc4f45a3a3ba300b44b04925 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:42.768236  3844 tablet_service.cc:1511] Processing CreateTablet for tablet 008722eae8ea40db92fea0a5f70961f3 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:42.769511  3838 tablet_service.cc:1511] Processing CreateTablet for tablet 8693e7a0624445758baf0b77c7686e0c (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:42.770507  3845 tablet_service.cc:1511] Processing CreateTablet for tablet 781f4e626c2b4af0af08871cfde2d83e (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:42.765076  3839 tablet_service.cc:1511] Processing CreateTablet for tablet 3d5f24773bb44448a1cb122558f0c4c9 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:42.774286  3992 tablet_service.cc:1511] Processing CreateTablet for tablet d1e53a5bcc4f45a3a3ba300b44b04925 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:42.774884  3917 tablet_service.cc:1511] Processing CreateTablet for tablet 415f89d9faf145eba38570ddee93ff31 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:42.775238  3994 tablet_service.cc:1511] Processing CreateTablet for tablet 781f4e626c2b4af0af08871cfde2d83e (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:42.776926  3991 tablet_service.cc:1511] Processing CreateTablet for tablet 415f89d9faf145eba38570ddee93ff31 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:42.777783  3993 tablet_service.cc:1511] Processing CreateTablet for tablet 008722eae8ea40db92fea0a5f70961f3 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:42.773437  3914 tablet_service.cc:1511] Processing CreateTablet for tablet 3d5f24773bb44448a1cb122558f0c4c9 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:42.753777  3995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c8fdf36221e4313b4289cb50019ec4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.786458  3989 tablet_service.cc:1511] Processing CreateTablet for tablet 8abf2cd47e3c44d995fbbb863bf3d5ac (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:42.787354  3987 tablet_service.cc:1511] Processing CreateTablet for tablet 8693e7a0624445758baf0b77c7686e0c (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:42.786458  3988 tablet_service.cc:1511] Processing CreateTablet for tablet 3d5f24773bb44448a1cb122558f0c4c9 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:42.789131  3992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e53a5bcc4f45a3a3ba300b44b04925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.790195  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8abf2cd47e3c44d995fbbb863bf3d5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.792156  3913 tablet_service.cc:1511] Processing CreateTablet for tablet 8693e7a0624445758baf0b77c7686e0c (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:42.806452  3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 781f4e626c2b4af0af08871cfde2d83e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.794440  3994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 781f4e626c2b4af0af08871cfde2d83e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.807629  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fdebd7b9154e47beb5e08a62175fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.809248  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e53a5bcc4f45a3a3ba300b44b04925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.810329  3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008722eae8ea40db92fea0a5f70961f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.802134  3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415f89d9faf145eba38570ddee93ff31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.811374  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d5f24773bb44448a1cb122558f0c4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.790735  3990 tablet_service.cc:1511] Processing CreateTablet for tablet 20fdebd7b9154e47beb5e08a62175fe5 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:42.810679  3991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415f89d9faf145eba38570ddee93ff31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.814240  3838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8693e7a0624445758baf0b77c7686e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.816139  3990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fdebd7b9154e47beb5e08a62175fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.818243  3842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415f89d9faf145eba38570ddee93ff31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.818542  3988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d5f24773bb44448a1cb122558f0c4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.819696  3989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8abf2cd47e3c44d995fbbb863bf3d5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.822367  3913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8693e7a0624445758baf0b77c7686e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.827850  3846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c8fdf36221e4313b4289cb50019ec4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.830304  3993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008722eae8ea40db92fea0a5f70961f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.838264  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d5f24773bb44448a1cb122558f0c4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.838951  3918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e53a5bcc4f45a3a3ba300b44b04925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.838342  3987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8693e7a0624445758baf0b77c7686e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.862869  4046 tablet_bootstrap.cc:492] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:42.863759  3922 tablet_service.cc:1511] Processing CreateTablet for tablet dcafa6aa2cb54d969725d5e69f9b4a5d (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:42.865258  3922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcafa6aa2cb54d969725d5e69f9b4a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.905287  3913 tablet_service.cc:1511] Processing CreateTablet for tablet 4e525bb5cdfd4c23b6ca117d6d5a526d (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:42.914352  3844 tablet_service.cc:1511] Processing CreateTablet for tablet 3d9116f60a784d21bf919694ec32bdbb (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:42.907153  3840 tablet_service.cc:1511] Processing CreateTablet for tablet dcafa6aa2cb54d969725d5e69f9b4a5d (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:42.915709  3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d9116f60a784d21bf919694ec32bdbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.916795  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcafa6aa2cb54d969725d5e69f9b4a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.914789  3913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e525bb5cdfd4c23b6ca117d6d5a526d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.911849  3994 tablet_service.cc:1511] Processing CreateTablet for tablet 4e525bb5cdfd4c23b6ca117d6d5a526d (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:42.926748  3994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e525bb5cdfd4c23b6ca117d6d5a526d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.911468  3995 tablet_service.cc:1511] Processing CreateTablet for tablet dcafa6aa2cb54d969725d5e69f9b4a5d (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:42.932258  4046 tablet_bootstrap.cc:654] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.945395  3995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcafa6aa2cb54d969725d5e69f9b4a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.947368  3838 tablet_service.cc:1511] Processing CreateTablet for tablet 4e525bb5cdfd4c23b6ca117d6d5a526d (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:42.963208  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 455f8427897049759001979ea81adec1 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:42.963343  3988 tablet_service.cc:1511] Processing CreateTablet for tablet 3d9116f60a784d21bf919694ec32bdbb (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:42.967686  4047 tablet_bootstrap.cc:492] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:42.968793  3990 tablet_service.cc:1511] Processing CreateTablet for tablet 455f8427897049759001979ea81adec1 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:42.972993  3842 tablet_service.cc:1511] Processing CreateTablet for tablet 9589deb8c4b64410a1f3793a7f6f1498 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:42.974978  3991 tablet_service.cc:1511] Processing CreateTablet for tablet 71bbfa14190c41d4a2fa5064e97996f1 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:42.975126  3843 tablet_service.cc:1511] Processing CreateTablet for tablet 36aa23e03c114b66abce211a070a9c93 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:42.975960  3990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455f8427897049759001979ea81adec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.975747  3989 tablet_service.cc:1511] Processing CreateTablet for tablet 9589deb8c4b64410a1f3793a7f6f1498 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:42.982604  3838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e525bb5cdfd4c23b6ca117d6d5a526d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.983902  3989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9589deb8c4b64410a1f3793a7f6f1498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.986743  4048 tablet_bootstrap.cc:492] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:42.988652  3842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9589deb8c4b64410a1f3793a7f6f1498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.989193  3988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d9116f60a784d21bf919694ec32bdbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.996091  3847 tablet_service.cc:1511] Processing CreateTablet for tablet a445f8740fa847ed9ac463915fa09725 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:42.989933  3845 tablet_service.cc:1511] Processing CreateTablet for tablet 71bbfa14190c41d4a2fa5064e97996f1 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:42.997303  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455f8427897049759001979ea81adec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.998126  3993 tablet_service.cc:1511] Processing CreateTablet for tablet 36aa23e03c114b66abce211a070a9c93 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:42.993914  3839 tablet_service.cc:1511] Processing CreateTablet for tablet 08e2bc60b69b4f4086209185a5fe10a4 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:42.999464  3993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36aa23e03c114b66abce211a070a9c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.998960  3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71bbfa14190c41d4a2fa5064e97996f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.999862  3915 tablet_service.cc:1511] Processing CreateTablet for tablet 3d9116f60a784d21bf919694ec32bdbb (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:43.008273  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e2bc60b69b4f4086209185a5fe10a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.010332  3914 tablet_service.cc:1511] Processing CreateTablet for tablet 455f8427897049759001979ea81adec1 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:43.011731  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455f8427897049759001979ea81adec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.011493  3920 tablet_service.cc:1511] Processing CreateTablet for tablet 9589deb8c4b64410a1f3793a7f6f1498 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:43.015792  3846 tablet_service.cc:1511] Processing CreateTablet for tablet 86e92801c3904600b054e99343413645 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:43.018072  3921 tablet_service.cc:1511] Processing CreateTablet for tablet 71bbfa14190c41d4a2fa5064e97996f1 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:43.013918  3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9589deb8c4b64410a1f3793a7f6f1498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.022418  3991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71bbfa14190c41d4a2fa5064e97996f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.012570  3916 tablet_service.cc:1511] Processing CreateTablet for tablet 36aa23e03c114b66abce211a070a9c93 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:43.018635  3918 tablet_service.cc:1511] Processing CreateTablet for tablet 08e2bc60b69b4f4086209185a5fe10a4 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:43.018880  3987 tablet_service.cc:1511] Processing CreateTablet for tablet a445f8740fa847ed9ac463915fa09725 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:43.023878  3987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a445f8740fa847ed9ac463915fa09725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.025548  4047 tablet_bootstrap.cc:654] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.030357  4048 tablet_bootstrap.cc:654] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.033396  3847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a445f8740fa847ed9ac463915fa09725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.035871  3922 tablet_service.cc:1511] Processing CreateTablet for tablet a445f8740fa847ed9ac463915fa09725 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:42.985555  3992 tablet_service.cc:1511] Processing CreateTablet for tablet 08e2bc60b69b4f4086209185a5fe10a4 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:43.030476  3921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71bbfa14190c41d4a2fa5064e97996f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.038868  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d9116f60a784d21bf919694ec32bdbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.040812  3919 tablet_service.cc:1511] Processing CreateTablet for tablet 86e92801c3904600b054e99343413645 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:43.042138  3919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e92801c3904600b054e99343413645. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.048700  3917 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf4f0ff3c484df18d42d887c059c170 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:43.049736  4046 tablet_bootstrap.cc:492] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:43.050311  4046 ts_tablet_manager.cc:1403] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.188s	user 0.003s	sys 0.013s
I20260709 12:26:43.050367  3992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e2bc60b69b4f4086209185a5fe10a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.054692  3996 tablet_service.cc:1511] Processing CreateTablet for tablet 86e92801c3904600b054e99343413645 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:43.055999  3996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e92801c3904600b054e99343413645. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.058041  3922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a445f8740fa847ed9ac463915fa09725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.058259  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36aa23e03c114b66abce211a070a9c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.066256  3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf4f0ff3c484df18d42d887c059c170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.053452  4046 raft_consensus.cc:359] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } }
I20260709 12:26:43.072535  4046 raft_consensus.cc:385] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.073179  4046 raft_consensus.cc:740] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.078997  4046 consensus_queue.cc:260] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } }
I20260709 12:26:43.079249  3840 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf4f0ff3c484df18d42d887c059c170 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:43.080210  3846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e92801c3904600b054e99343413645. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.086051  3993 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf4f0ff3c484df18d42d887c059c170 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:43.087348  3993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf4f0ff3c484df18d42d887c059c170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.079275  4047 tablet_bootstrap.cc:492] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:43.090010  3918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e2bc60b69b4f4086209185a5fe10a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.090356  4047 ts_tablet_manager.cc:1403] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.123s	user 0.009s	sys 0.008s
I20260709 12:26:43.093469  4047 raft_consensus.cc:359] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.094805  4047 raft_consensus.cc:385] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.083374  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 8d772c24bae14b138d4062798651f82f (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20260709 12:26:43.097460  3802 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:43.094509  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf4f0ff3c484df18d42d887c059c170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.107535  3913 tablet_service.cc:1511] Processing CreateTablet for tablet 8d772c24bae14b138d4062798651f82f (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:43.108399  3990 tablet_service.cc:1511] Processing CreateTablet for tablet 8d772c24bae14b138d4062798651f82f (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:43.109277  3913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d772c24bae14b138d4062798651f82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.109637  3990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d772c24bae14b138d4062798651f82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.112110  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d772c24bae14b138d4062798651f82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.117533  3838 tablet_service.cc:1511] Processing CreateTablet for tablet dc613acf018f4e72bbca376671df9f71 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:43.119238  4047 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.125176  3916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36aa23e03c114b66abce211a070a9c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.134711  3920 tablet_service.cc:1511] Processing CreateTablet for tablet dc613acf018f4e72bbca376671df9f71 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:43.135994  3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc613acf018f4e72bbca376671df9f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.136301  3995 tablet_service.cc:1511] Processing CreateTablet for tablet dc613acf018f4e72bbca376671df9f71 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:43.137521  3995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc613acf018f4e72bbca376671df9f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.140769  4047 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.131088  4052 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.143877  4052 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } }
I20260709 12:26:43.152129  3838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc613acf018f4e72bbca376671df9f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.154585  3839 tablet_service.cc:1511] Processing CreateTablet for tablet ac74d3d7308e4121b8d2bbb920bb9294 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:43.158877  3844 tablet_service.cc:1511] Processing CreateTablet for tablet eadf6ff4956f47ff8a85f77d02584a0d (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:43.160383  3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eadf6ff4956f47ff8a85f77d02584a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.163007  3988 tablet_service.cc:1511] Processing CreateTablet for tablet eadf6ff4956f47ff8a85f77d02584a0d (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:43.164445  3988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eadf6ff4956f47ff8a85f77d02584a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.168614  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac74d3d7308e4121b8d2bbb920bb9294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.182469  4052 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:26:43.186540  3957 heartbeater.cc:499] Master 127.2.157.62:44099 was elected leader, sending a full tablet report...
I20260709 12:26:43.191300  3989 tablet_service.cc:1511] Processing CreateTablet for tablet ac74d3d7308e4121b8d2bbb920bb9294 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:43.210253  3845 tablet_service.cc:1511] Processing CreateTablet for tablet 274c43c8bd05433a8c00fffabbd5b8b7 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:43.213501  4048 tablet_bootstrap.cc:492] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:43.214148  4048 ts_tablet_manager.cc:1403] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.228s	user 0.006s	sys 0.014s
I20260709 12:26:43.217231  4048 raft_consensus.cc:359] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.218232  4046 ts_tablet_manager.cc:1434] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.167s	user 0.012s	sys 0.003s
I20260709 12:26:43.213604  3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274c43c8bd05433a8c00fffabbd5b8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.222358  3914 tablet_service.cc:1511] Processing CreateTablet for tablet eadf6ff4956f47ff8a85f77d02584a0d (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:43.227530  3989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac74d3d7308e4121b8d2bbb920bb9294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.228804  3921 tablet_service.cc:1511] Processing CreateTablet for tablet ac74d3d7308e4121b8d2bbb920bb9294 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:43.230414  3987 tablet_service.cc:1511] Processing CreateTablet for tablet 274c43c8bd05433a8c00fffabbd5b8b7 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:43.237567  4048 raft_consensus.cc:385] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.261127  4046 tablet_bootstrap.cc:492] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:43.275309  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eadf6ff4956f47ff8a85f77d02584a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.276144  4047 ts_tablet_manager.cc:1434] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.185s	user 0.020s	sys 0.007s
I20260709 12:26:43.277005  3921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac74d3d7308e4121b8d2bbb920bb9294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.283546  3882 heartbeater.cc:499] Master 127.2.157.62:44099 was elected leader, sending a full tablet report...
I20260709 12:26:43.288149  3993 tablet_service.cc:1511] Processing CreateTablet for tablet c5bc554f69c94b9887b24097921bd77e (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:43.288627  3840 tablet_service.cc:1511] Processing CreateTablet for tablet c5bc554f69c94b9887b24097921bd77e (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:43.289260  4047 tablet_bootstrap.cc:492] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:43.290942  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5bc554f69c94b9887b24097921bd77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.302114  3843 tablet_service.cc:1511] Processing CreateTablet for tablet a8cb467dd69d4e7785fd70c9c63614ea (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:43.303336  4055 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.303529  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8cb467dd69d4e7785fd70c9c63614ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.251438  4048 raft_consensus.cc:740] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.283665  4046 tablet_bootstrap.cc:654] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.319502  3921 tablet_service.cc:1511] Processing CreateTablet for tablet a8cb467dd69d4e7785fd70c9c63614ea (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:43.319626  3919 tablet_service.cc:1511] Processing CreateTablet for tablet c5bc554f69c94b9887b24097921bd77e (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:43.322175  3846 tablet_service.cc:1511] Processing CreateTablet for tablet 66c9e284191247a69a13f47c43baec1b (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:43.323390  3915 tablet_service.cc:1511] Processing CreateTablet for tablet 66c9e284191247a69a13f47c43baec1b (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:43.306099  4055 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.324918  3995 tablet_service.cc:1511] Processing CreateTablet for tablet a8cb467dd69d4e7785fd70c9c63614ea (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:43.330792  3847 tablet_service.cc:1511] Processing CreateTablet for tablet e9a1caee5b3c48638d8c44f6919fb5ed (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:43.334288  3847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a1caee5b3c48638d8c44f6919fb5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.334959  3846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c9e284191247a69a13f47c43baec1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.342247  3987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274c43c8bd05433a8c00fffabbd5b8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.342976  3993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5bc554f69c94b9887b24097921bd77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.342775  4048 consensus_queue.cc:260] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.346531  4047 tablet_bootstrap.cc:654] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.269204  3917 tablet_service.cc:1511] Processing CreateTablet for tablet 274c43c8bd05433a8c00fffabbd5b8b7 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:43.362043  3916 tablet_service.cc:1511] Processing CreateTablet for tablet e9a1caee5b3c48638d8c44f6919fb5ed (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:43.363178  4048 ts_tablet_manager.cc:1434] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.149s	user 0.006s	sys 0.006s
I20260709 12:26:43.363998  4031 heartbeater.cc:499] Master 127.2.157.62:44099 was elected leader, sending a full tablet report...
I20260709 12:26:43.364319  4048 tablet_bootstrap.cc:492] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:43.370792  3995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8cb467dd69d4e7785fd70c9c63614ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.378969  4060 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.378438  3988 tablet_service.cc:1511] Processing CreateTablet for tablet 66c9e284191247a69a13f47c43baec1b (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:43.379524  4060 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.386977  4055 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:43.398085  3988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c9e284191247a69a13f47c43baec1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.411602  4060 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:43.417690  3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274c43c8bd05433a8c00fffabbd5b8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.426095  3921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8cb467dd69d4e7785fd70c9c63614ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.428138  3916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a1caee5b3c48638d8c44f6919fb5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.435259  3919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5bc554f69c94b9887b24097921bd77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.442116  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c9e284191247a69a13f47c43baec1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.447815  3990 tablet_service.cc:1511] Processing CreateTablet for tablet e9a1caee5b3c48638d8c44f6919fb5ed (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:43.449208  3990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a1caee5b3c48638d8c44f6919fb5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.451864  3996 tablet_service.cc:1511] Processing CreateTablet for tablet 383a24e3cada4485922ab39de63b4de9 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:43.453166  3996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383a24e3cada4485922ab39de63b4de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.468439  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:43.479962  3897 leader_election.cc:343] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.481243  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:26:43.483338  3895 leader_election.cc:343] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.483964  3895 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:43.485039  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 88b08017bb344d72aa432be8a7d5d03f (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:43.485602  4053 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:43.486505  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b08017bb344d72aa432be8a7d5d03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.498708  3845 tablet_service.cc:1511] Processing CreateTablet for tablet 383a24e3cada4485922ab39de63b4de9 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:43.507937  3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383a24e3cada4485922ab39de63b4de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.528291  4047 tablet_bootstrap.cc:492] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:43.528843  4047 ts_tablet_manager.cc:1403] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.240s	user 0.006s	sys 0.011s
I20260709 12:26:43.533550  3993 tablet_service.cc:1511] Processing CreateTablet for tablet 88b08017bb344d72aa432be8a7d5d03f (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:43.536901  3993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b08017bb344d72aa432be8a7d5d03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.535422  3840 tablet_service.cc:1511] Processing CreateTablet for tablet d5c03e098f9a45cd94c52ada1bc9fa11 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:43.539386  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c03e098f9a45cd94c52ada1bc9fa11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.562645  4046 tablet_bootstrap.cc:492] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:43.563190  4046 ts_tablet_manager.cc:1403] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.309s	user 0.012s	sys 0.027s
I20260709 12:26:43.566432  4046 raft_consensus.cc:359] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.567271  4046 raft_consensus.cc:385] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.567634  4046 raft_consensus.cc:740] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.568536  4046 consensus_queue.cc:260] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.571034  4046 ts_tablet_manager.cc:1434] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:43.574151  3841 tablet_service.cc:1511] Processing CreateTablet for tablet d70a29fa5e29440f92c76824dcf74449 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:43.575757  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70a29fa5e29440f92c76824dcf74449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.577158  3987 tablet_service.cc:1511] Processing CreateTablet for tablet d5c03e098f9a45cd94c52ada1bc9fa11 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:43.580932  3987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c03e098f9a45cd94c52ada1bc9fa11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.581368  3920 tablet_service.cc:1511] Processing CreateTablet for tablet 383a24e3cada4485922ab39de63b4de9 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:43.582660  3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383a24e3cada4485922ab39de63b4de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.582957  3991 tablet_service.cc:1511] Processing CreateTablet for tablet d70a29fa5e29440f92c76824dcf74449 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:43.584326  3991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70a29fa5e29440f92c76824dcf74449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.588582  4046 tablet_bootstrap.cc:492] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:43.597426  3847 tablet_service.cc:1511] Processing CreateTablet for tablet 1fd9ef15e49a427d989c258ac6614daa (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:43.600454  3992 tablet_service.cc:1511] Processing CreateTablet for tablet 1fd9ef15e49a427d989c258ac6614daa (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:43.601835  3992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fd9ef15e49a427d989c258ac6614daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.603257  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:26:43.604908  3821 leader_election.cc:343] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.605265  3847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fd9ef15e49a427d989c258ac6614daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.601760  3915 tablet_service.cc:1511] Processing CreateTablet for tablet 88b08017bb344d72aa432be8a7d5d03f (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:43.609493  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b08017bb344d72aa432be8a7d5d03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.612694  3919 tablet_service.cc:1511] Processing CreateTablet for tablet d5c03e098f9a45cd94c52ada1bc9fa11 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:43.616436  3919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c03e098f9a45cd94c52ada1bc9fa11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.614475  3917 tablet_service.cc:1511] Processing CreateTablet for tablet 1fd9ef15e49a427d989c258ac6614daa (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:43.622767  3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fd9ef15e49a427d989c258ac6614daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.614471  3921 tablet_service.cc:1511] Processing CreateTablet for tablet d70a29fa5e29440f92c76824dcf74449 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:43.547871  4047 raft_consensus.cc:359] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.627138  4047 raft_consensus.cc:385] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.627488  4047 raft_consensus.cc:740] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.628034  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:43.628376  4047 consensus_queue.cc:260] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:43.629729  3822 leader_election.cc:343] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.630227  3822 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:43.630678  4047 ts_tablet_manager.cc:1434] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.102s	user 0.010s	sys 0.000s
I20260709 12:26:43.631340  4055 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:43.631604  4047 tablet_bootstrap.cc:492] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:43.632513  3921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70a29fa5e29440f92c76824dcf74449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.643260  3840 tablet_service.cc:1511] Processing CreateTablet for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:43.644610  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.677222  3995 tablet_service.cc:1511] Processing CreateTablet for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:43.682015  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:43.683676  4046 tablet_bootstrap.cc:654] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:43.683847  3969 leader_election.cc:343] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.685258  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:43.686002  4048 tablet_bootstrap.cc:654] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:43.686941  3970 leader_election.cc:343] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.687451  3970 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:43.691514  4062 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:43.694872  3995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.697379  3920 tablet_service.cc:1511] Processing CreateTablet for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:43.698731  3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.699688  3846 tablet_service.cc:1511] Processing CreateTablet for tablet e10f480d05fc4f71af73fcd88b588f21 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:43.702011  3846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e10f480d05fc4f71af73fcd88b588f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.708395  4053 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.714370  4053 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.716569  4053 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:43.719180  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:43.719870  3857 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:43.720858  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:43.722328  3897 leader_election.cc:343] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.723977  3895 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:43.724375  3988 tablet_service.cc:1511] Processing CreateTablet for tablet e10f480d05fc4f71af73fcd88b588f21 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:43.725174  4053 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.725028  3916 tablet_service.cc:1511] Processing CreateTablet for tablet e10f480d05fc4f71af73fcd88b588f21 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:43.725591  4053 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.725821  3988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e10f480d05fc4f71af73fcd88b588f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.726042  4053 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.726528  3916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e10f480d05fc4f71af73fcd88b588f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.725760  4047 tablet_bootstrap.cc:654] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.748052  3847 tablet_service.cc:1511] Processing CreateTablet for tablet e9c4439798ed4427881ec18a55649f4b (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:43.749400  3847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c4439798ed4427881ec18a55649f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.754163  3914 tablet_service.cc:1511] Processing CreateTablet for tablet e9c4439798ed4427881ec18a55649f4b (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:43.755434  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c4439798ed4427881ec18a55649f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.775386  3992 tablet_service.cc:1511] Processing CreateTablet for tablet e9c4439798ed4427881ec18a55649f4b (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:43.777040  3992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c4439798ed4427881ec18a55649f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.798663  3840 tablet_service.cc:1511] Processing CreateTablet for tablet ace1274bf4f34853b37ab7a08103d367 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:43.799993  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace1274bf4f34853b37ab7a08103d367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.802507  3921 tablet_service.cc:1511] Processing CreateTablet for tablet ace1274bf4f34853b37ab7a08103d367 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:43.806890  3921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace1274bf4f34853b37ab7a08103d367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.807229  3845 tablet_service.cc:1511] Processing CreateTablet for tablet ecfd004856c24015ae137dfd5fd34b2c (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:43.809113  3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecfd004856c24015ae137dfd5fd34b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.803435  3990 tablet_service.cc:1511] Processing CreateTablet for tablet ace1274bf4f34853b37ab7a08103d367 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:43.810657  3990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace1274bf4f34853b37ab7a08103d367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.813786  3915 tablet_service.cc:1511] Processing CreateTablet for tablet ecfd004856c24015ae137dfd5fd34b2c (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:43.796519  4047 tablet_bootstrap.cc:492] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:43.787318  4053 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.830155  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecfd004856c24015ae137dfd5fd34b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.832392  4046 tablet_bootstrap.cc:492] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:43.833818  4046 ts_tablet_manager.cc:1403] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.245s	user 0.046s	sys 0.056s
I20260709 12:26:43.835820  4048 tablet_bootstrap.cc:492] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:43.836261  4048 ts_tablet_manager.cc:1403] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.472s	user 0.022s	sys 0.000s
I20260709 12:26:43.836860  4046 raft_consensus.cc:359] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.837625  4046 raft_consensus.cc:385] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.837951  4047 ts_tablet_manager.cc:1403] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.207s	user 0.027s	sys 0.007s
I20260709 12:26:43.837940  4046 raft_consensus.cc:740] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.839061  4046 consensus_queue.cc:260] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.840281  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:43.841008  3857 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.851958  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3145ab3db147c9a4fd5ca3a3ccc700 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:43.853513  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3145ab3db147c9a4fd5ca3a3ccc700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.853636  3992 tablet_service.cc:1511] Processing CreateTablet for tablet ecfd004856c24015ae137dfd5fd34b2c (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:43.863444  3995 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3145ab3db147c9a4fd5ca3a3ccc700 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:43.864722  3914 tablet_service.cc:1511] Processing CreateTablet for tablet 3b3145ab3db147c9a4fd5ca3a3ccc700 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:43.866475  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3145ab3db147c9a4fd5ca3a3ccc700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.859084  4053 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:43.882129  3992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecfd004856c24015ae137dfd5fd34b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.882977  3995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b3145ab3db147c9a4fd5ca3a3ccc700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.885390  4047 raft_consensus.cc:359] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.886198  4047 raft_consensus.cc:385] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.886489  4047 raft_consensus.cc:740] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.887326  4053 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.887214  4047 consensus_queue.cc:260] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.888926  4048 raft_consensus.cc:359] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.890136  4053 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.893451  4047 ts_tablet_manager.cc:1434] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 12:26:43.894657  4047 tablet_bootstrap.cc:492] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:43.892508  4048 raft_consensus.cc:385] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.903187  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:43.907755  4047 tablet_bootstrap.cc:654] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.909865  3857 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:43.900338  4048 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.913779  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:43.914045  3895 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:43.914486  3856 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
W20260709 12:26:43.914726  3897 leader_election.cc:343] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.917725  3895 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:43.917914  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:43.918519  4073 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.919685  4072 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.920071  4072 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:43.920490  3897 leader_election.cc:343] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.920867  4053 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:43.923049  4072 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.922637  4046 ts_tablet_manager.cc:1434] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.088s	user 0.012s	sys 0.035s
I20260709 12:26:43.925715  4046 tablet_bootstrap.cc:492] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:43.914508  4048 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.929294  4073 raft_consensus.cc:697] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:43.931066  4073 consensus_queue.cc:237] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.931814  4048 ts_tablet_manager.cc:1434] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.095s	user 0.010s	sys 0.000s
I20260709 12:26:43.932888  4048 tablet_bootstrap.cc:492] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:43.940229  3845 tablet_service.cc:1511] Processing CreateTablet for tablet 9a955b1f59694973b581077ee60e7e4a (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:43.940732  3915 tablet_service.cc:1511] Processing CreateTablet for tablet 9a955b1f59694973b581077ee60e7e4a (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:43.941644  3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a955b1f59694973b581077ee60e7e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.942127  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a955b1f59694973b581077ee60e7e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.954769  3840 tablet_service.cc:1511] Processing CreateTablet for tablet 7185a57fbd78466ab6ccbbbd0453c2aa (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:43.956211  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7185a57fbd78466ab6ccbbbd0453c2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.957839  4072 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:43.958999  3916 tablet_service.cc:1511] Processing CreateTablet for tablet 7185a57fbd78466ab6ccbbbd0453c2aa (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:43.960525  3916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7185a57fbd78466ab6ccbbbd0453c2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.961594  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:26:43.963145  3897 leader_election.cc:343] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.962947  3917 tablet_service.cc:1511] Processing CreateTablet for tablet 812f8e58e6d54e67a0d699b41fc6815b (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:43.964354  3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812f8e58e6d54e67a0d699b41fc6815b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.966215  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:43.966883  3857 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.972352  3990 tablet_service.cc:1511] Processing CreateTablet for tablet 812f8e58e6d54e67a0d699b41fc6815b (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:43.973798  3990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812f8e58e6d54e67a0d699b41fc6815b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.973443  3992 tablet_service.cc:1511] Processing CreateTablet for tablet 7185a57fbd78466ab6ccbbbd0453c2aa (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:43.974768  3992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7185a57fbd78466ab6ccbbbd0453c2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.974227  3752 catalog_manager.cc:5697] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.974867  4046 tablet_bootstrap.cc:654] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.982968  3995 tablet_service.cc:1511] Processing CreateTablet for tablet 9a955b1f59694973b581077ee60e7e4a (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:43.986986  4048 tablet_bootstrap.cc:654] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.987838  3995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a955b1f59694973b581077ee60e7e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.991129  4072 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:43.993388  3845 tablet_service.cc:1511] Processing CreateTablet for tablet 812f8e58e6d54e67a0d699b41fc6815b (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:43.995285  3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812f8e58e6d54e67a0d699b41fc6815b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.996256  4047 tablet_bootstrap.cc:492] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:43.996779  4047 ts_tablet_manager.cc:1403] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.102s	user 0.008s	sys 0.003s
I20260709 12:26:44.000195  4047 raft_consensus.cc:359] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.001016  4047 raft_consensus.cc:385] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.001343  4047 raft_consensus.cc:740] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.008654  3840 tablet_service.cc:1511] Processing CreateTablet for tablet ebb5663ff7fe4055bcad8b1fe2d00403 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:44.010291  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb5663ff7fe4055bcad8b1fe2d00403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.010201  4047 consensus_queue.cc:260] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.012145  3987 tablet_service.cc:1511] Processing CreateTablet for tablet ebb5663ff7fe4055bcad8b1fe2d00403 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:44.012681  4047 ts_tablet_manager.cc:1434] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 12:26:44.013408  3987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb5663ff7fe4055bcad8b1fe2d00403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.016330  3921 tablet_service.cc:1511] Processing CreateTablet for tablet 5149ad67f39c49a6b07934b58605690c (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:44.017652  3921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5149ad67f39c49a6b07934b58605690c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.017427  3841 tablet_service.cc:1511] Processing CreateTablet for tablet 5149ad67f39c49a6b07934b58605690c (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:44.018671  3841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5149ad67f39c49a6b07934b58605690c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.013795  4047 tablet_bootstrap.cc:492] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:44.022500  3857 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:44.031530  3895 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:44.033123  4072 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.033718  4072 raft_consensus.cc:697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:44.035183  4072 consensus_queue.cc:237] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.039297  3988 tablet_service.cc:1511] Processing CreateTablet for tablet 5149ad67f39c49a6b07934b58605690c (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:44.040606  3988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5149ad67f39c49a6b07934b58605690c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.046351  3914 tablet_service.cc:1511] Processing CreateTablet for tablet 26de30c1b5e74f05815f13d9ceea7f45 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:44.047713  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26de30c1b5e74f05815f13d9ceea7f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.049494  3846 tablet_service.cc:1511] Processing CreateTablet for tablet 26de30c1b5e74f05815f13d9ceea7f45 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:44.051314  3846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26de30c1b5e74f05815f13d9ceea7f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.054257  3990 tablet_service.cc:1511] Processing CreateTablet for tablet 26de30c1b5e74f05815f13d9ceea7f45 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:44.058482  3915 tablet_service.cc:1511] Processing CreateTablet for tablet ebb5663ff7fe4055bcad8b1fe2d00403 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:44.071046  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb5663ff7fe4055bcad8b1fe2d00403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.076239  3996 tablet_service.cc:1511] Processing CreateTablet for tablet a196cfd02592426389eee8bd2a8edb36 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:44.077843  4046 tablet_bootstrap.cc:492] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:44.078547  4046 ts_tablet_manager.cc:1403] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.153s	user 0.017s	sys 0.015s
I20260709 12:26:44.082609  3991 tablet_service.cc:1511] Processing CreateTablet for tablet 378a06c64b37451cbad82415b967e001 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:44.065218  4047 tablet_bootstrap.cc:654] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.093538  3919 tablet_service.cc:1511] Processing CreateTablet for tablet a196cfd02592426389eee8bd2a8edb36 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:44.093964  3920 tablet_service.cc:1511] Processing CreateTablet for tablet 378a06c64b37451cbad82415b967e001 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:44.094316  3913 tablet_service.cc:1511] Processing CreateTablet for tablet 821e5786ae7e416cb9f41668b6ee4718 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:44.094967  3919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a196cfd02592426389eee8bd2a8edb36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.094805  3843 tablet_service.cc:1511] Processing CreateTablet for tablet 821e5786ae7e416cb9f41668b6ee4718 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:44.095732  3913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821e5786ae7e416cb9f41668b6ee4718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.096076  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821e5786ae7e416cb9f41668b6ee4718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.096091  3847 tablet_service.cc:1511] Processing CreateTablet for tablet 378a06c64b37451cbad82415b967e001 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:44.097415  3847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 378a06c64b37451cbad82415b967e001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.100435  3840 tablet_service.cc:1511] Processing CreateTablet for tablet a196cfd02592426389eee8bd2a8edb36 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:44.101698  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a196cfd02592426389eee8bd2a8edb36. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:44.103758  3802 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:44.105805  3990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26de30c1b5e74f05815f13d9ceea7f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.111581  3996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a196cfd02592426389eee8bd2a8edb36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.119067  3991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 378a06c64b37451cbad82415b967e001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.116917  3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 378a06c64b37451cbad82415b967e001. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:44.133864  3958 tablet.cc:2406] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:44.141018  3992 tablet_service.cc:1511] Processing CreateTablet for tablet 821e5786ae7e416cb9f41668b6ee4718 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:44.142441  4046 raft_consensus.cc:359] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.143198  4046 raft_consensus.cc:385] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.143513  4046 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.144409  4046 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.147480  4046 ts_tablet_manager.cc:1434] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 12:26:44.143210  3992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821e5786ae7e416cb9f41668b6ee4718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.172906  3916 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8564889b304f44b9b2b4ad6e5687c4 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:44.175211  3840 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8564889b304f44b9b2b4ad6e5687c4 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:44.176781  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8564889b304f44b9b2b4ad6e5687c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.181137  3916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8564889b304f44b9b2b4ad6e5687c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.196422  3838 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7d3aec426d4ef7aa5adcd0ab4c8da2 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:44.196561  3988 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8564889b304f44b9b2b4ad6e5687c4 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:44.197945  3995 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7d3aec426d4ef7aa5adcd0ab4c8da2 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:44.199841  3917 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7d3aec426d4ef7aa5adcd0ab4c8da2 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:44.200006  3839 tablet_service.cc:1511] Processing CreateTablet for tablet 65ec95afb9e240f29bd517e63249c8d2 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:44.200932  3914 tablet_service.cc:1511] Processing CreateTablet for tablet 65ec95afb9e240f29bd517e63249c8d2 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:44.197983  3838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7d3aec426d4ef7aa5adcd0ab4c8da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.201501  3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7d3aec426d4ef7aa5adcd0ab4c8da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.202819  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ec95afb9e240f29bd517e63249c8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.206187  3839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ec95afb9e240f29bd517e63249c8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.197993  3988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8564889b304f44b9b2b4ad6e5687c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.213126  3993 tablet_service.cc:1511] Processing CreateTablet for tablet 65ec95afb9e240f29bd517e63249c8d2 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:44.214489  3993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ec95afb9e240f29bd517e63249c8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.215494  3845 tablet_service.cc:1511] Processing CreateTablet for tablet 611a21088f764ac6bf8767713d911869 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:44.216816  3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611a21088f764ac6bf8767713d911869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.219148  4047 tablet_bootstrap.cc:492] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:44.219738  4047 ts_tablet_manager.cc:1403] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.206s	user 0.011s	sys 0.004s
I20260709 12:26:44.193271  4046 tablet_bootstrap.cc:492] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:44.222210  3995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7d3aec426d4ef7aa5adcd0ab4c8da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.222647  4047 raft_consensus.cc:359] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.223347  4047 raft_consensus.cc:385] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.223651  4047 raft_consensus.cc:740] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.225692  4047 consensus_queue.cc:260] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.231382  4048 tablet_bootstrap.cc:492] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:44.231979  4048 ts_tablet_manager.cc:1403] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.299s	user 0.021s	sys 0.030s
I20260709 12:26:44.233274  3918 tablet_service.cc:1511] Processing CreateTablet for tablet 611a21088f764ac6bf8767713d911869 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:44.234233  3989 tablet_service.cc:1511] Processing CreateTablet for tablet 611a21088f764ac6bf8767713d911869 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:44.234735  3918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611a21088f764ac6bf8767713d911869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.235304  4047 ts_tablet_manager.cc:1434] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:26:44.235495  3989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611a21088f764ac6bf8767713d911869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.236622  4055 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.237071  4055 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.239183  4055 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.241243  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:44.242945  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:26:44.244415  3822 leader_election.cc:343] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:44.245847  3821 leader_election.cc:343] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.246323  3821 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:44.249769  3844 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff60edb937844e9aaed043337660571 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:44.250921  4055 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.253047  3922 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff60edb937844e9aaed043337660571 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:44.253943  3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff60edb937844e9aaed043337660571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.254380  3922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff60edb937844e9aaed043337660571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.259279  4048 raft_consensus.cc:359] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.260035  4048 raft_consensus.cc:385] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.260341  4048 raft_consensus.cc:740] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.261214  4048 consensus_queue.cc:260] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.267055  4047 tablet_bootstrap.cc:492] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:44.272624  3994 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff60edb937844e9aaed043337660571 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:44.273240  4047 tablet_bootstrap.cc:654] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.273615  4046 tablet_bootstrap.cc:654] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.274039  3994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff60edb937844e9aaed043337660571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.279930  4055 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.280441  4055 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.282583  4055 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.284211  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:44.285431  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:44.286852  3822 leader_election.cc:343] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:44.287972  3821 leader_election.cc:343] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.288398  3821 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:44.290031  4055 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.289796  3843 tablet_service.cc:1511] Processing CreateTablet for tablet 6c3cd5d9caa54ebe9ef9762ebb258852 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:44.290987  4048 ts_tablet_manager.cc:1434] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:26:44.291378  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3cd5d9caa54ebe9ef9762ebb258852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.315212  3992 tablet_service.cc:1511] Processing CreateTablet for tablet 6c3cd5d9caa54ebe9ef9762ebb258852 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:44.317224  4047 tablet_bootstrap.cc:492] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:44.317732  4047 ts_tablet_manager.cc:1403] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.008s
I20260709 12:26:44.318912  3990 tablet_service.cc:1511] Processing CreateTablet for tablet 6017f50df9e3498d929adc22812d22cf (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:44.319733  3917 tablet_service.cc:1511] Processing CreateTablet for tablet 6017f50df9e3498d929adc22812d22cf (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:44.321024  3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6017f50df9e3498d929adc22812d22cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.320780  3919 tablet_service.cc:1511] Processing CreateTablet for tablet 6c3cd5d9caa54ebe9ef9762ebb258852 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:44.322129  3919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3cd5d9caa54ebe9ef9762ebb258852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.323516  4048 tablet_bootstrap.cc:492] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:44.344311  3845 tablet_service.cc:1511] Processing CreateTablet for tablet fb53ea47358c4bca95e2856114bf0412 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:44.344311  3840 tablet_service.cc:1511] Processing CreateTablet for tablet 6017f50df9e3498d929adc22812d22cf (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:44.345775  3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb53ea47358c4bca95e2856114bf0412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.346325  3840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6017f50df9e3498d929adc22812d22cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.351128  3992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3cd5d9caa54ebe9ef9762ebb258852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.356731  3990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6017f50df9e3498d929adc22812d22cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.376039  4048 tablet_bootstrap.cc:654] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.392190  4046 tablet_bootstrap.cc:492] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:44.340776  4047 raft_consensus.cc:359] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.396430  4047 raft_consensus.cc:385] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.396857  4047 raft_consensus.cc:740] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.397727  4046 ts_tablet_manager.cc:1403] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.212s	user 0.026s	sys 0.009s
I20260709 12:26:44.398703  3915 tablet_service.cc:1511] Processing CreateTablet for tablet fb53ea47358c4bca95e2856114bf0412 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:44.407102  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb53ea47358c4bca95e2856114bf0412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.407006  3838 tablet_service.cc:1511] Processing CreateTablet for tablet 95a53a95fd9f44e59c1b1615b9281948 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:44.408486  3838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a53a95fd9f44e59c1b1615b9281948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.410866  4062 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.411399  4062 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.415656  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:26:44.417235  3969 leader_election.cc:343] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.418645  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:26:44.420290  3970 leader_election.cc:343] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.420789  3970 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:44.413748  4062 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:44.421908  3991 tablet_service.cc:1511] Processing CreateTablet for tablet 95a53a95fd9f44e59c1b1615b9281948 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:44.422254  4062 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.423373  3991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a53a95fd9f44e59c1b1615b9281948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.403945  4046 raft_consensus.cc:359] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.395679  3996 tablet_service.cc:1511] Processing CreateTablet for tablet fb53ea47358c4bca95e2856114bf0412 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:44.397666  4047 consensus_queue.cc:260] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.434016  3996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb53ea47358c4bca95e2856114bf0412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.435015  4047 ts_tablet_manager.cc:1434] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.000s
I20260709 12:26:44.406061  4048 tablet_bootstrap.cc:492] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:44.435856  4048 ts_tablet_manager.cc:1403] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.138s	user 0.009s	sys 0.004s
I20260709 12:26:44.439247  3917 tablet_service.cc:1511] Processing CreateTablet for tablet 95a53a95fd9f44e59c1b1615b9281948 (DEFAULT_TABLE table=test-workload [id=d9414e0696b542ed971437326e01ed15]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:44.440871  3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a53a95fd9f44e59c1b1615b9281948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.444041  4046 raft_consensus.cc:385] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.444406  4046 raft_consensus.cc:740] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.445257  4046 consensus_queue.cc:260] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.452862  4047 tablet_bootstrap.cc:492] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:44.454805  4046 ts_tablet_manager.cc:1434] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 12:26:44.455832  4046 tablet_bootstrap.cc:492] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:44.456513  3755 catalog_manager.cc:5697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.439182  4048 raft_consensus.cc:359] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.458170  4048 raft_consensus.cc:385] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.458560  4048 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.459450  4048 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.460340  4047 tablet_bootstrap.cc:654] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.461845  4046 tablet_bootstrap.cc:654] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.462460  4048 ts_tablet_manager.cc:1434] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:26:44.463557  4048 tablet_bootstrap.cc:492] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
W20260709 12:26:44.466352  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 46078.4us
I20260709 12:26:44.468179  4046 tablet_bootstrap.cc:492] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:44.468775  4046 ts_tablet_manager.cc:1403] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.005s
I20260709 12:26:44.470117  4055 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.470873  4055 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.471958  4048 tablet_bootstrap.cc:654] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.471841  4046 raft_consensus.cc:359] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.472616  4046 raft_consensus.cc:385] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.472947  4046 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.473917  4046 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.476979  4046 ts_tablet_manager.cc:1434] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:44.478395  4046 tablet_bootstrap.cc:492] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:44.480824  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:44.481559  3932 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:44.484074  4072 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.484745  4072 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.485304  3821 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:44.488284  4072 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.494042  4055 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.496723  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:44.497380  4006 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:44.499159  4048 tablet_bootstrap.cc:492] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:44.499444  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:44.499903  4048 ts_tablet_manager.cc:1403] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.016s
I20260709 12:26:44.500128  4006 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:44.502767  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:26:44.503966  3897 consensus_peers.cc:597] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.504837  4072 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.505466  4072 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.504730  4048 raft_consensus.cc:359] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.506013  4048 raft_consensus.cc:385] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.506034  4072 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.494704  4055 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.506520  4048 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.506937  4055 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.507340  4055 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.507707  4048 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.510985  4048 ts_tablet_manager.cc:1434] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:26:44.512527  4048 tablet_bootstrap.cc:492] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
W20260709 12:26:44.514581  3897 consensus_peers.cc:597] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:44.515726  4046 tablet_bootstrap.cc:654] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.518482  4055 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.519693  4072 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.521005  4062 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.521631  4048 tablet_bootstrap.cc:654] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.521776  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:44.523494  4005 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.524115  4047 tablet_bootstrap.cc:492] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:44.524744  4047 ts_tablet_manager.cc:1403] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.072s	user 0.038s	sys 0.025s
I20260709 12:26:44.527765  4047 raft_consensus.cc:359] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.528537  4047 raft_consensus.cc:385] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.528834  4047 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.521937  4055 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.522535  4062 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:44.530252  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 45104.3us
I20260709 12:26:44.531697  4062 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:44.531761  4072 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.533708  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:44.534696  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:26:44.535233  3969 leader_election.cc:343] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.535482  3932 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.536854  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:44.537470  4006 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.540141  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:44.529505  4047 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:44.542044  3970 leader_election.cc:343] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.542366  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:44.542891  4047 ts_tablet_manager.cc:1434] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:26:44.542672  3970 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:44.544176  4047 tablet_bootstrap.cc:492] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
W20260709 12:26:44.546867  3895 leader_election.cc:343] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.540325  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:44.550344  4072 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:44.552042  4047 tablet_bootstrap.cc:654] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.552457  4062 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.552917  3932 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:44.555740  4046 tablet_bootstrap.cc:492] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:44.555536  3821 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:44.556293  4046 ts_tablet_manager.cc:1403] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.004s
I20260709 12:26:44.557852  4092 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:44.558295  3895 leader_election.cc:343] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.559882  4046 raft_consensus.cc:359] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.560962  4046 raft_consensus.cc:385] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.561398  4046 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.562686  4092 raft_consensus.cc:697] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:44.563781  4092 consensus_queue.cc:237] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.563783  4046 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.565763  4074 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:44.571916  4074 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.572526  4074 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.574697  4074 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.576371  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:44.577347  4004 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:44.577839  4046 ts_tablet_manager.cc:1434] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:26:44.579255  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:44.580283  4048 tablet_bootstrap.cc:492] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:44.580790  4048 ts_tablet_manager.cc:1403] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.019s
I20260709 12:26:44.580312  4072 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.581929  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:44.582563  4072 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.582928  4072 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.582857  3856 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:44.587568  4048 raft_consensus.cc:359] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.588410  4048 raft_consensus.cc:385] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.588865  4048 raft_consensus.cc:740] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.589757  4048 consensus_queue.cc:260] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.590757  4072 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.592797  4072 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.594000  4046 tablet_bootstrap.cc:492] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:44.594527  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:44.595425  4004 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.598282  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:44.599050  3856 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.599308  4047 tablet_bootstrap.cc:492] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:44.599776  4047 ts_tablet_manager.cc:1403] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.033s
I20260709 12:26:44.599665  4005 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:44.600741  4048 ts_tablet_manager.cc:1434] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:26:44.602603  4047 raft_consensus.cc:359] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.603296  4047 raft_consensus.cc:385] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.603547  4047 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.604204  4047 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.604759  4048 tablet_bootstrap.cc:492] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:44.610618  4072 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.611174  4072 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.612445  4048 tablet_bootstrap.cc:654] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.613534  4072 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.614655  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:44.620800  4005 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:44.621169  4047 ts_tablet_manager.cc:1434] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:26:44.622491  4047 tablet_bootstrap.cc:492] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:44.622370  3897 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:44.615085  4004 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:44.615900  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:44.623689  3854 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:44.624238  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:44.616413  4006 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:44.632892  3856 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:44.635246  4047 tablet_bootstrap.cc:654] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.618328  4046 tablet_bootstrap.cc:654] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.644426  3755 catalog_manager.cc:5697] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.645691  4103 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.646277  4103 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.646709  4103 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.650769  4104 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.651043  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:44.654057  4074 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.654686  4074 raft_consensus.cc:697] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:44.655764  4074 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.659713  4047 tablet_bootstrap.cc:492] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:44.660339  4047 ts_tablet_manager.cc:1403] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.012s
I20260709 12:26:44.663779  4047 raft_consensus.cc:359] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } }
I20260709 12:26:44.664731  4047 raft_consensus.cc:385] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.665069  4047 raft_consensus.cc:740] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.666206  4047 consensus_queue.cc:260] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } }
I20260709 12:26:44.669481  4047 ts_tablet_manager.cc:1434] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:26:44.670727  4104 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:44.671944  4104 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.671939  4047 tablet_bootstrap.cc:492] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:44.675611  4046 tablet_bootstrap.cc:492] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:44.676090  4046 ts_tablet_manager.cc:1403] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.000s
I20260709 12:26:44.678725  4046 raft_consensus.cc:359] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.679416  4046 raft_consensus.cc:385] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.679689  4046 raft_consensus.cc:740] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.680379  4046 consensus_queue.cc:260] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.685514  4047 tablet_bootstrap.cc:654] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.688060  4048 tablet_bootstrap.cc:492] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:44.688804  4048 ts_tablet_manager.cc:1403] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.084s	user 0.028s	sys 0.037s
I20260709 12:26:44.688980  4103 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.691525  4046 ts_tablet_manager.cc:1434] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:26:44.692073  4103 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.692759  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:44.693282  4046 tablet_bootstrap.cc:492] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:44.693353  4006 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.693848  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:44.694567  3856 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.695322  3755 catalog_manager.cc:5697] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.698500  4048 raft_consensus.cc:359] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.700556  4048 raft_consensus.cc:385] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.701057  4048 raft_consensus.cc:740] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.703836  4048 consensus_queue.cc:260] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.707748  4046 tablet_bootstrap.cc:654] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.701719  4006 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:44.701906  3856 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:44.711215  3895 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:44.712064  4104 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.712564  4104 raft_consensus.cc:697] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:44.713438  4104 consensus_queue.cc:237] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.714175  4048 ts_tablet_manager.cc:1434] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.002s
I20260709 12:26:44.715205  4048 tablet_bootstrap.cc:492] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:44.720925  4048 tablet_bootstrap.cc:654] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.724834  4047 tablet_bootstrap.cc:492] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:44.725317  4047 ts_tablet_manager.cc:1403] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.012s
I20260709 12:26:44.727942  4047 raft_consensus.cc:359] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.727530  3752 catalog_manager.cc:5697] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.728603  4047 raft_consensus.cc:385] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.728911  4047 raft_consensus.cc:740] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.729792  4047 consensus_queue.cc:260] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.731374  4046 tablet_bootstrap.cc:492] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:44.729559  3752 catalog_manager.cc:5697] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.732126  4046 ts_tablet_manager.cc:1403] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.002s
I20260709 12:26:44.735694  4046 raft_consensus.cc:359] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.737972  4047 ts_tablet_manager.cc:1434] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:26:44.738893  4047 tablet_bootstrap.cc:492] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:44.739147  4046 raft_consensus.cc:385] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.739655  4046 raft_consensus.cc:740] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.740566  4046 consensus_queue.cc:260] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.743721  4046 ts_tablet_manager.cc:1434] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:26:44.744401  4047 tablet_bootstrap.cc:654] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.745049  4046 tablet_bootstrap.cc:492] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:44.754369  4046 tablet_bootstrap.cc:654] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.755827  4047 tablet_bootstrap.cc:492] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:44.756212  4048 tablet_bootstrap.cc:492] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:44.756326  4047 ts_tablet_manager.cc:1403] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:26:44.757261  4048 ts_tablet_manager.cc:1403] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.013s
I20260709 12:26:44.760244  4048 raft_consensus.cc:359] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.760221  4047 raft_consensus.cc:359] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.761184  4048 raft_consensus.cc:385] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.761307  4047 raft_consensus.cc:385] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.761518  4048 raft_consensus.cc:740] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.761726  4047 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.762688  4048 consensus_queue.cc:260] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.762640  4047 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.765120  4048 ts_tablet_manager.cc:1434] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:26:44.765450  4047 ts_tablet_manager.cc:1434] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:26:44.766459  4047 tablet_bootstrap.cc:492] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:44.766459  4048 tablet_bootstrap.cc:492] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:44.767894  4046 tablet_bootstrap.cc:492] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:44.768395  4046 ts_tablet_manager.cc:1403] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.009s
I20260709 12:26:44.772403  4047 tablet_bootstrap.cc:654] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.773033  4048 tablet_bootstrap.cc:654] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.776546  4046 raft_consensus.cc:359] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.777319  4046 raft_consensus.cc:385] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.777607  4046 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.778292  4046 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.780511  4104 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.781021  4104 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.783141  4104 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.784534  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:44.786664  3897 leader_election.cc:343] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.780520  4046 ts_tablet_manager.cc:1434] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 12:26:44.790459  4046 tablet_bootstrap.cc:492] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:44.790230  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:44.792423  3856 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:44.794118  3895 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:44.795608  4104 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.796053  4104 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.796463  4104 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.798331  4046 tablet_bootstrap.cc:654] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.815948  4104 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.816890  4103 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.817595  4103 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.821736  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:44.822721  3856 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:44.824530  3895 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:44.825662  4074 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.826629  4103 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.828946  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:44.829766  4006 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:44.826042  4074 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.831948  4074 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.833703  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:44.834614  3856 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.842814  4092 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.843221  4074 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.843607  4092 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } }
I20260709 12:26:44.845381  4104 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.849382  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:44.849900  3856 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
W20260709 12:26:44.851022  3897 leader_election.cc:343] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.849382  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:44.851517  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:44.852193  3932 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:44.852843  4092 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:44.852975  3895 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:26:44.853842  3822 leader_election.cc:343] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.854645  3821 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:44.855448  4104 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.856104  4092 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.856304  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:44.856506  4092 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.856866  4092 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.856987  4074 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.857223  4104 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:44.856877  4006 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.858618  4104 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.864385  4047 tablet_bootstrap.cc:492] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:44.864260  4092 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } }
I20260709 12:26:44.864879  4046 tablet_bootstrap.cc:492] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:44.864910  4047 ts_tablet_manager.cc:1403] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.099s	user 0.034s	sys 0.038s
I20260709 12:26:44.865512  4046 ts_tablet_manager.cc:1403] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.075s	user 0.038s	sys 0.036s
I20260709 12:26:44.864606  4006 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:44.866611  4048 tablet_bootstrap.cc:492] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:44.867102  4048 ts_tablet_manager.cc:1403] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.101s	user 0.018s	sys 0.036s
I20260709 12:26:44.867045  3897 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:44.868088  4047 raft_consensus.cc:359] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.868901  4047 raft_consensus.cc:385] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.868809  4046 raft_consensus.cc:359] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.869238  4047 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.869344  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:44.869565  4046 raft_consensus.cc:385] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.869954  4046 raft_consensus.cc:740] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.870270  4074 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:44.870645  3822 leader_election.cc:343] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.871156  4074 raft_consensus.cc:697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:44.871825  4046 consensus_queue.cc:260] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.873039  4092 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:44.872960  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:44.873248  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:44.873728  3932 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.871825  4047 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.872042  4074 consensus_queue.cc:237] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.874220  4046 ts_tablet_manager.cc:1434] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:26:44.873972  3856 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.874815  4048 raft_consensus.cc:359] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.876286  4048 raft_consensus.cc:385] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.876617  4048 raft_consensus.cc:740] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.877415  4048 consensus_queue.cc:260] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.882332  4048 ts_tablet_manager.cc:1434] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:26:44.883350  4048 tablet_bootstrap.cc:492] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:44.875211  4046 tablet_bootstrap.cc:492] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:44.875743  4047 ts_tablet_manager.cc:1434] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:44.886862  4047 tablet_bootstrap.cc:492] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:44.889755  4096 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.890323  4096 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.894506  4096 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:44.895743  4004 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.896332  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:26:44.898504  3821 leader_election.cc:343] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.901916  3932 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:44.911553  4048 tablet_bootstrap.cc:654] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.912309  4046 tablet_bootstrap.cc:654] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.906543  3856 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:44.904747  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:44.909825  3821 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:44.917956  4096 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.918481  4096 raft_consensus.cc:697] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:44.919345  4096 consensus_queue.cc:237] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } }
W20260709 12:26:44.921032  3822 leader_election.cc:343] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.922626  3822 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:44.923580  4092 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.917528  3753 catalog_manager.cc:5697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.930761  4046 tablet_bootstrap.cc:492] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:44.931288  4046 ts_tablet_manager.cc:1403] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.004s
I20260709 12:26:44.939440  4046 raft_consensus.cc:359] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.940302  4046 raft_consensus.cc:385] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.940595  4046 raft_consensus.cc:740] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.941139  4046 consensus_queue.cc:260] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.942999  4046 ts_tablet_manager.cc:1434] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:26:44.944027  4046 tablet_bootstrap.cc:492] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:44.945509  4047 tablet_bootstrap.cc:654] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.951376  3753 catalog_manager.cc:5697] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.953078  3752 catalog_manager.cc:5697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.956511  4048 tablet_bootstrap.cc:492] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:44.957157  4048 ts_tablet_manager.cc:1403] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.001s
I20260709 12:26:44.962296  4046 tablet_bootstrap.cc:654] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.962443  4048 raft_consensus.cc:359] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } }
I20260709 12:26:44.963423  4048 raft_consensus.cc:385] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.963800  4048 raft_consensus.cc:740] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.964816  4048 consensus_queue.cc:260] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } }
I20260709 12:26:44.968940  4048 ts_tablet_manager.cc:1434] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 12:26:44.973004  4048 tablet_bootstrap.cc:492] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:44.975998  4046 tablet_bootstrap.cc:492] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:44.976540  4046 ts_tablet_manager.cc:1403] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.012s
I20260709 12:26:44.979053  4048 tablet_bootstrap.cc:654] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.981163  4047 tablet_bootstrap.cc:492] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:44.981719  4047 ts_tablet_manager.cc:1403] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.004s
I20260709 12:26:44.984547  4047 raft_consensus.cc:359] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.985263  4047 raft_consensus.cc:385] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.985533  4047 raft_consensus.cc:740] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.986269  4047 consensus_queue.cc:260] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.988633  4047 ts_tablet_manager.cc:1434] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:44.989099  4046 raft_consensus.cc:359] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.989846  4046 raft_consensus.cc:385] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.990150  4046 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.990501  4048 tablet_bootstrap.cc:492] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:44.990976  4048 ts_tablet_manager.cc:1403] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
I20260709 12:26:44.992879  4047 tablet_bootstrap.cc:492] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:44.993695  4048 raft_consensus.cc:359] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.993820  4046 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.994443  4048 raft_consensus.cc:385] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.994763  4048 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.995628  4048 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:44.997653  4048 ts_tablet_manager.cc:1434] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:44.998483  4046 ts_tablet_manager.cc:1434] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:26:44.998781  4048 tablet_bootstrap.cc:492] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:45.003079  4047 tablet_bootstrap.cc:654] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.004702  4048 tablet_bootstrap.cc:654] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.009328  4046 tablet_bootstrap.cc:492] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:45.015853  4048 tablet_bootstrap.cc:492] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:45.016213  4048 ts_tablet_manager.cc:1403] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:26:45.016237  4046 tablet_bootstrap.cc:654] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.018317  4096 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.018261  4048 raft_consensus.cc:359] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.018796  4048 raft_consensus.cc:385] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.018980  4048 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.019874  4092 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:45.020008  4048 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.022202  4048 ts_tablet_manager.cc:1434] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.005s
I20260709 12:26:45.022199  4046 tablet_bootstrap.cc:492] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:45.023070  4046 ts_tablet_manager.cc:1403] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:26:45.023599  4048 tablet_bootstrap.cc:492] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:45.018857  4096 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.025763  4046 raft_consensus.cc:359] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.026328  4004 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.027184  4096 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.028347  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:45.029140  4006 raft_consensus.cc:2393] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 1: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:26:45.029420  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:45.032766  4048 tablet_bootstrap.cc:654] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.033147  3821 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:45.036290  4096 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.026417  4046 raft_consensus.cc:385] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.038039  4046 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.039268  4046 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.041417  4046 ts_tablet_manager.cc:1434] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:26:45.047158  4092 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.057758  4138 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.058688  4138 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.067777  4046 tablet_bootstrap.cc:492] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:45.069136  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:45.070544  4062 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.070724  4004 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:45.071038  4062 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.073269  4062 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:45.074913  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.075598  3856 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:45.076668  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:45.076826  3969 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:45.076903  4074 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.077319  3931 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:45.077584  4074 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.078150  4062 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.078594  4062 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.079419  4062 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.081440  4048 tablet_bootstrap.cc:492] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:45.081964  4048 ts_tablet_manager.cc:1403] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.004s
I20260709 12:26:45.082036  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:45.081339  4074 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:26:45.083379  3897 leader_election.cc:343] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.083910  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:45.083920  3821 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:45.082417  4138 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.084923  4074 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.085727  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.086527  3856 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:45.086424  4074 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.087738  3895 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:45.084574  3932 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:45.088537  4104 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.088919  4104 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.089268  4104 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.089823  4138 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.092123  4062 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.094118  4138 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.090029  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.094749  4104 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.096444  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:45.097049  3854 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.096951  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:45.098603  3897 leader_election.cc:343] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:45.099227  3895 leader_election.cc:343] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.099805  3895 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:45.100800  4138 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.089294  4074 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.085704  4046 tablet_bootstrap.cc:654] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.100821  4103 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.103850  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:45.084780  4048 raft_consensus.cc:359] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.104722  3856 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.104918  4048 raft_consensus.cc:385] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.106603  4048 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
W20260709 12:26:45.107456  3802 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:45.108090  4048 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.111814  3854 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
W20260709 12:26:45.114828  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 52487.7us
I20260709 12:26:45.116259  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:45.118124  4103 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:45.120349  4096 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.121529  3969 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:45.122644  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:45.123565  4062 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:26:45.125566  3897 leader_election.cc:343] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.132840  4138 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.139669  4062 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.140173  4062 raft_consensus.cc:697] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:26:45.141196  4062 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.142900  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:45.143476  3931 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.144913  4138 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.148152  4046 tablet_bootstrap.cc:492] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:45.148631  4046 ts_tablet_manager.cc:1403] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.000s
I20260709 12:26:45.149183  4047 tablet_bootstrap.cc:492] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:45.149811  4047 ts_tablet_manager.cc:1403] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.157s	user 0.025s	sys 0.039s
I20260709 12:26:45.152516  4047 raft_consensus.cc:359] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.153239  4047 raft_consensus.cc:385] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.153551  4047 raft_consensus.cc:740] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.154387  4047 consensus_queue.cc:260] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.137398  4104 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.138574  3932 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.155201  4046 raft_consensus.cc:359] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.155999  4046 raft_consensus.cc:385] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.156265  4046 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.156381  4048 ts_tablet_manager.cc:1434] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.074s	user 0.003s	sys 0.011s
I20260709 12:26:45.157371  4048 tablet_bootstrap.cc:492] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:45.158057  4046 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.160073  4046 ts_tablet_manager.cc:1434] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:26:45.154590  4103 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.162436  3931 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:45.162350  4074 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.162802  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:45.164011  4048 tablet_bootstrap.cc:654] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.164356  3932 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:45.165068  4004 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.169502  4046 tablet_bootstrap.cc:492] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:45.172086  4047 ts_tablet_manager.cc:1434] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:26:45.173301  4047 tablet_bootstrap.cc:492] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:45.175207  4048 tablet_bootstrap.cc:492] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:45.175671  4048 ts_tablet_manager.cc:1403] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:26:45.175971  4046 tablet_bootstrap.cc:654] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.178472  4048 raft_consensus.cc:359] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.179171  4048 raft_consensus.cc:385] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.179448  4048 raft_consensus.cc:740] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.179697  4047 tablet_bootstrap.cc:654] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.180140  4048 consensus_queue.cc:260] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.182200  4004 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:45.137070  3856 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:45.182703  4048 ts_tablet_manager.cc:1434] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:26:45.183974  4048 tablet_bootstrap.cc:492] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:45.186834  3822 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:45.188577  4138 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.189244  4138 raft_consensus.cc:697] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:45.190464  4096 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.190358  4138 consensus_queue.cc:237] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.191150  4096 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.195529  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:45.196446  4004 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:45.198504  3822 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:45.198058  3751 catalog_manager.cc:5697] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.199800  4140 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.200358  4140 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.200809  4140 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.206163  4096 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.212709  4048 tablet_bootstrap.cc:654] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.218484  4047 tablet_bootstrap.cc:492] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:45.219022  4047 ts_tablet_manager.cc:1403] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.025s
I20260709 12:26:45.218675  4140 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.237449  3895 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:45.225039  4046 tablet_bootstrap.cc:492] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:45.235421  4142 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.238720  4046 ts_tablet_manager.cc:1403] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.069s	user 0.033s	sys 0.019s
I20260709 12:26:45.238580  4142 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.241263  4142 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:45.235898  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:45.242519  4104 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.243204  4104 raft_consensus.cc:697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:45.244304  4104 consensus_queue.cc:237] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.242398  4046 raft_consensus.cc:359] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.245013  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:45.232573  4074 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.245602  4006 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.244779  4140 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.245360  4046 raft_consensus.cc:385] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.247128  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:45.247258  4046 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
W20260709 12:26:45.248479  3970 leader_election.cc:343] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.248409  4046 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.251551  4046 ts_tablet_manager.cc:1434] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:45.255429  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.256523  4046 tablet_bootstrap.cc:492] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:45.255012  4074 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.259814  4074 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.262765  4074 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.235571  4047 raft_consensus.cc:359] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.263406  4047 raft_consensus.cc:385] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.265478  4142 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.265772  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:45.266857  3969 leader_election.cc:343] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.267095  4047 raft_consensus.cc:740] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.267365  3969 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:45.267383  4142 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.268288  4062 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.268496  4003 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:45.268306  4047 consensus_queue.cc:260] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.272197  4047 ts_tablet_manager.cc:1434] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 12:26:45.273397  4047 tablet_bootstrap.cc:492] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:45.273610  4142 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:45.274865  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:45.275502  3932 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:45.276604  3970 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:45.277727  4142 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.278132  4142 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.278501  4142 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.280041  4046 tablet_bootstrap.cc:654] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.286403  4047 tablet_bootstrap.cc:654] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.292330  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.293186  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:45.295325  3856 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:45.296926  4074 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:45.298897  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:45.300004  4103 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.300761  4006 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:45.306175  3822 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:45.307272  4140 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.307823  4140 raft_consensus.cc:697] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:45.307639  4047 tablet_bootstrap.cc:492] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:45.308650  4047 ts_tablet_manager.cc:1403] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.004s
I20260709 12:26:45.300765  4103 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.308722  4140 consensus_queue.cc:237] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.309428  4074 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:26:45.316610  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.317282  3856 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:45.320616  4048 tablet_bootstrap.cc:492] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:45.321295  4048 ts_tablet_manager.cc:1403] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.138s	user 0.039s	sys 0.047s
W20260709 12:26:45.326056  3821 leader_election.cc:343] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.326478  4046 tablet_bootstrap.cc:492] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:45.327193  4046 ts_tablet_manager.cc:1403] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.007s
I20260709 12:26:45.330470  4048 raft_consensus.cc:359] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.360319  4048 raft_consensus.cc:385] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.360658  4048 raft_consensus.cc:740] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.363010  4046 raft_consensus.cc:359] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.363742  4046 raft_consensus.cc:385] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.364003  4046 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.364647  4046 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.351198  4142 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.366729  4046 ts_tablet_manager.cc:1434] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:26:45.361372  4048 consensus_queue.cc:260] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.368284  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:45.368861  3856 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:45.327379  3821 leader_election.cc:343] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.318569  4103 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:45.371006  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 67672.8us
I20260709 12:26:45.373317  4048 ts_tablet_manager.cc:1434] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 12:26:45.330106  4047 raft_consensus.cc:359] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.373821  4047 raft_consensus.cc:385] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.374773  4047 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.367594  4046 tablet_bootstrap.cc:492] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:45.375665  4047 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.376850  3856 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:45.378221  3969 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:45.379282  4062 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.374337  4048 tablet_bootstrap.cc:492] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:45.379818  4062 raft_consensus.cc:697] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:26:45.380913  4047 ts_tablet_manager.cc:1434] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.072s	user 0.013s	sys 0.002s
W20260709 12:26:45.371049  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 43706.8us
I20260709 12:26:45.388918  4103 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.380752  4062 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.392481  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:45.394378  4103 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.374239  4074 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.399063  4074 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.401155  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:45.401434  4074 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.382616  3751 catalog_manager.cc:5697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.402309  3855 raft_consensus.cc:2393] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 1: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:26:45.384725  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:45.403019  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:45.403654  3932 raft_consensus.cc:2393] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 1: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:26:45.385445  4142 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:26:45.404642  3897 leader_election.cc:343] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.387970  4046 tablet_bootstrap.cc:654] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.410290  4074 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.421589  4103 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:45.424675  3895 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:45.424319  3755 catalog_manager.cc:5697] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.388051  4048 tablet_bootstrap.cc:654] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.426259  4005 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.426532  4103 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.429141  4047 tablet_bootstrap.cc:492] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:45.436777  4046 tablet_bootstrap.cc:492] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:45.438025  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.438741  3856 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:45.441488  4046 ts_tablet_manager.cc:1403] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.008s
I20260709 12:26:45.441392  3895 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:45.442353  4104 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.442749  4104 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.443113  4104 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.447722  4046 raft_consensus.cc:359] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.448561  4046 raft_consensus.cc:385] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.448907  4046 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.449913  4062 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.449654  4046 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.450443  4062 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } }
I20260709 12:26:45.451960  4046 ts_tablet_manager.cc:1434] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:26:45.452821  4062 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:26:45.454272  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.455636  4048 tablet_bootstrap.cc:492] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:45.456202  4048 ts_tablet_manager.cc:1403] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.001s
I20260709 12:26:45.456369  4104 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.458424  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:45.459501  3932 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 1: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:26:45.461750  4046 tablet_bootstrap.cc:492] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:45.461980  4048 raft_consensus.cc:359] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.462865  4048 raft_consensus.cc:385] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.463240  4048 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.464063  4048 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.464995  3969 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:45.465859  4062 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.466713  4048 ts_tablet_manager.cc:1434] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:45.466550  4103 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.467250  4142 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.467792  4048 tablet_bootstrap.cc:492] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:45.467864  4103 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.467758  4142 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.468426  4103 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.470150  4142 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:45.558475  4047 tablet_bootstrap.cc:654] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:45.559314  4166 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:26:45.477362  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:45.517802  4138 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20260709 12:26:45.513422  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.478132  4103 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.551923  4142 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.565604  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.565860  3970 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:45.567703  4142 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.570017  4142 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:26:45.570941  3895 leader_election.cc:343] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.562036  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:45.572249  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.574795  3753 catalog_manager.cc:5697] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:45.576467  3897 leader_election.cc:343] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.576915  3897 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:45.577006  3753 catalog_manager.cc:5697] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.578230  4074 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.574311  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:26:45.578914  3969 leader_election.cc:343] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.586433  4047 tablet_bootstrap.cc:492] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:45.587172  4047 ts_tablet_manager.cc:1403] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.158s	user 0.011s	sys 0.005s
I20260709 12:26:45.588501  4104 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.571460  4062 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.583545  4048 tablet_bootstrap.cc:654] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.584427  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:45.585186  3856 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.599201  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:45.608484  4055 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.613566  4074 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.614634  3932 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:45.580216  4103 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:26:45.620536  3970 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:45.623288  4062 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.623711  4062 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.624814  4062 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.614142  4074 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.633946  4074 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.635568  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:45.636266  3897 leader_election.cc:343] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:45.637519  3897 leader_election.cc:343] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.641656  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.642287  4142 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.644126  4055 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.644640  4055 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.646256  3856 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:45.646760  4055 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.644878  4046 tablet_bootstrap.cc:654] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.632972  4062 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:45.648468  3895 leader_election.cc:343] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.665321  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:45.668263  4047 raft_consensus.cc:359] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.669111  4047 raft_consensus.cc:385] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.668973  4144 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:45.669507  4047 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.670331  4047 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.672178  4047 ts_tablet_manager.cc:1434] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.002s
I20260709 12:26:45.673094  4047 tablet_bootstrap.cc:492] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:45.668263  3895 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:26:45.694747  3821 leader_election.cc:343] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.668049  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:45.696033  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 48152.8us
W20260709 12:26:45.703575  3822 leader_election.cc:343] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.709033  4055 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:26:45.703372  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:45.711668  3822 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:45.713388  4062 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:45.703236  3895 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:45.716082  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:45.716650  3930 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:45.717058  3969 leader_election.cc:343] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.703293  4144 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.703364  4103 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.714978  4055 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.724277  4047 tablet_bootstrap.cc:654] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.728791  3930 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:45.729045  4161 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.742411  4048 tablet_bootstrap.cc:492] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:45.742936  4048 ts_tablet_manager.cc:1403] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.275s	user 0.021s	sys 0.008s
I20260709 12:26:45.719878  4144 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.746582  4047 tablet_bootstrap.cc:492] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:45.747015  4047 ts_tablet_manager.cc:1403] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.006s
I20260709 12:26:45.749704  4144 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:45.752476  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.753413  3856 raft_consensus.cc:2393] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 1: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:26:45.738680  4161 raft_consensus.cc:697] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:45.755775  4161 consensus_queue.cc:237] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.758776  4096 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:45.760921  3970 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:45.765655  4178 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.766723  4178 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:26:45.775378  4004 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.770515  4142 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:26:45.788587  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:26:45.794992  3821 consensus_peers.cc:597] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:45.859187  4074 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.859879  4074 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.862522  4074 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.865149  4048 raft_consensus.cc:359] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.866110  4048 raft_consensus.cc:385] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.866310  4048 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.866919  4048 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.868014  4048 ts_tablet_manager.cc:1434] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.000s
I20260709 12:26:45.868706  4048 tablet_bootstrap.cc:492] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:45.869179  4142 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.869637  4142 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.871690  4142 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:45.873764  4048 tablet_bootstrap.cc:654] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.874306  4047 raft_consensus.cc:359] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.874881  4047 raft_consensus.cc:385] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.875202  4047 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.875862  4047 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.876430  4142 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:45.880045  3970 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:45.881668  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.882844  4047 ts_tablet_manager.cc:1434] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.135s	user 0.007s	sys 0.002s
I20260709 12:26:45.883945  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:26:45.884004  3895 leader_election.cc:343] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.769625  4178 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.884683  3855 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:45.884856  4047 tablet_bootstrap.cc:492] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:45.885751  4142 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.886381  3969 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:45.888494  4144 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.888919  4144 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.889110  4046 tablet_bootstrap.cc:492] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:45.889394  4144 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.889639  4046 ts_tablet_manager.cc:1403] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.428s	user 0.031s	sys 0.037s
I20260709 12:26:45.892642  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:45.895637  4142 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.896011  4046 raft_consensus.cc:359] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.896667  4046 raft_consensus.cc:385] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.896946  4046 raft_consensus.cc:740] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.893352  4004 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:45.881486  4161 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.901644  3897 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:45.901362  4046 consensus_queue.cc:260] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.904978  4144 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.907373  4074 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:45.908473  4103 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.908869  4103 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.909192  4103 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.910048  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:45.916533  4046 ts_tablet_manager.cc:1434] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.001s
I20260709 12:26:45.918392  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:26:45.919986  3970 leader_election.cc:343] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.922327  4103 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:45.925567  3970 leader_election.cc:343] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.926963  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:45.930326  4046 tablet_bootstrap.cc:492] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:45.914204  4144 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:26:45.928751  3895 leader_election.cc:343] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.931619  4160 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.932154  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:45.932219  4160 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.934144  3855 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.942303  4138 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.956300  4048 tablet_bootstrap.cc:492] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:45.957275  4048 ts_tablet_manager.cc:1403] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.089s	user 0.021s	sys 0.003s
I20260709 12:26:45.960814  3855 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:45.964133  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:45.966138  3969 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:26:45.968932  3753 catalog_manager.cc:5697] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.972277  4046 tablet_bootstrap.cc:654] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.969746  4160 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.984529  4103 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:45.967962  4048 raft_consensus.cc:359] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.985966  4048 raft_consensus.cc:385] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.986433  4048 raft_consensus.cc:740] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.974349  4142 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.993505  4142 raft_consensus.cc:697] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:26:45.994468  4142 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:45.992720  4047 tablet_bootstrap.cc:654] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.002182  4048 consensus_queue.cc:260] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.006832  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:46.006227  3752 catalog_manager.cc:5697] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.015278  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:46.015805  4003 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.021239  4048 ts_tablet_manager.cc:1434] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.003s
I20260709 12:26:46.020665  3897 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:46.034811  4161 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.058131  4048 tablet_bootstrap.cc:492] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:46.064803  4046 tablet_bootstrap.cc:492] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:46.065313  4046 ts_tablet_manager.cc:1403] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.148s	user 0.024s	sys 0.021s
I20260709 12:26:46.065979  4003 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:46.068889  3897 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:46.070577  4160 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.071151  4160 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:46.072103  4160 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.077581  4096 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.078115  4096 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.079146  4046 raft_consensus.cc:359] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.079782  4046 raft_consensus.cc:385] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.080051  4046 raft_consensus.cc:740] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.080161  4096 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.080750  4046 consensus_queue.cc:260] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.081216  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:46.081955  3932 raft_consensus.cc:2393] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 1: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:26:46.082901  4046 ts_tablet_manager.cc:1434] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:26:46.083798  4046 tablet_bootstrap.cc:492] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:46.085448  3753 catalog_manager.cc:5697] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.087318  4048 tablet_bootstrap.cc:654] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.088212  4047 tablet_bootstrap.cc:492] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:46.088814  4047 ts_tablet_manager.cc:1403] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.205s	user 0.009s	sys 0.011s
I20260709 12:26:46.091398  4047 raft_consensus.cc:359] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.092037  4047 raft_consensus.cc:385] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.092303  4047 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.092908  4047 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.095038  4046 tablet_bootstrap.cc:654] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.095268  4047 ts_tablet_manager.cc:1434] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:46.096118  4047 tablet_bootstrap.cc:492] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:46.099937  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:46.099896  3755 catalog_manager.cc:5697] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.104789  3822 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:46.105427  4047 tablet_bootstrap.cc:654] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.106066  4055 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.108071  4046 tablet_bootstrap.cc:492] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:46.108525  4046 ts_tablet_manager.cc:1403] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 12:26:46.114032  4046 raft_consensus.cc:359] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.116715  4046 raft_consensus.cc:385] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.116971  4046 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.117535  4046 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.120312  4046 ts_tablet_manager.cc:1434] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:26:46.121521  4046 tablet_bootstrap.cc:492] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:46.124727  4055 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.134735  4046 tablet_bootstrap.cc:654] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.146865  4046 tablet_bootstrap.cc:492] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:46.147360  4046 ts_tablet_manager.cc:1403] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.011s
I20260709 12:26:46.150121  4046 raft_consensus.cc:359] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.151674  4046 raft_consensus.cc:385] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.151958  4046 raft_consensus.cc:740] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.152653  4046 consensus_queue.cc:260] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.155009  4046 ts_tablet_manager.cc:1434] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:46.155948  4046 tablet_bootstrap.cc:492] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:46.158207  4048 tablet_bootstrap.cc:492] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:46.158655  4048 ts_tablet_manager.cc:1403] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.137s	user 0.036s	sys 0.011s
I20260709 12:26:46.161247  4048 raft_consensus.cc:359] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.161893  4048 raft_consensus.cc:385] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.162168  4048 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.162798  4048 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.163484  4191 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.164032  4191 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.165588  4048 ts_tablet_manager.cc:1434] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:46.166225  4191 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:46.167728  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:46.173197  4046 tablet_bootstrap.cc:654] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.173648  4048 tablet_bootstrap.cc:492] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
W20260709 12:26:46.172602  3802 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:46.167728  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:46.174297  3855 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:46.175638  3969 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:46.173528  3932 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:46.176491  4191 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.176860  4191 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.177229  4191 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.177856  4047 tablet_bootstrap.cc:492] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:46.178368  4047 ts_tablet_manager.cc:1403] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.082s	user 0.018s	sys 0.043s
I20260709 12:26:46.179944  4048 tablet_bootstrap.cc:654] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.181047  4047 raft_consensus.cc:359] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.181734  4047 raft_consensus.cc:385] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.182011  4047 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.182786  4047 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.183821  4191 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.184918  4047 ts_tablet_manager.cc:1434] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:46.185963  4047 tablet_bootstrap.cc:492] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:46.187480  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:46.188162  3855 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.188446  4191 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:46.191088  4048 tablet_bootstrap.cc:492] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:46.191519  4048 ts_tablet_manager.cc:1403] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.002s
I20260709 12:26:46.191346  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:46.191987  4047 tablet_bootstrap.cc:654] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.192158  3932 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.194139  4048 raft_consensus.cc:359] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.194886  4048 raft_consensus.cc:385] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.195181  4048 raft_consensus.cc:740] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.200695  4048 consensus_queue.cc:260] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.202731  3932 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:46.203001  4048 ts_tablet_manager.cc:1434] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:26:46.203473  4047 tablet_bootstrap.cc:492] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:46.203903  4047 ts_tablet_manager.cc:1403] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:26:46.203984  3970 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:46.204913  4142 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.205356  4142 raft_consensus.cc:697] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:26:46.206185  4142 consensus_queue.cc:237] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.206569  4047 raft_consensus.cc:359] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.207214  4047 raft_consensus.cc:385] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.207491  4047 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.208150  4047 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.209096  3855 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:46.203981  4048 tablet_bootstrap.cc:492] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:46.212884  4047 ts_tablet_manager.cc:1434] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:26:46.213788  4047 tablet_bootstrap.cc:492] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:46.222569  4047 tablet_bootstrap.cc:654] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.225512  4046 tablet_bootstrap.cc:492] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:46.226075  4046 ts_tablet_manager.cc:1403] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.070s	user 0.007s	sys 0.011s
I20260709 12:26:46.228664  4048 tablet_bootstrap.cc:654] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.229642  4046 raft_consensus.cc:359] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.230626  4046 raft_consensus.cc:385] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.230970  4046 raft_consensus.cc:740] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.231974  4046 consensus_queue.cc:260] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.227613  3751 catalog_manager.cc:5697] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.246313  4046 ts_tablet_manager.cc:1434] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 12:26:46.250398  4047 tablet_bootstrap.cc:492] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:46.250952  4047 ts_tablet_manager.cc:1403] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.037s	user 0.024s	sys 0.008s
I20260709 12:26:46.251358  4048 tablet_bootstrap.cc:492] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:46.251812  4048 ts_tablet_manager.cc:1403] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.013s
I20260709 12:26:46.253715  4047 raft_consensus.cc:359] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.254510  4047 raft_consensus.cc:385] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.254343  4048 raft_consensus.cc:359] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.254858  4047 raft_consensus.cc:740] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.255066  4048 raft_consensus.cc:385] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.255378  4048 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.255664  4046 tablet_bootstrap.cc:492] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:46.255999  4048 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.255962  4047 consensus_queue.cc:260] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.258188  4048 ts_tablet_manager.cc:1434] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:26:46.259078  4048 tablet_bootstrap.cc:492] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:46.264736  4047 ts_tablet_manager.cc:1434] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:26:46.264999  4048 tablet_bootstrap.cc:654] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.265707  4047 tablet_bootstrap.cc:492] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:46.271709  4047 tablet_bootstrap.cc:654] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.281947  4138 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.282516  4138 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.284762  4138 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.286289  4046 tablet_bootstrap.cc:654] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.289938  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:46.290535  3929 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.290699  3932 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:46.292240  4048 tablet_bootstrap.cc:492] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:46.292171  3821 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:46.292804  4048 ts_tablet_manager.cc:1403] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.034s	user 0.026s	sys 0.005s
I20260709 12:26:46.294152  4138 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.294800  4138 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.295303  4138 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.295652  4048 raft_consensus.cc:359] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.295861  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:46.296351  4048 raft_consensus.cc:385] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.296653  4048 raft_consensus.cc:740] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.297928  4047 tablet_bootstrap.cc:492] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:46.298424  4047 ts_tablet_manager.cc:1403] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.006s
I20260709 12:26:46.301293  4160 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.301668  4047 raft_consensus.cc:359] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.301824  4160 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.297344  4048 consensus_queue.cc:260] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.302430  4047 raft_consensus.cc:385] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.302814  4047 raft_consensus.cc:740] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.303485  4003 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:46.304158  4048 ts_tablet_manager.cc:1434] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:26:46.303661  4047 consensus_queue.cc:260] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.305116  4048 tablet_bootstrap.cc:492] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:46.306382  4047 ts_tablet_manager.cc:1434] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:46.307730  4046 tablet_bootstrap.cc:492] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:46.308204  4046 ts_tablet_manager.cc:1403] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.005s
I20260709 12:26:46.308531  4160 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.311615  4046 raft_consensus.cc:359] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.312285  4046 raft_consensus.cc:385] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.312633  4046 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.312526  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:46.313036  4047 tablet_bootstrap.cc:492] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:46.313789  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:46.314621  3855 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 1: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:26:46.313385  4046 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.311947  4138 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.319334  4046 ts_tablet_manager.cc:1434] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:26:46.319979  4138 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.321305  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:46.321710  3895 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:46.322304  4003 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.324110  4047 tablet_bootstrap.cc:654] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.326608  4103 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.327395  4048 tablet_bootstrap.cc:654] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.333146  4046 tablet_bootstrap.cc:492] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:46.333927  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:46.337524  3932 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.341192  4103 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.342988  4191 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.344362  4006 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.345152  4160 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.349705  4046 tablet_bootstrap.cc:654] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.350773  4160 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.353375  4160 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.362736  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:46.359325  4003 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
W20260709 12:26:46.368734  3895 leader_election.cc:343] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.368093  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:46.369918  4047 tablet_bootstrap.cc:492] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:46.370384  4047 ts_tablet_manager.cc:1403] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.001s
I20260709 12:26:46.373621  3822 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:26:46.374588  3897 leader_election.cc:343] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.375049  3897 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:46.374416  4103 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.375223  4138 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.375903  4161 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.375931  4138 raft_consensus.cc:697] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:46.378916  4047 raft_consensus.cc:359] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.379570  4047 raft_consensus.cc:385] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.378521  4138 consensus_queue.cc:237] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.371537  4160 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.379825  4047 raft_consensus.cc:740] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.382659  3932 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:46.382246  4047 consensus_queue.cc:260] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.400827  4047 ts_tablet_manager.cc:1434] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:26:46.401799  4047 tablet_bootstrap.cc:492] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:46.410936  4178 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.413162  4046 tablet_bootstrap.cc:492] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:46.413695  4046 ts_tablet_manager.cc:1403] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.016s
I20260709 12:26:46.414113  4047 tablet_bootstrap.cc:654] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.415817  4046 raft_consensus.cc:359] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.416348  4046 raft_consensus.cc:385] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.416602  4046 raft_consensus.cc:740] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.417207  4046 consensus_queue.cc:260] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.422062  4046 ts_tablet_manager.cc:1434] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 12:26:46.423168  4046 tablet_bootstrap.cc:492] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:46.436954  4178 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.437683  4138 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.438627  4046 tablet_bootstrap.cc:654] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.439951  4048 tablet_bootstrap.cc:492] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:46.440636  4048 ts_tablet_manager.cc:1403] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.011s
I20260709 12:26:46.445358  4048 raft_consensus.cc:359] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.446130  4048 raft_consensus.cc:385] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.446482  4048 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.447221  4048 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.438280  4138 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.443311  3752 catalog_manager.cc:5697] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.450529  4048 ts_tablet_manager.cc:1434] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:46.462288  4048 tablet_bootstrap.cc:492] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:46.483206  4138 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.484371  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:46.485121  3929 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:46.487746  3821 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:46.488049  4047 tablet_bootstrap.cc:492] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:46.488606  4047 ts_tablet_manager.cc:1403] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.008s
I20260709 12:26:46.488756  4055 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.489179  4055 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.489557  4055 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.491529  4047 raft_consensus.cc:359] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.492268  4047 raft_consensus.cc:385] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.492554  4047 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.494285  4047 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.495936  4047 ts_tablet_manager.cc:1434] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:46.496820  4047 tablet_bootstrap.cc:492] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:46.485613  4048 tablet_bootstrap.cc:654] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.500759  4096 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.501302  4096 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.501685  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:46.503561  4096 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:26:46.510398  3822 leader_election.cc:343] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.514853  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:46.515612  3932 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:46.516964  3821 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:46.518229  4138 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.518462  4055 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.518792  4138 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.519480  4138 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.520852  4055 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.513024  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:46.527215  4191 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.528290  4191 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.530484  4191 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:46.531111  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:46.531766  3853 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:46.533365  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:46.534209  4142 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.534560  4142 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.534869  4142 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.526504  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:46.535851  3929 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.541250  4062 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:46.541922  3822 leader_election.cc:343] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.542711  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:46.542307  3929 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:46.544204  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:46.544917  3821 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:46.545930  3932 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:46.550060  4096 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.550562  4096 raft_consensus.cc:697] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:46.551347  4096 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.553292  4047 tablet_bootstrap.cc:654] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:46.553808  3822 leader_election.cc:343] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.558525  4046 tablet_bootstrap.cc:492] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:46.559015  4046 ts_tablet_manager.cc:1403] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.136s	user 0.033s	sys 0.019s
I20260709 12:26:46.543282  4142 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.544888  4138 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.568863  4142 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:46.569788  3853 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.570189  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:46.570788  3932 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.575033  4138 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.575546  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:46.575875  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:46.576208  3856 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.576422  3931 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.579685  4046 raft_consensus.cc:359] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.580432  4046 raft_consensus.cc:385] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.580801  4046 raft_consensus.cc:740] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.579887  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:46.581658  4046 consensus_queue.cc:260] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.584146  4046 ts_tablet_manager.cc:1434] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:26:46.585103  4046 tablet_bootstrap.cc:492] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
W20260709 12:26:46.590045  3822 leader_election.cc:343] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.593437  4160 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.597424  4046 tablet_bootstrap.cc:654] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.600637  3931 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:46.601964  3932 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:46.602169  4103 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.603777  3821 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:46.604310  4048 tablet_bootstrap.cc:492] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:46.604737  4048 ts_tablet_manager.cc:1403] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.143s	user 0.020s	sys 0.010s
I20260709 12:26:46.607862  4048 raft_consensus.cc:359] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.608486  3970 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:46.609369  4142 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.609867  4142 raft_consensus.cc:697] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:26:46.610538  4140 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.610925  4046 tablet_bootstrap.cc:492] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:46.611042  4140 raft_consensus.cc:697] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:46.610796  4142 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.612299  3856 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:46.611941  4140 consensus_queue.cc:237] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.608546  4048 raft_consensus.cc:385] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.614705  4048 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.615491  4048 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.618183  4048 ts_tablet_manager.cc:1434] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:26:46.619355  4048 tablet_bootstrap.cc:492] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:46.621958  3751 catalog_manager.cc:5697] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.624930  4138 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.625551  4138 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.627653  4191 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.628150  4191 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.628513  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:46.629257  3931 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:46.630623  3821 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:46.631489  4055 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.631870  4055 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.632202  4055 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.632793  4191 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:46.633440  4062 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.634023  4048 tablet_bootstrap.cc:654] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.638142  4047 tablet_bootstrap.cc:492] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:46.638091  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:46.638823  4047 ts_tablet_manager.cc:1403] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.142s	user 0.017s	sys 0.003s
I20260709 12:26:46.639007  3856 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:46.640122  4055 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.641754  4047 raft_consensus.cc:359] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.642481  4047 raft_consensus.cc:385] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.642769  4047 raft_consensus.cc:740] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.643419  4047 consensus_queue.cc:260] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.644147  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:46.644928  4004 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.645048  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:46.645663  3932 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.644264  3969 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:46.652366  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:46.653050  3929 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:46.660494  4142 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.662318  3753 catalog_manager.cc:5697] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.668993  4231 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.669533  4231 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.672782  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:46.660940  4142 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.675498  4142 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.683949  3932 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:46.684458  4004 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:46.685491  4191 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.685902  3822 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:46.686031  4191 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.688535  4191 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:46.690943  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:46.650007  4055 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.685040  4231 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.691937  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:46.692731  4003 raft_consensus.cc:2376] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1. Re-sending same reply.
I20260709 12:26:46.694335  4047 ts_tablet_manager.cc:1434] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.055s	user 0.017s	sys 0.009s
I20260709 12:26:46.695297  4047 tablet_bootstrap.cc:492] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:46.703295  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:46.704176  3929 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:46.611416  4046 ts_tablet_manager.cc:1403] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.002s
I20260709 12:26:46.691490  4232 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.709159  4048 tablet_bootstrap.cc:492] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:46.710129  4048 ts_tablet_manager.cc:1403] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.091s	user 0.002s	sys 0.034s
I20260709 12:26:46.692230  4138 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.692590  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:46.714397  3931 raft_consensus.cc:2393] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 1: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:26:46.712605  4232 raft_consensus.cc:697] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:46.715993  3970 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:46.717684  4191 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.718350  3821 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:46.716111  4232 consensus_queue.cc:237] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.719626  4096 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.725507  4096 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.725912  4096 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.726537  4046 raft_consensus.cc:359] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.727283  4046 raft_consensus.cc:385] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.727586  4046 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.727897  3755 catalog_manager.cc:5697] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.730894  4048 raft_consensus.cc:359] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.731565  4048 raft_consensus.cc:385] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.732028  4048 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.731551  4046 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.719995  4047 tablet_bootstrap.cc:654] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.724010  4191 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.732502  4160 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.733178  4160 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.732554  4096 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.738345  4191 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.741623  4160 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.742326  4142 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.732661  4048 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.749357  4048 ts_tablet_manager.cc:1434] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 12:26:46.745373  4006 raft_consensus.cc:2393] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 1: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:26:46.757807  4046 ts_tablet_manager.cc:1434] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.007s
I20260709 12:26:46.759732  4046 tablet_bootstrap.cc:492] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:46.755249  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:46.756807  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:46.769907  4048 tablet_bootstrap.cc:492] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:46.781194  4096 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:26:46.782009  3895 leader_election.cc:343] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.778790  4160 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:46.783160  3897 leader_election.cc:343] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.783452  4160 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.784230  4047 tablet_bootstrap.cc:492] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:46.784075  3897 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:46.787657  4074 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.788142  4160 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.788053  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:46.789099  4003 raft_consensus.cc:2393] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 1: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:26:46.789405  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:46.789520  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:46.790310  3853 raft_consensus.cc:2393] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 1: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:26:46.868985  4047 ts_tablet_manager.cc:1403] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.174s	user 0.010s	sys 0.015s
W20260709 12:26:46.872277  3897 leader_election.cc:343] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.875058  4047 raft_consensus.cc:359] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.868888  4142 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:46.875804  4047 raft_consensus.cc:385] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.876134  4047 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.879371  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:46.880194  3931 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.936829  4096 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.938302  4096 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.941497  4096 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.900482  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:46.941777  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:46.942413  3932 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:46.942770  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:46.890303  3931 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:46.885440  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:46.944232  3929 raft_consensus.cc:2393] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 1: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:26:46.944602  3970 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:46.937575  4046 tablet_bootstrap.cc:654] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.945699  4142 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.946281  4047 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.947554  4142 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:26:46.946381  3753 catalog_manager.cc:5697] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.949676  4096 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.872633  4048 tablet_bootstrap.cc:654] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:46.950662  3822 leader_election.cc:343] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.953938  4047 ts_tablet_manager.cc:1434] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.004s
I20260709 12:26:46.954885  4047 tablet_bootstrap.cc:492] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:46.948832  4142 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.942413  3856 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:46.967718  3821 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:46.973382  4047 tablet_bootstrap.cc:654] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.977386  4096 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.977866  4096 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.978359  4096 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.978771  4046 tablet_bootstrap.cc:492] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:46.979224  3821 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:46.979229  4046 ts_tablet_manager.cc:1403] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.220s	user 0.023s	sys 0.015s
I20260709 12:26:46.985628  4046 raft_consensus.cc:359] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.989439  4047 tablet_bootstrap.cc:492] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:46.989991  4047 ts_tablet_manager.cc:1403] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.001s
I20260709 12:26:46.989499  4046 raft_consensus.cc:385] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.988104  4048 tablet_bootstrap.cc:492] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:46.988520  4232 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.991271  4048 ts_tablet_manager.cc:1403] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.222s	user 0.018s	sys 0.011s
I20260709 12:26:46.986310  4096 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.993171  4047 raft_consensus.cc:359] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.993848  4047 raft_consensus.cc:385] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.994082  4096 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:46.994146  4047 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.992517  3755 catalog_manager.cc:5697] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.994881  4048 raft_consensus.cc:359] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.995067  4047 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:46.995808  4048 raft_consensus.cc:385] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.996268  4048 raft_consensus.cc:740] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.996464  4046 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.997412  4047 ts_tablet_manager.cc:1434] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:46.998517  4047 tablet_bootstrap.cc:492] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:46.997388  4048 consensus_queue.cc:260] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.000156  4048 ts_tablet_manager.cc:1434] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:46.997769  4046 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.001395  4048 tablet_bootstrap.cc:492] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:47.003429  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:47.004024  3929 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.005865  4046 ts_tablet_manager.cc:1434] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:26:47.006903  4046 tablet_bootstrap.cc:492] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:47.010800  3895 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:47.012976  3929 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:47.013485  4160 raft_consensus.cc:2764] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:26:47.013566  4046 tablet_bootstrap.cc:654] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.014380  4048 tablet_bootstrap.cc:654] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.017917  4047 tablet_bootstrap.cc:654] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.024756  4233 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.026695  4233 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.029284  4046 tablet_bootstrap.cc:492] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:47.029734  4046 ts_tablet_manager.cc:1403] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.006s
I20260709 12:26:47.034744  3821 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:47.037940  4233 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.038529  4233 raft_consensus.cc:697] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:47.039433  4233 consensus_queue.cc:237] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.041422  4046 raft_consensus.cc:359] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.041930  4046 raft_consensus.cc:385] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.037979  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:47.042228  4046 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.042894  4006 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.059484  4006 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:47.067952  4046 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.069976  4047 tablet_bootstrap.cc:492] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:47.070454  4047 ts_tablet_manager.cc:1403] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.003s
I20260709 12:26:47.073977  4046 ts_tablet_manager.cc:1434] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.044s	user 0.011s	sys 0.000s
I20260709 12:26:47.074218  4048 tablet_bootstrap.cc:492] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:47.074741  4048 ts_tablet_manager.cc:1403] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.009s
I20260709 12:26:47.074930  4047 raft_consensus.cc:359] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.076939  4047 raft_consensus.cc:385] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.077221  4047 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.075299  4046 tablet_bootstrap.cc:492] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:47.078225  4047 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.081372  4047 ts_tablet_manager.cc:1434] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:47.083513  4047 tablet_bootstrap.cc:492] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:47.083774  4048 raft_consensus.cc:359] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.084589  4048 raft_consensus.cc:385] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.083945  3755 catalog_manager.cc:5697] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.084896  4048 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.085623  4048 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.093977  4048 ts_tablet_manager.cc:1434] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:26:47.095024  4048 tablet_bootstrap.cc:492] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:47.098785  4046 tablet_bootstrap.cc:654] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.101330  4142 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.101811  4142 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.104424  4142 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:47.109651  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:47.112177  3854 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:47.116470  3969 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:47.117745  4191 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.118189  4191 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.118520  4191 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.120842  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:47.121510  3929 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:47.123682  4048 tablet_bootstrap.cc:654] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.126823  4047 tablet_bootstrap.cc:654] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.129724  4191 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:47.143904  3822 consensus_peers.cc:597] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:47.144073  4048 tablet_bootstrap.cc:492] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:47.141340  4233 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.141491  4142 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.144577  4048 ts_tablet_manager.cc:1403] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.010s
I20260709 12:26:47.144979  4191 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:47.146333  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:47.146977  3856 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.147351  4046 tablet_bootstrap.cc:492] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:47.147857  4046 ts_tablet_manager.cc:1403] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.014s
I20260709 12:26:47.146333  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:47.152809  3930 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.154066  4096 consensus_queue.cc:1048] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.162726  4233 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.163647  4046 raft_consensus.cc:359] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.164750  4046 raft_consensus.cc:385] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.165162  4046 raft_consensus.cc:740] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.166134  4046 consensus_queue.cc:260] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.172725  3930 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:47.174023  4046 ts_tablet_manager.cc:1434] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.004s
I20260709 12:26:47.178251  4046 tablet_bootstrap.cc:492] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:47.178743  3970 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:47.182367  4191 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.182868  4191 raft_consensus.cc:697] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:26:47.183674  4191 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.184101  3856 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:47.186221  4046 tablet_bootstrap.cc:654] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.186483  4048 raft_consensus.cc:359] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.187158  4048 raft_consensus.cc:385] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.187430  4048 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.191248  4047 tablet_bootstrap.cc:492] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:47.193897  4047 ts_tablet_manager.cc:1403] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.005s
I20260709 12:26:47.194456  4178 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.197228  4048 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.205518  4160 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.206059  4160 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.208168  4160 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:47.211083  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:47.211779  4004 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:47.213219  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:47.216589  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:47.217371  3853 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:47.216622  4160 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.218737  4160 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.219206  4160 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.227838  4048 ts_tablet_manager.cc:1434] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.083s	user 0.010s	sys 0.000s
I20260709 12:26:47.229120  4048 tablet_bootstrap.cc:492] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:47.227339  4047 raft_consensus.cc:359] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.231905  4047 raft_consensus.cc:385] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.232270  4047 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.239099  4047 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.235585  4160 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.251716  4160 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:47.253613  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:47.254287  3853 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.262594  4047 ts_tablet_manager.cc:1434] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 12:26:47.264290  4047 tablet_bootstrap.cc:492] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:47.264616  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:47.265205  4004 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.265673  4046 tablet_bootstrap.cc:492] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:47.266165  4046 ts_tablet_manager.cc:1403] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.025s
I20260709 12:26:47.280472  4179 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.280999  4179 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.284047  4179 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:47.286801  4004 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:47.290076  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:47.290802  3854 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:47.287741  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:47.277642  3853 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:47.294385  4096 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.300083  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:47.300855  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:47.301357  4179 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.301849  4179 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.301303  4046 raft_consensus.cc:359] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.302121  3929 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:47.303223  4160 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.302279  4046 raft_consensus.cc:385] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.302228  4179 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.303769  4160 raft_consensus.cc:697] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:47.304667  4160 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.303742  4046 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.308161  4046 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.310590  4046 ts_tablet_manager.cc:1434] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:26:47.311587  4046 tablet_bootstrap.cc:492] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:47.312258  4179 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.317813  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:47.319551  3854 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.320907  4048 tablet_bootstrap.cc:654] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.318400  4179 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:26:47.318938  3802 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:47.336802  3854 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:47.339627  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:47.340623  4142 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.341212  4142 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:26:47.342103  4142 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.345808  4074 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.346369  4074 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.348677  4074 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:47.350072  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:47.351577  3897 leader_election.cc:343] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.351063  3751 catalog_manager.cc:5697] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.352875  4047 tablet_bootstrap.cc:654] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.354571  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:26:47.355897  3895 leader_election.cc:343] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.356437  3895 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:47.357067  4046 tablet_bootstrap.cc:654] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.357502  4074 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.369148  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:47.369992  3930 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.380402  3930 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:47.384063  4048 tablet_bootstrap.cc:492] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:47.384904  4048 ts_tablet_manager.cc:1403] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.156s	user 0.008s	sys 0.005s
I20260709 12:26:47.390936  4048 raft_consensus.cc:359] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.393952  4048 raft_consensus.cc:385] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.394269  4048 raft_consensus.cc:740] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.394955  4048 consensus_queue.cc:260] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.397686  4048 ts_tablet_manager.cc:1434] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:47.399133  4048 tablet_bootstrap.cc:492] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:47.401373  4047 tablet_bootstrap.cc:492] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:47.401954  4047 ts_tablet_manager.cc:1403] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.138s	user 0.007s	sys 0.020s
I20260709 12:26:47.404584  4047 raft_consensus.cc:359] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.405280  4047 raft_consensus.cc:385] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.405612  4047 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.406409  4047 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.408639  4048 tablet_bootstrap.cc:654] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.408700  4047 ts_tablet_manager.cc:1434] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:47.409123  3751 catalog_manager.cc:5697] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.414069  4047 tablet_bootstrap.cc:492] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:47.420454  4047 tablet_bootstrap.cc:654] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.434644  4047 tablet_bootstrap.cc:492] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:47.435127  4047 ts_tablet_manager.cc:1403] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 12:26:47.437822  4047 raft_consensus.cc:359] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.438527  4047 raft_consensus.cc:385] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.438802  4047 raft_consensus.cc:740] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.439422  4047 consensus_queue.cc:260] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.442091  4047 ts_tablet_manager.cc:1434] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:47.441807  3755 catalog_manager.cc:5697] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.443028  4047 tablet_bootstrap.cc:492] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:47.448840  4047 tablet_bootstrap.cc:654] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.449342  4046 tablet_bootstrap.cc:492] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:47.449851  4046 ts_tablet_manager.cc:1403] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.138s	user 0.019s	sys 0.008s
I20260709 12:26:47.452425  4046 raft_consensus.cc:359] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.453141  4046 raft_consensus.cc:385] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.455459  4046 raft_consensus.cc:740] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.454981  4231 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.456037  4231 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.459245  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:47.456248  4046 consensus_queue.cc:260] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.460223  4047 tablet_bootstrap.cc:492] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:47.460767  4047 ts_tablet_manager.cc:1403] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.011s
W20260709 12:26:47.460773  3822 leader_election.cc:343] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.462014  4046 ts_tablet_manager.cc:1434] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 12:26:47.462502  4231 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:47.464022  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:47.463907  4047 raft_consensus.cc:359] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.464650  4047 raft_consensus.cc:385] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.464763  4046 tablet_bootstrap.cc:492] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:47.464977  4047 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
W20260709 12:26:47.465483  3821 leader_election.cc:343] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.465920  4047 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.466045  3821 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:47.467114  4096 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.468237  4047 ts_tablet_manager.cc:1434] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:47.469023  4048 tablet_bootstrap.cc:492] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:47.469064  4047 tablet_bootstrap.cc:492] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:47.469491  4048 ts_tablet_manager.cc:1403] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.003s
I20260709 12:26:47.471704  4048 raft_consensus.cc:359] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.472195  4048 raft_consensus.cc:385] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.472366  4048 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.473031  4048 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.476032  4047 tablet_bootstrap.cc:654] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.477629  4046 tablet_bootstrap.cc:654] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.504241  4179 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.528565  4096 consensus_queue.cc:1048] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.539271  4179 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.554337  4006 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.553793  4048 ts_tablet_manager.cc:1434] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.084s	user 0.005s	sys 0.000s
I20260709 12:26:47.556663  4048 tablet_bootstrap.cc:492] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:47.569067  4048 tablet_bootstrap.cc:654] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.572894  4096 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.582058  4096 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.584378  4096 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:47.586539  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:47.586671  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:47.588032  3929 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:47.588640  4046 tablet_bootstrap.cc:492] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:47.589675  4046 ts_tablet_manager.cc:1403] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.127s	user 0.017s	sys 0.034s
I20260709 12:26:47.589390  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:26:47.590823  3822 leader_election.cc:343] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.592921  4046 raft_consensus.cc:359] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.593748  4046 raft_consensus.cc:385] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.596271  4231 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.596693  4231 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.597074  4231 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.596786  4179 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.598304  4048 tablet_bootstrap.cc:492] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:47.594314  4046 raft_consensus.cc:740] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.598874  4048 ts_tablet_manager.cc:1403] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.001s
I20260709 12:26:47.599155  4046 consensus_queue.cc:260] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.601714  4048 raft_consensus.cc:359] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.602438  4048 raft_consensus.cc:385] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.602753  4048 raft_consensus.cc:740] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.603437  4048 consensus_queue.cc:260] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.604918  4046 ts_tablet_manager.cc:1434] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:26:47.605865  4048 ts_tablet_manager.cc:1434] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:47.605683  4231 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.606889  4048 tablet_bootstrap.cc:492] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:47.606102  4046 tablet_bootstrap.cc:492] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:47.608920  4047 tablet_bootstrap.cc:492] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:47.609370  4047 ts_tablet_manager.cc:1403] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.140s	user 0.047s	sys 0.045s
I20260709 12:26:47.609611  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:47.610263  3932 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.612008  4047 raft_consensus.cc:359] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.612681  4047 raft_consensus.cc:385] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.612938  4047 raft_consensus.cc:740] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.613570  4047 consensus_queue.cc:260] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.615298  4231 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:47.617425  3932 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:47.620208  4046 tablet_bootstrap.cc:654] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.619936  4179 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.623942  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:47.624706  4231 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.625316  4231 raft_consensus.cc:697] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:47.620573  4096 consensus_queue.cc:1048] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.620759  4142 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.626165  4231 consensus_queue.cc:237] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.626295  4142 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.628635  4142 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:47.622351  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:47.630322  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:47.631381  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:26:47.631734  3822 leader_election.cc:343] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:47.632820  3969 leader_election.cc:343] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:47.633347  3970 leader_election.cc:343] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.633754  4048 tablet_bootstrap.cc:654] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.633812  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:47.636234  4142 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.641294  4047 ts_tablet_manager.cc:1434] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.003s
I20260709 12:26:47.642828  4047 tablet_bootstrap.cc:492] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:47.646294  4160 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.646860  4160 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.649163  4160 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:47.651823  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:47.653556  3897 leader_election.cc:343] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.654693  4048 tablet_bootstrap.cc:492] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:47.671679  4048 ts_tablet_manager.cc:1403] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.000s
I20260709 12:26:47.666846  4047 tablet_bootstrap.cc:654] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.664883  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:47.673223  3854 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:47.674675  3895 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:47.675957  4074 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.676327  4074 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.676666  4074 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.687112  4074 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.684644  3752 catalog_manager.cc:5697] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.692456  4048 raft_consensus.cc:359] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.693142  4048 raft_consensus.cc:385] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.693468  4048 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.694659  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:47.694348  4048 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.695613  4074 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:47.697150  3854 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.697939  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:26:47.699331  3897 leader_election.cc:343] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.703568  4048 ts_tablet_manager.cc:1434] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:26:47.704607  4048 tablet_bootstrap.cc:492] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:47.710579  3854 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:47.711743  3895 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:47.712836  4046 tablet_bootstrap.cc:492] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:47.713275  4046 ts_tablet_manager.cc:1403] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.107s	user 0.015s	sys 0.028s
I20260709 12:26:47.715853  4046 raft_consensus.cc:359] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.716485  4046 raft_consensus.cc:385] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.716740  4046 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.717125  4047 tablet_bootstrap.cc:492] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:47.717689  4047 ts_tablet_manager.cc:1403] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.008s
I20260709 12:26:47.718051  4074 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.718803  4074 raft_consensus.cc:697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:47.719622  4074 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.717358  4046 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.725276  4046 ts_tablet_manager.cc:1434] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:47.726261  4046 tablet_bootstrap.cc:492] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:47.732108  4047 raft_consensus.cc:359] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.733199  4047 raft_consensus.cc:385] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.733513  4047 raft_consensus.cc:740] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.737413  4046 tablet_bootstrap.cc:654] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.738041  4047 consensus_queue.cc:260] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.740429  4048 tablet_bootstrap.cc:654] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.742996  4047 ts_tablet_manager.cc:1434] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:26:47.743942  4047 tablet_bootstrap.cc:492] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:47.749047  4046 tablet_bootstrap.cc:492] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:47.749500  4046 ts_tablet_manager.cc:1403] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.003s
I20260709 12:26:47.749817  4047 tablet_bootstrap.cc:654] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.752235  4046 raft_consensus.cc:359] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.753157  4046 raft_consensus.cc:385] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.753495  4046 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.754086  4048 tablet_bootstrap.cc:492] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:47.754595  4048 ts_tablet_manager.cc:1403] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 12:26:47.754366  4046 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.757709  4046 ts_tablet_manager.cc:1434] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:47.758991  4046 tablet_bootstrap.cc:492] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:47.760653  3751 catalog_manager.cc:5697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.758901  4048 raft_consensus.cc:359] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.764452  4048 raft_consensus.cc:385] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.764838  4048 raft_consensus.cc:740] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.773540  4046 tablet_bootstrap.cc:654] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.778755  4047 tablet_bootstrap.cc:492] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:47.779197  4047 ts_tablet_manager.cc:1403] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.007s
I20260709 12:26:47.781607  4047 raft_consensus.cc:359] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.782326  4047 raft_consensus.cc:385] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.782568  4047 raft_consensus.cc:740] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.783144  4047 consensus_queue.cc:260] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.784685  4047 ts_tablet_manager.cc:1434] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:26:47.786686  4046 tablet_bootstrap.cc:492] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:47.787163  4046 ts_tablet_manager.cc:1403] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.003s
I20260709 12:26:47.789244  4046 raft_consensus.cc:359] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.789748  4046 raft_consensus.cc:385] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.790002  4046 raft_consensus.cc:740] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.790699  4047 tablet_bootstrap.cc:492] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:47.790593  4046 consensus_queue.cc:260] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.792111  4046 ts_tablet_manager.cc:1434] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:47.793406  4046 tablet_bootstrap.cc:492] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:47.770877  4048 consensus_queue.cc:260] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.806025  4074 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.799273  4046 tablet_bootstrap.cc:654] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.800153  4231 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.811659  4047 tablet_bootstrap.cc:654] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.823729  4231 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.805404  4178 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.825969  4161 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.806214  4179 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.827106  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:47.827261  4179 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.829428  4179 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:26:47.830515  3822 leader_election.cc:343] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.833257  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:47.837532  4047 tablet_bootstrap.cc:492] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:47.838065  4047 ts_tablet_manager.cc:1403] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.000s
I20260709 12:26:47.841025  4047 raft_consensus.cc:359] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.841758  4047 raft_consensus.cc:385] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.842962  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:47.843716  3929 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:47.843158  4047 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.845067  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:47.845961  3931 raft_consensus.cc:2393] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 1: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:26:47.845625  4047 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.849385  3970 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:47.849711  3821 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:47.850368  4179 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.850472  4233 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.851715  4233 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.852188  4233 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.853264  4047 ts_tablet_manager.cc:1434] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:26:47.854674  4047 tablet_bootstrap.cc:492] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:47.826473  4231 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:47.863489  4048 ts_tablet_manager.cc:1434] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.000s
I20260709 12:26:47.865775  4047 tablet_bootstrap.cc:654] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.878018  4048 tablet_bootstrap.cc:492] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:47.879431  4047 tablet_bootstrap.cc:492] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:47.879916  4047 ts_tablet_manager.cc:1403] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.000s
I20260709 12:26:47.882190  4191 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.882722  4191 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.883646  4233 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.884997  4191 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:47.888015  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:47.888715  3931 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:47.889820  3970 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:47.890749  4191 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.891166  4191 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.891546  4191 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.893163  4138 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.893862  4138 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.896517  4138 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:47.897687  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:47.899542  3822 leader_election.cc:343] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.901538  4074 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.902084  4074 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.886174  4179 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.905089  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:47.906036  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:47.905720  4233 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:26:47.907582  3822 leader_election.cc:343] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.908281  3854 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:47.909698  3895 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:47.910673  4161 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.911149  4161 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.911573  4161 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.911713  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:47.912443  3853 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:47.917399  4191 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.953452  4179 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.954389  4191 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:47.954097  4179 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.957309  4047 raft_consensus.cc:359] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.958107  4047 raft_consensus.cc:385] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.958405  4047 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.954808  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:47.955451  4048 tablet_bootstrap.cc:654] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.959408  4046 tablet_bootstrap.cc:492] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:47.959939  4046 ts_tablet_manager.cc:1403] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.167s	user 0.066s	sys 0.047s
I20260709 12:26:47.959079  4047 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.963165  4047 ts_tablet_manager.cc:1434] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.083s	user 0.025s	sys 0.004s
I20260709 12:26:47.966136  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:47.966375  4161 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.966774  3931 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:47.962462  4074 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:47.959452  3853 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.959100  4179 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:47.968295  4046 raft_consensus.cc:359] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.968864  4046 raft_consensus.cc:385] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.969110  4046 raft_consensus.cc:740] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.969622  4046 consensus_queue.cc:260] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.972406  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:47.972991  3931 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.973789  4046 ts_tablet_manager.cc:1434] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:26:47.974716  4046 tablet_bootstrap.cc:492] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:47.975312  4231 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.975813  4231 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:47.978657  3821 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:47.978879  4231 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:47.980273  4233 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.980698  4233 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.981081  4233 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.984216  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:47.985443  3931 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:47.989624  3853 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:47.995239  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:47.995893  4004 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:47.996346  4046 tablet_bootstrap.cc:654] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.996798  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:47.997416  4006 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.001564  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:48.002182  3856 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.002301  4047 tablet_bootstrap.cc:492] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:48.005699  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:48.010135  4006 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:48.011047  3853 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
W20260709 12:26:47.990878  3822 leader_election.cc:343] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.011557  4179 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.989343  4233 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.010943  3969 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:48.016326  3897 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:48.017324  4074 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.017479  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:48.017969  4074 raft_consensus.cc:697] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:26:48.018944  3822 leader_election.cc:343] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.018965  4074 consensus_queue.cc:237] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.020488  4047 tablet_bootstrap.cc:654] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.022043  3969 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:48.016485  4179 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.991111  4161 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.030634  4191 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.031101  4191 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.031486  4191 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.031868  4048 tablet_bootstrap.cc:492] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:48.031774  4179 raft_consensus.cc:697] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:26:48.032397  4048 ts_tablet_manager.cc:1403] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.155s	user 0.028s	sys 0.022s
I20260709 12:26:48.032819  4179 consensus_queue.cc:237] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.035351  3856 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:48.037317  4046 tablet_bootstrap.cc:492] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:48.037753  4046 ts_tablet_manager.cc:1403] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.001s
I20260709 12:26:48.043126  4046 raft_consensus.cc:359] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.043803  4046 raft_consensus.cc:385] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.044081  4046 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.044700  4046 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.045917  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:48.046787  4046 ts_tablet_manager.cc:1434] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:26:48.046744  3931 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.047863  4046 tablet_bootstrap.cc:492] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:48.024727  4233 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.061354  4048 raft_consensus.cc:359] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.062448  4048 raft_consensus.cc:385] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.062847  4048 raft_consensus.cc:740] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.066083  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:48.086143  3932 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:48.094894  4048 consensus_queue.cc:260] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.100515  4048 ts_tablet_manager.cc:1434] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.068s	user 0.010s	sys 0.007s
I20260709 12:26:48.101291  4047 tablet_bootstrap.cc:492] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:48.101828  4047 ts_tablet_manager.cc:1403] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.112s	user 0.008s	sys 0.016s
I20260709 12:26:48.103065  4046 tablet_bootstrap.cc:654] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.104377  4048 tablet_bootstrap.cc:492] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:48.119814  3821 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:48.146735  4191 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.151485  4191 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:48.126859  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:48.110423  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:48.155840  4047 raft_consensus.cc:359] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.156371  4047 raft_consensus.cc:385] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.156600  4047 raft_consensus.cc:740] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.157058  4047 consensus_queue.cc:260] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.146449  4231 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.159029  4231 raft_consensus.cc:697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:48.159108  3751 catalog_manager.cc:5697] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.159854  4231 consensus_queue.cc:237] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.145782  4294 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.162990  4294 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.164960  4138 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.165248  4294 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.169641  3755 catalog_manager.cc:5697] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:48.175294  3929 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:48.173316  3930 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.183259  4047 ts_tablet_manager.cc:1434] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.081s	user 0.000s	sys 0.006s
I20260709 12:26:48.184592  4047 tablet_bootstrap.cc:492] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:48.188998  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:48.189415  3821 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:48.189666  3926 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.192217  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:48.192853  3853 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:48.194233  4294 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.196668  4231 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.200007  4231 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.200166  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:48.200376  4231 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:48.204990  3897 leader_election.cc:343] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.210157  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:48.210812  3853 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.212247  4231 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.212081  3931 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:48.214841  4231 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.215356  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:48.215997  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:48.216252  3928 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:48.217255  3822 leader_election.cc:343] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:48.224709  3897 consensus_peers.cc:597] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:48.240481  3930 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:48.242295  3821 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:48.238382  3751 catalog_manager.cc:5697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.248745  4138 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.249857  4138 raft_consensus.cc:697] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:48.250808  4138 consensus_queue.cc:237] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.258490  3928 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:48.260017  3821 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:48.260733  4231 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.261435  4231 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:26:48.245596  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 51386.7us
I20260709 12:26:48.262629  4231 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.274322  4233 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.284596  4048 tablet_bootstrap.cc:654] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.298810  4138 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.298480  3895 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:48.302412  4138 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.307766  4046 tablet_bootstrap.cc:492] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:48.308386  4046 ts_tablet_manager.cc:1403] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.261s	user 0.022s	sys 0.010s
I20260709 12:26:48.299582  4232 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.308583  4142 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.315063  4232 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.315688  4142 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.318001  4138 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.318411  4232 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.304592  4160 raft_consensus.cc:2764] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:26:48.317672  4142 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:48.319235  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:48.321450  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:48.321616  3854 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:48.322964  3969 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:48.322784  4046 raft_consensus.cc:359] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.323599  4046 raft_consensus.cc:385] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.323912  4046 raft_consensus.cc:740] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
W20260709 12:26:48.324270  3821 leader_election.cc:343] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.324643  4142 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.324589  4046 consensus_queue.cc:260] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.325155  4142 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.325637  4142 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.325187  4047 tablet_bootstrap.cc:654] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:48.334532  4303 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:26:48.338495  4046 ts_tablet_manager.cc:1434] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 12:26:48.339468  4046 tablet_bootstrap.cc:492] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:48.307391  3926 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:48.344813  3751 catalog_manager.cc:5697] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.348766  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:48.352738  3751 catalog_manager.cc:5697] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.354616  3853 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:48.356251  3969 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:48.358014  4300 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.358582  4300 raft_consensus.cc:697] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:26:48.353655  3928 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:48.359511  4300 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.367434  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:48.368223  3926 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:48.371718  4048 tablet_bootstrap.cc:492] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:48.372848  4048 ts_tablet_manager.cc:1403] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.269s	user 0.022s	sys 0.005s
I20260709 12:26:48.379117  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:48.385239  3821 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:48.386224  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:48.386529  4232 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.386968  4232 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.387363  4232 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:48.391460  3822 leader_election.cc:343] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.392015  3822 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:48.392820  4138 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.404771  4048 raft_consensus.cc:359] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.406175  4142 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.407380  4006 raft_consensus.cc:2393] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 1: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:26:48.397676  4232 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.410370  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:48.410969  3929 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.413609  4046 tablet_bootstrap.cc:654] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.418467  4046 tablet_bootstrap.cc:492] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:48.418879  4046 ts_tablet_manager.cc:1403] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.000s
I20260709 12:26:48.420126  4232 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.420614  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:48.420886  4142 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:48.421317  3856 raft_consensus.cc:2393] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 1: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:26:48.405557  4048 raft_consensus.cc:385] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.421805  4048 raft_consensus.cc:740] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.422704  4048 consensus_queue.cc:260] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.427052  4048 ts_tablet_manager.cc:1434] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.004s
I20260709 12:26:48.426954  4046 raft_consensus.cc:359] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.427711  4046 raft_consensus.cc:385] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.427994  4046 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.428155  4048 tablet_bootstrap.cc:492] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:48.428704  4046 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.430616  4046 ts_tablet_manager.cc:1434] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:26:48.431514  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:48.432924  4046 tablet_bootstrap.cc:492] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:48.434495  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:48.435348  4004 raft_consensus.cc:2393] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 1: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:26:48.439165  4047 tablet_bootstrap.cc:492] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:48.442217  4047 ts_tablet_manager.cc:1403] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.258s	user 0.006s	sys 0.007s
I20260709 12:26:48.443735  3970 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:48.435792  3755 catalog_manager.cc:5697] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:48.445300  3929 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:48.446823  4179 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.469973  4047 raft_consensus.cc:359] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.470892  4047 raft_consensus.cc:385] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.471221  4047 raft_consensus.cc:740] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.472081  4048 tablet_bootstrap.cc:654] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.471918  4047 consensus_queue.cc:260] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.472740  4046 tablet_bootstrap.cc:654] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.474488  4047 ts_tablet_manager.cc:1434] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.003s
I20260709 12:26:48.474993  3821 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:48.475587  4047 tablet_bootstrap.cc:492] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:48.476799  4231 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.477351  4231 raft_consensus.cc:697] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:48.478312  4231 consensus_queue.cc:237] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.482769  4047 tablet_bootstrap.cc:654] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:48.492677  3802 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:48.494078  4047 tablet_bootstrap.cc:492] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:48.494715  4047 ts_tablet_manager.cc:1403] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:26:48.495747  4046 tablet_bootstrap.cc:492] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:48.496356  4046 ts_tablet_manager.cc:1403] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.008s
I20260709 12:26:48.498976  4046 raft_consensus.cc:359] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.499598  4160 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.500977  4048 tablet_bootstrap.cc:492] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:48.501407  4048 ts_tablet_manager.cc:1403] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.006s
I20260709 12:26:48.499631  4046 raft_consensus.cc:385] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.502487  4046 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.503296  4046 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.503983  4048 raft_consensus.cc:359] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.504693  4048 raft_consensus.cc:385] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.505029  4048 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.505695  4048 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.507229  4048 ts_tablet_manager.cc:1434] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:26:48.508076  4048 tablet_bootstrap.cc:492] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:48.512871  4047 raft_consensus.cc:359] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.513620  4047 raft_consensus.cc:385] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.513923  4047 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.514104  4048 tablet_bootstrap.cc:654] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.515298  4047 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.516896  4047 ts_tablet_manager.cc:1434] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:26:48.522300  4046 ts_tablet_manager.cc:1434] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:26:48.524091  4047 tablet_bootstrap.cc:492] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:48.525800  4048 tablet_bootstrap.cc:492] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:48.526279  4048 ts_tablet_manager.cc:1403] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 12:26:48.528904  4048 raft_consensus.cc:359] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.529539  4048 raft_consensus.cc:385] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.529805  4048 raft_consensus.cc:740] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.530133  4046 tablet_bootstrap.cc:492] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:48.530519  4048 consensus_queue.cc:260] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.533082  4048 ts_tablet_manager.cc:1434] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:48.533962  4048 tablet_bootstrap.cc:492] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:48.536036  4046 tablet_bootstrap.cc:654] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.539664  4048 tablet_bootstrap.cc:654] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.529860  4047 tablet_bootstrap.cc:654] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.546813  3752 catalog_manager.cc:5697] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.548364  4046 tablet_bootstrap.cc:492] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:48.548767  4046 ts_tablet_manager.cc:1403] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.003s
I20260709 12:26:48.550372  4231 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.551409  4047 tablet_bootstrap.cc:492] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:48.550981  4046 raft_consensus.cc:359] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.551795  4046 raft_consensus.cc:385] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.551956  4047 ts_tablet_manager.cc:1403] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.003s
I20260709 12:26:48.551019  4231 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.552080  4046 raft_consensus.cc:740] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.554169  4046 consensus_queue.cc:260] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.555225  4047 raft_consensus.cc:359] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.555889  4047 raft_consensus.cc:385] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.556201  4047 raft_consensus.cc:740] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.556598  4046 ts_tablet_manager.cc:1434] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:48.556876  4047 consensus_queue.cc:260] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.559202  4047 ts_tablet_manager.cc:1434] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:48.560127  4047 tablet_bootstrap.cc:492] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:48.563745  4046 tablet_bootstrap.cc:492] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:48.564855  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:48.565714  3928 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:48.566010  4047 tablet_bootstrap.cc:654] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.568305  4074 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.570933  4046 tablet_bootstrap.cc:654] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.578243  4047 tablet_bootstrap.cc:492] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:48.579370  4047 ts_tablet_manager.cc:1403] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 12:26:48.581563  4047 raft_consensus.cc:359] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.582109  4047 raft_consensus.cc:385] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.582449  4047 raft_consensus.cc:740] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.583258  4047 consensus_queue.cc:260] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.585861  4047 ts_tablet_manager.cc:1434] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:48.586558  4046 tablet_bootstrap.cc:492] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:48.586745  4047 tablet_bootstrap.cc:492] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:48.587179  4046 ts_tablet_manager.cc:1403] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.001s
I20260709 12:26:48.592300  4046 raft_consensus.cc:359] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.593421  4046 raft_consensus.cc:385] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.593717  4047 tablet_bootstrap.cc:654] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.593792  4046 raft_consensus.cc:740] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.594708  4046 consensus_queue.cc:260] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.602902  4046 ts_tablet_manager.cc:1434] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:26:48.603726  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:48.604324  4046 tablet_bootstrap.cc:492] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
W20260709 12:26:48.605682  3822 leader_election.cc:343] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.609764  4179 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.610489  4179 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.613699  4046 tablet_bootstrap.cc:654] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.614315  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:48.616425  4179 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:48.622584  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:48.623400  3928 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 1: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:26:48.623857  4300 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.628012  4231 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.630100  3970 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:48.631224  4300 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.631935  3821 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:26:48.632789  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 62204.6us
I20260709 12:26:48.637705  4231 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.638156  4231 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.638523  4231 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.640249  4300 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.644904  4300 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.645295  4160 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.646009  4160 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.649816  4160 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.650358  4232 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.651926  4232 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.652582  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:48.650695  4138 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.655687  4048 tablet_bootstrap.cc:492] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:48.656148  4048 ts_tablet_manager.cc:1403] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.122s	user 0.025s	sys 0.054s
W20260709 12:26:48.656493  3897 leader_election.cc:343] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.656069  4232 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.658375  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:48.660125  3822 leader_election.cc:343] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.663197  4046 tablet_bootstrap.cc:492] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:48.663673  4046 ts_tablet_manager.cc:1403] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.011s
I20260709 12:26:48.666565  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:48.667655  3854 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:48.677471  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:48.669941  4046 raft_consensus.cc:359] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.681011  3929 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:48.681458  4046 raft_consensus.cc:385] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.682003  4046 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.683215  4046 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.685510  3895 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:48.669847  4048 raft_consensus.cc:359] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.686578  4074 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.688798  4074 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.688943  4048 raft_consensus.cc:385] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.689153  4074 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.698527  4005 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.702004  4048 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.703147  4048 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.688238  4046 ts_tablet_manager.cc:1434] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 12:26:48.705843  4179 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.706022  4046 tablet_bootstrap.cc:492] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:48.706383  4179 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.708674  4179 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:48.709483  4232 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.710182  4231 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.711637  4004 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.713598  4048 ts_tablet_manager.cc:1434] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.005s
I20260709 12:26:48.714563  4048 tablet_bootstrap.cc:492] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:48.717736  4074 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.721087  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:48.722420  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:48.725600  4074 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.725847  4231 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.727538  4047 tablet_bootstrap.cc:492] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:48.728039  4047 ts_tablet_manager.cc:1403] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.141s	user 0.045s	sys 0.074s
I20260709 12:26:48.728050  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:48.730527  4046 tablet_bootstrap.cc:654] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.730729  4047 raft_consensus.cc:359] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:48.731125  3822 leader_election.cc:343] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.731405  4047 raft_consensus.cc:385] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.731727  4047 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.732008  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:48.732362  4047 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.733250  3969 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:26:48.736387  3897 leader_election.cc:343] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.738756  4048 tablet_bootstrap.cc:654] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.739974  3821 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:48.741025  4231 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.741484  4231 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.741976  4231 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.742342  4047 ts_tablet_manager.cc:1434] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:26:48.743260  4047 tablet_bootstrap.cc:492] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:48.757633  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:48.758472  3856 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.759044  4047 tablet_bootstrap.cc:654] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.767848  4048 tablet_bootstrap.cc:492] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:48.768404  4048 ts_tablet_manager.cc:1403] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.002s
I20260709 12:26:48.763252  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:48.769273  4179 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.769726  3931 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.771358  4048 raft_consensus.cc:359] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.772120  4048 raft_consensus.cc:385] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.772403  4048 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.773228  4048 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.763597  4231 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.774957  4048 ts_tablet_manager.cc:1434] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:48.775908  4048 tablet_bootstrap.cc:492] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:48.776185  4231 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.776922  4302 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.777422  4302 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.785367  4302 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.790720  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:48.796339  3856 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:48.797941  4232 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.798811  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:48.801033  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:26:48.806035  3897 leader_election.cc:343] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:48.804157  3822 leader_election.cc:343] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.812429  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:48.816119  3927 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.816864  4074 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.817273  4074 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.816815  3931 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:48.818837  4074 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.820160  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:48.821985  4191 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.808115  3895 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:26:48.825577  3895 leader_election.cc:343] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.826052  3895 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:48.827334  4003 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:48.828979  4074 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.829555  4074 raft_consensus.cc:697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:48.832852  4294 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.833485  3821 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:48.833712  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:48.834266  4232 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.834477  3855 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:48.834774  4232 raft_consensus.cc:697] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:48.835697  4232 consensus_queue.cc:237] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.837222  3897 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:48.830478  4074 consensus_queue.cc:237] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.843918  4046 tablet_bootstrap.cc:492] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:48.844628  4046 ts_tablet_manager.cc:1403] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.139s	user 0.021s	sys 0.020s
I20260709 12:26:48.847360  4160 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.850155  4160 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.850587  4160 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.867373  4096 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:26:48.873548  4048 tablet_bootstrap.cc:654] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.875437  4160 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.877622  4191 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.878328  4191 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.877715  4160 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.880671  4191 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:48.881709  4179 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.895514  3927 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
W20260709 12:26:48.915576  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 78444.7us
I20260709 12:26:48.931867  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:48.932447  4006 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.933029  4233 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.939267  4006 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:48.933518  4233 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.932446  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:26:48.951921  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 81822us
I20260709 12:26:48.955139  4233 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:48.957496  4003 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.958096  4046 raft_consensus.cc:359] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:48.961429  4046 raft_consensus.cc:385] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.961808  4046 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.962587  4046 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:48.998126  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 92298.7us
I20260709 12:26:48.999320  3821 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:49.049414  4046 ts_tablet_manager.cc:1434] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.204s	user 0.008s	sys 0.001s
W20260709 12:26:49.049490  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 50256.9us
I20260709 12:26:49.002876  4231 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.073589  4046 tablet_bootstrap.cc:492] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:49.002591  4233 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.061s
W20260709 12:26:49.058831  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 62824.1us
W20260709 12:26:49.060691  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 107956us
I20260709 12:26:49.090620  4340 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.091235  4340 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.070149  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:49.093232  4048 tablet_bootstrap.cc:492] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:49.097757  4048 ts_tablet_manager.cc:1403] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.322s	user 0.016s	sys 0.009s
I20260709 12:26:49.068933  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:49.104785  4047 tablet_bootstrap.cc:492] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:49.105795  4047 ts_tablet_manager.cc:1403] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.363s	user 0.014s	sys 0.006s
I20260709 12:26:49.065639  4231 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.132964  3929 raft_consensus.cc:2393] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 1: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:26:49.143344  4344 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.191570  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:49.203853  4047 raft_consensus.cc:359] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.213001  4047 raft_consensus.cc:385] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.213371  4047 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.222421  4048 raft_consensus.cc:359] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.223277  4048 raft_consensus.cc:385] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.223652  4048 raft_consensus.cc:740] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
W20260709 12:26:49.225332  4339 log.cc:927] Time spent T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:26:49.192512  3897 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:49.220758  3855 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.237253  4048 consensus_queue.cc:260] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.229408  4340 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:49.238721  4302 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:49.237464  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 85055.5us
W20260709 12:26:49.247418  3822 leader_election.cc:343] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.266961  4047 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.285137  3970 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:49.289749  4047 ts_tablet_manager.cc:1434] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.184s	user 0.011s	sys 0.008s
I20260709 12:26:49.293462  4047 tablet_bootstrap.cc:492] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:49.297948  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:49.298736  3930 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:49.300081  3821 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:49.286799  4302 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:49.303622  4302 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.284638  4344 raft_consensus.cc:697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:49.307667  3751 catalog_manager.cc:5697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.288559  4231 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:49.322548  4346 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:49.323175  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:49.327171  4048 ts_tablet_manager.cc:1434] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.229s	user 0.005s	sys 0.029s
I20260709 12:26:49.329593  4048 tablet_bootstrap.cc:492] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:49.329521  4350 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:49.323174  4346 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.342810  4346 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.334378  4344 consensus_queue.cc:237] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.381255  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:49.389065  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:49.378907  3855 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:49.384248  4357 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.399760  4357 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.424626  4046 tablet_bootstrap.cc:654] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.427773  4047 tablet_bootstrap.cc:654] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.428119  4138 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:49.428954  4341 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:49.429523  3895 leader_election.cc:343] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.434195  4003 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.434572  4138 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:49.440294  4357 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:49.478989  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:49.469997  4138 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:26:49.490828  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:26:49.515442  3822 leader_election.cc:343] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:49.552788  3821 leader_election.cc:343] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.555657  4048 tablet_bootstrap.cc:654] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.553362  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:49.568181  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:26:49.571839  3897 leader_election.cc:343] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.574631  3897 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:49.577244  3970 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:49.580353  4357 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:49.580348  4047 tablet_bootstrap.cc:492] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:49.581703  4047 ts_tablet_manager.cc:1403] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.288s	user 0.007s	sys 0.027s
I20260709 12:26:49.583788  4302 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:49.572407  4344 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:49.569991  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 58986.9us
I20260709 12:26:49.602223  4046 tablet_bootstrap.cc:492] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:49.602681  4046 ts_tablet_manager.cc:1403] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.529s	user 0.018s	sys 0.013s
I20260709 12:26:49.599563  4096 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.615852  4354 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:26:49.615249  4096 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.620679  4096 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:49.632458  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:49.643186  4338 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:26:49.643693  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:26:49.648566  3822 leader_election.cc:343] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:49.649865  3821 leader_election.cc:343] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.650295  3821 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:49.651952  4354 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:49.634529  4346 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.666378  3752 catalog_manager.cc:5697] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:49.678277  3802 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:49.678519  4046 raft_consensus.cc:359] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.679370  4046 raft_consensus.cc:385] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.679708  4046 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.685959  4346 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:49.689664  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:26:49.697254  3822 leader_election.cc:343] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.699131  4047 raft_consensus.cc:359] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.700022  4047 raft_consensus.cc:385] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.722674  4047 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.729172  4046 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.732728  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:49.733362  3931 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.749210  3931 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:49.750670  4046 ts_tablet_manager.cc:1434] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.148s	user 0.004s	sys 0.003s
I20260709 12:26:49.751663  4046 tablet_bootstrap.cc:492] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
W20260709 12:26:49.751184  3897 consensus_peers.cc:597] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:49.765107  4048 tablet_bootstrap.cc:492] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:49.765651  4048 ts_tablet_manager.cc:1403] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.438s	user 0.031s	sys 0.041s
I20260709 12:26:49.766848  3821 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:49.754097  4047 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.772029  4345 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.772542  3752 catalog_manager.cc:5697] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.777171  4048 raft_consensus.cc:359] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.777835  4048 raft_consensus.cc:385] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.778141  4048 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.778807  4048 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.780217  4345 raft_consensus.cc:697] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:49.781956  4047 ts_tablet_manager.cc:1434] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.200s	user 0.007s	sys 0.005s
I20260709 12:26:49.782133  4048 ts_tablet_manager.cc:1434] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:26:49.781349  4345 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.786262  4047 tablet_bootstrap.cc:492] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:49.791400  4046 tablet_bootstrap.cc:654] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.793174  4048 tablet_bootstrap.cc:492] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:49.807783  4074 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:49.808844  4047 tablet_bootstrap.cc:654] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.815291  4302 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:49.825619  4048 tablet_bootstrap.cc:654] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.836128  3753 catalog_manager.cc:5697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.842051  4346 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.842702  4346 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.845347  4346 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:49.846628  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:49.848508  3822 leader_election.cc:343] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.850818  4047 tablet_bootstrap.cc:492] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:49.852299  4048 tablet_bootstrap.cc:492] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:49.852747  4048 ts_tablet_manager.cc:1403] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.002s
I20260709 12:26:49.853452  4047 ts_tablet_manager.cc:1403] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.010s
I20260709 12:26:49.854064  4046 tablet_bootstrap.cc:492] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:49.854776  4046 ts_tablet_manager.cc:1403] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.103s	user 0.005s	sys 0.008s
I20260709 12:26:49.855273  4048 raft_consensus.cc:359] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.856068  4048 raft_consensus.cc:385] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.856352  4048 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.856835  4047 raft_consensus.cc:359] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.856987  4048 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.857625  4047 raft_consensus.cc:385] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.857563  4046 raft_consensus.cc:359] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.858122  4047 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.858384  4046 raft_consensus.cc:385] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.858716  4046 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.859236  4047 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.859529  4046 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.863545  4048 ts_tablet_manager.cc:1434] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:26:49.864307  4047 ts_tablet_manager.cc:1434] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:49.866011  4047 tablet_bootstrap.cc:492] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:49.864533  4048 tablet_bootstrap.cc:492] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:49.871670  4074 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.872140  4074 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.873497  4047 tablet_bootstrap.cc:654] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.873950  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:49.874709  3931 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:49.877950  4048 tablet_bootstrap.cc:654] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.878648  4046 ts_tablet_manager.cc:1434] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:26:49.884294  4047 tablet_bootstrap.cc:492] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:49.884812  4047 ts_tablet_manager.cc:1403] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.003s
I20260709 12:26:49.887427  4047 raft_consensus.cc:359] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.889132  4047 raft_consensus.cc:385] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.889456  4047 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.889868  4074 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:49.890224  4047 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.890702  4048 tablet_bootstrap.cc:492] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:49.891348  4048 ts_tablet_manager.cc:1403] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.003s
I20260709 12:26:49.891387  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:49.892660  4047 ts_tablet_manager.cc:1434] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:26:49.893605  4047 tablet_bootstrap.cc:492] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
W20260709 12:26:49.893777  3897 leader_election.cc:343] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.894352  4048 raft_consensus.cc:359] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.895103  4048 raft_consensus.cc:385] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.895390  4048 raft_consensus.cc:740] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.899158  4046 tablet_bootstrap.cc:492] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:49.900732  4047 tablet_bootstrap.cc:654] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.896490  4048 consensus_queue.cc:260] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.904018  3821 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:49.905550  4345 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:49.905990  4345 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.906410  4345 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.906553  4048 ts_tablet_manager.cc:1434] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:26:49.907625  4048 tablet_bootstrap.cc:492] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:49.909509  4232 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:49.910831  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:49.911653  3855 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:49.913985  3895 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:49.915067  4074 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:49.915385  4074 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.915601  4074 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.916396  4302 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.921315  4074 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.918375  4302 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.927243  4074 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:49.929803  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:49.930682  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:49.933673  3855 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.941803  4232 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.944661  4232 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.946964  4302 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:49.947517  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:49.948164  3931 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
W20260709 12:26:49.948344  3897 leader_election.cc:343] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.949190  3821 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:49.949690  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:49.950241  4346 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:49.950584  4346 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.950928  4346 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:49.951836  3822 leader_election.cc:343] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.952026  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:49.953470  3855 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:49.952739  4232 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:26:49.954593  3897 leader_election.cc:343] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.957084  4346 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.957253  4345 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.960170  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:49.960695  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:49.960947  4048 tablet_bootstrap.cc:654] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.961040  4346 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:26:49.962021  3822 leader_election.cc:343] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.962798  4003 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.966178  4046 tablet_bootstrap.cc:654] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.968611  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:49.969087  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:49.969857  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:49.970201  3931 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.971030  3854 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 1: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:26:49.969391  3924 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.977402  3931 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:49.979121  3895 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:49.980906  4338 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:49.981947  3821 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:49.983501  4047 tablet_bootstrap.cc:492] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:49.983991  4047 ts_tablet_manager.cc:1403] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.009s
I20260709 12:26:49.976394  3751 catalog_manager.cc:5697] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.985205  4006 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.986279  4232 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.986804  4232 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:49.987737  4232 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.990505  3924 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:49.993049  4003 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:49.994562  3822 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:49.995950  4345 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:49.996071  4359 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.996810  4359 raft_consensus.cc:697] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:49.995605  4047 raft_consensus.cc:359] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:49.999374  4047 raft_consensus.cc:385] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.999699  4047 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.001446  3895 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:49.998001  4359 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.004163  4138 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.006666  4047 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.013835  4048 tablet_bootstrap.cc:492] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:50.014555  4048 ts_tablet_manager.cc:1403] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.006s
I20260709 12:26:50.007507  4338 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.021611  4338 raft_consensus.cc:697] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:50.024807  4338 consensus_queue.cc:237] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.036100  4047 ts_tablet_manager.cc:1434] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 12:26:50.038272  4047 tablet_bootstrap.cc:492] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:50.052104  4046 tablet_bootstrap.cc:492] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:50.052652  4046 ts_tablet_manager.cc:1403] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.154s	user 0.008s	sys 0.012s
I20260709 12:26:50.053751  4048 raft_consensus.cc:359] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.054463  4048 raft_consensus.cc:385] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.054739  4048 raft_consensus.cc:740] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.055359  4046 raft_consensus.cc:359] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.056105  4046 raft_consensus.cc:385] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.056427  4046 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.056233  3751 catalog_manager.cc:5697] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.058851  3751 catalog_manager.cc:5697] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.057212  4046 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.055361  4048 consensus_queue.cc:260] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.069700  4048 ts_tablet_manager.cc:1434] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 12:26:50.070843  4046 ts_tablet_manager.cc:1434] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:26:50.071784  4046 tablet_bootstrap.cc:492] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:50.075821  4358 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.076344  4358 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.077478  4046 tablet_bootstrap.cc:654] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.078578  4358 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:50.082896  4048 tablet_bootstrap.cc:492] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:50.086858  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:50.087013  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:50.087800  3931 raft_consensus.cc:2393] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 1: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:26:50.093501  4048 tablet_bootstrap.cc:654] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.093650  4047 tablet_bootstrap.cc:654] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.093478  3970 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:26:50.095484  4398 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:26:50.099869  4352 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.108973  4048 tablet_bootstrap.cc:492] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:50.109505  4048 ts_tablet_manager.cc:1403] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.008s
I20260709 12:26:50.119164  4048 raft_consensus.cc:359] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.119817  4048 raft_consensus.cc:385] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.120092  4048 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.122992  4048 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.127265  4048 ts_tablet_manager.cc:1434] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:26:50.128221  4048 tablet_bootstrap.cc:492] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:50.132740  4352 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.132781  3752 catalog_manager.cc:5697] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.136264  4047 tablet_bootstrap.cc:492] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:50.136746  4047 ts_tablet_manager.cc:1403] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.028s
I20260709 12:26:50.141417  4047 raft_consensus.cc:359] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.142556  4047 raft_consensus.cc:385] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.142881  4047 raft_consensus.cc:740] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.143769  4046 tablet_bootstrap.cc:492] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:50.143507  4047 consensus_queue.cc:260] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.145344  4046 ts_tablet_manager.cc:1403] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.010s
I20260709 12:26:50.146162  4047 ts_tablet_manager.cc:1434] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:50.148100  4048 tablet_bootstrap.cc:654] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.147192  4047 tablet_bootstrap.cc:492] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:50.147956  4046 raft_consensus.cc:359] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.148794  4046 raft_consensus.cc:385] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.149106  4046 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.149960  4046 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.152312  4046 ts_tablet_manager.cc:1434] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:26:50.153304  4046 tablet_bootstrap.cc:492] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:50.154999  4047 tablet_bootstrap.cc:654] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.160189  4046 tablet_bootstrap.cc:654] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.166523  4046 tablet_bootstrap.cc:492] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:50.166950  4046 ts_tablet_manager.cc:1403] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.002s
I20260709 12:26:50.169416  4046 raft_consensus.cc:359] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.170075  4046 raft_consensus.cc:385] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.170437  4046 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.171430  4046 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.174782  4046 ts_tablet_manager.cc:1434] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:50.184741  4048 tablet_bootstrap.cc:492] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:50.185325  4048 ts_tablet_manager.cc:1403] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.000s
I20260709 12:26:50.188489  4048 raft_consensus.cc:359] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.189293  4048 raft_consensus.cc:385] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.189595  4048 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.190035  4047 tablet_bootstrap.cc:492] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:50.190672  4047 ts_tablet_manager.cc:1403] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.003s
I20260709 12:26:50.190335  4048 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.193032  4048 ts_tablet_manager.cc:1434] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:50.193890  4047 raft_consensus.cc:359] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.194636  4047 raft_consensus.cc:385] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.194979  4048 tablet_bootstrap.cc:492] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:50.195436  4046 tablet_bootstrap.cc:492] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:50.194918  4047 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.197068  4047 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.201740  4046 tablet_bootstrap.cc:654] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.203894  4047 ts_tablet_manager.cc:1434] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:26:50.205365  4047 tablet_bootstrap.cc:492] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:50.211170  4359 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.212448  4048 tablet_bootstrap.cc:654] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.213171  4352 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.213701  4352 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.214648  4047 tablet_bootstrap.cc:654] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.216850  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:50.217095  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:50.218518  3970 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:50.219551  4358 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.220350  4352 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:50.231498  4047 tablet_bootstrap.cc:492] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:50.232035  4047 ts_tablet_manager.cc:1403] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.005s
I20260709 12:26:50.235436  4048 tablet_bootstrap.cc:492] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:50.236093  4048 ts_tablet_manager.cc:1403] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.003s
I20260709 12:26:50.239545  4345 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.241026  4160 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.240947  4048 raft_consensus.cc:359] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.242069  4048 raft_consensus.cc:385] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.241613  4160 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.242419  4048 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.243316  4048 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.244029  4160 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:50.245990  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:50.246268  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:50.247486  3895 leader_election.cc:343] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:50.248178  3897 leader_election.cc:343] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.248543  3897 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:50.253005  4047 raft_consensus.cc:359] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.253799  4047 raft_consensus.cc:385] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.254328  4047 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.254987  4047 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.257848  4048 ts_tablet_manager.cc:1434] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.002s
I20260709 12:26:50.258664  4338 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.259155  4048 tablet_bootstrap.cc:492] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:50.265579  4358 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.266330  4358 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.271601  4358 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:50.274293  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:50.280230  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:50.280539  3924 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 1: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:26:50.283071  3969 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:50.283980  4358 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.308650  4046 tablet_bootstrap.cc:492] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:50.309340  4046 ts_tablet_manager.cc:1403] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.134s	user 0.043s	sys 0.028s
I20260709 12:26:50.312258  4046 raft_consensus.cc:359] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.312813  4048 tablet_bootstrap.cc:654] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.312939  4046 raft_consensus.cc:385] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.313503  4046 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.314235  4046 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.315867  4046 ts_tablet_manager.cc:1434] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:50.316725  4047 ts_tablet_manager.cc:1434] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.084s	user 0.021s	sys 0.000s
I20260709 12:26:50.316836  4046 tablet_bootstrap.cc:492] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:50.317937  4047 tablet_bootstrap.cc:492] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:50.324874  4047 tablet_bootstrap.cc:654] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.336308  4046 tablet_bootstrap.cc:654] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.348500  4046 tablet_bootstrap.cc:492] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:50.349120  4046 ts_tablet_manager.cc:1403] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.008s
I20260709 12:26:50.364683  4358 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.366312  4338 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.367070  4338 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.370182  4338 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:50.372120  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:50.381106  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:50.381868  3853 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:50.383133  3895 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:50.388897  4160 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.392765  4160 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.393194  4160 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.401952  4046 raft_consensus.cc:359] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.402766  4046 raft_consensus.cc:385] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.403074  4046 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.403749  4046 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.405336  4046 ts_tablet_manager.cc:1434] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 12:26:50.405045  4359 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:50.405792  3897 leader_election.cc:343] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.410193  4160 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.412212  4160 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:50.412611  4302 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:50.415125  4046 tablet_bootstrap.cc:492] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:50.415752  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:50.416356  3853 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.416811  4048 tablet_bootstrap.cc:492] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:50.417035  4346 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.417260  4048 ts_tablet_manager.cc:1403] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.158s	user 0.035s	sys 0.036s
I20260709 12:26:50.417454  4346 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.419530  4346 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:50.419878  4048 raft_consensus.cc:359] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.420554  4048 raft_consensus.cc:385] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.420810  4048 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.421442  4048 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.423424  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:50.424748  4047 tablet_bootstrap.cc:492] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
W20260709 12:26:50.424701  3822 leader_election.cc:343] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.425588  4047 ts_tablet_manager.cc:1403] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.108s	user 0.033s	sys 0.031s
I20260709 12:26:50.427814  3853 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:50.428491  4047 raft_consensus.cc:359] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.430770  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:50.438731  4138 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.442250  4345 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.448434  4047 raft_consensus.cc:385] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.448133  4138 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.448748  4047 raft_consensus.cc:740] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.449455  4047 consensus_queue.cc:260] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.450649  4138 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:50.447381  3895 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:50.451851  4047 ts_tablet_manager.cc:1434] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:26:50.452422  4302 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.452904  4047 tablet_bootstrap.cc:492] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:50.453030  4302 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:50.454272  4335 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.442276  4048 ts_tablet_manager.cc:1434] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:26:50.454778  4335 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.455750  4048 tablet_bootstrap.cc:492] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:50.456143  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:26:50.457855  3822 leader_election.cc:343] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.457621  4335 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:50.454131  4302 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.461675  4046 tablet_bootstrap.cc:654] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.465579  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:26:50.536652  3821 leader_election.cc:343] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.538322  3821 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:50.539515  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:26:50.560763  3895 leader_election.cc:343] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:50.564559  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 110683us
I20260709 12:26:50.579627  4001 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.582398  4047 tablet_bootstrap.cc:654] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.586721  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:50.596490  4048 tablet_bootstrap.cc:654] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.602523  4138 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.604923  4335 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.609989  4335 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.614779  4335 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:50.616669  4300 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.617678  4300 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.601606  4428 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.626122  4300 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:26:50.651078  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 62422.8us
I20260709 12:26:50.650244  4428 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.654183  4428 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:50.681041  4046 tablet_bootstrap.cc:492] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:50.682415  4046 ts_tablet_manager.cc:1403] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.268s	user 0.012s	sys 0.015s
I20260709 12:26:50.688027  4046 raft_consensus.cc:359] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.695129  4046 raft_consensus.cc:385] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.696285  4046 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.697865  4046 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.701305  4358 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.701710  4352 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.702019  4358 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.702340  4352 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.704661  4046 ts_tablet_manager.cc:1434] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:26:50.717252  4046 tablet_bootstrap.cc:492] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:50.719204  4358 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:50.723639  4352 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:50.748683  4359 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.749513  4359 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.752969  4359 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:50.755463  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:50.784125  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:50.784996  3856 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
W20260709 12:26:50.785264  4416 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.133s	user 0.000s	sys 0.009s
I20260709 12:26:50.791409  3895 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:26:50.798171  3822 leader_election.cc:343] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.806927  4335 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.806591  4418 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.813637  4335 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.808768  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:50.814299  4335 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.815016  3931 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:50.816530  4418 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:50.817862  3897 leader_election.cc:343] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.819356  4418 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:50.822353  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:50.823433  3856 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:50.825624  4422 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.826298  4422 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.830287  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:50.819380  4047 tablet_bootstrap.cc:492] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:50.831718  4047 ts_tablet_manager.cc:1403] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.379s	user 0.028s	sys 0.062s
W20260709 12:26:50.838249  3895 leader_election.cc:343] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.840672  4048 tablet_bootstrap.cc:492] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:50.841522  4048 ts_tablet_manager.cc:1403] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.386s	user 0.016s	sys 0.010s
W20260709 12:26:50.844069  3897 leader_election.cc:343] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.845242  3897 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:50.848740  4422 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:50.856423  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:50.856633  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:50.859377  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:50.864683  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:50.877089  4046 tablet_bootstrap.cc:654] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.855163  4428 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.884996  4047 raft_consensus.cc:359] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.886001  4047 raft_consensus.cc:385] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.886309  4047 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.887019  4047 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.888156  3853 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:50.888141  4048 raft_consensus.cc:359] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.889106  4048 raft_consensus.cc:385] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.889473  4048 raft_consensus.cc:740] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
W20260709 12:26:50.879254  3822 leader_election.cc:343] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.890396  4047 ts_tablet_manager.cc:1434] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.002s
I20260709 12:26:50.890985  3895 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:50.891894  4047 tablet_bootstrap.cc:492] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:50.894251  4428 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.894759  4428 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.895174  4428 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.883620  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:50.890420  4048 consensus_queue.cc:260] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:50.906397  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:50.915740  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:50.917096  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:50.918952  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:50.919598  3931 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
W20260709 12:26:50.921474  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 77514us
I20260709 12:26:50.924415  4048 ts_tablet_manager.cc:1434] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.083s	user 0.011s	sys 0.000s
I20260709 12:26:50.932921  4048 tablet_bootstrap.cc:492] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:50.928013  4160 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:26:50.940913  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:50.941567  4046 tablet_bootstrap.cc:492] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:50.942087  4046 ts_tablet_manager.cc:1403] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.225s	user 0.021s	sys 0.003s
I20260709 12:26:50.946029  4047 tablet_bootstrap.cc:654] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.947088  3970 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:50.947958  4429 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.948336  4429 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.948684  4429 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.951681  3821 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:50.948060  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:50.991243  4359 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.991710  4359 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.992074  4359 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:50.992267  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 67112us
I20260709 12:26:51.007791  4048 tablet_bootstrap.cc:654] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.007170  3755 catalog_manager.cc:5697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.010380  4346 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:50.994904  4335 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:51.011709  3821 leader_election.cc:343] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:51.012869  3821 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:51.013622  4346 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:51.009944  4046 raft_consensus.cc:359] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.019428  4046 raft_consensus.cc:385] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.019639  4335 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:51.019724  4046 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.020532  4046 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.026093  4428 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.026279  4422 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.027763  3926 raft_consensus.cc:2393] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 1: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:26:51.028723  3821 leader_election.cc:343] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:51.029280  3821 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:51.028812  4428 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:51.018415  4429 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.032178  4422 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:51.040040  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:51.040829  3998 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:51.042284  4003 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.051317  4359 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.055532  4046 ts_tablet_manager.cc:1434] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.113s	user 0.009s	sys 0.000s
I20260709 12:26:51.056960  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:51.057912  4428 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.058076  4429 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:26:51.058804  3822 leader_election.cc:343] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:51.058063  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:51.059441  3931 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.064600  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:51.065349  3855 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:51.079690  3802 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:51.056687  4359 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:51.080454  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:51.081236  3853 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.116165  3931 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:51.117810  3970 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:51.118973  4430 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:51.119925  4430 raft_consensus.cc:697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:26:51.116165  3855 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:51.122143  4430 consensus_queue.cc:237] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.123378  3853 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:51.123725  4046 tablet_bootstrap.cc:492] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:51.126209  4047 tablet_bootstrap.cc:492] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:51.126899  4048 tablet_bootstrap.cc:492] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:51.126823  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:51.131188  3895 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:51.143033  3924 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.144088  4338 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:51.147051  4048 ts_tablet_manager.cc:1403] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.214s	user 0.014s	sys 0.015s
I20260709 12:26:51.147811  4047 ts_tablet_manager.cc:1403] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.256s	user 0.022s	sys 0.004s
I20260709 12:26:51.151750  3895 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:26:51.150483  3897 leader_election.cc:343] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:51.153374  4160 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:51.156172  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:51.156761  4006 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.147281  4338 raft_consensus.cc:697] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:51.154879  4358 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.163517  3969 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:51.173640  4160 raft_consensus.cc:697] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:51.171072  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:51.177495  3854 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.171274  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:26:51.194077  3897 leader_election.cc:343] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:51.194662  3897 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:51.196434  4338 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.207826  4048 raft_consensus.cc:359] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.170496  4358 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.208979  4048 raft_consensus.cc:385] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.188897  4160 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.210923  4427 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:51.215526  4048 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.239178  4046 tablet_bootstrap.cc:654] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.244413  3854 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:51.247421  4047 raft_consensus.cc:359] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.251660  4047 raft_consensus.cc:385] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.252108  4047 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
W20260709 12:26:51.254837  3897 consensus_peers.cc:597] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.261925  4047 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.275547  4006 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:51.276490  4432 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:51.284478  4047 ts_tablet_manager.cc:1434] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.136s	user 0.009s	sys 0.000s
I20260709 12:26:51.286226  4047 tablet_bootstrap.cc:492] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
W20260709 12:26:51.296808  4441 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.180s	user 0.004s	sys 0.005s
W20260709 12:26:51.299856  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 136423us
I20260709 12:26:51.300719  3969 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:51.301234  4427 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.313283  4427 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.336629  4447 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:51.338218  3924 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
W20260709 12:26:51.356714  3897 leader_election.cc:343] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:51.370990  4427 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:51.373471  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:51.400246  4047 tablet_bootstrap.cc:654] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.406935  4046 tablet_bootstrap.cc:492] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:51.407657  4046 ts_tablet_manager.cc:1403] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.284s	user 0.020s	sys 0.004s
I20260709 12:26:51.409163  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:51.405043  3855 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
W20260709 12:26:51.423310  3897 leader_election.cc:343] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:51.427559  4439 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.298s	user 0.004s	sys 0.005s
I20260709 12:26:51.430624  4048 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.432108  4300 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.440747  4048 ts_tablet_manager.cc:1434] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.293s	user 0.004s	sys 0.010s
I20260709 12:26:51.440452  4300 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.446972  4048 tablet_bootstrap.cc:492] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:51.448521  4358 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:51.445050  4046 raft_consensus.cc:359] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.450137  4046 raft_consensus.cc:385] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.450628  4046 raft_consensus.cc:740] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.453334  3969 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:51.453032  4046 consensus_queue.cc:260] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.458340  4358 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:51.458782  4358 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.459151  4358 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.477731  4046 ts_tablet_manager.cc:1434] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.001s
I20260709 12:26:51.482214  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:51.482944  4046 tablet_bootstrap.cc:492] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:51.483062  3925 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:51.488269  4047 tablet_bootstrap.cc:492] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:51.497598  4047 ts_tablet_manager.cc:1403] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.212s	user 0.028s	sys 0.035s
I20260709 12:26:51.502460  4048 tablet_bootstrap.cc:654] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.505437  4047 raft_consensus.cc:359] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.506162  4047 raft_consensus.cc:385] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.506410  4047 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.506888  4358 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.507112  4047 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.511664  4046 tablet_bootstrap.cc:654] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.512198  4047 ts_tablet_manager.cc:1434] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:26:51.513350  4047 tablet_bootstrap.cc:492] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:51.517853  4358 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:51.521482  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:51.522737  3924 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.523119  4047 tablet_bootstrap.cc:654] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.524331  4046 tablet_bootstrap.cc:492] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:51.524942  4046 ts_tablet_manager.cc:1403] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.002s
I20260709 12:26:51.528554  4046 raft_consensus.cc:359] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.529327  4046 raft_consensus.cc:385] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.529621  4046 raft_consensus.cc:740] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.530337  4046 consensus_queue.cc:260] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.534621  4046 ts_tablet_manager.cc:1434] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:26:51.534686  4422 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.535270  4422 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.535892  4046 tablet_bootstrap.cc:492] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:51.539309  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:51.541251  4422 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:26:51.544884  3822 leader_election.cc:343] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:51.550657  4046 tablet_bootstrap.cc:654] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:51.551726  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 51611.2us
I20260709 12:26:51.553467  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:51.554237  3853 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.561306  3853 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:51.564950  4046 tablet_bootstrap.cc:492] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:51.565554  4046 ts_tablet_manager.cc:1403] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.004s
I20260709 12:26:51.571869  4046 raft_consensus.cc:359] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.573203  4046 raft_consensus.cc:385] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.573560  4046 raft_consensus.cc:740] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.574404  4046 consensus_queue.cc:260] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.575403  3924 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:51.577003  3969 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:51.577836  4358 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:51.578387  4358 raft_consensus.cc:697] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:26:51.579119  4046 ts_tablet_manager.cc:1434] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 12:26:51.579334  4358 consensus_queue.cc:237] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.580500  4046 tablet_bootstrap.cc:492] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:51.586710  4300 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:51.589533  4046 tablet_bootstrap.cc:654] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.590571  4429 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:51.592561  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:51.598639  3853 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:51.564189  3752 catalog_manager.cc:5697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:51.605512  4046 tablet_bootstrap.cc:492] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:51.606065  4046 ts_tablet_manager.cc:1403] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.004s
I20260709 12:26:51.608387  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:51.608820  4046 raft_consensus.cc:359] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.609150  3924 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:51.609534  4046 raft_consensus.cc:385] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.593591  3821 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:51.612567  4346 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:51.613075  4346 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:51.613991  4346 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.618762  4046 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.671015  3969 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:51.669126  4046 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.688439  4046 ts_tablet_manager.cc:1434] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.000s
I20260709 12:26:51.679381  4429 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:51.698177  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:51.698936  3851 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:51.714634  4426 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.709723  3752 catalog_manager.cc:5697] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.715139  4426 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.716427  3752 catalog_manager.cc:5697] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.718797  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:51.692749  4429 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.713320  4432 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:26:51.731583  4429 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:51.720544  3897 leader_election.cc:343] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:51.742856  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:51.743491  3854 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:51.746959  3895 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:26:51.751303  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 77144.4us
I20260709 12:26:51.720256  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:51.766338  4047 tablet_bootstrap.cc:492] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:51.766906  4047 ts_tablet_manager.cc:1403] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.254s	user 0.033s	sys 0.064s
I20260709 12:26:51.772136  4046 tablet_bootstrap.cc:492] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Bootstrap starting.
I20260709 12:26:51.717309  4426 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:51.774084  4048 tablet_bootstrap.cc:492] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:51.777359  4048 ts_tablet_manager.cc:1403] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.331s	user 0.044s	sys 0.040s
W20260709 12:26:51.775204  3897 consensus_peers.cc:597] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:51.754576  4338 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:51.776460  3924 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 0.
I20260709 12:26:51.787940  4338 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.802841  4338 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.808349  4047 raft_consensus.cc:359] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.809103  4047 raft_consensus.cc:385] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.809428  4047 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.810900  4046 tablet_bootstrap.cc:654] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.816560  4047 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:51.821789  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 47101.3us
I20260709 12:26:51.822876  3821 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:51.829604  4047 ts_tablet_manager.cc:1434] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.062s	user 0.002s	sys 0.005s
I20260709 12:26:51.834506  3895 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:51.835784  4418 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:51.837333  4418 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.837697  4418 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.838414  4048 raft_consensus.cc:359] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.839287  4302 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.846326  4302 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.839018  4338 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.837081  4335 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.848663  4302 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:51.849442  4048 raft_consensus.cc:385] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.849767  4048 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.846695  4418 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.856807  4047 tablet_bootstrap.cc:492] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:51.859656  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:51.836434  4474 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:51.888036  4338 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:51.889834  4418 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:26:51.891302  3897 leader_election.cc:343] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:51.895875  4302 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.896417  4302 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.895123  4048 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:51.898887  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 45618.3us
I20260709 12:26:51.898660  4047 tablet_bootstrap.cc:654] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.886008  4474 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.906930  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:51.901469  4474 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.908701  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:51.909749  4048 ts_tablet_manager.cc:1434] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.132s	user 0.020s	sys 0.015s
W20260709 12:26:51.911365  3897 leader_election.cc:343] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:51.912272  3897 leader_election.cc:343] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:51.898640  4302 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:51.947239  4048 tablet_bootstrap.cc:492] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:51.960318  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:51.960971  4046 tablet_bootstrap.cc:492] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: No bootstrap required, opened a new log
I20260709 12:26:51.961050  3852 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 0.
I20260709 12:26:51.961539  4046 ts_tablet_manager.cc:1403] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent bootstrapping tablet: real 0.194s	user 0.017s	sys 0.025s
I20260709 12:26:51.948171  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:51.976368  3895 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:51.980669  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:51.978492  4046 raft_consensus.cc:359] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.982378  4046 raft_consensus.cc:385] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.983238  4046 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.980502  4473 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:51.986616  4473 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.986979  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:51.987680  3855 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.988616  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:51.986987  4473 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.968835  4429 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:51.989202  3854 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.998564  4429 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:52.001394  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:52.002172  3850 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:51.973127  4338 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:26:52.001808  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:52.006642  3927 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:52.010077  3897 leader_election.cc:343] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.016675  4429 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:52.069455  3895 leader_election.cc:343] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.070060  3895 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:52.071329  4160 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:52.099550  4046 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:52.100821  4481 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:26:52.113453  4046 ts_tablet_manager.cc:1434] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent starting tablet: real 0.152s	user 0.035s	sys 0.006s
I20260709 12:26:52.115348  3855 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:52.110180  4338 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:26:52.122253  4474 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.140583  4474 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:52.142395  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:52.141806  3854 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:52.143088  4006 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.143088  4048 tablet_bootstrap.cc:654] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.146924  4302 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.147362  4302 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.149981  4302 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:52.156711  4006 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:52.156955  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:52.172245  3895 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:26:52.176434  3822 consensus_peers.cc:597] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.177142  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:52.152428  4473 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.176484  4419 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.179104  4419 raft_consensus.cc:697] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:52.188336  4431 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.190279  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:52.192740  4300 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.184753  4419 consensus_queue.cc:237] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:52.197845  3897 leader_election.cc:343] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:52.199937  3802 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:52.206652  4473 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:52.188943  4431 raft_consensus.cc:697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:52.209626  3895 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:52.214641  4444 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.220384  4444 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:26:52.218114  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:52.218554  3753 catalog_manager.cc:5697] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:52.219748  4047 tablet_bootstrap.cc:492] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:52.218009  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:52.251637  4047 ts_tablet_manager.cc:1403] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.395s	user 0.033s	sys 0.026s
W20260709 12:26:52.252421  3897 leader_election.cc:343] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.208221  4431 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:26:52.258118  3895 leader_election.cc:343] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.259469  3895 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:52.258006  3924 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.261289  4335 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:52.266844  3850 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:52.249444  4444 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.261902  3927 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:26:52.275161  3970 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:26:52.254530  4346 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:26:52.278916  4430 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.279539  4430 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:26:52.288612  4047 raft_consensus.cc:359] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.289693  4047 raft_consensus.cc:385] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.290078  4047 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.290920  4047 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.293805  4047 ts_tablet_manager.cc:1434] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 12:26:52.295224  4047 tablet_bootstrap.cc:492] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: Bootstrap starting.
I20260709 12:26:52.296418  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:26:52.297191  3849 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.329183  4047 tablet_bootstrap.cc:654] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.310985  4430 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.338361  4048 tablet_bootstrap.cc:492] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:52.338961  4048 ts_tablet_manager.cc:1403] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.393s	user 0.032s	sys 0.043s
I20260709 12:26:52.362574  3924 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:52.350739  4346 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.388161  4346 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.412367  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:52.413090  3930 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:52.414667  3821 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:52.417296  4346 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:52.393054  4048 raft_consensus.cc:359] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.418380  4048 raft_consensus.cc:385] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.418918  4048 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.420336  4048 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.429311  4422 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.429759  4422 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.430121  4422 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.440024  4422 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.442190  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:52.443943  4048 ts_tablet_manager.cc:1434] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.002s
W20260709 12:26:52.446347  3822 leader_election.cc:343] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.448040  4048 tablet_bootstrap.cc:492] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:52.459767  4422 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:52.459959  3849 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:26:52.465302  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:52.468168  3895 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:52.473011  4419 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.473578  4419 raft_consensus.cc:697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:26:52.471288  3822 leader_election.cc:343] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.490419  4419 consensus_queue.cc:237] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.492884  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:52.493556  3932 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.501089  3932 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:52.502665  3821 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:26:52.504024  4472 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.504606  4472 raft_consensus.cc:697] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:52.505437  4048 tablet_bootstrap.cc:654] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.505522  4472 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.527997  4047 tablet_bootstrap.cc:492] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: No bootstrap required, opened a new log
I20260709 12:26:52.528594  4047 ts_tablet_manager.cc:1403] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: Time spent bootstrapping tablet: real 0.234s	user 0.037s	sys 0.057s
I20260709 12:26:52.531231  4047 raft_consensus.cc:359] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.531904  4047 raft_consensus.cc:385] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.532236  4047 raft_consensus.cc:740] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.533224  4047 consensus_queue.cc:260] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.535710  4047 ts_tablet_manager.cc:1434] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:52.537371  3752 catalog_manager.cc:5697] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.539168  4048 tablet_bootstrap.cc:492] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:52.542223  4048 ts_tablet_manager.cc:1403] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.009s
I20260709 12:26:52.544857  4048 raft_consensus.cc:359] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.545547  4048 raft_consensus.cc:385] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.545799  4048 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.546429  4048 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.547319  3755 catalog_manager.cc:5697] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.548847  3755 catalog_manager.cc:5697] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.549274  4048 ts_tablet_manager.cc:1434] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:52.551863  4048 tablet_bootstrap.cc:492] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:52.561009  4048 tablet_bootstrap.cc:654] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.568847  3752 catalog_manager.cc:5697] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:52.588008  4048 tablet_bootstrap.cc:492] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:52.588482  4048 ts_tablet_manager.cc:1403] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.019s
W20260709 12:26:52.588739  3897 consensus_peers.cc:597] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.591096  4048 raft_consensus.cc:359] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.591790  4048 raft_consensus.cc:385] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.592056  4048 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.592691  4048 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.594803  4048 ts_tablet_manager.cc:1434] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:52.602984  4048 tablet_bootstrap.cc:492] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:52.609015  4048 tablet_bootstrap.cc:654] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.612411  4300 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.612947  4300 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.616111  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:52.618062  4300 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:52.624253  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:52.625095  3849 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 1: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:26:52.627795  3969 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:52.633476  4048 tablet_bootstrap.cc:492] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:52.634030  4048 ts_tablet_manager.cc:1403] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.020s
I20260709 12:26:52.634186  4352 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.629733  3752 catalog_manager.cc:5697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.637137  4048 raft_consensus.cc:359] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.637895  4048 raft_consensus.cc:385] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.638211  4048 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.638950  4048 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.637406  3752 catalog_manager.cc:5697] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.641283  4048 ts_tablet_manager.cc:1434] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:52.642298  4048 tablet_bootstrap.cc:492] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:52.648716  4048 tablet_bootstrap.cc:654] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.649325  4352 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:52.650205  4300 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.650784  4300 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.662050  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:52.668483  3755 catalog_manager.cc:5697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.670188  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:52.673920  3970 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:52.674569  4497 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:52.670028  4300 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:52.688926  4302 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.692623  4048 tablet_bootstrap.cc:492] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:52.693236  4048 ts_tablet_manager.cc:1403] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.051s	user 0.029s	sys 0.019s
I20260709 12:26:52.693953  4302 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:52.696744  4048 raft_consensus.cc:359] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.697642  4048 raft_consensus.cc:385] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.697949  4048 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.698781  4048 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.700511  4048 ts_tablet_manager.cc:1434] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:52.703935  4048 tablet_bootstrap.cc:492] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:52.709620  4048 tablet_bootstrap.cc:654] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.717962  4002 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.754093  4002 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.765516  3998 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.790736  4418 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:52.814409  4048 tablet_bootstrap.cc:492] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:52.814925  4048 ts_tablet_manager.cc:1403] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.111s	user 0.046s	sys 0.054s
I20260709 12:26:52.817552  4048 raft_consensus.cc:359] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.818218  4048 raft_consensus.cc:385] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.818481  4048 raft_consensus.cc:740] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.819265  4048 consensus_queue.cc:260] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.824710  4048 ts_tablet_manager.cc:1434] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:52.828063  4048 tablet_bootstrap.cc:492] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:52.833038  4048 tablet_bootstrap.cc:654] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.840830  4048 tablet_bootstrap.cc:492] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:52.841846  4048 ts_tablet_manager.cc:1403] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.001s
I20260709 12:26:52.844355  4048 raft_consensus.cc:359] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.845013  4048 raft_consensus.cc:385] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.845274  4048 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.845944  4048 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.847834  4048 ts_tablet_manager.cc:1434] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:26:52.848610  4048 tablet_bootstrap.cc:492] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Bootstrap starting.
I20260709 12:26:52.853717  4048 tablet_bootstrap.cc:654] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.854998  4430 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.858907  4048 tablet_bootstrap.cc:492] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: No bootstrap required, opened a new log
I20260709 12:26:52.860482  4048 ts_tablet_manager.cc:1403] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 12:26:52.863073  4048 raft_consensus.cc:359] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.863746  4048 raft_consensus.cc:385] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.864002  4048 raft_consensus.cc:740] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.864949  4048 consensus_queue.cc:260] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.867025  4048 ts_tablet_manager.cc:1434] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:52.874692  4498 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.878674  4300 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.877727  4498 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.883100  4498 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.886425  4498 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:52.888159  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:52.888836  3923 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:52.887492  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:26:52.890260  3821 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:52.891203  3998 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 0.
I20260709 12:26:52.891706  4498 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.892118  4498 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.892513  4498 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.903772  4498 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.905704  4498 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:52.908519  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:26:52.909112  4003 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.909638  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:26:52.910228  3923 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.915719  4003 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:52.916858  3923 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:26:52.918649  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:26:52.918725  4423 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.925561  4498 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.926083  4498 raft_consensus.cc:697] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:26:52.927244  4498 consensus_queue.cc:237] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.941965  4497 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.942471  4497 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:26:52.948652  4497 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:52.952539  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:26:52.953109  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:26:52.953392  3923 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 1: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:26:52.955621  3969 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:26:52.956655  4497 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.960727  3755 catalog_manager.cc:5697] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.963733  4497 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:52.967201  4423 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.982412  4498 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.020043  3998 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.028543  4302 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.040310  4419 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.119473  3998 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.325800  4476 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.337666  4498 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:54.939249  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:54.971782  4527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:54.972134  4528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:54.974443  4530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:54.976537  2676 server_base.cc:1061] running on GCE node
I20260709 12:26:54.977723  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:54.978053  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:54.978257  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600014978241 us; error 0 us; skew 500 ppm
I20260709 12:26:54.978785  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:54.981822  2676 webserver.cc:533] Webserver started at http://127.2.157.4:46355/ using document root <none> and password file <none>
I20260709 12:26:54.982404  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:54.982640  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:54.982959  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:54.984159  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-3-root/instance:
uuid: "f3cab225ecb7488386a1a19239498cfe"
format_stamp: "Formatted at 2026-07-09 12:26:54 on dist-test-slave-0768"
I20260709 12:26:54.989030  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:54.992733  4535 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:54.994562  2676 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:26:54.994956  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-3-root
uuid: "f3cab225ecb7488386a1a19239498cfe"
format_stamp: "Formatted at 2026-07-09 12:26:54 on dist-test-slave-0768"
I20260709 12:26:54.995323  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:55.025700  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:55.027438  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:55.029227  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:55.032938  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:55.033245  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:55.033563  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:55.033821  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:55.092566  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.4:41095
I20260709 12:26:55.092643  4598 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.4:41095 every 8 connection(s)
I20260709 12:26:55.096928  2676 auto_leader_rebalancer-test.cc:439] add a tserver: f3cab225ecb7488386a1a19239498cfe
I20260709 12:26:55.113708  4599 heartbeater.cc:344] Connected to a master server at 127.2.157.62:44099
I20260709 12:26:55.114158  4599 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:55.114842  4599 heartbeater.cc:507] Master 127.2.157.62:44099 requested a full tablet report, sending...
I20260709 12:26:55.116689  3755 ts_manager.cc:194] Registered new tserver with Master: f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:26:55.118070  3755 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39516
I20260709 12:26:55.383399  4003 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:55.392084  3924 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:55.395571  3849 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:55.398168  4300 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:55.399710  4430 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:55.492812  3971 consensus_peers.cc:597] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65ec95afb9e240f29bd517e63249c8d2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:55.490897  3924 raft_consensus.cc:2955] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.486581  4607 raft_consensus.cc:2955] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.502611  3850 raft_consensus.cc:2955] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.526436  3755 catalog_manager.cc:5697] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.551692  4003 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:55.565425  3924 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:55.567039  4614 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:55.569007  3971 consensus_peers.cc:597] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88b08017bb344d72aa432be8a7d5d03f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:55.571974  3850 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:55.573470  4614 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:55.586191  3924 raft_consensus.cc:2955] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.585958  3850 raft_consensus.cc:2955] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.583895  4300 raft_consensus.cc:2955] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.612041  3753 catalog_manager.cc:5697] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.620982  3849 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:55.634774  3924 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:55.637296  4003 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:55.638696  4613 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:55.641019  4613 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:55.647645  3822 consensus_peers.cc:597] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 812f8e58e6d54e67a0d699b41fc6815b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:55.652379  4612 raft_consensus.cc:2955] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.654073  3924 raft_consensus.cc:2955] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.654456  4003 raft_consensus.cc:2955] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.671321  3849 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:55.669286  3753 catalog_manager.cc:5697] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
W20260709 12:26:55.684794  3822 consensus_peers.cc:597] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b7d3aec426d4ef7aa5adcd0ab4c8da2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:55.684877  3924 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:55.685307  4003 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:55.686509  4612 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:55.689040  4613 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:55.715003  3924 raft_consensus.cc:2955] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.710718  4613 raft_consensus.cc:2955] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.744414  3755 catalog_manager.cc:5697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.745918  4006 raft_consensus.cc:2955] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:55.866801  4632 ts_tablet_manager.cc:933] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:55.870751  4632 tablet_copy_client.cc:323] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.3:33709
I20260709 12:26:55.887001  4016 tablet_copy_service.cc:140] P 34711da9380944d2969a2bc3e203db3d: Received BeginTabletCopySession request for tablet 65ec95afb9e240f29bd517e63249c8d2 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:51898)
I20260709 12:26:55.887696  4016 tablet_copy_service.cc:161] P 34711da9380944d2969a2bc3e203db3d: Beginning new tablet copy session on tablet 65ec95afb9e240f29bd517e63249c8d2 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:51898: session id = f3cab225ecb7488386a1a19239498cfe-65ec95afb9e240f29bd517e63249c8d2
I20260709 12:26:55.897584  4016 tablet_copy_source_session.cc:215] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:55.901753  4632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ec95afb9e240f29bd517e63249c8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:55.912240  4632 tablet_copy_client.cc:806] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:55.914310  4632 tablet_copy_client.cc:670] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:55.918891  4632 tablet_copy_client.cc:538] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:55.929057  4632 tablet_bootstrap.cc:492] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:26:55.955044  4632 tablet_bootstrap.cc:492] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:55.956126  4632 tablet_bootstrap.cc:492] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:26:55.956879  4632 ts_tablet_manager.cc:1403] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.008s
I20260709 12:26:55.960225  4632 raft_consensus.cc:359] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:55.961190  4632 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:26:55.961963  4632 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:55.965555  4599 heartbeater.cc:499] Master 127.2.157.62:44099 was elected leader, sending a full tablet report...
I20260709 12:26:55.966338  4632 ts_tablet_manager.cc:1434] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:26:55.971148  4016 tablet_copy_service.cc:342] P 34711da9380944d2969a2bc3e203db3d: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-65ec95afb9e240f29bd517e63249c8d2 received from {username='slave'} at 127.0.0.1:51898
I20260709 12:26:55.971675  4016 tablet_copy_service.cc:434] P 34711da9380944d2969a2bc3e203db3d: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-65ec95afb9e240f29bd517e63249c8d2 on tablet 65ec95afb9e240f29bd517e63249c8d2 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:26:56.086421  4632 ts_tablet_manager.cc:933] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:26:56.091212  4632 tablet_copy_client.cc:323] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.1:32843
I20260709 12:26:56.101850  3867 tablet_copy_service.cc:140] P 4eedd844c09d456ca0b3614490dd1dbb: Received BeginTabletCopySession request for tablet 9b7d3aec426d4ef7aa5adcd0ab4c8da2 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:40038)
I20260709 12:26:56.102481  3867 tablet_copy_service.cc:161] P 4eedd844c09d456ca0b3614490dd1dbb: Beginning new tablet copy session on tablet 9b7d3aec426d4ef7aa5adcd0ab4c8da2 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:40038: session id = f3cab225ecb7488386a1a19239498cfe-9b7d3aec426d4ef7aa5adcd0ab4c8da2
I20260709 12:26:56.109541  3867 tablet_copy_source_session.cc:215] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:56.112756  4632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7d3aec426d4ef7aa5adcd0ab4c8da2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.129024  4632 tablet_copy_client.cc:806] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:56.129698  4632 tablet_copy_client.cc:670] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:56.133936  4632 tablet_copy_client.cc:538] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:56.143015  4632 tablet_bootstrap.cc:492] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:26:56.165447  4632 tablet_bootstrap.cc:492] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.166482  4632 tablet_bootstrap.cc:492] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:26:56.167222  4632 ts_tablet_manager.cc:1403] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.012s
I20260709 12:26:56.170624  4632 raft_consensus.cc:359] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:56.171554  4632 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:26:56.172478  4632 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:56.175177  4632 ts_tablet_manager.cc:1434] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:26:56.177937  3867 tablet_copy_service.cc:342] P 4eedd844c09d456ca0b3614490dd1dbb: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-9b7d3aec426d4ef7aa5adcd0ab4c8da2 received from {username='slave'} at 127.0.0.1:40038
I20260709 12:26:56.178372  3867 tablet_copy_service.cc:434] P 4eedd844c09d456ca0b3614490dd1dbb: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-9b7d3aec426d4ef7aa5adcd0ab4c8da2 on tablet 9b7d3aec426d4ef7aa5adcd0ab4c8da2 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:26:56.183171  4632 ts_tablet_manager.cc:933] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:26:56.191030  4639 ts_tablet_manager.cc:933] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:26:56.194342  4639 tablet_copy_client.cc:323] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.1:32843
I20260709 12:26:56.195974  3867 tablet_copy_service.cc:140] P 4eedd844c09d456ca0b3614490dd1dbb: Received BeginTabletCopySession request for tablet 812f8e58e6d54e67a0d699b41fc6815b from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:40038)
I20260709 12:26:56.196537  3867 tablet_copy_service.cc:161] P 4eedd844c09d456ca0b3614490dd1dbb: Beginning new tablet copy session on tablet 812f8e58e6d54e67a0d699b41fc6815b from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:40038: session id = f3cab225ecb7488386a1a19239498cfe-812f8e58e6d54e67a0d699b41fc6815b
I20260709 12:26:56.197119  4632 tablet_copy_client.cc:323] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.3:33709
I20260709 12:26:56.198884  4016 tablet_copy_service.cc:140] P 34711da9380944d2969a2bc3e203db3d: Received BeginTabletCopySession request for tablet 88b08017bb344d72aa432be8a7d5d03f from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:51898)
I20260709 12:26:56.199453  4016 tablet_copy_service.cc:161] P 34711da9380944d2969a2bc3e203db3d: Beginning new tablet copy session on tablet 88b08017bb344d72aa432be8a7d5d03f from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:51898: session id = f3cab225ecb7488386a1a19239498cfe-88b08017bb344d72aa432be8a7d5d03f
I20260709 12:26:56.203212  3867 tablet_copy_source_session.cc:215] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:56.207083  4016 tablet_copy_source_session.cc:215] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:56.209781  4639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812f8e58e6d54e67a0d699b41fc6815b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.210459  4632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b08017bb344d72aa432be8a7d5d03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.223675  4639 tablet_copy_client.cc:806] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:56.224308  4639 tablet_copy_client.cc:670] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:56.225476  4632 tablet_copy_client.cc:806] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:56.226006  4632 tablet_copy_client.cc:670] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:56.231745  4632 tablet_copy_client.cc:538] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:56.232905  4639 tablet_copy_client.cc:538] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:56.239329  4632 tablet_bootstrap.cc:492] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:26:56.248018  4639 tablet_bootstrap.cc:492] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:26:56.264128  4632 tablet_bootstrap.cc:492] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.264976  4632 tablet_bootstrap.cc:492] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:26:56.265581  4632 ts_tablet_manager.cc:1403] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.008s
I20260709 12:26:56.268256  4632 raft_consensus.cc:359] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:56.268998  4632 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:26:56.269451  4639 tablet_bootstrap.cc:492] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.269549  4632 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:56.270447  4639 tablet_bootstrap.cc:492] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:26:56.271114  4639 ts_tablet_manager.cc:1403] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 12:26:56.272641  4632 ts_tablet_manager.cc:1434] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:26:56.274263  4639 raft_consensus.cc:359] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:56.275178  4639 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:26:56.275614  4016 tablet_copy_service.cc:342] P 34711da9380944d2969a2bc3e203db3d: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-88b08017bb344d72aa432be8a7d5d03f received from {username='slave'} at 127.0.0.1:51898
I20260709 12:26:56.276037  4016 tablet_copy_service.cc:434] P 34711da9380944d2969a2bc3e203db3d: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-88b08017bb344d72aa432be8a7d5d03f on tablet 88b08017bb344d72aa432be8a7d5d03f with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:26:56.275856  4639 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:56.278744  4639 ts_tablet_manager.cc:1434] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 12:26:56.283020  3867 tablet_copy_service.cc:342] P 4eedd844c09d456ca0b3614490dd1dbb: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-812f8e58e6d54e67a0d699b41fc6815b received from {username='slave'} at 127.0.0.1:40038
I20260709 12:26:56.283497  3867 tablet_copy_service.cc:434] P 4eedd844c09d456ca0b3614490dd1dbb: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-812f8e58e6d54e67a0d699b41fc6815b on tablet 812f8e58e6d54e67a0d699b41fc6815b with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:26:56.434275  4574 raft_consensus.cc:1217] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:56.647887  4574 raft_consensus.cc:1217] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:56.687916  4574 raft_consensus.cc:1217] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:56.764427  4574 raft_consensus.cc:1217] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:56.919881  4300 raft_consensus.cc:1064] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:26:56.922329  4300 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:26:56.928364  3924 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:56.928980  4574 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:56.929952  4300 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:56.930197  3848 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:56.930887  4644 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:56.931699  4614 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:56.954522  4614 raft_consensus.cc:2955] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:56.960130  3924 raft_consensus.cc:2955] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:56.962401  4574 raft_consensus.cc:2955] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:56.981249  3752 catalog_manager.cc:5697] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:56.998889  3849 raft_consensus.cc:2955] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.053886  4006 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:26:57.059891  4574 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:57.061457  4651 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.065759  3849 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:57.068395  4614 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.070449  4644 raft_consensus.cc:2955] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.079315  4574 raft_consensus.cc:2955] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.086232  3849 raft_consensus.cc:2955] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.097076  3741 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 65ec95afb9e240f29bd517e63249c8d2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:57.104117  3755 catalog_manager.cc:5697] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.121666  3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 65ec95afb9e240f29bd517e63249c8d2 with delete_type TABLET_DATA_TOMBSTONED (TS 073f84fcc295417f9bcc1eea29d2bb58 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43294
I20260709 12:26:57.161361  4656 tablet_replica.cc:333] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:26:57.162472  4656 raft_consensus.cc:2243] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:57.163232  4656 raft_consensus.cc:2272] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:57.170195  4656 ts_tablet_manager.cc:1916] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:57.186913  4656 ts_tablet_manager.cc:1929] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:57.187400  4656 log.cc:1199] T 65ec95afb9e240f29bd517e63249c8d2 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/wals/65ec95afb9e240f29bd517e63249c8d2
I20260709 12:26:57.189174  3740 catalog_manager.cc:5028] TS 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): tablet 65ec95afb9e240f29bd517e63249c8d2 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:26:57.272723  4612 raft_consensus.cc:1064] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:26:57.275576  4612 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:26:57.284137  4574 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:57.285543  4655 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:57.286527  3932 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:57.288890  4006 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:57.291147  4540 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:57.292970  4540 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:57.302670  4655 raft_consensus.cc:1064] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:26:57.306748  4540 raft_consensus.cc:2955] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.305198  4655 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:26:57.310766  4573 raft_consensus.cc:2955] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.315781  4651 raft_consensus.cc:1064] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:26:57.319175  4651 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:26:57.324767  4574 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:57.326285  4613 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:57.329818  4000 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:57.333755  4474 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:57.343976  4003 raft_consensus.cc:2955] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.361245  3925 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:57.360750  3924 raft_consensus.cc:2955] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.368153  4573 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:57.370306  4650 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:57.353586  4540 raft_consensus.cc:2955] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.372292  3755 catalog_manager.cc:5697] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.358019  4572 raft_consensus.cc:2955] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.378688  3849 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:57.380820  4650 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:57.383024  3932 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:57.386087  4651 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:57.397529  4006 raft_consensus.cc:2955] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.407800  4612 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:57.413839  4644 raft_consensus.cc:2955] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.425730  3932 raft_consensus.cc:2955] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.432930  3753 catalog_manager.cc:5697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.438625  4572 raft_consensus.cc:2955] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.451140  3924 raft_consensus.cc:2955] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.462148  3848 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:26:57.479074  3753 catalog_manager.cc:5697] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.508986  3924 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:57.511518  4006 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:26:57.509788  4572 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:57.515050  4612 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.525780  4655 raft_consensus.cc:2955] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.528743  3925 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:57.535339  3848 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:26:57.531319  4574 raft_consensus.cc:2955] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.541474  4644 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.543045  4572 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:57.546643  4644 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.547029  3739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 812f8e58e6d54e67a0d699b41fc6815b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:57.551548  4671 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.553678  4650 raft_consensus.cc:2955] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.556815  3751 catalog_manager.cc:5697] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.560519  3924 raft_consensus.cc:2955] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.569664  3996 tablet_service.cc:1558] Processing DeleteTablet for tablet 812f8e58e6d54e67a0d699b41fc6815b with delete_type TABLET_DATA_TOMBSTONED (TS 34711da9380944d2969a2bc3e203db3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36508
I20260709 12:26:57.573637  3741 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 88b08017bb344d72aa432be8a7d5d03f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:57.574270  4574 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:57.576037  4670 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.579404  4574 raft_consensus.cc:2955] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.588941  4670 raft_consensus.cc:2955] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.595680  4572 raft_consensus.cc:2955] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.600802  3932 raft_consensus.cc:2955] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.603067  4000 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:57.605587  4671 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.606479  3753 catalog_manager.cc:5697] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.611231  4000 raft_consensus.cc:2955] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.625435  3840 tablet_service.cc:1558] Processing DeleteTablet for tablet 88b08017bb344d72aa432be8a7d5d03f with delete_type TABLET_DATA_TOMBSTONED (TS 4eedd844c09d456ca0b3614490dd1dbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42036
I20260709 12:26:57.625741  4672 tablet_replica.cc:333] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:26:57.626910  4672 raft_consensus.cc:2243] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:57.627741  4672 raft_consensus.cc:2272] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:57.631413  4672 ts_tablet_manager.cc:1916] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:57.636102  3739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b7d3aec426d4ef7aa5adcd0ab4c8da2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:57.640657  3753 catalog_manager.cc:5697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:26:57.664763  4672 ts_tablet_manager.cc:1929] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:57.670836  4672 log.cc:1199] T 812f8e58e6d54e67a0d699b41fc6815b P 34711da9380944d2969a2bc3e203db3d: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/wals/812f8e58e6d54e67a0d699b41fc6815b
I20260709 12:26:57.673591  3741 catalog_manager.cc:5028] TS 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): tablet 812f8e58e6d54e67a0d699b41fc6815b (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:26:57.679486  3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b7d3aec426d4ef7aa5adcd0ab4c8da2 with delete_type TABLET_DATA_TOMBSTONED (TS 073f84fcc295417f9bcc1eea29d2bb58 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43294
I20260709 12:26:57.680084  4673 tablet_replica.cc:333] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:26:57.683727  4656 tablet_replica.cc:333] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:26:57.689811  4656 raft_consensus.cc:2243] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:57.690539  4656 raft_consensus.cc:2272] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:57.691582  4673 raft_consensus.cc:2243] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:57.693478  4673 pending_rounds.cc:70] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb: Trying to abort 1 pending ops.
I20260709 12:26:57.693831  4673 pending_rounds.cc:77] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305625670930006016 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "88b08017bb344d72aa432be8a7d5d03f" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } } }
I20260709 12:26:57.694832  4656 ts_tablet_manager.cc:1916] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:57.695222  4673 raft_consensus.cc:2917] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:26:57.696933  4673 raft_consensus.cc:2889] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:26:57.697314  4673 raft_consensus.cc:2272] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:57.701103  4673 ts_tablet_manager.cc:1916] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:57.710196  4656 ts_tablet_manager.cc:1929] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:57.710691  4656 log.cc:1199] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/wals/9b7d3aec426d4ef7aa5adcd0ab4c8da2
I20260709 12:26:57.712154  3740 catalog_manager.cc:5028] TS 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): tablet 9b7d3aec426d4ef7aa5adcd0ab4c8da2 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:26:57.717283  4673 ts_tablet_manager.cc:1929] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:57.717695  4673 log.cc:1199] T 88b08017bb344d72aa432be8a7d5d03f P 4eedd844c09d456ca0b3614490dd1dbb: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/wals/88b08017bb344d72aa432be8a7d5d03f
I20260709 12:26:57.719264  3739 catalog_manager.cc:5028] TS 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): tablet 88b08017bb344d72aa432be8a7d5d03f (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:26:58.753569  3925 consensus_queue.cc:237] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:58.761596  3848 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:58.763276  4006 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:58.764140  4657 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.767266  4603 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.773909  4603 raft_consensus.cc:2955] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:58.779659  3848 raft_consensus.cc:2955] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
W20260709 12:26:58.787782  3897 consensus_peers.cc:597] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8693e7a0624445758baf0b77c7686e0c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:58.790099  4000 raft_consensus.cc:2955] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:58.800629  3753 catalog_manager.cc:5697] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:58.813395  3925 consensus_queue.cc:237] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
W20260709 12:26:58.828367  3897 consensus_peers.cc:597] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7185a57fbd78466ab6ccbbbd0453c2aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:58.828929  4000 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:58.830260  4603 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:58.831887  3854 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:58.836417  4603 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.848664  4657 raft_consensus.cc:2955] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:58.851667  3854 raft_consensus.cc:2955] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:58.852814  4000 raft_consensus.cc:2955] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:58.864849  3854 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:58.869612  3751 catalog_manager.cc:5697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
W20260709 12:26:58.872612  3822 consensus_peers.cc:597] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 378a06c64b37451cbad82415b967e001. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:58.874166  4000 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:58.875573  3925 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:58.875782  4670 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.877323  4613 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.888794  4670 raft_consensus.cc:2955] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:58.890532  4000 raft_consensus.cc:2955] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:58.894795  3925 raft_consensus.cc:2955] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:58.915922  3753 catalog_manager.cc:5697] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:58.932577  3925 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:58.953953  3998 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:58.955041  3897 consensus_peers.cc:597] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 781f4e626c2b4af0af08871cfde2d83e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:58.955933  4603 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.956632  3854 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:58.958142  4603 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.963512  4603 raft_consensus.cc:2955] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:58.965237  4006 raft_consensus.cc:2955] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:58.982928  3848 raft_consensus.cc:2955] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:26:58.990985  3751 catalog_manager.cc:5697] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.284482  4697 ts_tablet_manager.cc:933] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:59.286080  4697 tablet_copy_client.cc:323] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:26:59.298209  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet 8693e7a0624445758baf0b77c7686e0c from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:26:59.298822  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet 8693e7a0624445758baf0b77c7686e0c from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-8693e7a0624445758baf0b77c7686e0c
I20260709 12:26:59.305063  3942 tablet_copy_source_session.cc:215] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:59.309067  4697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8693e7a0624445758baf0b77c7686e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.324985  4697 tablet_copy_client.cc:806] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:59.325542  4697 tablet_copy_client.cc:670] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:59.328949  4697 tablet_copy_client.cc:538] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:59.335311  4697 tablet_bootstrap.cc:492] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:26:59.353720  4697 tablet_bootstrap.cc:492] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:59.354682  4697 tablet_bootstrap.cc:492] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:26:59.355330  4697 ts_tablet_manager.cc:1403] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.007s
I20260709 12:26:59.358260  4697 raft_consensus.cc:359] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:59.359050  4697 raft_consensus.cc:740] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:26:59.359679  4697 consensus_queue.cc:260] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:59.362990  4697 ts_tablet_manager.cc:1434] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:26:59.365104  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-8693e7a0624445758baf0b77c7686e0c received from {username='slave'} at 127.0.0.1:54068
I20260709 12:26:59.365535  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-8693e7a0624445758baf0b77c7686e0c on tablet 8693e7a0624445758baf0b77c7686e0c with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:26:59.393868  4697 ts_tablet_manager.cc:933] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:59.395716  4697 tablet_copy_client.cc:323] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:26:59.397374  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet 781f4e626c2b4af0af08871cfde2d83e from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:26:59.398052  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet 781f4e626c2b4af0af08871cfde2d83e from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-781f4e626c2b4af0af08871cfde2d83e
I20260709 12:26:59.409161  3942 tablet_copy_source_session.cc:215] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:59.412571  4697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 781f4e626c2b4af0af08871cfde2d83e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.412586  4704 ts_tablet_manager.cc:933] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:26:59.428058  4704 tablet_copy_client.cc:323] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:26:59.429723  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet 7185a57fbd78466ab6ccbbbd0453c2aa from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:26:59.430346  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet 7185a57fbd78466ab6ccbbbd0453c2aa from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-7185a57fbd78466ab6ccbbbd0453c2aa
I20260709 12:26:59.432226  4697 tablet_copy_client.cc:806] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:59.432789  4697 tablet_copy_client.cc:670] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:59.438130  3942 tablet_copy_source_session.cc:215] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:59.438319  4697 tablet_copy_client.cc:538] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:59.444494  4704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7185a57fbd78466ab6ccbbbd0453c2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.449326  4697 tablet_bootstrap.cc:492] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:26:59.479660  4707 ts_tablet_manager.cc:933] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:26:59.492583  4707 tablet_copy_client.cc:323] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.1:32843
I20260709 12:26:59.495049  3867 tablet_copy_service.cc:140] P 4eedd844c09d456ca0b3614490dd1dbb: Received BeginTabletCopySession request for tablet 378a06c64b37451cbad82415b967e001 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:40038)
I20260709 12:26:59.495740  3867 tablet_copy_service.cc:161] P 4eedd844c09d456ca0b3614490dd1dbb: Beginning new tablet copy session on tablet 378a06c64b37451cbad82415b967e001 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:40038: session id = f3cab225ecb7488386a1a19239498cfe-378a06c64b37451cbad82415b967e001
I20260709 12:26:59.504172  4704 tablet_copy_client.cc:806] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:59.504845  4704 tablet_copy_client.cc:670] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:59.506829  3867 tablet_copy_source_session.cc:215] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:59.508910  4704 tablet_copy_client.cc:538] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:59.511458  4707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 378a06c64b37451cbad82415b967e001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.514102  4697 tablet_bootstrap.cc:492] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:59.515110  4697 tablet_bootstrap.cc:492] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:26:59.515853  4697 ts_tablet_manager.cc:1403] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.067s	user 0.038s	sys 0.023s
I20260709 12:26:59.519232  4697 raft_consensus.cc:359] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:59.520219  4697 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:26:59.522017  4697 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:59.524755  4697 ts_tablet_manager.cc:1434] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:26:59.527621  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-781f4e626c2b4af0af08871cfde2d83e received from {username='slave'} at 127.0.0.1:54068
I20260709 12:26:59.528106  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-781f4e626c2b4af0af08871cfde2d83e on tablet 781f4e626c2b4af0af08871cfde2d83e with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:26:59.528290  4704 tablet_bootstrap.cc:492] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:26:59.549080  4707 tablet_copy_client.cc:806] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:59.549685  4707 tablet_copy_client.cc:670] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:59.553778  4707 tablet_copy_client.cc:538] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:59.561708  4704 tablet_bootstrap.cc:492] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:59.562657  4704 tablet_bootstrap.cc:492] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:26:59.564019  4704 ts_tablet_manager.cc:1403] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.036s	user 0.024s	sys 0.007s
I20260709 12:26:59.564643  4707 tablet_bootstrap.cc:492] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:26:59.567132  4704 raft_consensus.cc:359] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:59.567824  4704 raft_consensus.cc:740] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:26:59.569456  4704 consensus_queue.cc:260] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:59.574249  4704 ts_tablet_manager.cc:1434] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:26:59.576097  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-7185a57fbd78466ab6ccbbbd0453c2aa received from {username='slave'} at 127.0.0.1:54068
I20260709 12:26:59.576493  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-7185a57fbd78466ab6ccbbbd0453c2aa on tablet 7185a57fbd78466ab6ccbbbd0453c2aa with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:26:59.601158  4707 tablet_bootstrap.cc:492] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:59.602186  4707 tablet_bootstrap.cc:492] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:26:59.602924  4707 ts_tablet_manager.cc:1403] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.002s
I20260709 12:26:59.605929  4707 raft_consensus.cc:359] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:59.606817  4707 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:26:59.607527  4707 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:26:59.610819  4707 ts_tablet_manager.cc:1434] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:26:59.612860  3867 tablet_copy_service.cc:342] P 4eedd844c09d456ca0b3614490dd1dbb: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-378a06c64b37451cbad82415b967e001 received from {username='slave'} at 127.0.0.1:40038
I20260709 12:26:59.613269  3867 tablet_copy_service.cc:434] P 4eedd844c09d456ca0b3614490dd1dbb: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-378a06c64b37451cbad82415b967e001 on tablet 378a06c64b37451cbad82415b967e001 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:26:59.745632  4574 raft_consensus.cc:1217] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:59.855149  4574 raft_consensus.cc:1217] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:59.868336  4574 raft_consensus.cc:1217] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:59.868434  4572 raft_consensus.cc:1217] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:00.268357  4603 raft_consensus.cc:1064] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:00.271446  4603 consensus_queue.cc:237] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:00.278102  4574 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:00.279718  4657 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:00.280253  4006 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:00.280592  3849 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:00.282471  4631 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:00.285395  4657 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:00.307265  4657 raft_consensus.cc:2955] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.309741  3849 raft_consensus.cc:2955] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.338768  4574 raft_consensus.cc:2955] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.339958  4006 raft_consensus.cc:2955] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.357048  4692 raft_consensus.cc:1064] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:00.357690  3753 catalog_manager.cc:5697] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.364619  4603 raft_consensus.cc:1064] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:00.366946  4603 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:00.367740  4692 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:00.385367  4574 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:00.386327  4000 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:00.388056  4712 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:00.389659  3849 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:00.392964  4603 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:00.396663  4657 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:00.396881  4572 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:00.397097  4006 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:00.398774  4718 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:00.401139  4718 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:00.448679  3924 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:00.452430  4692 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:00.519001  4603 raft_consensus.cc:1064] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:00.522346  4603 consensus_queue.cc:237] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:00.547582  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 45555.1us
I20260709 12:27:00.545142  3925 raft_consensus.cc:2955] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.554337  4000 raft_consensus.cc:2955] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.570336  3854 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:00.570528  4006 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:00.571975  4603 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:00.577939  4631 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:00.552103  4692 raft_consensus.cc:2955] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.591703  4715 raft_consensus.cc:2955] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.604008  3849 raft_consensus.cc:2955] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.609781  4574 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:00.614657  4574 raft_consensus.cc:2955] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.618233  4603 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:27:00.635671  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 73674.6us
I20260709 12:27:00.637116  4574 raft_consensus.cc:2955] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.657378  3998 raft_consensus.cc:2955] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.704037  3751 catalog_manager.cc:5697] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.707536  3924 consensus_queue.cc:237] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:00.718295  4573 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:00.720364  4731 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:00.728266  4631 raft_consensus.cc:2955] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.733043  4730 raft_consensus.cc:2955] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.734266  3755 catalog_manager.cc:5697] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.736042  4571 raft_consensus.cc:2955] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.742266  4000 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:00.744273  4603 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:00.745110  3740 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8693e7a0624445758baf0b77c7686e0c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:00.745543  4000 raft_consensus.cc:2955] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.782191  3854 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:00.774859  3998 raft_consensus.cc:2955] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.791857  3752 catalog_manager.cc:5697] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.780267  4572 raft_consensus.cc:2955] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.797158  3932 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:00.809906  4571 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:00.811126  4574 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:00.812999  4718 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:00.814275  4731 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:00.822906  4715 raft_consensus.cc:2955] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.831434  3998 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:00.834563  3849 raft_consensus.cc:2955] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.839804  4731 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:00.847278  4000 raft_consensus.cc:2955] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.844607  4574 raft_consensus.cc:2955] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.851161  3998 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:00.889675  3740 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 781f4e626c2b4af0af08871cfde2d83e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:00.940317  4613 raft_consensus.cc:2955] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:00.947695  3840 tablet_service.cc:1558] Processing DeleteTablet for tablet 8693e7a0624445758baf0b77c7686e0c with delete_type TABLET_DATA_TOMBSTONED (TS 4eedd844c09d456ca0b3614490dd1dbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42036
W20260709 12:27:00.951303  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 47512.1us
I20260709 12:27:00.955518  4745 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:00.971258  4748 tablet_replica.cc:333] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:27:00.988430  3752 catalog_manager.cc:5697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:01.004346  4748 raft_consensus.cc:2243] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.006078  4748 raft_consensus.cc:2272] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.014873  4000 raft_consensus.cc:2955] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:01.025312  4571 raft_consensus.cc:2955] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:01.030562  3739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 378a06c64b37451cbad82415b967e001 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:01.045225  3751 catalog_manager.cc:5697] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:01.075613  3751 catalog_manager.cc:5697] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:01.087508  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 62797.3us
I20260709 12:27:01.096196  3840 tablet_service.cc:1558] Processing DeleteTablet for tablet 781f4e626c2b4af0af08871cfde2d83e with delete_type TABLET_DATA_TOMBSTONED (TS 4eedd844c09d456ca0b3614490dd1dbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42036
I20260709 12:27:01.108314  3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 378a06c64b37451cbad82415b967e001 with delete_type TABLET_DATA_TOMBSTONED (TS 073f84fcc295417f9bcc1eea29d2bb58 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43294
I20260709 12:27:01.096153  4748 ts_tablet_manager.cc:1916] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:01.137439  4749 tablet_replica.cc:333] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:27:01.138933  4749 raft_consensus.cc:2243] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.139995  4749 raft_consensus.cc:2272] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.150899  4748 ts_tablet_manager.cc:1929] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:01.151486  4748 log.cc:1199] T 8693e7a0624445758baf0b77c7686e0c P 4eedd844c09d456ca0b3614490dd1dbb: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/wals/8693e7a0624445758baf0b77c7686e0c
I20260709 12:27:01.160650  3739 catalog_manager.cc:5028] TS 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): tablet 8693e7a0624445758baf0b77c7686e0c (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:01.191934  3932 consensus_queue.cc:237] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:01.199127  4571 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:01.202114  4631 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:01.221318  4748 tablet_replica.cc:333] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:27:01.221685  4749 ts_tablet_manager.cc:1916] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:01.222764  3850 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:01.226046  4715 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:01.228585  4748 raft_consensus.cc:2243] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.229687  4748 raft_consensus.cc:2272] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.234472  4730 raft_consensus.cc:2955] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:01.236335  3849 raft_consensus.cc:2955] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:01.261361  4748 ts_tablet_manager.cc:1916] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:01.269407  4571 raft_consensus.cc:2955] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:01.275333  4749 ts_tablet_manager.cc:1929] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:01.275822  4749 log.cc:1199] T 378a06c64b37451cbad82415b967e001 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/wals/378a06c64b37451cbad82415b967e001
I20260709 12:27:01.277717  3740 catalog_manager.cc:5028] TS 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): tablet 378a06c64b37451cbad82415b967e001 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:01.272926  3751 catalog_manager.cc:5697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:01.287853  4748 ts_tablet_manager.cc:1929] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:01.288341  4748 log.cc:1199] T 781f4e626c2b4af0af08871cfde2d83e P 4eedd844c09d456ca0b3614490dd1dbb: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/wals/781f4e626c2b4af0af08871cfde2d83e
I20260709 12:27:01.290251  3739 catalog_manager.cc:5028] TS 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): tablet 781f4e626c2b4af0af08871cfde2d83e (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:01.290690  3740 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7185a57fbd78466ab6ccbbbd0453c2aa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:01.294793  3996 tablet_service.cc:1558] Processing DeleteTablet for tablet 7185a57fbd78466ab6ccbbbd0453c2aa with delete_type TABLET_DATA_TOMBSTONED (TS 34711da9380944d2969a2bc3e203db3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36508
I20260709 12:27:01.301400  4750 tablet_replica.cc:333] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:27:01.302935  4750 raft_consensus.cc:2243] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:01.303934  4750 raft_consensus.cc:2272] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:01.307592  4750 ts_tablet_manager.cc:1916] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:01.321995  4750 ts_tablet_manager.cc:1929] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:01.322475  4750 log.cc:1199] T 7185a57fbd78466ab6ccbbbd0453c2aa P 34711da9380944d2969a2bc3e203db3d: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/wals/7185a57fbd78466ab6ccbbbd0453c2aa
I20260709 12:27:01.324249  3741 catalog_manager.cc:5028] TS 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): tablet 7185a57fbd78466ab6ccbbbd0453c2aa (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:02.373847  3857 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:02.384459  3932 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:02.387478  4743 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:27:02.395360  3822 consensus_peers.cc:597] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a955b1f59694973b581077ee60e7e4a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:02.403295  4000 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:02.403748  4743 raft_consensus.cc:2955] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:02.407013  4746 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:02.409428  3932 raft_consensus.cc:2955] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:02.412662  4002 raft_consensus.cc:2955] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:02.425146  4006 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:02.428771  3753 catalog_manager.cc:5697] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:02.462042  3932 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:27:02.463056  3971 consensus_peers.cc:597] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 455f8427897049759001979ea81adec1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:02.465348  4735 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:02.467162  3857 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:02.469290  4735 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:02.487254  4733 raft_consensus.cc:2955] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:02.490301  3932 raft_consensus.cc:2955] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:02.501523  3849 raft_consensus.cc:2955] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:02.509917  4006 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:02.518363  3752 catalog_manager.cc:5697] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:02.534569  3932 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:27:02.534802  3971 consensus_peers.cc:597] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a445f8740fa847ed9ac463915fa09725. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:02.538954  4764 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:02.539800  3857 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:02.543996  4764 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:02.552817  4763 raft_consensus.cc:2955] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:02.556059  3849 raft_consensus.cc:2955] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:02.558123  3932 raft_consensus.cc:2955] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:02.575445  3857 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:02.575446  3752 catalog_manager.cc:5697] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:02.588646  4003 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:02.590073  3932 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:02.590631  4751 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:02.592363  4746 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:02.596006  3822 consensus_peers.cc:597] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86e92801c3904600b054e99343413645. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:02.600780  4751 raft_consensus.cc:2955] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:02.603379  4000 raft_consensus.cc:2955] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:02.606726  3932 raft_consensus.cc:2955] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:02.619856  3753 catalog_manager.cc:5697] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:02.969028  4777 ts_tablet_manager.cc:933] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:02.976037  4777 tablet_copy_client.cc:323] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.1:32843
I20260709 12:27:02.977736  3867 tablet_copy_service.cc:140] P 4eedd844c09d456ca0b3614490dd1dbb: Received BeginTabletCopySession request for tablet 9a955b1f59694973b581077ee60e7e4a from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:40038)
I20260709 12:27:02.978268  3867 tablet_copy_service.cc:161] P 4eedd844c09d456ca0b3614490dd1dbb: Beginning new tablet copy session on tablet 9a955b1f59694973b581077ee60e7e4a from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:40038: session id = f3cab225ecb7488386a1a19239498cfe-9a955b1f59694973b581077ee60e7e4a
I20260709 12:27:02.987525  3867 tablet_copy_source_session.cc:215] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:02.989899  4779 ts_tablet_manager.cc:933] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:02.991859  4777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a955b1f59694973b581077ee60e7e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:02.992177  4779 tablet_copy_client.cc:323] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.3:33709
I20260709 12:27:02.994228  4016 tablet_copy_service.cc:140] P 34711da9380944d2969a2bc3e203db3d: Received BeginTabletCopySession request for tablet a445f8740fa847ed9ac463915fa09725 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:51898)
I20260709 12:27:02.994745  4016 tablet_copy_service.cc:161] P 34711da9380944d2969a2bc3e203db3d: Beginning new tablet copy session on tablet a445f8740fa847ed9ac463915fa09725 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:51898: session id = f3cab225ecb7488386a1a19239498cfe-a445f8740fa847ed9ac463915fa09725
I20260709 12:27:03.010968  4777 tablet_copy_client.cc:806] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:03.011689  4777 tablet_copy_client.cc:670] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:03.016197  4777 tablet_copy_client.cc:538] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:03.028149  4777 tablet_bootstrap.cc:492] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:03.028954  4781 ts_tablet_manager.cc:933] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:03.031857  4016 tablet_copy_source_session.cc:215] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:03.043651  4781 tablet_copy_client.cc:323] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.3:33709
I20260709 12:27:03.057898  4016 tablet_copy_service.cc:140] P 34711da9380944d2969a2bc3e203db3d: Received BeginTabletCopySession request for tablet 455f8427897049759001979ea81adec1 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:51898)
I20260709 12:27:03.058527  4779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a445f8740fa847ed9ac463915fa09725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:03.058547  4016 tablet_copy_service.cc:161] P 34711da9380944d2969a2bc3e203db3d: Beginning new tablet copy session on tablet 455f8427897049759001979ea81adec1 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:51898: session id = f3cab225ecb7488386a1a19239498cfe-455f8427897049759001979ea81adec1
I20260709 12:27:03.079850  4777 tablet_bootstrap.cc:492] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.080869  4777 tablet_bootstrap.cc:492] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:03.081604  4777 ts_tablet_manager.cc:1403] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.032s
I20260709 12:27:03.084903  4777 raft_consensus.cc:359] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:03.085798  4777 raft_consensus.cc:740] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:03.086516  4777 consensus_queue.cc:260] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:03.088258  4016 tablet_copy_source_session.cc:215] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:03.092218  4781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 455f8427897049759001979ea81adec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:03.092053  4779 tablet_copy_client.cc:806] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:03.093638  4779 tablet_copy_client.cc:670] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:03.102193  4777 ts_tablet_manager.cc:1434] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 12:27:03.103178  4779 tablet_copy_client.cc:538] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:03.111044  3867 tablet_copy_service.cc:342] P 4eedd844c09d456ca0b3614490dd1dbb: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-9a955b1f59694973b581077ee60e7e4a received from {username='slave'} at 127.0.0.1:40038
I20260709 12:27:03.111572  3867 tablet_copy_service.cc:434] P 4eedd844c09d456ca0b3614490dd1dbb: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-9a955b1f59694973b581077ee60e7e4a on tablet 9a955b1f59694973b581077ee60e7e4a with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:03.117069  4781 tablet_copy_client.cc:806] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:03.117687  4781 tablet_copy_client.cc:670] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:03.118911  4779 tablet_bootstrap.cc:492] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:03.122498  4781 tablet_copy_client.cc:538] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:03.136325  4781 tablet_bootstrap.cc:492] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:03.143080  4779 tablet_bootstrap.cc:492] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.144358  4779 tablet_bootstrap.cc:492] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:03.145112  4779 ts_tablet_manager.cc:1403] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.008s
I20260709 12:27:03.148860  4779 raft_consensus.cc:359] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:03.150177  4779 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:03.150910  4779 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:03.155838  4779 ts_tablet_manager.cc:1434] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 12:27:03.159646  4016 tablet_copy_service.cc:342] P 34711da9380944d2969a2bc3e203db3d: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-a445f8740fa847ed9ac463915fa09725 received from {username='slave'} at 127.0.0.1:51898
I20260709 12:27:03.160143  4016 tablet_copy_service.cc:434] P 34711da9380944d2969a2bc3e203db3d: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-a445f8740fa847ed9ac463915fa09725 on tablet a445f8740fa847ed9ac463915fa09725 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:03.162729  4781 tablet_bootstrap.cc:492] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.164810  4781 tablet_bootstrap.cc:492] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:03.165517  4781 ts_tablet_manager.cc:1403] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.004s
I20260709 12:27:03.168529  4781 raft_consensus.cc:359] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:03.169360  4781 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:03.170009  4781 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:03.172385  4781 ts_tablet_manager.cc:1434] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:27:03.174265  4016 tablet_copy_service.cc:342] P 34711da9380944d2969a2bc3e203db3d: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-455f8427897049759001979ea81adec1 received from {username='slave'} at 127.0.0.1:51898
I20260709 12:27:03.174697  4016 tablet_copy_service.cc:434] P 34711da9380944d2969a2bc3e203db3d: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-455f8427897049759001979ea81adec1 on tablet 455f8427897049759001979ea81adec1 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:03.204802  4781 ts_tablet_manager.cc:933] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:03.206565  4781 tablet_copy_client.cc:323] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.1:32843
I20260709 12:27:03.208348  3867 tablet_copy_service.cc:140] P 4eedd844c09d456ca0b3614490dd1dbb: Received BeginTabletCopySession request for tablet 86e92801c3904600b054e99343413645 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:40038)
I20260709 12:27:03.208847  3867 tablet_copy_service.cc:161] P 4eedd844c09d456ca0b3614490dd1dbb: Beginning new tablet copy session on tablet 86e92801c3904600b054e99343413645 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:40038: session id = f3cab225ecb7488386a1a19239498cfe-86e92801c3904600b054e99343413645
I20260709 12:27:03.215991  3867 tablet_copy_source_session.cc:215] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:03.229239  4781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e92801c3904600b054e99343413645. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:03.255241  4781 tablet_copy_client.cc:806] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:03.255908  4781 tablet_copy_client.cc:670] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:03.259374  4781 tablet_copy_client.cc:538] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:03.266170  4781 tablet_bootstrap.cc:492] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:03.284441  4781 tablet_bootstrap.cc:492] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:03.285224  4781 tablet_bootstrap.cc:492] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:03.285820  4781 ts_tablet_manager.cc:1403] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 12:27:03.288525  4781 raft_consensus.cc:359] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:03.289305  4781 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:03.290032  4781 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:03.292728  4781 ts_tablet_manager.cc:1434] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:03.294834  3867 tablet_copy_service.cc:342] P 4eedd844c09d456ca0b3614490dd1dbb: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-86e92801c3904600b054e99343413645 received from {username='slave'} at 127.0.0.1:40038
I20260709 12:27:03.295308  3867 tablet_copy_service.cc:434] P 4eedd844c09d456ca0b3614490dd1dbb: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-86e92801c3904600b054e99343413645 on tablet 86e92801c3904600b054e99343413645 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:03.379767  4574 raft_consensus.cc:1217] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:03.484818  4571 raft_consensus.cc:1217] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:03.493443  4571 raft_consensus.cc:1217] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:03.609863  4571 raft_consensus.cc:1217] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:27:03.714823  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08000359c0 after lost signal to thread 2679
W20260709 12:27:03.716092  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08000360a0 after lost signal to thread 3789
W20260709 12:27:03.720474  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2740 after lost signal to thread 3881
W20260709 12:27:03.721338  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1780 after lost signal to thread 3956
W20260709 12:27:03.723908  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4560 after lost signal to thread 4030
W20260709 12:27:03.725723  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4420 after lost signal to thread 4598
I20260709 12:27:03.857404  4754 raft_consensus.cc:1064] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:03.860342  4754 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:03.929056  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 52959.3us
I20260709 12:27:03.977558  4571 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:03.983304  3998 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:03.989454  4772 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:03.992754  4754 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:03.993705  3924 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:04.016697  4789 raft_consensus.cc:1064] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:04.018738  4754 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:04.020131  4789 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:04.049839  4574 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:04.050135  3849 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:04.051649  4764 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:04.055207  4733 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:04.068192  3927 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:04.070153  4796 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:04.081139  4764 raft_consensus.cc:1064] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:04.117086  4733 raft_consensus.cc:2955] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.121191  3927 raft_consensus.cc:2955] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.124123  3849 raft_consensus.cc:2955] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.085321  4764 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:04.137941  4751 raft_consensus.cc:2955] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.155514  4791 raft_consensus.cc:1064] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:04.159488  3998 raft_consensus.cc:2955] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.165272  3753 catalog_manager.cc:5697] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.167342  4574 raft_consensus.cc:2955] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.175220  3751 catalog_manager.cc:5697] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:04.159777  4791 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:04.183981  3924 raft_consensus.cc:2955] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.206369  4571 raft_consensus.cc:2955] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.237645  4574 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:04.240473  3848 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:04.243377  3924 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:04.249593  4803 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:04.252916  4733 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:04.253988  4764 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:04.256644  3998 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:04.258821  4574 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:04.260771  3927 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:04.261914  4794 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:04.264473  4751 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:04.278378  4751 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:04.299798  4764 raft_consensus.cc:2955] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.301640  4791 raft_consensus.cc:2955] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.304011  3848 raft_consensus.cc:2955] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.307610  3998 raft_consensus.cc:2955] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.305819  4571 raft_consensus.cc:2955] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.328819  3932 raft_consensus.cc:2955] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.346459  3924 raft_consensus.cc:2955] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.363622  4002 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:04.380628  4571 raft_consensus.cc:2955] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.385527  4574 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:04.388459  4733 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:04.392745  3927 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:04.399809  4796 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:04.403610  4789 raft_consensus.cc:2955] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.408027  4573 raft_consensus.cc:2955] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.464257  3741 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 455f8427897049759001979ea81adec1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:04.503247  3932 raft_consensus.cc:2955] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.512827  3753 catalog_manager.cc:5697] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:04.531091  3754 catalog_manager.cc:5697] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.534699  3998 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:04.552546  4573 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:04.554201  4803 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:04.559221  3848 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:04.561013  4733 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:04.566382  4573 raft_consensus.cc:2955] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.563779  4803 raft_consensus.cc:2955] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.589293  3741 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a445f8740fa847ed9ac463915fa09725 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:04.600944  3849 raft_consensus.cc:2955] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.604418  3755 catalog_manager.cc:5697] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.618590  3850 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:04.623769  3857 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:04.631798  3924 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:04.632282  3925 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:04.632434  4573 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:04.633947  4571 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:04.635720  4791 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:04.637626  4794 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:04.638517  3840 tablet_service.cc:1558] Processing DeleteTablet for tablet 455f8427897049759001979ea81adec1 with delete_type TABLET_DATA_TOMBSTONED (TS 4eedd844c09d456ca0b3614490dd1dbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42036
I20260709 12:27:04.635787  4790 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:04.646481  4772 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:04.649024  4751 raft_consensus.cc:2955] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.658380  3755 catalog_manager.cc:5697] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.662366  4573 raft_consensus.cc:2955] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.666744  4821 tablet_replica.cc:333] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:27:04.667958  4821 raft_consensus.cc:2243] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:04.668790  4821 raft_consensus.cc:2272] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:04.673084  4821 ts_tablet_manager.cc:1916] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:04.673537  3739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a955b1f59694973b581077ee60e7e4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:04.709406  4794 raft_consensus.cc:2955] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.711169  4821 ts_tablet_manager.cc:1929] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:04.711616  4821 log.cc:1199] T 455f8427897049759001979ea81adec1 P 4eedd844c09d456ca0b3614490dd1dbb: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/wals/455f8427897049759001979ea81adec1
I20260709 12:27:04.729478  3924 raft_consensus.cc:2955] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.732147  3932 raft_consensus.cc:2955] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.777842  4571 raft_consensus.cc:2955] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.723551  3739 catalog_manager.cc:5028] TS 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): tablet 455f8427897049759001979ea81adec1 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
W20260709 12:27:04.783394  3739 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 59868.2us
I20260709 12:27:04.784525  3739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 86e92801c3904600b054e99343413645 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:04.785331  3917 tablet_service.cc:1558] Processing DeleteTablet for tablet a445f8740fa847ed9ac463915fa09725 with delete_type TABLET_DATA_TOMBSTONED (TS 073f84fcc295417f9bcc1eea29d2bb58 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43294
I20260709 12:27:04.791111  4825 tablet_replica.cc:333] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:27:04.790892  3755 catalog_manager.cc:5697] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:04.810194  3996 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a955b1f59694973b581077ee60e7e4a with delete_type TABLET_DATA_TOMBSTONED (TS 34711da9380944d2969a2bc3e203db3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36508
I20260709 12:27:04.827955  4825 raft_consensus.cc:2243] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:04.833684  4825 raft_consensus.cc:2272] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:04.838522  4825 ts_tablet_manager.cc:1916] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:04.821424  3753 catalog_manager.cc:5697] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:04.858880  4826 tablet_replica.cc:333] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:27:04.875928  3996 tablet_service.cc:1558] Processing DeleteTablet for tablet 86e92801c3904600b054e99343413645 with delete_type TABLET_DATA_TOMBSTONED (TS 34711da9380944d2969a2bc3e203db3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36508
I20260709 12:27:04.876353  4826 raft_consensus.cc:2243] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:04.877065  4826 raft_consensus.cc:2272] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:04.880437  4826 ts_tablet_manager.cc:1916] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:04.896718  4826 ts_tablet_manager.cc:1929] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:04.897137  4826 log.cc:1199] T 9a955b1f59694973b581077ee60e7e4a P 34711da9380944d2969a2bc3e203db3d: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/wals/9a955b1f59694973b581077ee60e7e4a
I20260709 12:27:04.897400  4825 ts_tablet_manager.cc:1929] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:04.898037  4825 log.cc:1199] T a445f8740fa847ed9ac463915fa09725 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/wals/a445f8740fa847ed9ac463915fa09725
I20260709 12:27:04.898939  3741 catalog_manager.cc:5028] TS 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): tablet 9a955b1f59694973b581077ee60e7e4a (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:04.899886  3740 catalog_manager.cc:5028] TS 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): tablet a445f8740fa847ed9ac463915fa09725 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:04.902662  4826 tablet_replica.cc:333] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:27:04.911619  4826 raft_consensus.cc:2243] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:04.912537  4826 raft_consensus.cc:2272] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:04.916257  4826 ts_tablet_manager.cc:1916] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:04.938546  4826 ts_tablet_manager.cc:1929] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:04.939005  4826 log.cc:1199] T 86e92801c3904600b054e99343413645 P 34711da9380944d2969a2bc3e203db3d: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/wals/86e92801c3904600b054e99343413645
I20260709 12:27:04.940537  3741 catalog_manager.cc:5028] TS 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): tablet 86e92801c3904600b054e99343413645 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:05.988795  4006 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:05.995086  3932 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:27:05.995929  3971 consensus_peers.cc:597] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2bf4f0ff3c484df18d42d887c059c170. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:05.997026  3849 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:05.997328  4789 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.999203  4827 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:06.006309  4789 raft_consensus.cc:2955] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:06.008455  3932 raft_consensus.cc:2955] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:06.011776  3848 raft_consensus.cc:2955] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:06.040311  3755 catalog_manager.cc:5697] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:06.051441  3932 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:06.064316  4006 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:06.064916  3848 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:27:06.066924  3897 consensus_peers.cc:597] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ace1274bf4f34853b37ab7a08103d367. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.066824  4795 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:06.069056  4820 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:06.086369  4795 raft_consensus.cc:2955] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:06.095104  3848 raft_consensus.cc:2955] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:06.101323  4006 raft_consensus.cc:2955] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:06.120106  3932 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:06.122428  3754 catalog_manager.cc:5697] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
W20260709 12:27:06.162763  3897 consensus_peers.cc:597] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20fdebd7b9154e47beb5e08a62175fe5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.178043  3998 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:06.178102  3848 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:06.179651  4820 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:06.180588  4795 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:06.196841  4795 raft_consensus.cc:2955] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:06.199167  3848 raft_consensus.cc:2955] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:06.200155  3998 raft_consensus.cc:2955] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:06.222396  3849 consensus_queue.cc:237] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:06.227176  3754 catalog_manager.cc:5697] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
W20260709 12:27:06.252661  3822 consensus_peers.cc:597] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d5f24773bb44448a1cb122558f0c4c9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.268607  4002 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:06.269632  3932 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:06.271032  4791 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:06.271950  4824 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:06.298453  4842 raft_consensus.cc:2955] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:06.301332  3998 raft_consensus.cc:2955] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:06.310472  3932 raft_consensus.cc:2955] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:06.323439  3754 catalog_manager.cc:5697] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:06.458483  4845 ts_tablet_manager.cc:933] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:06.467073  4845 tablet_copy_client.cc:323] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:27:06.469252  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet ace1274bf4f34853b37ab7a08103d367 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:27:06.469918  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet ace1274bf4f34853b37ab7a08103d367 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-ace1274bf4f34853b37ab7a08103d367
I20260709 12:27:06.480351  3942 tablet_copy_source_session.cc:215] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:06.486054  4845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace1274bf4f34853b37ab7a08103d367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:06.514921  4845 tablet_copy_client.cc:806] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:06.515583  4845 tablet_copy_client.cc:670] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:06.521355  4845 tablet_copy_client.cc:538] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:06.531351  4845 tablet_bootstrap.cc:492] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:06.566358  4845 tablet_bootstrap.cc:492] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:06.567390  4845 tablet_bootstrap.cc:492] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:06.568109  4845 ts_tablet_manager.cc:1403] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.006s
I20260709 12:27:06.571367  4845 raft_consensus.cc:359] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:06.572274  4845 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:06.572994  4845 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:06.576498  4849 ts_tablet_manager.cc:933] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:06.581429  4849 tablet_copy_client.cc:323] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.3:33709
I20260709 12:27:06.584105  4016 tablet_copy_service.cc:140] P 34711da9380944d2969a2bc3e203db3d: Received BeginTabletCopySession request for tablet 2bf4f0ff3c484df18d42d887c059c170 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:51898)
I20260709 12:27:06.584923  4016 tablet_copy_service.cc:161] P 34711da9380944d2969a2bc3e203db3d: Beginning new tablet copy session on tablet 2bf4f0ff3c484df18d42d887c059c170 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:51898: session id = f3cab225ecb7488386a1a19239498cfe-2bf4f0ff3c484df18d42d887c059c170
I20260709 12:27:06.587574  4845 ts_tablet_manager.cc:1434] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 12:27:06.596163  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-ace1274bf4f34853b37ab7a08103d367 received from {username='slave'} at 127.0.0.1:54068
I20260709 12:27:06.596601  4016 tablet_copy_source_session.cc:215] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:06.596688  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-ace1274bf4f34853b37ab7a08103d367 on tablet ace1274bf4f34853b37ab7a08103d367 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:06.602916  4849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf4f0ff3c484df18d42d887c059c170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:06.636497  4849 tablet_copy_client.cc:806] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:06.637126  4849 tablet_copy_client.cc:670] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:06.641140  4849 tablet_copy_client.cc:538] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:06.652817  4849 tablet_bootstrap.cc:492] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:06.690511  4849 tablet_bootstrap.cc:492] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:06.691529  4849 tablet_bootstrap.cc:492] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:06.692337  4849 ts_tablet_manager.cc:1403] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.014s
I20260709 12:27:06.695739  4849 raft_consensus.cc:359] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:06.696668  4849 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:06.697374  4849 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:06.700227  4849 ts_tablet_manager.cc:1434] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:06.730221  4016 tablet_copy_service.cc:342] P 34711da9380944d2969a2bc3e203db3d: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-2bf4f0ff3c484df18d42d887c059c170 received from {username='slave'} at 127.0.0.1:51898
I20260709 12:27:06.730716  4016 tablet_copy_service.cc:434] P 34711da9380944d2969a2bc3e203db3d: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-2bf4f0ff3c484df18d42d887c059c170 on tablet 2bf4f0ff3c484df18d42d887c059c170 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:06.774107  4849 ts_tablet_manager.cc:933] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:06.791481  4845 ts_tablet_manager.cc:933] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:06.794870  4849 tablet_copy_client.cc:323] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:27:06.797689  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet 20fdebd7b9154e47beb5e08a62175fe5 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:27:06.798327  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet 20fdebd7b9154e47beb5e08a62175fe5 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-20fdebd7b9154e47beb5e08a62175fe5
I20260709 12:27:06.807394  3942 tablet_copy_source_session.cc:215] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:06.810882  4849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fdebd7b9154e47beb5e08a62175fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:06.846777  4845 tablet_copy_client.cc:323] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.1:32843
I20260709 12:27:06.848618  3867 tablet_copy_service.cc:140] P 4eedd844c09d456ca0b3614490dd1dbb: Received BeginTabletCopySession request for tablet 3d5f24773bb44448a1cb122558f0c4c9 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:40038)
I20260709 12:27:06.849148  3867 tablet_copy_service.cc:161] P 4eedd844c09d456ca0b3614490dd1dbb: Beginning new tablet copy session on tablet 3d5f24773bb44448a1cb122558f0c4c9 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:40038: session id = f3cab225ecb7488386a1a19239498cfe-3d5f24773bb44448a1cb122558f0c4c9
I20260709 12:27:06.864758  3867 tablet_copy_source_session.cc:215] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:06.872159  4845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d5f24773bb44448a1cb122558f0c4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:06.876768  4573 raft_consensus.cc:1217] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:06.896052  4849 tablet_copy_client.cc:806] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:06.896828  4849 tablet_copy_client.cc:670] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:06.906534  4849 tablet_copy_client.cc:538] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:06.925648  4849 tablet_bootstrap.cc:492] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:06.975250  4845 tablet_copy_client.cc:806] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:06.975919  4845 tablet_copy_client.cc:670] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:06.983363  4845 tablet_copy_client.cc:538] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:07.004465  4849 tablet_bootstrap.cc:492] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:07.014402  4849 tablet_bootstrap.cc:492] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:07.015775  4849 ts_tablet_manager.cc:1403] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.091s	user 0.026s	sys 0.008s
I20260709 12:27:07.019486  4849 raft_consensus.cc:359] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:07.022405  4849 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:07.024230  4849 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:07.028116  4849 ts_tablet_manager.cc:1434] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:27:07.032742  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-20fdebd7b9154e47beb5e08a62175fe5 received from {username='slave'} at 127.0.0.1:54068
I20260709 12:27:07.033167  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-20fdebd7b9154e47beb5e08a62175fe5 on tablet 20fdebd7b9154e47beb5e08a62175fe5 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:07.043253  4845 tablet_bootstrap.cc:492] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:07.072788  4845 tablet_bootstrap.cc:492] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:07.073971  4845 tablet_bootstrap.cc:492] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:07.074841  4845 ts_tablet_manager.cc:1403] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.008s
I20260709 12:27:07.079571  4845 raft_consensus.cc:359] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:07.080689  4845 raft_consensus.cc:740] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:07.081573  4845 consensus_queue.cc:260] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:07.086164  4845 ts_tablet_manager.cc:1434] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:27:07.088106  3867 tablet_copy_service.cc:342] P 4eedd844c09d456ca0b3614490dd1dbb: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-3d5f24773bb44448a1cb122558f0c4c9 received from {username='slave'} at 127.0.0.1:40038
I20260709 12:27:07.088568  3867 tablet_copy_service.cc:434] P 4eedd844c09d456ca0b3614490dd1dbb: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-3d5f24773bb44448a1cb122558f0c4c9 on tablet 3d5f24773bb44448a1cb122558f0c4c9 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:07.173455  4573 raft_consensus.cc:1217] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:07.344246  4819 raft_consensus.cc:1064] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:07.346793  4819 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:07.356935  4573 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:07.356935  3848 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:07.359467  3998 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:07.359352  4820 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:07.361302  4820 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:07.364660  4857 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:07.402824  4571 raft_consensus.cc:1217] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:07.412395  4820 raft_consensus.cc:2955] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.416822  4572 raft_consensus.cc:1217] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:07.423730  3998 raft_consensus.cc:2955] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.471920  4573 raft_consensus.cc:2955] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.490789  3849 raft_consensus.cc:2955] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.503922  3754 catalog_manager.cc:5697] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.575719  3924 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:07.580298  4573 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:07.582216  4795 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:07.589910  3849 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:07.594900  4820 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:07.606637  4820 raft_consensus.cc:2955] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.617709  3849 raft_consensus.cc:2955] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.620669  4573 raft_consensus.cc:2955] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.630105  3740 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ace1274bf4f34853b37ab7a08103d367 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:07.638286  3755 catalog_manager.cc:5697] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.653931  3996 tablet_service.cc:1558] Processing DeleteTablet for tablet ace1274bf4f34853b37ab7a08103d367 with delete_type TABLET_DATA_TOMBSTONED (TS 34711da9380944d2969a2bc3e203db3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36508
I20260709 12:27:07.663089  4867 tablet_replica.cc:333] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:27:07.664839  4867 raft_consensus.cc:2243] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:07.665979  4867 raft_consensus.cc:2272] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:07.669584  4867 ts_tablet_manager.cc:1916] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:07.693650  4867 ts_tablet_manager.cc:1929] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:07.694176  4867 log.cc:1199] T ace1274bf4f34853b37ab7a08103d367 P 34711da9380944d2969a2bc3e203db3d: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/wals/ace1274bf4f34853b37ab7a08103d367
I20260709 12:27:07.695736  3741 catalog_manager.cc:5028] TS 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): tablet ace1274bf4f34853b37ab7a08103d367 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:07.777518  4827 raft_consensus.cc:1064] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:07.780637  4827 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:07.791253  3925 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:07.792599  4573 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:07.794548  4827 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:07.796541  4852 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:07.800720  3849 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:07.802457  4852 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:07.848541  4870 raft_consensus.cc:2955] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.859117  3849 raft_consensus.cc:2955] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.875696  4819 raft_consensus.cc:1064] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:07.880643  4572 raft_consensus.cc:2955] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.886636  3924 raft_consensus.cc:2955] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.878582  4819 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:07.898691  3755 catalog_manager.cc:5697] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.908003  4842 raft_consensus.cc:1064] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:07.911195  4842 consensus_queue.cc:237] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:07.956710  3998 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:07.961280  4573 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:07.968708  4819 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:07.969568  4573 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:07.971401  4827 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:07.976423  4006 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:07.979020  4852 raft_consensus.cc:2955] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.982571  4571 raft_consensus.cc:2955] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:07.990762  3848 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:07.992233  4819 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:08.003408  3849 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:08.006049  4795 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:08.030627  3751 catalog_manager.cc:5697] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.036825  4571 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:08.042100  4790 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:27:08.062634  3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bf4f0ff3c484df18d42d887c059c170 with delete_type TABLET_DATA_TOMBSTONED (TS 073f84fcc295417f9bcc1eea29d2bb58 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43294
I20260709 12:27:08.059648  4827 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:27:08.111121  3741 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2bf4f0ff3c484df18d42d887c059c170 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:08.115229  3857 raft_consensus.cc:2955] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.132129  4883 tablet_replica.cc:333] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:27:08.133306  4883 raft_consensus.cc:2243] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.135329  4883 raft_consensus.cc:2272] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.140551  4883 ts_tablet_manager.cc:1916] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:08.143980  4572 raft_consensus.cc:2955] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.140590  4820 raft_consensus.cc:2955] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:08.154784  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 135175us
I20260709 12:27:08.160130  3924 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:08.164268  3751 catalog_manager.cc:5697] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.167763  4006 raft_consensus.cc:2955] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:08.183350  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 158883us
I20260709 12:27:08.189543  4006 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:08.195070  3924 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:08.209268  4572 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:08.211545  4002 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:08.215646  4819 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:08.217787  4862 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:08.226042  4862 raft_consensus.cc:2955] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.234308  4842 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:08.242336  4002 raft_consensus.cc:2955] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.247399  3740 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 20fdebd7b9154e47beb5e08a62175fe5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:08.264681  4572 raft_consensus.cc:2955] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.263521  3751 catalog_manager.cc:5697] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:08.276248  4876 raft_consensus.cc:2955] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.292529  4883 ts_tablet_manager.cc:1929] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:08.299563  4883 log.cc:1199] T 2bf4f0ff3c484df18d42d887c059c170 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/wals/2bf4f0ff3c484df18d42d887c059c170
I20260709 12:27:08.294142  3840 tablet_service.cc:1558] Processing DeleteTablet for tablet 20fdebd7b9154e47beb5e08a62175fe5 with delete_type TABLET_DATA_TOMBSTONED (TS 4eedd844c09d456ca0b3614490dd1dbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42036
I20260709 12:27:08.301502  3740 catalog_manager.cc:5028] TS 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): tablet 2bf4f0ff3c484df18d42d887c059c170 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:08.303822  4571 raft_consensus.cc:2955] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.316077  4006 raft_consensus.cc:2955] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.332938  4842 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:08.345268  3755 catalog_manager.cc:5697] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.350033  4887 tablet_replica.cc:333] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:27:08.353546  4887 raft_consensus.cc:2243] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.354095  4887 pending_rounds.cc:70] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb: Trying to abort 1 pending ops.
I20260709 12:27:08.354344  4887 pending_rounds.cc:77] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305625714183880704 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } } }
I20260709 12:27:08.355676  4887 raft_consensus.cc:2917] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:27:08.356101  4887 raft_consensus.cc:2889] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:27:08.356462  4887 raft_consensus.cc:2272] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.387380  3924 raft_consensus.cc:2955] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.411067  3849 consensus_queue.cc:237] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:08.420562  4887 ts_tablet_manager.cc:1916] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:08.444087  3998 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:08.431907  4572 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:08.447567  4790 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:08.458317  4885 raft_consensus.cc:2955] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.467761  4887 ts_tablet_manager.cc:1929] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:08.468441  4887 log.cc:1199] T 20fdebd7b9154e47beb5e08a62175fe5 P 4eedd844c09d456ca0b3614490dd1dbb: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/wals/20fdebd7b9154e47beb5e08a62175fe5
I20260709 12:27:08.467628  4573 raft_consensus.cc:2955] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.470352  3739 catalog_manager.cc:5028] TS 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): tablet 20fdebd7b9154e47beb5e08a62175fe5 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:08.486362  3751 catalog_manager.cc:5697] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.499298  3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d5f24773bb44448a1cb122558f0c4c9 with delete_type TABLET_DATA_TOMBSTONED (TS 073f84fcc295417f9bcc1eea29d2bb58 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43294
I20260709 12:27:08.500295  4883 tablet_replica.cc:333] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:27:08.502424  4876 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:08.505558  3739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3d5f24773bb44448a1cb122558f0c4c9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:08.509189  3998 raft_consensus.cc:2955] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:08.515349  4883 raft_consensus.cc:2243] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.516216  4883 raft_consensus.cc:2272] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.528650  4883 ts_tablet_manager.cc:1916] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:08.545228  4883 ts_tablet_manager.cc:1929] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:08.545709  4883 log.cc:1199] T 3d5f24773bb44448a1cb122558f0c4c9 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/wals/3d5f24773bb44448a1cb122558f0c4c9
I20260709 12:27:08.547358  3740 catalog_manager.cc:5028] TS 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): tablet 3d5f24773bb44448a1cb122558f0c4c9 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:09.564877  3932 consensus_queue.cc:237] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:09.570704  4006 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:09.570951  3857 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:27:09.571256  3897 consensus_peers.cc:597] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fb53ea47358c4bca95e2856114bf0412. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:09.572182  4862 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.573117  4890 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.588384  4862 raft_consensus.cc:2955] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:09.590265  4006 raft_consensus.cc:2955] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:09.603808  3848 raft_consensus.cc:2955] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:09.611161  3755 catalog_manager.cc:5697] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:09.622799  3924 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:09.632426  3848 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:09.633773  4890 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.637547  4006 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:27:09.638645  3897 consensus_peers.cc:597] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a196cfd02592426389eee8bd2a8edb36. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:09.639627  4894 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.841387  4907 raft_consensus.cc:2955] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:09.858349  4000 raft_consensus.cc:2955] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:09.878087  3848 raft_consensus.cc:2955] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:09.920732  3751 catalog_manager.cc:5697] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:09.926633  3931 consensus_queue.cc:237] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
W20260709 12:27:09.941672  3897 consensus_peers.cc:597] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8abf2cd47e3c44d995fbbb863bf3d5ac. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:09.942054  4000 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:09.943601  3848 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:09.944223  4890 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.945175  4894 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.955435  4907 raft_consensus.cc:2955] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:09.957422  4000 raft_consensus.cc:2955] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:09.968237  3848 raft_consensus.cc:2955] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:09.971022  3857 consensus_queue.cc:237] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:09.977005  3751 catalog_manager.cc:5697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
W20260709 12:27:09.988852  3822 consensus_peers.cc:597] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ecfd004856c24015ae137dfd5fd34b2c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:09.991008  4000 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:09.992406  3931 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:09.994313  4876 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:09.996428  4904 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:10.006398  4914 ts_tablet_manager.cc:933] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:10.014827  4876 raft_consensus.cc:2955] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:10.021847  4000 raft_consensus.cc:2955] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:10.023669  4914 tablet_copy_client.cc:323] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:27:10.024587  3932 raft_consensus.cc:2955] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:10.026108  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet fb53ea47358c4bca95e2856114bf0412 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:27:10.026683  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet fb53ea47358c4bca95e2856114bf0412 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-fb53ea47358c4bca95e2856114bf0412
I20260709 12:27:10.034065  3942 tablet_copy_source_session.cc:215] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:10.036592  3751 catalog_manager.cc:5697] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:10.047158  4914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb53ea47358c4bca95e2856114bf0412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.064422  4914 tablet_copy_client.cc:806] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:10.065025  4914 tablet_copy_client.cc:670] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:10.068725  4914 tablet_copy_client.cc:538] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:10.078023  4914 tablet_bootstrap.cc:492] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:10.094439  4914 tablet_bootstrap.cc:492] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:10.095155  4914 tablet_bootstrap.cc:492] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:10.095685  4914 ts_tablet_manager.cc:1403] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:27:10.098484  4914 raft_consensus.cc:359] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:10.099246  4914 raft_consensus.cc:740] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:10.099898  4914 consensus_queue.cc:260] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:10.102756  4914 ts_tablet_manager.cc:1434] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:10.104629  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-fb53ea47358c4bca95e2856114bf0412 received from {username='slave'} at 127.0.0.1:54068
I20260709 12:27:10.105021  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-fb53ea47358c4bca95e2856114bf0412 on tablet fb53ea47358c4bca95e2856114bf0412 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:10.140879  4914 ts_tablet_manager.cc:933] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:10.147756  4914 tablet_copy_client.cc:323] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:27:10.149331  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet a196cfd02592426389eee8bd2a8edb36 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:27:10.149801  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet a196cfd02592426389eee8bd2a8edb36 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-a196cfd02592426389eee8bd2a8edb36
I20260709 12:27:10.157224  3942 tablet_copy_source_session.cc:215] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:10.161557  4914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a196cfd02592426389eee8bd2a8edb36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.177556  4914 tablet_copy_client.cc:806] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:10.178184  4914 tablet_copy_client.cc:670] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:10.181507  4914 tablet_copy_client.cc:538] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:10.192344  4914 tablet_bootstrap.cc:492] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:10.213182  4914 tablet_bootstrap.cc:492] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:10.214061  4914 tablet_bootstrap.cc:492] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:10.214696  4914 ts_tablet_manager.cc:1403] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.008s
I20260709 12:27:10.217468  4914 raft_consensus.cc:359] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:10.218322  4914 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:10.218930  4914 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:10.221287  4914 ts_tablet_manager.cc:1434] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:27:10.223177  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-a196cfd02592426389eee8bd2a8edb36 received from {username='slave'} at 127.0.0.1:54068
I20260709 12:27:10.223531  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-a196cfd02592426389eee8bd2a8edb36 on tablet a196cfd02592426389eee8bd2a8edb36 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:10.389061  4914 ts_tablet_manager.cc:933] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:10.391055  4914 tablet_copy_client.cc:323] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:27:10.392755  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet 8abf2cd47e3c44d995fbbb863bf3d5ac from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:27:10.393291  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet 8abf2cd47e3c44d995fbbb863bf3d5ac from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-8abf2cd47e3c44d995fbbb863bf3d5ac
I20260709 12:27:10.401221  3942 tablet_copy_source_session.cc:215] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:10.404265  4914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8abf2cd47e3c44d995fbbb863bf3d5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.426751  4914 tablet_copy_client.cc:806] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:10.427421  4914 tablet_copy_client.cc:670] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:10.435097  4914 tablet_copy_client.cc:538] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:10.444092  4914 tablet_bootstrap.cc:492] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:10.462381  4914 tablet_bootstrap.cc:492] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:10.463182  4914 tablet_bootstrap.cc:492] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:10.463843  4914 ts_tablet_manager.cc:1403] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 12:27:10.466328  4914 raft_consensus.cc:359] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:10.467072  4914 raft_consensus.cc:740] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:10.467628  4914 consensus_queue.cc:260] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:10.469590  4914 ts_tablet_manager.cc:1434] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:27:10.471797  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-8abf2cd47e3c44d995fbbb863bf3d5ac received from {username='slave'} at 127.0.0.1:54068
I20260709 12:27:10.472186  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-8abf2cd47e3c44d995fbbb863bf3d5ac on tablet 8abf2cd47e3c44d995fbbb863bf3d5ac with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:10.538596  4572 raft_consensus.cc:1217] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:10.555176  4914 ts_tablet_manager.cc:933] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:10.557299  4914 tablet_copy_client.cc:323] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.1:32843
I20260709 12:27:10.558744  3867 tablet_copy_service.cc:140] P 4eedd844c09d456ca0b3614490dd1dbb: Received BeginTabletCopySession request for tablet ecfd004856c24015ae137dfd5fd34b2c from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:40038)
I20260709 12:27:10.559181  3867 tablet_copy_service.cc:161] P 4eedd844c09d456ca0b3614490dd1dbb: Beginning new tablet copy session on tablet ecfd004856c24015ae137dfd5fd34b2c from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:40038: session id = f3cab225ecb7488386a1a19239498cfe-ecfd004856c24015ae137dfd5fd34b2c
I20260709 12:27:10.568217  3867 tablet_copy_source_session.cc:215] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:10.572093  4914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecfd004856c24015ae137dfd5fd34b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:10.583021  4914 tablet_copy_client.cc:806] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:10.583601  4914 tablet_copy_client.cc:670] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:10.587065  4914 tablet_copy_client.cc:538] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:10.593859  4914 tablet_bootstrap.cc:492] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:10.609263  4914 tablet_bootstrap.cc:492] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:10.610165  4914 tablet_bootstrap.cc:492] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:10.611310  4914 ts_tablet_manager.cc:1403] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.004s
I20260709 12:27:10.614928  4914 raft_consensus.cc:359] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:10.615712  4914 raft_consensus.cc:740] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:10.616276  4914 consensus_queue.cc:260] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:10.619077  4914 ts_tablet_manager.cc:1434] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:10.620924  3867 tablet_copy_service.cc:342] P 4eedd844c09d456ca0b3614490dd1dbb: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-ecfd004856c24015ae137dfd5fd34b2c received from {username='slave'} at 127.0.0.1:40038
I20260709 12:27:10.621385  3867 tablet_copy_service.cc:434] P 4eedd844c09d456ca0b3614490dd1dbb: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-ecfd004856c24015ae137dfd5fd34b2c on tablet ecfd004856c24015ae137dfd5fd34b2c with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:10.627055  4572 raft_consensus.cc:1217] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:10.791913  4572 raft_consensus.cc:1217] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:27:10.837556  4027 debug-util.cc:398] Leaking SignalData structure 0x7b080019bf20 after lost signal to thread 2679
W20260709 12:27:10.838646  4027 debug-util.cc:398] Leaking SignalData structure 0x7b08001dbd60 after lost signal to thread 3789
W20260709 12:27:10.839793  4027 debug-util.cc:398] Leaking SignalData structure 0x7b080028c800 after lost signal to thread 3881
W20260709 12:27:10.840801  4027 debug-util.cc:398] Leaking SignalData structure 0x7b0800315880 after lost signal to thread 3956
W20260709 12:27:10.841811  4027 debug-util.cc:398] Leaking SignalData structure 0x7b08002aed40 after lost signal to thread 4030
W20260709 12:27:10.842895  4027 debug-util.cc:398] Leaking SignalData structure 0x7b0800312180 after lost signal to thread 4598
I20260709 12:27:10.953334  4572 raft_consensus.cc:1217] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:11.020929  4907 raft_consensus.cc:1064] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:11.024492  4907 consensus_queue.cc:237] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:11.035359  4572 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:11.037318  3857 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:11.037384  4000 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:11.038640  4927 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:11.039546  4928 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:11.042105  4928 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:11.152851  4890 raft_consensus.cc:2955] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.156148  4002 raft_consensus.cc:2955] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.189796  4572 raft_consensus.cc:2955] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.190330  3857 raft_consensus.cc:2955] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.199569  4907 raft_consensus.cc:1064] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:11.206552  3753 catalog_manager.cc:5697] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.234535  4907 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:11.273204  4572 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:11.275025  4927 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:11.283193  4002 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:11.286581  4890 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:11.300155  3857 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:11.305701  4928 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:11.343608  4572 raft_consensus.cc:2955] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.370268  4885 raft_consensus.cc:1064] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:11.374377  4885 consensus_queue.cc:237] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:11.397608  4927 raft_consensus.cc:1064] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:11.401222  4927 consensus_queue.cc:237] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:11.338764  4894 raft_consensus.cc:2955] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.418695  3857 raft_consensus.cc:2955] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.436196  3926 consensus_queue.cc:237] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:11.453593  4573 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:11.458276  4890 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:11.464510  4002 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:11.466444  4907 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:11.466271  4002 raft_consensus.cc:2955] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.468360  3754 catalog_manager.cc:5697] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.469837  4907 raft_consensus.cc:2955] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.493816  3926 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:11.476400  4572 raft_consensus.cc:2955] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.487520  4573 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:11.488485  4000 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:11.502622  4928 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:11.501957  4000 raft_consensus.cc:2955] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.505674  4928 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:11.508323  4573 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:27:11.512588  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 55099.9us
W20260709 12:27:11.513080  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 63054us
I20260709 12:27:11.511113  4928 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:11.521436  3848 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:11.523684  3850 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:11.526490  3754 catalog_manager.cc:5697] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.545336  4573 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:11.549739  4928 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:11.543190  4890 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:27:11.552775  4904 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:27:11.592200  4006 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:11.592193  3932 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:27:11.594136  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 52222us
I20260709 12:27:11.604538  4885 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
W20260709 12:27:11.615350  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 52030.8us
I20260709 12:27:11.643322  4885 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:11.652961  4950 raft_consensus.cc:2955] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.679800  3740 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fb53ea47358c4bca95e2856114bf0412 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:27:11.690802  4945 log.cc:927] Time spent T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:27:11.693354  4571 raft_consensus.cc:2955] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:11.699615  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 57341us
I20260709 12:27:11.721752  3740 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a196cfd02592426389eee8bd2a8edb36 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:11.733717  3849 raft_consensus.cc:2955] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.774794  3840 tablet_service.cc:1558] Processing DeleteTablet for tablet fb53ea47358c4bca95e2856114bf0412 with delete_type TABLET_DATA_TOMBSTONED (TS 4eedd844c09d456ca0b3614490dd1dbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42036
I20260709 12:27:11.800314  3751 catalog_manager.cc:5697] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.834139  3996 tablet_service.cc:1558] Processing DeleteTablet for tablet a196cfd02592426389eee8bd2a8edb36 with delete_type TABLET_DATA_TOMBSTONED (TS 34711da9380944d2969a2bc3e203db3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36508
W20260709 12:27:11.839228  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 205211us
I20260709 12:27:11.868623  4894 raft_consensus.cc:2955] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.869342  4905 raft_consensus.cc:2955] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.926306  4964 tablet_replica.cc:333] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:27:11.927829  4964 raft_consensus.cc:2243] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.928675  4964 raft_consensus.cc:2272] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.933547  4963 tablet_replica.cc:333] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:27:11.935042  4963 raft_consensus.cc:2243] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.937058  4006 raft_consensus.cc:2955] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.936964  4963 raft_consensus.cc:2272] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.942777  4571 raft_consensus.cc:2955] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.942612  3753 catalog_manager.cc:5697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.963295  3932 raft_consensus.cc:2955] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.966436  4570 raft_consensus.cc:2955] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:11.978513  4963 ts_tablet_manager.cc:1916] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:11.991675  4964 ts_tablet_manager.cc:1916] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:12.015750  4000 raft_consensus.cc:2955] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:12.023152  3931 consensus_queue.cc:237] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:12.028730  4571 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:12.038743  3753 catalog_manager.cc:5697] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:12.055284  4890 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:12.066552  3848 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:12.067770  3849 raft_consensus.cc:2955] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:12.071987  4963 ts_tablet_manager.cc:1929] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:12.086035  4963 log.cc:1199] T fb53ea47358c4bca95e2856114bf0412 P 4eedd844c09d456ca0b3614490dd1dbb: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/wals/fb53ea47358c4bca95e2856114bf0412
I20260709 12:27:12.084003  4964 ts_tablet_manager.cc:1929] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:12.081540  4927 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:12.087553  4964 log.cc:1199] T a196cfd02592426389eee8bd2a8edb36 P 34711da9380944d2969a2bc3e203db3d: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/wals/a196cfd02592426389eee8bd2a8edb36
I20260709 12:27:12.095134  3739 catalog_manager.cc:5028] TS 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): tablet fb53ea47358c4bca95e2856114bf0412 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:12.097280  3741 catalog_manager.cc:5028] TS 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): tablet a196cfd02592426389eee8bd2a8edb36 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:12.103334  3849 raft_consensus.cc:2955] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:12.109385  4951 raft_consensus.cc:2955] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:12.111308  4571 raft_consensus.cc:2955] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:12.123733  3854 consensus_queue.cc:237] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:12.130128  3753 catalog_manager.cc:5697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:12.179068  3740 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8abf2cd47e3c44d995fbbb863bf3d5ac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:12.190263  3996 tablet_service.cc:1558] Processing DeleteTablet for tablet 8abf2cd47e3c44d995fbbb863bf3d5ac with delete_type TABLET_DATA_TOMBSTONED (TS 34711da9380944d2969a2bc3e203db3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36508
I20260709 12:27:12.192117  4964 tablet_replica.cc:333] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:27:12.287746  4964 raft_consensus.cc:2243] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:12.288628  4964 raft_consensus.cc:2272] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:12.296736  4964 ts_tablet_manager.cc:1916] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:12.326028  4570 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:12.333184  4006 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:12.333630  4964 ts_tablet_manager.cc:1929] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:12.337539  4885 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:12.336105  4964 log.cc:1199] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 34711da9380944d2969a2bc3e203db3d: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/wals/8abf2cd47e3c44d995fbbb863bf3d5ac
I20260709 12:27:12.347625  3741 catalog_manager.cc:5028] TS 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): tablet 8abf2cd47e3c44d995fbbb863bf3d5ac (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:12.354955  4885 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:12.374841  4885 raft_consensus.cc:2955] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:12.387832  4570 raft_consensus.cc:2955] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:12.423599  4003 raft_consensus.cc:2955] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:12.459376  3754 catalog_manager.cc:5697] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:12.465253  3739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ecfd004856c24015ae137dfd5fd34b2c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:12.486850  3917 tablet_service.cc:1558] Processing DeleteTablet for tablet ecfd004856c24015ae137dfd5fd34b2c with delete_type TABLET_DATA_TOMBSTONED (TS 073f84fcc295417f9bcc1eea29d2bb58 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43294
I20260709 12:27:12.489264  4974 tablet_replica.cc:333] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:27:12.490926  4974 raft_consensus.cc:2243] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:12.492329  4974 raft_consensus.cc:2272] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:12.497061  4974 ts_tablet_manager.cc:1916] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:12.520710  4974 ts_tablet_manager.cc:1929] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:12.521193  4974 log.cc:1199] T ecfd004856c24015ae137dfd5fd34b2c P 073f84fcc295417f9bcc1eea29d2bb58: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/wals/ecfd004856c24015ae137dfd5fd34b2c
I20260709 12:27:12.526387  3740 catalog_manager.cc:5028] TS 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): tablet ecfd004856c24015ae137dfd5fd34b2c (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:13.596006  3932 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:13.605173  3854 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:13.605844  4006 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:27:13.607007  3897 consensus_peers.cc:597] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8cb467dd69d4e7785fd70c9c63614ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.608021  4927 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:13.609179  4975 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:13.619542  4894 raft_consensus.cc:2955] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:13.628521  4003 raft_consensus.cc:2955] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:13.643854  3931 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:13.656836  3753 catalog_manager.cc:5697] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:13.671907  3849 raft_consensus.cc:2955] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
W20260709 12:27:13.703392  3897 consensus_peers.cc:597] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dcafa6aa2cb54d969725d5e69f9b4a5d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.705250  4006 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:13.705327  3849 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:13.706763  4894 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:13.708806  4894 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:13.729630  4894 raft_consensus.cc:2955] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:13.733798  4006 raft_consensus.cc:2955] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:13.762669  3849 raft_consensus.cc:2955] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:13.769236  3754 catalog_manager.cc:5697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:13.783273  4006 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:13.795496  3931 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:13.797072  4889 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:13.797080  3971 consensus_peers.cc:597] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 008722eae8ea40db92fea0a5f70961f3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.804960  3849 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:13.806597  4889 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:13.808604  4889 raft_consensus.cc:2955] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:13.827095  3931 raft_consensus.cc:2955] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:13.846082  3931 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:13.850666  3754 catalog_manager.cc:5697] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.864916  4000 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:27:13.866838  3897 consensus_peers.cc:597] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36aa23e03c114b66abce211a070a9c93. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:13.868206  4927 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:13.869252  3848 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:13.873306  4975 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:13.886821  3849 raft_consensus.cc:2955] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:13.897001  4951 raft_consensus.cc:2955] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:13.918752  4006 raft_consensus.cc:2955] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:13.951261  3854 raft_consensus.cc:2955] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:13.972898  3754 catalog_manager.cc:5697] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:14.185702  4997 ts_tablet_manager.cc:933] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:14.188172  4997 tablet_copy_client.cc:323] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:27:14.190469  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet a8cb467dd69d4e7785fd70c9c63614ea from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:27:14.191069  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet a8cb467dd69d4e7785fd70c9c63614ea from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-a8cb467dd69d4e7785fd70c9c63614ea
I20260709 12:27:14.200695  3942 tablet_copy_source_session.cc:215] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:14.209570  4997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8cb467dd69d4e7785fd70c9c63614ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.264978  4997 tablet_copy_client.cc:806] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:14.266278  4997 tablet_copy_client.cc:670] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:14.271694  4997 tablet_copy_client.cc:538] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:14.285974  4997 tablet_bootstrap.cc:492] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:14.303364  4999 ts_tablet_manager.cc:933] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:14.321499  5000 ts_tablet_manager.cc:933] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:14.340691  5002 ts_tablet_manager.cc:933] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:14.344409  4999 tablet_copy_client.cc:323] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:27:14.351598  5002 tablet_copy_client.cc:323] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:27:14.358285  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet 36aa23e03c114b66abce211a070a9c93 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:27:14.358774  3941 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet dcafa6aa2cb54d969725d5e69f9b4a5d from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:27:14.358898  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet 36aa23e03c114b66abce211a070a9c93 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-36aa23e03c114b66abce211a070a9c93
I20260709 12:27:14.362022  3941 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet dcafa6aa2cb54d969725d5e69f9b4a5d from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-dcafa6aa2cb54d969725d5e69f9b4a5d
I20260709 12:27:14.370447  4997 tablet_bootstrap.cc:492] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:14.375480  4997 tablet_bootstrap.cc:492] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:14.376210  4997 ts_tablet_manager.cc:1403] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.012s
I20260709 12:27:14.379438  4997 raft_consensus.cc:359] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:14.380266  4997 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:14.380928  4997 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:14.384199  3942 tablet_copy_source_session.cc:215] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:14.388767  4999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36aa23e03c114b66abce211a070a9c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.384928  3941 tablet_copy_source_session.cc:215] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:14.398948  5000 tablet_copy_client.cc:323] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.3:33709
I20260709 12:27:14.402070  4016 tablet_copy_service.cc:140] P 34711da9380944d2969a2bc3e203db3d: Received BeginTabletCopySession request for tablet 008722eae8ea40db92fea0a5f70961f3 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:51898)
I20260709 12:27:14.402642  4016 tablet_copy_service.cc:161] P 34711da9380944d2969a2bc3e203db3d: Beginning new tablet copy session on tablet 008722eae8ea40db92fea0a5f70961f3 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:51898: session id = f3cab225ecb7488386a1a19239498cfe-008722eae8ea40db92fea0a5f70961f3
I20260709 12:27:14.410527  5002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcafa6aa2cb54d969725d5e69f9b4a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.412616  4997 ts_tablet_manager.cc:1434] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.036s	user 0.014s	sys 0.000s
I20260709 12:27:14.410578  4016 tablet_copy_source_session.cc:215] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:14.444151  5000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008722eae8ea40db92fea0a5f70961f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:14.448357  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-a8cb467dd69d4e7785fd70c9c63614ea received from {username='slave'} at 127.0.0.1:54068
I20260709 12:27:14.448944  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-a8cb467dd69d4e7785fd70c9c63614ea on tablet a8cb467dd69d4e7785fd70c9c63614ea with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:14.450627  4999 tablet_copy_client.cc:806] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:14.456923  4999 tablet_copy_client.cc:670] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:14.474951  5002 tablet_copy_client.cc:806] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:14.475641  5002 tablet_copy_client.cc:670] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:14.494161  5000 tablet_copy_client.cc:806] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:14.494817  5000 tablet_copy_client.cc:670] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:14.503067  5002 tablet_copy_client.cc:538] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:14.513336  5000 tablet_copy_client.cc:538] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:14.534591  5002 tablet_bootstrap.cc:492] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:14.543598  5000 tablet_bootstrap.cc:492] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:14.561018  4999 tablet_copy_client.cc:538] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:14.587361  4999 tablet_bootstrap.cc:492] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:14.657136  5000 tablet_bootstrap.cc:492] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:14.658100  4999 tablet_bootstrap.cc:492] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:14.659073  4999 tablet_bootstrap.cc:492] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:14.659783  4999 ts_tablet_manager.cc:1403] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.073s	user 0.031s	sys 0.006s
I20260709 12:27:14.667243  5000 tablet_bootstrap.cc:492] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:14.668097  5000 ts_tablet_manager.cc:1403] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.125s	user 0.019s	sys 0.009s
I20260709 12:27:14.671351  5000 raft_consensus.cc:359] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:14.673331  5000 raft_consensus.cc:740] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:14.674091  5000 consensus_queue.cc:260] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:14.672444  4999 raft_consensus.cc:359] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:14.675140  4999 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:14.675820  4999 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:14.678440  4999 ts_tablet_manager.cc:1434] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 12:27:14.699286  5000 ts_tablet_manager.cc:1434] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:27:14.702685  5002 tablet_bootstrap.cc:492] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:14.703438  4016 tablet_copy_service.cc:342] P 34711da9380944d2969a2bc3e203db3d: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-008722eae8ea40db92fea0a5f70961f3 received from {username='slave'} at 127.0.0.1:51898
I20260709 12:27:14.703809  5002 tablet_bootstrap.cc:492] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:14.704066  4016 tablet_copy_service.cc:434] P 34711da9380944d2969a2bc3e203db3d: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-008722eae8ea40db92fea0a5f70961f3 on tablet 008722eae8ea40db92fea0a5f70961f3 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:14.704613  5002 ts_tablet_manager.cc:1403] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.170s	user 0.016s	sys 0.009s
I20260709 12:27:14.703851  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-36aa23e03c114b66abce211a070a9c93 received from {username='slave'} at 127.0.0.1:54068
I20260709 12:27:14.705210  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-36aa23e03c114b66abce211a070a9c93 on tablet 36aa23e03c114b66abce211a070a9c93 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:14.715651  5002 raft_consensus.cc:359] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:14.716629  5002 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:14.717336  5002 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:14.720239  5002 ts_tablet_manager.cc:1434] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:27:14.721922  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-dcafa6aa2cb54d969725d5e69f9b4a5d received from {username='slave'} at 127.0.0.1:54068
I20260709 12:27:14.722355  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-dcafa6aa2cb54d969725d5e69f9b4a5d on tablet dcafa6aa2cb54d969725d5e69f9b4a5d with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:14.776786  4570 raft_consensus.cc:1217] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:14.817713  4570 raft_consensus.cc:1217] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:14.844806  4570 raft_consensus.cc:1217] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:14.883026  4570 raft_consensus.cc:1217] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:15.146703  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:15.238281  3931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:15.238955  3931 raft_consensus.cc:606] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:15.242611  3931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:15.243125  3931 raft_consensus.cc:606] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:15.268097  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:15.268806  3849 raft_consensus.cc:606] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:15.275909  3931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:15.277705  3931 raft_consensus.cc:606] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:15.280606  3931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:15.281136  3931 raft_consensus.cc:606] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:15.288751  5011 raft_consensus.cc:1064] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:15.291304  5011 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:15.296348  3931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:15.298226  3931 raft_consensus.cc:606] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:15.300314  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:27:15.301977  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:15.303099  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:15.305671  4927 raft_consensus.cc:993] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:15.306181  4927 raft_consensus.cc:1081] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:15.307925  4571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42178
I20260709 12:27:15.308465  4571 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:15.308502  4951 raft_consensus.cc:1064] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:15.308842  4571 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:15.309051  4951 raft_consensus.cc:1068] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Unable to promote non-voter f3cab225ecb7488386a1a19239498cfe: Service unavailable: leader transfer in progress
I20260709 12:27:15.319633  4927 raft_consensus.cc:993] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:15.320118  4927 raft_consensus.cc:1081] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:15.322150  4006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36516
I20260709 12:27:15.316932  4571 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:15.322754  4006 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:15.323175  4006 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.325708  4571 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:15.326726  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:15.327440  3931 raft_consensus.cc:3055] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:15.329470  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:15.329576  3931 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:15.330222  3849 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.331012  3931 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:15.340945  3931 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.353773  3931 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:15.355726  4537 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:15.356966  5006 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:15.363245  5006 raft_consensus.cc:697] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:15.364886  4975 raft_consensus.cc:1064] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:15.365944  5006 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:15.418987  4006 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:15.422528  3849 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:15.428445  4006 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:27:15.438326  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 48186.1us
I20260709 12:27:15.454316  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:15.455015  3931 raft_consensus.cc:3055] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:15.455379  3931 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:15.456259  3931 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:15.460191  3931 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.491400  4894 raft_consensus.cc:1064] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
W20260709 12:27:15.491973  4894 raft_consensus.cc:1068] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Unable to promote non-voter f3cab225ecb7488386a1a19239498cfe: Service unavailable: leader transfer in progress
W20260709 12:27:15.504156  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 65158.6us
I20260709 12:27:15.508750  4975 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:15.508181  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 92711.2us
I20260709 12:27:15.518842  3924 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:15.527403  3931 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:15.534093  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:15.534704  3849 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.514384  3753 catalog_manager.cc:5697] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 2 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:15.549953  5007 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:15.560468  3970 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:15.561834  5027 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:15.574501  4006 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:15.574748  4571 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:15.577066  5018 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:15.579030  5027 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:15.580389  5027 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:15.588567  4570 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:15.583771  4975 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:27:15.589993  3854 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:15.590221  5019 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:15.592933  5011 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:15.601070  3848 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:15.586565  3849 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:15.608618  5018 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:27:15.615731  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 166983us
I20260709 12:27:15.751305  4991 raft_consensus.cc:2955] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:15.759673  4927 raft_consensus.cc:2955] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:15.765488  3854 raft_consensus.cc:2955] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:15.771211  3755 catalog_manager.cc:5697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.812638  3924 raft_consensus.cc:2955] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:15.829155  3754 catalog_manager.cc:5697] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:15.830494  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 190020us
I20260709 12:27:15.844046  4571 raft_consensus.cc:2955] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:15.872215  3854 raft_consensus.cc:2955] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:15.889156  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 44551.2us
I20260709 12:27:15.919607  4003 raft_consensus.cc:2955] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:15.925444  3848 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:15.927747  5006 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:27:15.938858  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 70302.4us
I20260709 12:27:15.968504  5044 raft_consensus.cc:993] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:15.970198  5018 raft_consensus.cc:993] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:15.970718  5018 raft_consensus.cc:1081] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:15.971673  3931 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:15.976251  5044 raft_consensus.cc:1081] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:15.977130  5006 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:15.977566  5044 raft_consensus.cc:1064] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:15.979031  4003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36516
W20260709 12:27:15.978041  5044 raft_consensus.cc:1068] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Unable to promote non-voter f3cab225ecb7488386a1a19239498cfe: Service unavailable: leader transfer in progress
I20260709 12:27:15.979734  4003 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:16.011049  4003 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.003347  4894 raft_consensus.cc:993] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:16.015033  4571 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Advancing to term 2
I20260709 12:27:16.002416  4006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36516
I20260709 12:27:15.972585  4570 raft_consensus.cc:2955] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:16.015756  4006 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:16.017397  4006 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.028781  4894 raft_consensus.cc:1081] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:16.028081  4003 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:16.028698  5039 raft_consensus.cc:993] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:16.040869  4571 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:16.042865  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:16.043434  3849 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.050413  3849 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:16.053201  4991 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:16.059502  4003 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:16.061574  4006 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:16.060864  4972 raft_consensus.cc:1081] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:16.068953  4006 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:16.071569  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:16.072350  3849 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.070640  3969 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:16.088382  3849 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:16.099257  3969 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:16.100992  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:16.100543  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:16.101781  3924 raft_consensus.cc:3055] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:16.109795  3924 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:16.106454  3926 raft_consensus.cc:3055] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:16.113516  3926 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:16.114452  3926 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:16.116011  3926 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.098793  4991 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:16.110785  3924 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:16.127636  3924 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.101684  5019 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:16.138098  5019 raft_consensus.cc:697] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:16.141755  5019 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:16.156307  3926 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:16.169516  3924 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:16.182678  4574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42178
I20260709 12:27:16.183300  4574 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:16.183681  4574 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.212885  3857 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:16.208030  4574 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:16.218556  4572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42526
I20260709 12:27:16.221926  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:16.222683  3924 raft_consensus.cc:3055] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:16.223079  3924 raft_consensus.cc:740] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:16.219044  4572 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:16.226383  4572 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.229095  3931 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:16.229795  3924 consensus_queue.cc:260] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:16.234509  3924 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.240527  4574 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:16.222847  4991 raft_consensus.cc:697] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:16.231072  5011 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:27:16.264829  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:16.265568  3997 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.273252  4572 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:16.283034  3931 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:16.275439  5007 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:27:16.309784  4572 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:16.321427  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:16.322069  3857 raft_consensus.cc:3055] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:16.322413  3857 raft_consensus.cc:740] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:16.323151  3857 consensus_queue.cc:260] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:16.328605  4572 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:16.330091  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:16.330873  3931 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.343731  4991 consensus_queue.cc:237] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:16.364531  3924 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:16.372684  5051 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:16.376940  4572 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:16.382298  5024 raft_consensus.cc:1064] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
W20260709 12:27:16.383001  5024 raft_consensus.cc:1068] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: Unable to promote non-voter f3cab225ecb7488386a1a19239498cfe: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:27:16.387503  4537 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:16.384810  3754 catalog_manager.cc:5697] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:16.392468  3857 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.395301  4572 raft_consensus.cc:2955] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:16.413538  5047 raft_consensus.cc:2955] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:16.432049  3857 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:16.410107  5006 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:16.437171  5006 raft_consensus.cc:697] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:16.438185  5006 consensus_queue.cc:237] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:16.440753  3997 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:16.437646  3851 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:16.464494  4536 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:16.467607  5062 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:16.468137  5062 raft_consensus.cc:697] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:16.469048  5062 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:16.473814  3931 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:16.474524  3932 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:16.498750  4927 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:27:16.566037  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.570393  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:16.578329  3740 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36aa23e03c114b66abce211a070a9c93 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:16.588434  5011 raft_consensus.cc:1064] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
W20260709 12:27:16.588930  5011 raft_consensus.cc:1068] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: Unable to promote non-voter f3cab225ecb7488386a1a19239498cfe: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:27:16.617460  3924 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:16.621440  5011 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:16.657936  3849 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:27:16.695550  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 157499us
I20260709 12:27:16.675056  5024 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:27:16.731112  3851 raft_consensus.cc:2955] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:16.751688  4571 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Advancing to term 2
W20260709 12:27:16.758821  5078 log.cc:927] Time spent T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:27:16.761674  4571 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:16.772348  5021 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:27:16.823894  3930 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:16.828205  3930 raft_consensus.cc:606] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:16.901506  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 70733.5us
W20260709 12:27:16.903157  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 90168us
I20260709 12:27:16.912010  3924 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:16.917634  3857 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:16.949870  3928 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:16.954561  5006 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:16.961899  5065 raft_consensus.cc:1064] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:16.964690  5065 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:16.969182  3997 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:16.970718  5007 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:16.974231  5006 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:16.976616  3857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:16.977385  3857 raft_consensus.cc:606] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:16.982322  5065 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:16.988337  5069 raft_consensus.cc:1064] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:16.992749  3852 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:16.994045  3928 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:17.026664  3755 catalog_manager.cc:5697] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:17.028342  3923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ff60edb937844e9aaed043337660571"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:17.028998  3923 raft_consensus.cc:606] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:17.012672  5007 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:27:17.028700  3755 catalog_manager.cc:5697] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:17.037613  4569 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:17.065449  5065 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:17.076040  3924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:17.076695  3924 raft_consensus.cc:606] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:17.079722  5021 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:17.080107  3923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:17.080703  3923 raft_consensus.cc:606] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:17.081440  5092 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:27:17.086469  3923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:17.087088  3923 raft_consensus.cc:606] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:17.090073  3923 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:17.090713  3850 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:17.092453  5060 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:17.096159  5060 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:17.090097  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:27:17.099647  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:17.100466  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:17.110677  5069 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:17.115042  3997 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:17.117949  3754 catalog_manager.cc:5697] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 2 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:17.119801  3754 catalog_manager.cc:5697] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:17.128667  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 61309.6us
I20260709 12:27:17.129989  3754 catalog_manager.cc:5697] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 1 to 2, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 2 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:17.231989  4571 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:17.232079  4569 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:27:17.233762  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 67691.5us
I20260709 12:27:17.238302  3850 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:17.242432  3857 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:17.262396  5090 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:27:17.239068  5021 raft_consensus.cc:2955] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:17.259007  4991 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:27:17.286247  5007 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:17.289598  5087 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:27:17.294416  3996 tablet_service.cc:1558] Processing DeleteTablet for tablet 36aa23e03c114b66abce211a070a9c93 with delete_type TABLET_DATA_TOMBSTONED (TS 34711da9380944d2969a2bc3e203db3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36508
W20260709 12:27:17.297354  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 44072.4us
I20260709 12:27:17.308512  4569 raft_consensus.cc:2955] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:17.312453  5044 raft_consensus.cc:993] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
W20260709 12:27:17.320201  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 53676.3us
I20260709 12:27:17.332173  3931 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:17.333802  5049 raft_consensus.cc:993] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:17.327976  5047 raft_consensus.cc:1081] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:17.349371  4894 raft_consensus.cc:1081] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:17.357821  3931 raft_consensus.cc:2955] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:17.360157  5050 raft_consensus.cc:993] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:17.360661  5050 raft_consensus.cc:1081] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:17.364416  4991 raft_consensus.cc:2955] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:17.373387  5103 tablet_replica.cc:333] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
W20260709 12:27:17.383924  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 55041.9us
I20260709 12:27:17.378744  5090 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:27:17.423779  3850 raft_consensus.cc:2955] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:17.434684  3848 raft_consensus.cc:2955] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:17.442154  5097 raft_consensus.cc:993] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:17.443228  5103 raft_consensus.cc:2243] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:17.466490  4572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42178
I20260709 12:27:17.467095  4572 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:17.465109  5061 raft_consensus.cc:1081] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:17.467846  4006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36516
I20260709 12:27:17.468434  4006 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:17.468887  4006 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.467478  4572 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.463135  3931 raft_consensus.cc:2955] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:17.474464  4573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42526
I20260709 12:27:17.475131  4573 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:17.475566  4573 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.461187  5087 raft_consensus.cc:2955] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:17.546072  5027 raft_consensus.cc:670] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:27:17.553050  5047 raft_consensus.cc:993] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:17.553743  5047 raft_consensus.cc:1081] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:17.555811  4571 raft_consensus.cc:2955] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:17.557559  4572 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:17.532732  4570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42178
I20260709 12:27:17.571528  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:17.615127  5103 raft_consensus.cc:2272] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:17.730034  4572 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:17.735486  3851 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.739835  5103 ts_tablet_manager.cc:1916] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:17.733832  4570 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:17.740341  4570 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:17.741914  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 145353us
I20260709 12:27:17.746176  3755 catalog_manager.cc:5697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:17.750599  4006 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:17.559986  3852 raft_consensus.cc:2955] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:17.795337  4571 raft_consensus.cc:2955] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:17.801692  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 235674us
I20260709 12:27:17.756204  4573 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:17.739670  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 189112us
I20260709 12:27:17.759790  3741 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 008722eae8ea40db92fea0a5f70961f3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:17.775350  3851 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:17.781653  5103 ts_tablet_manager.cc:1929] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:17.823380  3850 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:17.823869  4573 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:17.830977  4006 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:17.834118  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:17.834637  3850 raft_consensus.cc:3055] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:17.834875  3850 raft_consensus.cc:740] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:27:17.830421  3741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 70653.5us
I20260709 12:27:17.837697  3850 consensus_queue.cc:260] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:17.839304  3850 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.842232  5047 consensus_queue.cc:1059] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:17.843295  5047 raft_consensus.cc:3055] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:17.843631  5047 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:17.844347  5047 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:17.845456  5047 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.854036  3850 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:17.832898  5103 log.cc:1199] T 36aa23e03c114b66abce211a070a9c93 P 34711da9380944d2969a2bc3e203db3d: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/wals/36aa23e03c114b66abce211a070a9c93
I20260709 12:27:17.873521  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:17.874234  3851 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.862986  4536 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:17.876192  4536 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:17.884430  5098 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:17.884137  5060 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:17.886687  5098 raft_consensus.cc:697] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:17.890828  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:17.891400  3931 raft_consensus.cc:3055] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:17.891698  3931 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:17.887746  5098 consensus_queue.cc:237] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:17.904563  3741 catalog_manager.cc:5028] TS 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): tablet 36aa23e03c114b66abce211a070a9c93 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:17.907613  3851 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:17.914333  3931 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:17.921283  5020 raft_consensus.cc:993] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:17.937825  3931 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.944348  4570 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:17.945467  3998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ff60edb937844e9aaed043337660571"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36516
I20260709 12:27:17.946031  3998 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:17.946359  3998 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.946578  4570 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:17.947793  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:17.948371  3852 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.949096  4573 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:17.950934  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:17.951476  3926 raft_consensus.cc:3055] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:17.951768  3926 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:17.952567  3926 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:17.954301  3926 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.962338  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:17.962659  3931 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:17.935173  5020 raft_consensus.cc:1081] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:17.967777  3852 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:17.969530  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:17.973752  3970 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:17.972851  3926 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:17.972733  4573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42178
I20260709 12:27:17.983392  4573 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:17.983886  4573 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.987320  5069 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:17.987921  5069 raft_consensus.cc:697] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:17.988924  5069 consensus_queue.cc:237] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:17.990103  3999 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:17.998227  3998 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:17.992501  5060 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:18.002296  3998 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:18.004719  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:18.005368  3926 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:18.005774  3926 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:18.005719  4573 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:17.988157  3928 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:18.012262  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:18.012885  3851 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:18.012779  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:18.013797  5006 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:18.014312  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:18.014962  3848 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:18.015100  3926 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:18.015686  4573 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:18.014331  5006 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:18.018941  5006 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:18.018975  4004 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:18.004639  3751 catalog_manager.cc:5697] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:18.025403  3848 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:18.028131  3926 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:18.035322  3926 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:18.036052  4573 raft_consensus.cc:1240] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:18.036499  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:18.037117  3928 raft_consensus.cc:3055] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:18.037432  3928 raft_consensus.cc:740] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:18.002693  5060 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:18.042945  3999 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:18.046350  4573 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:18.047312  3969 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:18.050748  3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 008722eae8ea40db92fea0a5f70961f3 with delete_type TABLET_DATA_TOMBSTONED (TS 073f84fcc295417f9bcc1eea29d2bb58 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43294
I20260709 12:27:18.055012  3753 catalog_manager.cc:5697] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:18.061856  5088 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:18.062582  5088 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:18.065689  5011 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:27:18.063629  5088 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:18.038376  3928 consensus_queue.cc:260] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:18.045955  3851 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:18.097857  5020 consensus_queue.cc:1059] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:18.098878  4536 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:18.100936  3928 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:18.101058  5098 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:18.101962  5098 raft_consensus.cc:697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:18.102377  4991 raft_consensus.cc:2955] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:18.102895  5098 consensus_queue.cc:237] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:18.106838  3926 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:18.109103  4002 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:18.116391  4571 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:18.115145  5011 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:27:18.129652  4571 raft_consensus.cc:2955] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:18.129773  3926 raft_consensus.cc:2955] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:18.139284  3754 catalog_manager.cc:5697] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 2 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:18.140981  3754 catalog_manager.cc:5697] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 1 to 2, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 2 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:18.142735  3754 catalog_manager.cc:5697] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 2 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:18.149422  5117 tablet_replica.cc:333] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:27:18.150894  5117 raft_consensus.cc:2243] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.168442  3741 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dcafa6aa2cb54d969725d5e69f9b4a5d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:18.165844  3753 catalog_manager.cc:5697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:18.188541  3928 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:18.152045  5117 raft_consensus.cc:2272] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.196483  5117 ts_tablet_manager.cc:1916] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:18.205149  3840 tablet_service.cc:1558] Processing DeleteTablet for tablet dcafa6aa2cb54d969725d5e69f9b4a5d with delete_type TABLET_DATA_TOMBSTONED (TS 4eedd844c09d456ca0b3614490dd1dbb not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42036
I20260709 12:27:18.206583  3754 catalog_manager.cc:5697] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:18.240406  5121 tablet_replica.cc:333] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:27:18.243287  5121 raft_consensus.cc:2243] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.245177  3753 catalog_manager.cc:5697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 2 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:18.249003  5121 raft_consensus.cc:2272] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.253402  5121 ts_tablet_manager.cc:1916] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:18.254674  5117 ts_tablet_manager.cc:1929] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:18.255172  5117 log.cc:1199] T 008722eae8ea40db92fea0a5f70961f3 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/wals/008722eae8ea40db92fea0a5f70961f3
I20260709 12:27:18.257068  3740 catalog_manager.cc:5028] TS 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): tablet 008722eae8ea40db92fea0a5f70961f3 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:18.265268  3999 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:18.284152  3754 catalog_manager.cc:5697] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:18.290392  3928 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:18.292773  5007 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:18.295351  4571 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:18.298870  5110 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:18.303619  5121 ts_tablet_manager.cc:1929] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:27:18.304195  5121 log.cc:1199] T dcafa6aa2cb54d969725d5e69f9b4a5d P 4eedd844c09d456ca0b3614490dd1dbb: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/wals/dcafa6aa2cb54d969725d5e69f9b4a5d
I20260709 12:27:18.310117  3739 catalog_manager.cc:5028] TS 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): tablet dcafa6aa2cb54d969725d5e69f9b4a5d (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:18.338012  4991 raft_consensus.cc:2955] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:18.344830  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:18.354045  4571 raft_consensus.cc:2955] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:18.367619  3741 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a8cb467dd69d4e7785fd70c9c63614ea with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:18.384910  3852 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:18.387214  5098 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:18.376333  3928 raft_consensus.cc:2955] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:18.431900  3998 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:18.438164  5098 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:27:18.486625  3931 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:18.487361  3926 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:18.502645  3926 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:18.504037  3754 catalog_manager.cc:5697] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:18.512223  5060 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:27:18.559823  3852 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:18.524381  5088 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:27:18.563143  4991 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:18.548159  5113 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:27:18.578852  3848 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:18.586771  5113 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:18.594101  3848 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:18.602758  5113 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:18.607599  3840 tablet_service.cc:1558] Processing DeleteTablet for tablet a8cb467dd69d4e7785fd70c9c63614ea with delete_type TABLET_DATA_TOMBSTONED (TS 4eedd844c09d456ca0b3614490dd1dbb not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42036
I20260709 12:27:18.608770  5121 tablet_replica.cc:333] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:27:18.616808  3930 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:18.619535  5121 raft_consensus.cc:2243] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.620543  5121 raft_consensus.cc:2272] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.635298  5011 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:18.642227  5121 ts_tablet_manager.cc:1916] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:18.721601  3850 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:18.724615  3848 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:18.732817  5007 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:27:18.728600  5006 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 12:27:18.819505  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 96170.6us
I20260709 12:27:18.989562  3928 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:18.990720  5121 ts_tablet_manager.cc:1929] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:27:18.991179  5121 log.cc:1199] T a8cb467dd69d4e7785fd70c9c63614ea P 4eedd844c09d456ca0b3614490dd1dbb: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/wals/a8cb467dd69d4e7785fd70c9c63614ea
I20260709 12:27:18.999224  5138 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:19.035319  3997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:19.036104  3997 raft_consensus.cc:606] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:19.049001  3739 catalog_manager.cc:5028] TS 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): tablet a8cb467dd69d4e7785fd70c9c63614ea (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
W20260709 12:27:19.065284  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 143137us
I20260709 12:27:19.248854  3850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:19.249481  3850 raft_consensus.cc:606] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:19.261147  3997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:19.261804  3997 raft_consensus.cc:606] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:19.264693  3997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:19.265272  3997 raft_consensus.cc:606] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:19.270522  4004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:19.271140  4004 raft_consensus.cc:606] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:19.273655  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:27:19.274905  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:19.275514  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:19.288550  5100 raft_consensus.cc:993] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:19.289121  5100 raft_consensus.cc:1081] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:19.299055  5157 raft_consensus.cc:993] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:19.299319  3931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43302
I20260709 12:27:19.300019  3931 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:19.300429  3931 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.299525  5157 raft_consensus.cc:1081] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:19.311441  3931 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:19.323572  3924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:27:19.324329  3924 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:19.324741  3924 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.338974  3924 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:19.342065  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:19.343078  3852 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.348163  3931 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:19.352321  3924 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:19.352519  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:19.353183  3997 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:19.353479  3997 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:19.354287  3997 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:19.355394  3997 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.364049  5153 raft_consensus.cc:993] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:19.364609  5153 raft_consensus.cc:1081] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:19.368546  3997 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:19.369100  4571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42516
I20260709 12:27:19.369653  4571 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:19.369903  3897 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:19.370029  4571 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.370745  5158 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:19.371333  5158 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:19.372365  5158 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:19.378688  5110 raft_consensus.cc:993] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:19.379297  5110 raft_consensus.cc:1081] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:19.380008  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:19.381155  3928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:27:19.382387  3928 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:19.382771  3928 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.387769  4004 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.396827  3928 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:19.400769  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:19.401291  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:19.401526  4005 raft_consensus.cc:3055] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:19.401928  3850 raft_consensus.cc:3055] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:19.390498  3852 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:19.401594  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:19.402313  3850 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:19.402774  3854 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.403256  3850 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:19.404434  3850 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.390182  4571 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:19.402210  4005 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:19.411127  3854 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:19.411252  4005 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:19.412040  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:19.412555  4005 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.412631  3848 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.416049  4004 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:19.417207  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:19.418015  5020 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:19.418494  3895 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:19.418570  5020 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:19.419713  5020 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:19.420500  5149 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:19.420991  5149 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:19.421844  5149 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:19.440593  4005 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:19.445423  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:19.446132  3999 raft_consensus.cc:3055] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:19.446449  3999 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:19.447356  3999 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:19.448336  3999 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:19.441855  3848 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:19.450469  3851 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:19.456967  4536 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:19.459368  5138 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:19.443535  4571 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:19.460665  3850 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:19.461748  5138 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:19.462690  5138 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:19.516873  3928 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:19.567668  3999 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:19.606789  3751 catalog_manager.cc:5697] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 2, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:19.670176  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 57236.5us
W20260709 12:27:19.688951  5167 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:27:19.690629  5168 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:27:19.768973  5157 raft_consensus.cc:993] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:19.769505  5157 raft_consensus.cc:1081] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:19.771602  3928 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:19.771703  3753 catalog_manager.cc:5697] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 1 to 2, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 2 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.773699  3929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:27:19.774310  3929 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:19.774686  3929 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:19.786038  3929 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:19.794697  3929 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:27:19.794957  3897 consensus_peers.cc:597] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 26de30c1b5e74f05815f13d9ceea7f45. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.800578  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:19.801187  4573 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:19.802786  3998 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:19.802124  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:19.804345  5149 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:19.805186  3997 raft_consensus.cc:3055] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:19.805601  3997 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:19.807142  3997 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:19.813095  4573 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:19.814494  3997 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:19.814693  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:19.817155  5149 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:19.817692  3848 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:19.817930  5149 raft_consensus.cc:697] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:19.819176  5147 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:19.820698  5149 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:19.853399  3851 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:19.854054  3753 catalog_manager.cc:5697] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 2, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:19.854846  5149 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:19.855877  3753 catalog_manager.cc:5697] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 2, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:19.857285  3753 catalog_manager.cc:5697] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 3, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 3 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:19.859750  5147 raft_consensus.cc:2955] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:19.864022  3998 raft_consensus.cc:2955] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:19.871444  3997 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:19.874148  3848 raft_consensus.cc:2955] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:19.891553  3852 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:19.893275  5060 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:19.921365  3997 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:19.923246  5149 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:19.928048  3751 catalog_manager.cc:5697] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:19.934721  3999 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:19.971354  4004 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:19.975191  5147 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:19.976400  5148 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:20.013410  3851 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.013553  3848 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:19.985427  3998 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:20.021761  5060 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:20.022775  5148 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.024170  5148 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:19.998965  3999 consensus_queue.cc:237] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:20.105926  3928 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:20.109341  5143 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:20.116336  3971 consensus_peers.cc:597] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 611a21088f764ac6bf8767713d911869. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:20.136410  3848 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:20.138406  4991 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:20.162464  5137 raft_consensus.cc:2955] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:20.225139  3848 raft_consensus.cc:2955] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:20.254714  3850 consensus_queue.cc:237] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:20.272261  3753 catalog_manager.cc:5697] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.279645  3928 raft_consensus.cc:2955] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:20.294698  4004 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:20.296658  5147 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:20.328501  3822 consensus_peers.cc:597] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e10f480d05fc4f71af73fcd88b588f21. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:20.331512  3999 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:20.335237  5100 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.347127  4573 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:20.357666  5020 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:20.361151  3928 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:20.375774  5160 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:20.376811  5203 ts_tablet_manager.cc:933] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:20.395622  5156 raft_consensus.cc:2955] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:20.397162  3999 raft_consensus.cc:2955] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:20.519654  5203 tablet_copy_client.cc:323] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:27:20.538125  3852 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:20.576615  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet 26de30c1b5e74f05815f13d9ceea7f45 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:27:20.577260  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet 26de30c1b5e74f05815f13d9ceea7f45 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-26de30c1b5e74f05815f13d9ceea7f45
W20260709 12:27:20.578881  3822 consensus_peers.cc:597] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9c4439798ed4427881ec18a55649f4b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:20.585242  3942 tablet_copy_source_session.cc:215] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:20.584780  3754 catalog_manager.cc:5697] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:20.591661  3932 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:20.593899  5097 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.596850  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:27:20.614687  5205 log.cc:927] Time spent T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:27:20.619179  5203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26de30c1b5e74f05815f13d9ceea7f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:20.643164  5156 raft_consensus.cc:2955] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:20.644685  3932 raft_consensus.cc:2955] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:20.646909  3999 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:20.674677  5097 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.676561  3852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:20.677232  3852 raft_consensus.cc:606] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:20.673651  3932 raft_consensus.cc:2955] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:20.683926  3928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:20.684489  3928 raft_consensus.cc:606] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:20.690459  5208 ts_tablet_manager.cc:933] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:20.700088  3852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "378a06c64b37451cbad82415b967e001"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:20.700805  3852 raft_consensus.cc:606] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:20.703845  3852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:20.704532  3852 raft_consensus.cc:606] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:20.707809  3852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba2105a333194a478762048de8b5853c"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:20.708493  3852 raft_consensus.cc:606] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:20.710440  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:27:20.709153  3751 catalog_manager.cc:5697] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.721271  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:20.721381  5203 tablet_copy_client.cc:806] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:20.722177  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:20.722234  5203 tablet_copy_client.cc:670] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:20.722352  4004 raft_consensus.cc:2955] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:20.744367  5208 tablet_copy_client.cc:323] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.3:33709
I20260709 12:27:20.753507  5203 tablet_copy_client.cc:538] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:20.755694  4016 tablet_copy_service.cc:140] P 34711da9380944d2969a2bc3e203db3d: Received BeginTabletCopySession request for tablet 611a21088f764ac6bf8767713d911869 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:51898)
I20260709 12:27:20.756412  4016 tablet_copy_service.cc:161] P 34711da9380944d2969a2bc3e203db3d: Beginning new tablet copy session on tablet 611a21088f764ac6bf8767713d911869 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:51898: session id = f3cab225ecb7488386a1a19239498cfe-611a21088f764ac6bf8767713d911869
I20260709 12:27:20.764369  5203 tablet_bootstrap.cc:492] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:20.764849  5156 raft_consensus.cc:993] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:20.765394  5029 raft_consensus.cc:1081] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:20.769418  3932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43302
I20260709 12:27:20.770080  3932 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.770577  3932 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.771986  4016 tablet_copy_source_session.cc:215] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:20.790380  5208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611a21088f764ac6bf8767713d911869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:20.791647  3932 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:20.816089  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:20.817046  3852 raft_consensus.cc:3055] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:20.817408  3852 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:20.818431  3852 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:20.819633  3852 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.823068  3932 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:20.837173  5211 ts_tablet_manager.cc:933] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:20.840046  5029 raft_consensus.cc:993] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:20.840616  5029 raft_consensus.cc:1081] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:20.843516  3852 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:20.845870  3895 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:20.848039  4004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "378a06c64b37451cbad82415b967e001"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36530
I20260709 12:27:20.848649  4004 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.849005  4004 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.849754  5020 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:20.850549  5020 raft_consensus.cc:697] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:20.851475  5020 consensus_queue.cc:237] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:20.856348  4004 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:20.859659  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:20.860234  4571 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.867120  4571 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:20.873749  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:20.874697  5157 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:20.875227  5157 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:20.876116  5157 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:20.887864  4004 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:20.909281  5211 tablet_copy_client.cc:323] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.1:32843
W20260709 12:27:20.983078  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 102215us
I20260709 12:27:20.997502  3754 catalog_manager.cc:5697] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 2, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:21.002725  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:21.003592  3999 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:21.017160  3867 tablet_copy_service.cc:140] P 4eedd844c09d456ca0b3614490dd1dbb: Received BeginTabletCopySession request for tablet e10f480d05fc4f71af73fcd88b588f21 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:40038)
I20260709 12:27:21.017848  3867 tablet_copy_service.cc:161] P 4eedd844c09d456ca0b3614490dd1dbb: Beginning new tablet copy session on tablet e10f480d05fc4f71af73fcd88b588f21 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:40038: session id = f3cab225ecb7488386a1a19239498cfe-e10f480d05fc4f71af73fcd88b588f21
I20260709 12:27:21.022749  3753 catalog_manager.cc:5697] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 2, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:21.029444  5203 tablet_bootstrap.cc:492] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:21.033775  5203 tablet_bootstrap.cc:492] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
W20260709 12:27:21.038568  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 125909us
I20260709 12:27:21.063192  5203 ts_tablet_manager.cc:1403] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.299s	user 0.018s	sys 0.024s
I20260709 12:27:21.049647  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:21.068591  3848 raft_consensus.cc:3055] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:21.068992  3848 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:21.069828  3848 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:21.071269  3848 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:21.053545  5020 raft_consensus.cc:993] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:21.080066  5020 raft_consensus.cc:1081] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:21.080359  3999 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:21.032352  3867 tablet_copy_source_session.cc:215] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:21.092747  3848 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:21.095033  5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e10f480d05fc4f71af73fcd88b588f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.085369  4005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36516
I20260709 12:27:21.095857  4005 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:21.063565  5208 tablet_copy_client.cc:806] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:21.096295  4005 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:21.096676  5208 tablet_copy_client.cc:670] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:21.100122  5154 raft_consensus.cc:993] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:21.100598  5154 raft_consensus.cc:1081] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:21.108740  3928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba2105a333194a478762048de8b5853c"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43302
I20260709 12:27:21.109649  3928 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:21.110680  3928 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:21.108451  5208 tablet_copy_client.cc:538] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:21.117884  3928 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } }
I20260709 12:27:21.120308  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:21.120849  4004 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:21.121218  3928 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:21.122175  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:21.122941  3848 raft_consensus.cc:3055] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:21.123217  3848 raft_consensus.cc:740] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:21.123942  3848 consensus_queue.cc:260] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } }
I20260709 12:27:21.124963  3848 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:21.127679  5208 tablet_bootstrap.cc:492] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:21.147890  4004 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:21.147750  5203 raft_consensus.cc:359] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:21.149405  5203 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:21.150134  5203 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:21.148504  4005 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:21.155856  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:21.156590  3852 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:21.158413  3897 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:21.160707  5020 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:21.161279  5020 raft_consensus.cc:697] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:21.162345  5020 consensus_queue.cc:237] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } }
I20260709 12:27:21.163818  5203 ts_tablet_manager.cc:1434] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.070s	user 0.003s	sys 0.004s
I20260709 12:27:21.168812  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:21.169420  3932 raft_consensus.cc:3055] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:21.169725  3932 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:21.170738  3932 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:21.172173  3932 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:21.165303  3848 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:21.166183  4005 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:21.180868  3932 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:21.184154  3970 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:21.188040  5157 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:21.188862  5157 raft_consensus.cc:697] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:21.209794  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-26de30c1b5e74f05815f13d9ceea7f45 received from {username='slave'} at 127.0.0.1:54068
I20260709 12:27:21.210354  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-26de30c1b5e74f05815f13d9ceea7f45 on tablet 26de30c1b5e74f05815f13d9ceea7f45 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:21.214534  5157 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:21.215287  3852 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:21.226257  5211 tablet_copy_client.cc:806] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:21.226876  5211 tablet_copy_client.cc:670] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:21.239455  5211 tablet_copy_client.cc:538] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:21.242674  5203 ts_tablet_manager.cc:933] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:21.258385  5203 tablet_copy_client.cc:323] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.1:32843
I20260709 12:27:21.258996  5154 raft_consensus.cc:993] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:21.259673  5154 raft_consensus.cc:1081] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:21.260452  3867 tablet_copy_service.cc:140] P 4eedd844c09d456ca0b3614490dd1dbb: Received BeginTabletCopySession request for tablet e9c4439798ed4427881ec18a55649f4b from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:40038)
I20260709 12:27:21.261078  3867 tablet_copy_service.cc:161] P 4eedd844c09d456ca0b3614490dd1dbb: Beginning new tablet copy session on tablet e9c4439798ed4427881ec18a55649f4b from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:40038: session id = f3cab225ecb7488386a1a19239498cfe-e9c4439798ed4427881ec18a55649f4b
I20260709 12:27:21.266173  3932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43302
I20260709 12:27:21.266803  3932 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:21.267194  3932 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:21.270047  5211 tablet_bootstrap.cc:492] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:21.276515  3867 tablet_copy_source_session.cc:215] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:21.282661  3932 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:21.286962  3932 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:21.297389  5208 tablet_bootstrap.cc:492] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:21.298260  5211 tablet_bootstrap.cc:492] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:21.298666  5208 tablet_bootstrap.cc:492] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:21.299135  5211 tablet_bootstrap.cc:492] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:21.299495  5208 ts_tablet_manager.cc:1403] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.172s	user 0.026s	sys 0.005s
I20260709 12:27:21.326094  3754 catalog_manager.cc:5697] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 2, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:21.327335  3753 catalog_manager.cc:5697] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:21.335088  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:21.336510  3848 raft_consensus.cc:3055] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:27:21.338029  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 49285.7us
I20260709 12:27:21.337002  3848 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:21.340855  3848 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:21.343983  3848 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:21.355895  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:21.356974  4004 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:21.396044  4005 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:21.402988  5020 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:27:21.404812  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 55148.4us
I20260709 12:27:21.299854  5211 ts_tablet_manager.cc:1403] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.016s
I20260709 12:27:21.434406  3848 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:21.438299  4004 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:21.453116  5203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c4439798ed4427881ec18a55649f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:21.464640  3895 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:21.466320  5224 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:21.466917  5224 raft_consensus.cc:697] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:21.471544  5211 raft_consensus.cc:359] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:21.472635  5211 raft_consensus.cc:740] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:21.473443  5211 consensus_queue.cc:260] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:21.480639  4571 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:21.480842  5211 ts_tablet_manager.cc:1434] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 12:27:21.504395  5224 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:21.513098  3852 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:21.517791  3852 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:21.530058  4004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36508
I20260709 12:27:21.530936  4004 raft_consensus.cc:606] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Received request to transfer leadership
I20260709 12:27:21.533051  3867 tablet_copy_service.cc:342] P 4eedd844c09d456ca0b3614490dd1dbb: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-e10f480d05fc4f71af73fcd88b588f21 received from {username='slave'} at 127.0.0.1:40038
I20260709 12:27:21.533726  3867 tablet_copy_service.cc:434] P 4eedd844c09d456ca0b3614490dd1dbb: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-e10f480d05fc4f71af73fcd88b588f21 on tablet e10f480d05fc4f71af73fcd88b588f21 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:21.536608  5226 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:21.537560  5143 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:21.541070  4000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36508
I20260709 12:27:21.541720  4000 raft_consensus.cc:606] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Received request to transfer leadership
W20260709 12:27:21.543663  3741 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 26de30c1b5e74f05815f13d9ceea7f45 already in progress [suppressed 3 similar messages]
I20260709 12:27:21.545575  5208 raft_consensus.cc:359] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:21.547961  5208 raft_consensus.cc:740] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:21.548687  5208 consensus_queue.cc:260] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:21.619378  4573 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Advancing to term 2
I20260709 12:27:21.629725  4573 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:21.635867  5208 ts_tablet_manager.cc:1434] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.336s	user 0.005s	sys 0.004s
I20260709 12:27:21.652842  5223 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:21.646899  4573 raft_consensus.cc:1217] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:27:21.638051  3741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 94526.5us
I20260709 12:27:21.640635  5226 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:27:21.660179  3753 catalog_manager.cc:5697] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 2, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:21.675793  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36508
I20260709 12:27:21.676432  3999 raft_consensus.cc:606] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Received request to transfer leadership
I20260709 12:27:21.680078  5203 tablet_copy_client.cc:806] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:21.680853  5203 tablet_copy_client.cc:670] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:21.683554  4016 tablet_copy_service.cc:342] P 34711da9380944d2969a2bc3e203db3d: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-611a21088f764ac6bf8767713d911869 received from {username='slave'} at 127.0.0.1:51898
I20260709 12:27:21.684137  4016 tablet_copy_service.cc:434] P 34711da9380944d2969a2bc3e203db3d: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-611a21088f764ac6bf8767713d911869 on tablet 611a21088f764ac6bf8767713d911869 with peer f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:21.684306  3802 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:27:21.684808  3802 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 26de30c1b5e74f05815f13d9ceea7f45 already in progress
W20260709 12:27:21.685132  3802 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 26de30c1b5e74f05815f13d9ceea7f45 already in progress
I20260709 12:27:21.710191  5203 tablet_copy_client.cc:538] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:21.759706  3926 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:21.761353  5226 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:21.761960  3848 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:21.771873  5148 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:21.791600  4004 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:21.800992  5157 raft_consensus.cc:993] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:21.807051  5143 raft_consensus.cc:1081] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:21.810606  3928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:27:21.811230  3928 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:21.811615  3928 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:21.834492  5203 tablet_bootstrap.cc:492] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:21.851738  3928 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:21.891834  3928 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:21.860095  5148 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 12:27:21.940811  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 81497.9us
I20260709 12:27:21.955365  4991 raft_consensus.cc:1064] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
W20260709 12:27:21.955909  4991 raft_consensus.cc:1068] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: Unable to promote non-voter f3cab225ecb7488386a1a19239498cfe: Service unavailable: leader transfer in progress
I20260709 12:27:21.976157  3849 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:21.989454  5137 raft_consensus.cc:1064] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
W20260709 12:27:21.993943  5217 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
W20260709 12:27:22.008175  5137 raft_consensus.cc:1068] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: Unable to promote non-voter f3cab225ecb7488386a1a19239498cfe: Service unavailable: leader transfer in progress
I20260709 12:27:22.035772  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:22.036407  3852 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:22.059453  3849 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.072880  4573 raft_consensus.cc:1217] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:22.092399  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:22.120394  3852 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
W20260709 12:27:22.126616  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 52247.1us
I20260709 12:27:22.131723  5250 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:27:22.138934  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 163503us
I20260709 12:27:22.141425  3895 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:22.147754  5225 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:22.148434  5225 raft_consensus.cc:697] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:22.149423  5225 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:22.184034  3753 catalog_manager.cc:5697] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 3, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 3 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:22.189972  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:22.190675  3999 raft_consensus.cc:3055] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:22.190994  3999 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:22.191790  3999 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:22.197830  3999 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:22.198843  4005 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.201613  5137 raft_consensus.cc:1064] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:22.220646  5203 tablet_bootstrap.cc:492] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:22.222040  5203 tablet_bootstrap.cc:492] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:22.222738  5203 ts_tablet_manager.cc:1403] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.389s	user 0.017s	sys 0.012s
I20260709 12:27:22.204169  5137 consensus_queue.cc:237] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:22.230955  5248 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:22.254173  5203 raft_consensus.cc:359] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:22.258486  5203 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:22.274241  3999 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:22.275570  5203 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:22.276832  4571 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:22.278118  3929 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:22.278338  5203 ts_tablet_manager.cc:1434] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:27:22.282226  5241 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:22.283759  3867 tablet_copy_service.cc:342] P 4eedd844c09d456ca0b3614490dd1dbb: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-e9c4439798ed4427881ec18a55649f4b received from {username='slave'} at 127.0.0.1:40038
I20260709 12:27:22.284339  3867 tablet_copy_service.cc:434] P 4eedd844c09d456ca0b3614490dd1dbb: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-e9c4439798ed4427881ec18a55649f4b on tablet e9c4439798ed4427881ec18a55649f4b with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:22.289443  5251 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:22.309918  3852 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:22.315312  5241 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:22.323766  5137 raft_consensus.cc:2955] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:22.330127  4571 raft_consensus.cc:2955] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:22.330639  3852 raft_consensus.cc:2955] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:22.348729  3755 catalog_manager.cc:5697] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:22.396421  3929 raft_consensus.cc:2955] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:22.422667  3999 consensus_queue.cc:237] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:22.446760  4571 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:22.449312  4991 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:22.452731  3929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:22.453370  3929 raft_consensus.cc:606] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:22.460855  4000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:22.461505  4000 raft_consensus.cc:606] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:22.462280  5226 raft_consensus.cc:2955] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:22.468178  3929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:22.468811  3929 raft_consensus.cc:606] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:22.472079  3852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:22.472700  3852 raft_consensus.cc:606] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:22.474170  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:27:22.476007  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:22.477193  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:22.480193  3741 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 611a21088f764ac6bf8767713d911869 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:22.468791  4571 raft_consensus.cc:2955] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:22.489369  5248 raft_consensus.cc:993] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:22.490101  5248 raft_consensus.cc:1081] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:22.501844  4572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42178
I20260709 12:27:22.502468  4572 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:22.502856  4572 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.508564  3931 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:22.514480  4572 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:22.520090  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:22.520816  3931 raft_consensus.cc:3055] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:22.521176  3931 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:22.522190  3753 catalog_manager.cc:5697] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.523137  3931 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:22.528915  4572 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:22.531678  5226 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:22.532980  3931 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.536106  3840 tablet_service.cc:1558] Processing DeleteTablet for tablet 611a21088f764ac6bf8767713d911869 with delete_type TABLET_DATA_TOMBSTONED (TS 4eedd844c09d456ca0b3614490dd1dbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42036
I20260709 12:27:22.541096  3931 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:22.542704  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:22.550664  3999 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.545277  3924 raft_consensus.cc:2955] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:22.561128  5266 tablet_replica.cc:333] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:27:22.569566  5266 raft_consensus.cc:2243] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:22.579083  5266 raft_consensus.cc:2272] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:22.580255  4537 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:22.581156  5253 raft_consensus.cc:1064] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:22.581836  5098 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:22.582384  5098 raft_consensus.cc:697] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:22.583248  5098 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:22.585793  5253 consensus_queue.cc:237] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:22.587811  3999 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:22.590114  3852 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:22.591660  5223 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:22.592320  5266 ts_tablet_manager.cc:1916] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:22.622995  4571 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:22.623649  3755 catalog_manager.cc:5697] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 2 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.624742  5097 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:22.635260  5266 ts_tablet_manager.cc:1929] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:22.635816  5266 log.cc:1199] T 611a21088f764ac6bf8767713d911869 P 4eedd844c09d456ca0b3614490dd1dbb: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/wals/611a21088f764ac6bf8767713d911869
I20260709 12:27:22.643785  3739 catalog_manager.cc:5028] TS 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): tablet 611a21088f764ac6bf8767713d911869 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:22.651681  3999 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:22.653788  5231 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:22.659842  3924 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:22.661423  5154 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:22.705358  5154 raft_consensus.cc:2955] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:22.707963  4573 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Advancing to term 3
I20260709 12:27:22.723824  3999 raft_consensus.cc:2955] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:22.728061  4573 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:22.729949  4572 raft_consensus.cc:1217] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:22.731552  4571 raft_consensus.cc:2955] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:22.759080  5225 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:22.772344  5250 raft_consensus.cc:1064] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
W20260709 12:27:22.772877  5250 raft_consensus.cc:1068] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Unable to promote non-voter f3cab225ecb7488386a1a19239498cfe: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:27:22.771762  3755 catalog_manager.cc:5697] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:22.783361  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 69600.2us
I20260709 12:27:22.792629  3924 raft_consensus.cc:2955] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:22.800822  4000 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:22.805799  5225 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:22.835990  5224 raft_consensus.cc:993] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:22.836483  5224 raft_consensus.cc:1081] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:22.844496  3848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:27:22.845091  3848 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:22.845458  3848 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.855744  3848 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:22.858394  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:22.858959  3931 raft_consensus.cc:3055] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:22.859259  3931 raft_consensus.cc:740] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:22.858978  3848 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:22.863782  3931 consensus_queue.cc:260] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:22.864874  3931 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.877259  3931 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:22.878772  3821 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:22.880017  5097 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:22.880240  5272 raft_consensus.cc:993] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:22.880537  5097 raft_consensus.cc:697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:22.881376  5272 raft_consensus.cc:1081] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:22.881307  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:22.882045  3997 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.881484  5097 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:22.892859  5226 raft_consensus.cc:993] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:22.893373  5226 raft_consensus.cc:1081] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:22.897411  4000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36530
I20260709 12:27:22.898006  4000 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:22.898428  4000 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.903198  3997 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:22.909142  3931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:27:22.909705  3931 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:22.910059  3931 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:22.906848  4000 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:22.913391  4000 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:22.916759  3931 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:22.917083  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:22.919014  3924 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.923725  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:22.924278  3854 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:22.929085  3924 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:22.930271  3970 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:22.931178  3854 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:22.931382  5241 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:22.932134  5241 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:22.932796  3931 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:22.935774  5223 raft_consensus.cc:1064] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:22.933235  5241 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:22.934597  3895 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:22.936725  5225 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:22.937245  5225 raft_consensus.cc:697] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:22.938114  5225 consensus_queue.cc:237] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:22.939457  5223 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:22.906242  3852 consensus_queue.cc:237] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:22.965855  4002 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:22.972242  5154 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:22.968820  4571 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:22.987216  3752 catalog_manager.cc:5697] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 3, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 3 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:22.992766  5097 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:22.991961  3754 catalog_manager.cc:5697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 2 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:23.003494  3924 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:23.005116  5098 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:23.012718  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:23.013375  3852 raft_consensus.cc:3055] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:23.013664  3852 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:23.012953  5274 raft_consensus.cc:2955] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.014460  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:23.014392  3852 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:23.015038  3999 raft_consensus.cc:3055] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:23.015362  3999 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:23.015951  3852 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.016068  3999 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:23.017307  3999 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.022125  4573 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:23.024014  4000 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:23.025023  5250 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:23.029176  3852 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:23.030359  5225 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:27:23.038663  3848 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:23.043040  4002 raft_consensus.cc:2955] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.050266  4571 raft_consensus.cc:2955] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.051551  5224 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:23.057600  5225 raft_consensus.cc:2955] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.059760  4573 raft_consensus.cc:2955] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.065011  3848 raft_consensus.cc:2955] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.067461  3754 catalog_manager.cc:5697] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 2, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:23.077505  4000 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:23.080099  5098 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:23.084538  3739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e10f480d05fc4f71af73fcd88b588f21 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:23.104609  3753 catalog_manager.cc:5697] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 2 to 5, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.108582  3999 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:23.135274  3752 catalog_manager.cc:5697] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:23.148224  3997 raft_consensus.cc:2955] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.152686  3924 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:23.160591  3917 tablet_service.cc:1558] Processing DeleteTablet for tablet e10f480d05fc4f71af73fcd88b588f21 with delete_type TABLET_DATA_TOMBSTONED (TS 073f84fcc295417f9bcc1eea29d2bb58 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43294
I20260709 12:27:23.171773  3852 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:23.172475  4571 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:23.173233  5248 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:23.179493  5224 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:23.187808  5248 raft_consensus.cc:2955] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.195665  5285 tablet_replica.cc:333] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:27:23.200299  5285 raft_consensus.cc:2243] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:23.206046  5285 raft_consensus.cc:2272] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:23.202853  3848 raft_consensus.cc:2955] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.199555  4571 raft_consensus.cc:2955] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.231216  3752 catalog_manager.cc:5697] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index 5 to 6, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New cstate: current_term: 3 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.234488  5285 ts_tablet_manager.cc:1916] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:23.239907  3740 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 26de30c1b5e74f05815f13d9ceea7f45 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:23.268522  5285 ts_tablet_manager.cc:1929] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:23.269023  5285 log.cc:1199] T e10f480d05fc4f71af73fcd88b588f21 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/wals/e10f480d05fc4f71af73fcd88b588f21
I20260709 12:27:23.272125  3740 catalog_manager.cc:5028] TS 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): tablet e10f480d05fc4f71af73fcd88b588f21 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:23.294483  3996 tablet_service.cc:1558] Processing DeleteTablet for tablet 26de30c1b5e74f05815f13d9ceea7f45 with delete_type TABLET_DATA_TOMBSTONED (TS 34711da9380944d2969a2bc3e203db3d not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36508
I20260709 12:27:23.320595  5286 tablet_replica.cc:333] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:27:23.324020  5286 raft_consensus.cc:2243] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:23.324973  5286 raft_consensus.cc:2272] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:23.330332  5286 ts_tablet_manager.cc:1916] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:23.361995  3924 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:23.363049  5286 ts_tablet_manager.cc:1929] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:27:23.363554  5286 log.cc:1199] T 26de30c1b5e74f05815f13d9ceea7f45 P 34711da9380944d2969a2bc3e203db3d: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/wals/26de30c1b5e74f05815f13d9ceea7f45
I20260709 12:27:23.365516  3741 catalog_manager.cc:5028] TS 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): tablet 26de30c1b5e74f05815f13d9ceea7f45 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:23.366469  5097 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:23.423228  3997 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:23.427235  5274 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:23.435913  3999 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:23.438247  5223 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:23.447532  3852 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:23.454231  5248 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:23.458328  3924 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:23.460753  5241 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:23.555464  4571 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Advancing to term 2
I20260709 12:27:23.563676  4571 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:23.565016  4991 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:23.565344  3852 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:23.567617  5294 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:23.587002  5293 raft_consensus.cc:1064] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:23.589540  5293 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:23.598724  4571 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:23.598845  3924 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:23.600124  4991 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:23.601432  5226 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:23.606469  3852 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:23.608654  5295 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:23.615201  5295 raft_consensus.cc:2955] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.616922  3848 raft_consensus.cc:2955] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.618722  3924 raft_consensus.cc:2955] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.632437  4571 raft_consensus.cc:2955] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.646963  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:23.655068  3755 catalog_manager.cc:5697] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 2 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.671888  3999 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:23.689210  4571 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:23.690727  5295 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:27:23.697535  3852 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:23.699213  4991 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:23.729753  5295 raft_consensus.cc:2955] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.731488  3852 raft_consensus.cc:2955] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.746941  4571 raft_consensus.cc:2955] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:23.757057  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 49381.8us
I20260709 12:27:23.759106  3752 catalog_manager.cc:5697] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index 4 to 5, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:23.772737  3917 tablet_service.cc:1558] Processing DeleteTablet for tablet e9c4439798ed4427881ec18a55649f4b with delete_type TABLET_DATA_TOMBSTONED (TS 073f84fcc295417f9bcc1eea29d2bb58 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43294
I20260709 12:27:23.773329  3741 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e9c4439798ed4427881ec18a55649f4b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:23.774384  5285 tablet_replica.cc:333] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:27:23.775563  5285 raft_consensus.cc:2243] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:23.776458  5285 raft_consensus.cc:2272] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:23.780882  5285 ts_tablet_manager.cc:1916] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:23.793504  3929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:23.794162  3929 raft_consensus.cc:606] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:23.796869  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ff60edb937844e9aaed043337660571"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:23.797418  3999 raft_consensus.cc:606] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:23.800628  3929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:23.801098  3929 raft_consensus.cc:606] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:23.803922  3852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:23.804461  3852 raft_consensus.cc:606] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:23.805672  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:27:23.806819  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:23.807343  5285 ts_tablet_manager.cc:1929] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:27:23.807423  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:23.807796  5285 log.cc:1199] T e9c4439798ed4427881ec18a55649f4b P 073f84fcc295417f9bcc1eea29d2bb58: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/wals/e9c4439798ed4427881ec18a55649f4b
I20260709 12:27:23.809111  3740 catalog_manager.cc:5028] TS 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): tablet e9c4439798ed4427881ec18a55649f4b (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:23.838001  5274 raft_consensus.cc:993] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:23.838577  5154 raft_consensus.cc:1081] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:23.840168  3999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36530
I20260709 12:27:23.840610  3999 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:23.840920  3999 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.846508  3999 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:23.849490  3999 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:23.849671  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:23.849781  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:23.850312  4571 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.850423  3852 raft_consensus.cc:3055] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:23.850826  3852 raft_consensus.cc:740] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:23.852468  3852 consensus_queue.cc:260] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:23.853492  3852 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.856204  4571 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:23.857640  3971 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:23.858373  5293 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:23.858877  5293 raft_consensus.cc:697] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:23.859826  5293 consensus_queue.cc:237] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:23.863631  3852 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:23.873335  3753 catalog_manager.cc:5697] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 2, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.086647  5293 raft_consensus.cc:993] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:24.087235  4991 raft_consensus.cc:1081] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:24.090085  3929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ff60edb937844e9aaed043337660571"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:27:24.090657  3929 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:24.091010  3929 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:24.097694  3929 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:24.100239  3929 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:24.100353  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:24.101020  3848 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:24.101783  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:24.102455  3999 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:24.102691  3999 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:24.103569  3999 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:24.104766  3999 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:24.106312  3848 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:24.107385  3895 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:24.108273  5224 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:24.108737  5224 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:24.109567  5224 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:24.110662  3999 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:24.120335  3753 catalog_manager.cc:5697] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 3, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 3 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.241026  4571 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:24.242395  4991 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:24.258816  3852 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:24.262549  5295 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:24.265836  5307 raft_consensus.cc:993] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:24.266608  5224 raft_consensus.cc:1081] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:24.268260  3999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36516
I20260709 12:27:24.268865  3999 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:24.269245  3999 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:24.283159  3999 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:24.285912  3999 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:24.286384  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:24.287016  3852 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:24.287117  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:24.287670  3929 raft_consensus.cc:3055] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:24.287997  3929 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:24.288764  3929 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:24.289791  3929 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:24.295233  3852 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:24.296371  3969 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:24.297240  5295 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:24.297732  5295 raft_consensus.cc:697] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:24.298907  5295 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:24.299108  3929 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:24.309826  3753 catalog_manager.cc:5697] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 2 to 3, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 3 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.312505  5307 raft_consensus.cc:993] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:24.313078  5248 raft_consensus.cc:1081] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:24.315704  3848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:27:24.316265  3848 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:24.316615  3848 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.326478  3848 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:24.328509  3848 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:24.329026  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:24.329955  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:24.331003  3929 raft_consensus.cc:3055] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:24.331297  3999 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.331398  3929 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:24.332261  3929 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:24.333148  3929 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.336091  3999 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:24.337157  3822 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:24.337638  3929 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:24.337819  5097 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:24.338371  5097 raft_consensus.cc:697] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:24.339018  5097 consensus_queue.cc:237] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:24.347671  3753 catalog_manager.cc:5697] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 2 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.538928  3848 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:24.540046  5224 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:24.548508  3997 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:24.549986  5307 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:24.687278  3849 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:24.688498  5293 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:24.698457  3929 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:24.701136  5293 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:24.748939  3924 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:24.751040  5097 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:24.761067  3997 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:24.762584  5274 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:24.846815  3929 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:24.854275  3999 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:27:24.855069  3897 consensus_peers.cc:597] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5149ad67f39c49a6b07934b58605690c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:24.855400  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:24.855778  3849 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:24.856555  5307 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:24.858661  5307 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:24.872251  5224 raft_consensus.cc:2955] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:24.879051  3997 raft_consensus.cc:2955] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:24.896560  3848 consensus_queue.cc:237] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
W20260709 12:27:24.918531  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 47296.6us
I20260709 12:27:24.922111  3753 catalog_manager.cc:5697] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:24.924196  3849 raft_consensus.cc:2955] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
W20260709 12:27:24.933828  3822 consensus_peers.cc:597] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d9116f60a784d21bf919694ec32bdbb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:24.934670  3997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "455f8427897049759001979ea81adec1"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:24.935271  3997 raft_consensus.cc:606] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:24.938548  4000 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:24.940457  5097 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:24.951884  3929 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:24.953948  5097 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:24.957962  3924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:24.958698  3924 raft_consensus.cc:606] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:24.964068  4000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:24.964826  4000 raft_consensus.cc:606] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:24.967754  3924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:24.968327  3924 raft_consensus.cc:606] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:25.026813  3848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:25.027491  3848 raft_consensus.cc:606] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:25.075233  4991 raft_consensus.cc:993] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:25.075733  4991 raft_consensus.cc:1081] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:25.076660  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:27:25.078240  5326 raft_consensus.cc:993] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:25.080235  5311 raft_consensus.cc:1081] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:25.078450  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:25.084199  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:25.086181  3926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "455f8427897049759001979ea81adec1"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:27:25.086930  3926 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:25.087425  3926 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:25.099529  4572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42178
I20260709 12:27:25.100189  4572 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:25.100570  4572 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:25.150820  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 52644.4us
I20260709 12:27:25.169198  4572 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:25.212129  4572 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:25.214661  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:25.215260  3924 raft_consensus.cc:3055] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:25.215561  3924 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:25.235481  3924 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:25.347169  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 289545us
I20260709 12:27:25.164621  5154 raft_consensus.cc:2955] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:25.362192  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:25.363018  3997 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:25.380915  3997 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:25.424849  3926 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:25.446769  3928 raft_consensus.cc:2955] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:25.449700  3926 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:27:25.429459  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 153322us
W20260709 12:27:25.504519  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 54760.3us
I20260709 12:27:25.533185  5335 raft_consensus.cc:993] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:25.535064  5335 raft_consensus.cc:1081] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
W20260709 12:27:25.541153  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 445677us
I20260709 12:27:25.540835  3848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42066
I20260709 12:27:25.545948  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:25.546370  3848 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:25.546567  4571 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:25.546854  3848 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:25.532105  3924 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:25.574808  5344 raft_consensus.cc:993] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
W20260709 12:27:25.575038  3802 auto_rebalancer.cc:629] Failed to schedule move for tablet 7d8564889b304f44b9b2b4ad6e5687c4: Remote error: Service unavailable: leader transfer in progress
I20260709 12:27:25.575384  5344 raft_consensus.cc:1081] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:25.575802  3753 catalog_manager.cc:5697] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:25.542514  4538 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:25.580817  3852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:27:25.581499  3852 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:25.581838  3852 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:25.582489  5345 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:25.582998  5345 raft_consensus.cc:697] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:25.584472  4571 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:25.583873  5345 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:25.589923  3848 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:25.590363  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 47931.5us
I20260709 12:27:25.591969  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:25.595078  5368 ts_tablet_manager.cc:933] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:25.597102  5342 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:25.600225  5342 raft_consensus.cc:697] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:25.598412  3997 raft_consensus.cc:2955] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:25.601186  5342 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:25.606807  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:25.607445  3999 raft_consensus.cc:3055] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:25.607786  3999 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:25.609584  3999 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:25.610759  3999 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:25.597568  3852 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:25.626811  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:25.627453  3928 raft_consensus.cc:3055] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:25.627763  3928 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:25.628559  3928 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:25.629612  3931 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:25.629582  3928 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:25.631567  3852 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:25.591962  3848 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:25.639458  5368 tablet_copy_client.cc:323] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:27:25.643689  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet 5149ad67f39c49a6b07934b58605690c from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:27:25.644387  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet 5149ad67f39c49a6b07934b58605690c from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-5149ad67f39c49a6b07934b58605690c
I20260709 12:27:25.658532  4000 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:25.662979  3942 tablet_copy_source_session.cc:215] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:25.594547  3926 consensus_queue.cc:237] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:25.667975  5368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5149ad67f39c49a6b07934b58605690c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:25.679634  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:25.680540  4571 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:25.667977  3924 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:25.702522  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:25.703328  4000 raft_consensus.cc:3055] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:25.703723  4000 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:25.704809  4000 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:25.706264  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:25.706851  3997 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:25.707710  5367 ts_tablet_manager.cc:933] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:25.710361  5368 tablet_copy_client.cc:806] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:25.711161  5368 tablet_copy_client.cc:670] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:25.714673  3999 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:25.716087  3997 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:25.721320  3754 catalog_manager.cc:5697] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 3 to 4, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 4 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:25.722882  5097 raft_consensus.cc:993] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:25.739431  5097 raft_consensus.cc:1081] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:25.726751  4002 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 1. Current term is 2. Ops: []
W20260709 12:27:25.728927  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.730347  4000 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:25.736987  5368 tablet_copy_client.cc:538] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:25.754230  3752 catalog_manager.cc:5697] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 2, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:25.677774  3928 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
W20260709 12:27:25.773595  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 44883.9us
W20260709 12:27:25.774049  3897 consensus_peers.cc:597] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba2105a333194a478762048de8b5853c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:25.776264  4571 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:25.776484  5367 tablet_copy_client.cc:323] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.1:32843
I20260709 12:27:25.778138  5368 tablet_bootstrap.cc:492] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:25.778466  3867 tablet_copy_service.cc:140] P 4eedd844c09d456ca0b3614490dd1dbb: Received BeginTabletCopySession request for tablet 3d9116f60a784d21bf919694ec32bdbb from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:40038)
I20260709 12:27:25.778985  3867 tablet_copy_service.cc:161] P 4eedd844c09d456ca0b3614490dd1dbb: Beginning new tablet copy session on tablet 3d9116f60a784d21bf919694ec32bdbb from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:40038: session id = f3cab225ecb7488386a1a19239498cfe-3d9116f60a784d21bf919694ec32bdbb
I20260709 12:27:25.786983  3867 tablet_copy_source_session.cc:215] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:25.792976  4002 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:25.797999  5367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d9116f60a784d21bf919694ec32bdbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:25.799590  3821 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:25.801517  5348 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:25.802011  5348 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:25.802815  5348 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:25.809155  3852 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:25.814086  5328 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:25.814953  5342 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:25.816064  5367 tablet_copy_client.cc:806] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:25.816680  5367 tablet_copy_client.cc:670] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:25.823287  5367 tablet_copy_client.cc:538] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:25.831723  4000 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:25.835170  3752 catalog_manager.cc:5697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 2 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:25.841792  5367 tablet_bootstrap.cc:492] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:25.842574  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:25.850468  5348 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:25.851016  5348 raft_consensus.cc:697] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:25.851881  5348 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:25.852978  5342 raft_consensus.cc:2955] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:25.860435  3998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36530
I20260709 12:27:25.861331  3998 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:25.861861  3998 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:25.876320  3997 raft_consensus.cc:2955] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:25.876870  3752 catalog_manager.cc:5697] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 1 to 2, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 2 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:25.902033  3998 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:25.906294  3998 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:25.907578  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:25.908952  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:25.909576  3848 raft_consensus.cc:3055] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:25.909852  3848 raft_consensus.cc:740] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:25.910105  3928 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:25.910612  3848 consensus_queue.cc:260] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:25.911912  3848 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:25.914994  5368 tablet_bootstrap.cc:492] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:25.915902  5368 tablet_bootstrap.cc:492] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:25.916569  5368 ts_tablet_manager.cc:1403] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.139s	user 0.030s	sys 0.010s
I20260709 12:27:25.905580  3754 catalog_manager.cc:5697] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:25.917728  3854 raft_consensus.cc:2955] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:25.935542  3928 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:25.936618  5368 raft_consensus.cc:359] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:25.937484  5368 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:25.938158  5368 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:25.939801  3848 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:25.940907  5368 ts_tablet_manager.cc:1434] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 12:27:25.941794  3969 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:25.942663  5354 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:25.943140  5354 raft_consensus.cc:697] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:25.943965  5354 consensus_queue.cc:237] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:25.962816  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-5149ad67f39c49a6b07934b58605690c received from {username='slave'} at 127.0.0.1:54068
I20260709 12:27:25.963333  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-5149ad67f39c49a6b07934b58605690c on tablet 5149ad67f39c49a6b07934b58605690c with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:25.984354  5367 tablet_bootstrap.cc:492] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:25.985316  5367 tablet_bootstrap.cc:492] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:25.988894  5367 ts_tablet_manager.cc:1403] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.147s	user 0.021s	sys 0.023s
I20260709 12:27:26.016312  3755 catalog_manager.cc:5697] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 2, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.019155  5367 raft_consensus.cc:359] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:26.020066  5367 raft_consensus.cc:740] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:26.020704  5367 consensus_queue.cc:260] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:26.041983  4571 raft_consensus.cc:1217] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:27:26.069710  4569 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:26.071012  3926 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:27:26.074186  3998 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:27:26.076687  5367 ts_tablet_manager.cc:1434] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.001s
I20260709 12:27:26.073602  5328 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:27:26.075428  5345 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:27:26.079183  5299 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:26.083205  3867 tablet_copy_service.cc:342] P 4eedd844c09d456ca0b3614490dd1dbb: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-3d9116f60a784d21bf919694ec32bdbb received from {username='slave'} at 127.0.0.1:40038
I20260709 12:27:26.083606  3867 tablet_copy_service.cc:434] P 4eedd844c09d456ca0b3614490dd1dbb: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-3d9116f60a784d21bf919694ec32bdbb on tablet 3d9116f60a784d21bf919694ec32bdbb with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:26.151028  4000 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:26.152585  5311 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:26.234740  5367 ts_tablet_manager.cc:933] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:26.236918  5367 tablet_copy_client.cc:323] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:27:26.238667  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet ba2105a333194a478762048de8b5853c from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:27:26.239181  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet ba2105a333194a478762048de8b5853c from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-ba2105a333194a478762048de8b5853c
I20260709 12:27:26.247095  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:26.249302  3942 tablet_copy_source_session.cc:215] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:26.256767  5367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2105a333194a478762048de8b5853c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.277030  5367 tablet_copy_client.cc:806] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:26.277629  5367 tablet_copy_client.cc:670] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:26.283315  5367 tablet_copy_client.cc:538] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:26.308224  4571 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:26.311024  5154 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:26.336984  3928 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:26.355880  4000 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:26.356230  3998 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:26.373927  3998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "378a06c64b37451cbad82415b967e001"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:26.374574  3998 raft_consensus.cc:606] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:26.379065  5337 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:26.386408  5362 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:26.386562  5337 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:26.469543  5367 tablet_bootstrap.cc:492] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:26.474368  3926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:26.475109  3926 raft_consensus.cc:606] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:26.478708  3852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86e92801c3904600b054e99343413645"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:26.479404  3852 raft_consensus.cc:606] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:26.497870  4571 raft_consensus.cc:1217] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:26.507320  3852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:26.507956  3852 raft_consensus.cc:606] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:26.509244  5154 raft_consensus.cc:993] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:26.509559  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:27:26.509748  5154 raft_consensus.cc:1081] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:26.511373  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:26.515519  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:26.524446  3926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86e92801c3904600b054e99343413645"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43302
I20260709 12:27:26.525143  3926 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:26.525504  3926 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:26.539463  3926 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:26.543033  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:26.543664  4571 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:26.544332  3928 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:26.546036  5317 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:26.550927  4571 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:26.552292  3897 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:26.553097  5311 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:26.553614  5311 raft_consensus.cc:697] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:26.554180  3926 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:26.554591  5311 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:26.561666  5367 tablet_bootstrap.cc:492] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:26.562707  5367 tablet_bootstrap.cc:492] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:26.563352  5367 ts_tablet_manager.cc:1403] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.265s	user 0.038s	sys 0.004s
I20260709 12:27:26.564127  3854 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:26.566260  5367 raft_consensus.cc:359] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:26.567159  5367 raft_consensus.cc:740] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:26.567790  5367 consensus_queue.cc:260] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:26.568900  5359 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:26.575053  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:26.575639  3852 raft_consensus.cc:3055] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:26.575961  3852 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:26.576710  3852 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:26.577955  5367 ts_tablet_manager.cc:1434] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:27:26.577785  3852 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:26.579975  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-ba2105a333194a478762048de8b5853c received from {username='slave'} at 127.0.0.1:54068
I20260709 12:27:26.580627  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-ba2105a333194a478762048de8b5853c on tablet ba2105a333194a478762048de8b5853c with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:26.613291  3852 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:26.631249  3752 catalog_manager.cc:5697] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 2, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.656096  4571 raft_consensus.cc:1217] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:27:26.659381  5328 raft_consensus.cc:1064] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:26.662254  5328 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:26.676244  5317 raft_consensus.cc:993] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:26.676792  5366 raft_consensus.cc:1081] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:26.680889  3854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "378a06c64b37451cbad82415b967e001"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42066
I20260709 12:27:26.681465  3854 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:26.681962  3854 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:26.690361  3854 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:26.692516  3854 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:26.694499  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:26.695122  4000 raft_consensus.cc:3055] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:26.695425  4000 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:26.695950  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:26.697326  4569 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:26.702775  3998 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:26.704252  4571 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:26.696797  4000 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:26.704958  4569 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:26.705487  4000 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:26.706426  5342 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:26.708281  5342 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:26.711562  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:26.712332  5348 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:26.712803  5348 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:26.713979  5348 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:26.712642  4000 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:26.719533  3854 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:26.721076  5328 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:26.725430  5311 raft_consensus.cc:2955] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:26.729409  5342 raft_consensus.cc:993] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:26.729903  5342 raft_consensus.cc:1081] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:26.731398  4000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36516
I20260709 12:27:26.731899  4000 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:26.732241  4000 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:26.732172  3752 catalog_manager.cc:5697] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 2 to 3, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 3 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.736640  3998 raft_consensus.cc:2955] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:26.753698  4570 raft_consensus.cc:2955] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:26.754868  3752 catalog_manager.cc:5697] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.757916  4000 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:26.763833  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:26.764575  3852 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:26.770851  4000 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:26.771924  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:26.772535  3928 raft_consensus.cc:3055] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:26.772886  3928 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:26.773612  3928 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:26.774663  3928 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:26.780369  3926 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:26.790540  3852 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:26.793910  3969 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:26.795001  5317 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:26.795490  5317 raft_consensus.cc:697] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:26.796278  5317 consensus_queue.cc:237] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:26.806234  3928 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:26.807979  4570 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:26.809834  4002 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:26.816671  5342 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:26.818584  5342 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:26.820809  3754 catalog_manager.cc:5697] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 3 to 4, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 4 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.824887  5344 raft_consensus.cc:2955] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:26.828994  4002 raft_consensus.cc:2955] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:26.835124  4570 raft_consensus.cc:2955] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:26.842696  3740 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5149ad67f39c49a6b07934b58605690c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:26.845315  3754 catalog_manager.cc:5697] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:26.864444  3840 tablet_service.cc:1558] Processing DeleteTablet for tablet 5149ad67f39c49a6b07934b58605690c with delete_type TABLET_DATA_TOMBSTONED (TS 4eedd844c09d456ca0b3614490dd1dbb not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42036
I20260709 12:27:26.866353  5411 tablet_replica.cc:333] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:27:26.867311  5411 raft_consensus.cc:2243] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.867836  5411 pending_rounds.cc:70] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb: Trying to abort 1 pending ops.
I20260709 12:27:26.868085  5411 pending_rounds.cc:77] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb: Aborting op as it isn't in flight: id { term: 2 index: 4 } timestamp: 7305625791121575936 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "5149ad67f39c49a6b07934b58605690c" old_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } } new_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } } }
I20260709 12:27:26.869370  5411 raft_consensus.cc:2917] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted
I20260709 12:27:26.869774  5411 raft_consensus.cc:2889] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:27:26.870169  5411 raft_consensus.cc:2272] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.873553  5411 ts_tablet_manager.cc:1916] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:26.890034  5411 ts_tablet_manager.cc:1929] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:27:26.890599  5411 log.cc:1199] T 5149ad67f39c49a6b07934b58605690c P 4eedd844c09d456ca0b3614490dd1dbb: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/wals/5149ad67f39c49a6b07934b58605690c
I20260709 12:27:26.892601  3739 catalog_manager.cc:5028] TS 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): tablet 5149ad67f39c49a6b07934b58605690c (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:26.902556  5340 raft_consensus.cc:993] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:26.903029  5340 raft_consensus.cc:1081] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:26.904811  4002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36530
I20260709 12:27:26.905252  4002 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:26.905592  4002 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:26.911134  4002 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:26.913530  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:26.913535  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:26.914165  4570 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:26.914176  3852 raft_consensus.cc:3055] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:26.917521  3852 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:26.918150  3852 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:26.918903  3852 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:26.927294  4570 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:26.914201  4002 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:26.928754  3971 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:26.929740  5317 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:26.930370  5317 raft_consensus.cc:697] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:26.931198  5317 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:26.942827  5340 raft_consensus.cc:1064] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:26.974007  3755 catalog_manager.cc:5697] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 2 to 3, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 3 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.979307  3852 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:26.981137  5340 consensus_queue.cc:237] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:26.998142  4570 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:26.999670  5154 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:27.003265  3928 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:27.005115  5340 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:27.009055  4002 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:27.010942  5154 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:27.019784  5340 raft_consensus.cc:2955] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.021404  3926 raft_consensus.cc:2955] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.027778  4002 raft_consensus.cc:2955] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.037118  4570 raft_consensus.cc:2955] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.047698  3755 catalog_manager.cc:5697] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.067307  3854 consensus_queue.cc:237] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:27.072510  4570 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:27.072463  3926 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:27.075207  5348 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:27.077072  5348 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:27.083609  4570 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:27.085028  5344 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:27.096590  5348 raft_consensus.cc:2955] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.099892  3926 raft_consensus.cc:2955] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.104825  4569 raft_consensus.cc:2955] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.109787  3739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3d9116f60a784d21bf919694ec32bdbb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:27.118157  3753 catalog_manager.cc:5697] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.131608  3996 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d9116f60a784d21bf919694ec32bdbb with delete_type TABLET_DATA_TOMBSTONED (TS 34711da9380944d2969a2bc3e203db3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36508
I20260709 12:27:27.134233  5421 tablet_replica.cc:333] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:27:27.146780  5421 raft_consensus.cc:2243] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.147671  5421 raft_consensus.cc:2272] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.156729  5421 ts_tablet_manager.cc:1916] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:27.161100  3852 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:27.162896  5328 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:27.181548  5421 ts_tablet_manager.cc:1929] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:27.182188  5421 log.cc:1199] T 3d9116f60a784d21bf919694ec32bdbb P 34711da9380944d2969a2bc3e203db3d: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/wals/3d9116f60a784d21bf919694ec32bdbb
I20260709 12:27:27.184141  3741 catalog_manager.cc:5028] TS 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): tablet 3d9116f60a784d21bf919694ec32bdbb (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:27.208519  5328 raft_consensus.cc:1064] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:27.211285  5328 consensus_queue.cc:237] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:27.218498  3852 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:27.218586  4569 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:27.219861  5342 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:27.220621  5311 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:27.223170  4002 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:27.225234  4570 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:27.228431  5412 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:27.236063  5342 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:27.237442  3926 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:27.239009  5317 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:27.254513  3998 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:27.258225  5154 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:27.270491  3854 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:27.272114  5317 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:27:27.370313  5427 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:27:27.373327  5311 raft_consensus.cc:2955] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.395895  4002 raft_consensus.cc:2955] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.399950  3852 raft_consensus.cc:2955] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.406637  4569 raft_consensus.cc:2955] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.429961  3752 catalog_manager.cc:5697] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.471524  3926 consensus_queue.cc:237] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:27.479645  4569 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:27.481514  5328 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:27.490868  5344 raft_consensus.cc:2955] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.504959  4569 raft_consensus.cc:2955] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.511833  3740 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ba2105a333194a478762048de8b5853c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:27.531287  3752 catalog_manager.cc:5697] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 4 to 5, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.556514  3849 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:27.557086  3996 tablet_service.cc:1558] Processing DeleteTablet for tablet ba2105a333194a478762048de8b5853c with delete_type TABLET_DATA_TOMBSTONED (TS 34711da9380944d2969a2bc3e203db3d not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36508
I20260709 12:27:27.559290  5421 tablet_replica.cc:333] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:27:27.560670  5421 raft_consensus.cc:2243] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.561724  5421 raft_consensus.cc:2272] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.565393  4573 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:27.566563  5421 ts_tablet_manager.cc:1916] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:27.567896  5359 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:27.569587  5328 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:27.578338  3849 raft_consensus.cc:2955] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:27.607822  3852 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:27.620558  5317 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:27.635083  5421 ts_tablet_manager.cc:1929] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:27:27.635675  5421 log.cc:1199] T ba2105a333194a478762048de8b5853c P 34711da9380944d2969a2bc3e203db3d: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/wals/ba2105a333194a478762048de8b5853c
I20260709 12:27:27.637166  3741 catalog_manager.cc:5028] TS 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): tablet ba2105a333194a478762048de8b5853c (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:27.646349  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:27.686841  3931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:27.687428  3931 raft_consensus.cc:606] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:27.689769  3854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:27.690255  3854 raft_consensus.cc:606] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:27.692576  4002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:27.693050  4002 raft_consensus.cc:606] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:27.695201  4002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:27.695639  4002 raft_consensus.cc:606] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:27.696683  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:27:27.698092  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:27.698694  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:27.713196  5344 raft_consensus.cc:993] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:27.713740  5344 raft_consensus.cc:1081] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:27.715471  4573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42178
I20260709 12:27:27.715981  4573 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:27.716293  4573 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.723847  4573 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:27.725322  4573 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:27.726233  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:27.726154  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:27.726900  3931 raft_consensus.cc:3055] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:27.727262  3931 raft_consensus.cc:740] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:27.727022  3854 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.727970  3931 consensus_queue.cc:260] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:27.729229  3931 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.735999  3931 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:27.737136  4537 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:27.737978  5363 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:27.738452  5363 raft_consensus.cc:697] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:27.739352  3854 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:27.739293  5363 consensus_queue.cc:237] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:27.750411  3753 catalog_manager.cc:5697] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 2 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.763592  5317 raft_consensus.cc:993] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:27.764144  5437 raft_consensus.cc:1081] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:27.765574  3931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:27:27.766011  3931 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:27.766247  3931 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.771654  3931 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:27.773515  3931 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:27.774323  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:27.774935  3852 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.775074  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:27.775635  3998 raft_consensus.cc:3055] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:27.775938  3998 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:27.776602  3998 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:27.777667  3998 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.780316  3852 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:27.781363  3895 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:27.782038  5342 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:27.782799  5342 raft_consensus.cc:697] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:27.783300  3998 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:27.783677  5342 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:27.792387  3753 catalog_manager.cc:5697] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 2, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.804550  5412 raft_consensus.cc:993] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:27.805110  5348 raft_consensus.cc:1081] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:27.806756  4002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36530
I20260709 12:27:27.807288  4002 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:27.807618  4002 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.812451  4002 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:27.814147  4002 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:27.814747  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:27.815300  3852 raft_consensus.cc:3055] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:27.815220  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:27.815734  3852 raft_consensus.cc:740] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:27.815965  3931 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.816543  3852 consensus_queue.cc:260] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:27.817477  3852 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.821062  3931 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:27.821991  3852 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:27.822484  3970 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:27.823243  5437 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:27.823941  5437 raft_consensus.cc:697] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:27.824801  5437 consensus_queue.cc:237] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:27.835117  3753 catalog_manager.cc:5697] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 2, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.939608  5317 raft_consensus.cc:993] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:27.940176  5437 raft_consensus.cc:1081] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:27.941429  3852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42066
I20260709 12:27:27.941905  3852 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:27.942215  3852 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:27.947248  3852 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:27.948990  3852 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:27.950029  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:27.950129  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:27.950683  4573 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:27.950724  4002 raft_consensus.cc:3055] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:27.951135  4002 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:27.951694  4002 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:27.952520  4002 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:27.955183  4573 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:27.956169  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:27.956871  5348 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:27.956945  4002 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:27.957484  5348 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:27.958323  5348 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:27.967947  3753 catalog_manager.cc:5697] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 2 to 3, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 3 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.184700  3854 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:28.186034  5363 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:28.197724  3926 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:28.204499  5446 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:28.209285  4002 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.211170  5342 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.217267  3931 raft_consensus.cc:1275] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.218778  5435 consensus_queue.cc:1048] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.238881  3854 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.240769  3854 raft_consensus.cc:1275] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:28.242166  5317 consensus_queue.cc:1048] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.243140  5344 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:28.367233  3998 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:28.368683  5348 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:28.376667  4573 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:28.378048  5458 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:28.612298  4002 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:28.618466  3931 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:28.618456  3854 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:27:28.619694  3971 consensus_peers.cc:597] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d772c24bae14b138d4062798651f82f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.620065  5317 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.620977  5435 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.630743  5317 raft_consensus.cc:2955] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:28.633162  3931 raft_consensus.cc:2955] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:28.643859  4002 consensus_queue.cc:237] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:28.643579  3848 raft_consensus.cc:2955] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:28.659955  3754 catalog_manager.cc:5697] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.661459  3848 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:28.662887  3931 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:28.662781  5317 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.664197  5435 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:28.666296  3971 consensus_peers.cc:597] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 383a24e3cada4485922ab39de63b4de9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.685228  5437 raft_consensus.cc:2955] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:28.687904  3854 raft_consensus.cc:2955] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:28.690629  3924 raft_consensus.cc:2955] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:28.710752  3854 consensus_queue.cc:237] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:28.726557  3926 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:28.728214  5458 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:28.730544  3822 consensus_peers.cc:597] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6017f50df9e3498d929adc22812d22cf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.731043  4002 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:28.735656  5412 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:28.768428  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:28.771102  5348 raft_consensus.cc:2955] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:28.778420  4002 raft_consensus.cc:2955] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:28.776399  3926 raft_consensus.cc:2955] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:28.788416  3924 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
W20260709 12:27:28.801162  3897 consensus_peers.cc:597] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c5bc554f69c94b9887b24097921bd77e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.798430  3754 catalog_manager.cc:5697] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:28.802059  3854 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:28.802682  4002 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:28.803447  5328 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:28.805120  5342 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:28.812855  5344 raft_consensus.cc:2955] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:28.837801  3752 catalog_manager.cc:5697] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:28.854427  3854 raft_consensus.cc:2955] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:28.898214  4002 raft_consensus.cc:2955] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:28.902876  3752 catalog_manager.cc:5697] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.927875  3926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:28.928449  3926 raft_consensus.cc:606] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:28.931488  4002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:28.932049  4002 raft_consensus.cc:606] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:28.934916  3854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:28.935432  3854 raft_consensus.cc:606] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:28.936681  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:28.938300  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:28.939018  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:29.110078  5317 raft_consensus.cc:993] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:29.111563  5317 raft_consensus.cc:1081] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:29.113180  3926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:27:29.113720  3926 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:29.114099  3926 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:29.120832  3926 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:29.123723  5477 ts_tablet_manager.cc:933] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:29.126410  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:29.127184  3854 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:29.127620  3926 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:29.146906  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:29.147503  4002 raft_consensus.cc:3055] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:29.147779  4002 raft_consensus.cc:740] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:29.148581  3854 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:29.148466  4002 consensus_queue.cc:260] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:29.149663  4002 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:29.156279  3895 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:29.157171  5476 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:29.157676  5476 raft_consensus.cc:697] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:29.158507  5476 consensus_queue.cc:237] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:29.166394  4002 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:29.182422  3753 catalog_manager.cc:5697] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 3, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 3 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:29.184508  5477 tablet_copy_client.cc:323] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.3:33709
I20260709 12:27:29.186108  4016 tablet_copy_service.cc:140] P 34711da9380944d2969a2bc3e203db3d: Received BeginTabletCopySession request for tablet 383a24e3cada4485922ab39de63b4de9 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:51898)
I20260709 12:27:29.186672  4016 tablet_copy_service.cc:161] P 34711da9380944d2969a2bc3e203db3d: Beginning new tablet copy session on tablet 383a24e3cada4485922ab39de63b4de9 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:51898: session id = f3cab225ecb7488386a1a19239498cfe-383a24e3cada4485922ab39de63b4de9
I20260709 12:27:29.196903  4016 tablet_copy_source_session.cc:215] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:29.197489  5480 ts_tablet_manager.cc:933] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:29.199484  5480 tablet_copy_client.cc:323] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.3:33709
I20260709 12:27:29.200624  5477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383a24e3cada4485922ab39de63b4de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.201388  4016 tablet_copy_service.cc:140] P 34711da9380944d2969a2bc3e203db3d: Received BeginTabletCopySession request for tablet 8d772c24bae14b138d4062798651f82f from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:51898)
I20260709 12:27:29.202046  4016 tablet_copy_service.cc:161] P 34711da9380944d2969a2bc3e203db3d: Beginning new tablet copy session on tablet 8d772c24bae14b138d4062798651f82f from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:51898: session id = f3cab225ecb7488386a1a19239498cfe-8d772c24bae14b138d4062798651f82f
I20260709 12:27:29.217085  5477 tablet_copy_client.cc:806] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:29.217705  5477 tablet_copy_client.cc:670] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:29.222519  5477 tablet_copy_client.cc:538] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:29.223965  4016 tablet_copy_source_session.cc:215] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:29.232084  5480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d772c24bae14b138d4062798651f82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.235700  5477 tablet_bootstrap.cc:492] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:29.259735  5480 tablet_copy_client.cc:806] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:29.260989  5480 tablet_copy_client.cc:670] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:29.264232  5477 tablet_bootstrap.cc:492] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:29.264703  5480 tablet_copy_client.cc:538] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:29.265333  5477 tablet_bootstrap.cc:492] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:29.266105  5477 ts_tablet_manager.cc:1403] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.007s
I20260709 12:27:29.269515  5477 raft_consensus.cc:359] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:29.270649  5477 raft_consensus.cc:740] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:29.271384  5477 consensus_queue.cc:260] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:29.274545  5480 tablet_bootstrap.cc:492] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:29.274684  5477 ts_tablet_manager.cc:1434] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:27:29.278803  4016 tablet_copy_service.cc:342] P 34711da9380944d2969a2bc3e203db3d: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-383a24e3cada4485922ab39de63b4de9 received from {username='slave'} at 127.0.0.1:51898
I20260709 12:27:29.279224  4016 tablet_copy_service.cc:434] P 34711da9380944d2969a2bc3e203db3d: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-383a24e3cada4485922ab39de63b4de9 on tablet 383a24e3cada4485922ab39de63b4de9 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:29.285220  5474 raft_consensus.cc:993] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:29.285751  5474 raft_consensus.cc:1081] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:29.287557  3848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:27:29.288107  3848 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:29.288434  3848 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:29.303613  3848 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:29.306545  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:29.307017  3848 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:29.307132  3926 raft_consensus.cc:3055] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:29.307319  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:29.307637  3926 raft_consensus.cc:740] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:29.307942  3998 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:29.308383  3926 consensus_queue.cc:260] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:29.309583  3926 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:29.310858  5477 ts_tablet_manager.cc:933] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:29.314296  3998 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:29.315956  3926 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:29.316378  3822 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:29.317478  5458 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:29.317965  5458 raft_consensus.cc:697] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:29.318836  5458 consensus_queue.cc:237] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:29.323168  5480 tablet_bootstrap.cc:492] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:29.323195  5477 tablet_copy_client.cc:323] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.1:32843
I20260709 12:27:29.324244  5480 tablet_bootstrap.cc:492] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:29.324944  5480 ts_tablet_manager.cc:1403] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.014s
I20260709 12:27:29.325219  3867 tablet_copy_service.cc:140] P 4eedd844c09d456ca0b3614490dd1dbb: Received BeginTabletCopySession request for tablet 6017f50df9e3498d929adc22812d22cf from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:40038)
I20260709 12:27:29.325755  3867 tablet_copy_service.cc:161] P 4eedd844c09d456ca0b3614490dd1dbb: Beginning new tablet copy session on tablet 6017f50df9e3498d929adc22812d22cf from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:40038: session id = f3cab225ecb7488386a1a19239498cfe-6017f50df9e3498d929adc22812d22cf
I20260709 12:27:29.328377  5480 raft_consensus.cc:359] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:29.329214  5480 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:29.332690  5348 raft_consensus.cc:993] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:29.333107  5348 raft_consensus.cc:1081] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:29.329842  5480 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:29.334669  3998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36530
I20260709 12:27:29.335171  3998 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:29.335544  3998 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:29.339608  3867 tablet_copy_source_session.cc:215] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:29.342554  5480 ts_tablet_manager.cc:1434] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:27:29.342927  3998 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:29.347409  4016 tablet_copy_service.cc:342] P 34711da9380944d2969a2bc3e203db3d: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-8d772c24bae14b138d4062798651f82f received from {username='slave'} at 127.0.0.1:51898
I20260709 12:27:29.347841  4016 tablet_copy_service.cc:434] P 34711da9380944d2969a2bc3e203db3d: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-8d772c24bae14b138d4062798651f82f on tablet 8d772c24bae14b138d4062798651f82f with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:29.349779  3998 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:29.349217  3753 catalog_manager.cc:5697] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 2 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:29.354342  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:29.354732  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:29.355002  3848 raft_consensus.cc:3055] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:29.355278  3926 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:29.355314  3848 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:29.356192  3848 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:29.357246  5477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6017f50df9e3498d929adc22812d22cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.357314  3848 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:29.361861  3926 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:29.366310  3848 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:29.367929  3970 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:29.368721  5473 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:29.369196  5473 raft_consensus.cc:697] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:29.375108  5473 consensus_queue.cc:237] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:29.378052  5477 tablet_copy_client.cc:806] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:29.378813  5477 tablet_copy_client.cc:670] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:29.383363  5477 tablet_copy_client.cc:538] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:29.393141  5477 tablet_bootstrap.cc:492] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:29.393352  5480 ts_tablet_manager.cc:933] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:29.415756  5480 tablet_copy_client.cc:323] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:27:29.417543  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet c5bc554f69c94b9887b24097921bd77e from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:27:29.418093  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet c5bc554f69c94b9887b24097921bd77e from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-c5bc554f69c94b9887b24097921bd77e
I20260709 12:27:29.426704  3942 tablet_copy_source_session.cc:215] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:29.430056  5477 tablet_bootstrap.cc:492] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:29.431036  5477 tablet_bootstrap.cc:492] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:29.431687  5477 ts_tablet_manager.cc:1403] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.011s
I20260709 12:27:29.434835  5477 raft_consensus.cc:359] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:29.435631  5477 raft_consensus.cc:740] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:29.436573  5477 consensus_queue.cc:260] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:29.438660  5480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5bc554f69c94b9887b24097921bd77e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.439076  5477 ts_tablet_manager.cc:1434] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 12:27:29.447379  3867 tablet_copy_service.cc:342] P 4eedd844c09d456ca0b3614490dd1dbb: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-6017f50df9e3498d929adc22812d22cf received from {username='slave'} at 127.0.0.1:40038
I20260709 12:27:29.447829  3867 tablet_copy_service.cc:434] P 4eedd844c09d456ca0b3614490dd1dbb: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-6017f50df9e3498d929adc22812d22cf on tablet 6017f50df9e3498d929adc22812d22cf with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:29.450338  3753 catalog_manager.cc:5697] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 2, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:29.460353  5480 tablet_copy_client.cc:806] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:29.460995  5480 tablet_copy_client.cc:670] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:29.465137  5480 tablet_copy_client.cc:538] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:29.473925  5480 tablet_bootstrap.cc:492] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:29.500524  5480 tablet_bootstrap.cc:492] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:29.501340  5480 tablet_bootstrap.cc:492] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:29.501950  5480 ts_tablet_manager.cc:1403] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.028s	user 0.026s	sys 0.004s
I20260709 12:27:29.504405  5480 raft_consensus.cc:359] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:29.505040  5480 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:29.505561  5480 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:29.507539  5480 ts_tablet_manager.cc:1434] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:29.508991  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-c5bc554f69c94b9887b24097921bd77e received from {username='slave'} at 127.0.0.1:54068
I20260709 12:27:29.509393  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-c5bc554f69c94b9887b24097921bd77e on tablet c5bc554f69c94b9887b24097921bd77e with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:29.543512  3848 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:29.544754  5476 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:29.572129  3998 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:29.573668  5342 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:29.591159  4573 raft_consensus.cc:1217] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:29.667265  4573 raft_consensus.cc:1217] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:29.701473  4573 raft_consensus.cc:1217] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:29.758550  3931 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:29.759992  5473 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:29.774596  3848 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:29.774955  3926 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:29.776811  5458 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:29.783993  5435 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:29.807596  4002 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:29.811818  5458 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:29.910269  4569 raft_consensus.cc:1217] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:27:29.990091  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:30.057988  3926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:30.058617  3926 raft_consensus.cc:606] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:30.061393  3854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:30.061964  3854 raft_consensus.cc:606] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:30.064486  4002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:30.065009  4002 raft_consensus.cc:606] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:30.066193  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:30.067394  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:30.068022  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:30.138741  5348 raft_consensus.cc:1064] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:30.141073  5348 consensus_queue.cc:237] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:30.150588  4569 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:30.152662  3926 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:30.152798  5412 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:30.154579  4002 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:30.156258  5348 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:30.161742  5348 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:30.173117  5458 raft_consensus.cc:2955] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.175079  3926 raft_consensus.cc:2955] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.182349  4002 raft_consensus.cc:2955] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.185623  4569 raft_consensus.cc:2955] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.193419  3753 catalog_manager.cc:5697] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.211004  5435 raft_consensus.cc:1064] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:30.213759  5435 consensus_queue.cc:237] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:30.232244  5473 raft_consensus.cc:1064] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:30.238862  5473 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:30.271036  4569 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:30.276554  5472 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:30.292840  3926 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:30.295986  5511 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:27:30.318835  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 44362.7us
I20260709 12:27:30.325806  3848 consensus_queue.cc:237] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:30.336418  3848 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:30.337932  5509 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:30.338548  4569 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:30.346737  4569 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:30.346737  4002 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:30.348111  3928 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:30.349267  5435 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:30.350752  5473 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:30.351667  3849 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:30.340601  5348 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:27:30.356365  5473 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:30.378458  5458 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:30.393031  5473 raft_consensus.cc:993] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:30.398098  5473 raft_consensus.cc:1081] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:30.401453  5510 raft_consensus.cc:2955] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.404704  3928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:27:30.405336  3928 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:30.405710  3928 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:30.409530  4002 raft_consensus.cc:2955] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.412606  3928 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:30.415457  5412 raft_consensus.cc:993] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:30.412902  3854 raft_consensus.cc:2955] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.421099  3928 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:30.421824  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:30.422101  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:30.422461  3849 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:30.422712  4000 raft_consensus.cc:3055] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:30.423089  4000 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:30.423826  4000 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:30.424852  4000 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:30.425338  5518 raft_consensus.cc:1081] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:30.430176  4570 raft_consensus.cc:2955] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.432639  4000 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:30.434638  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:30.383721  5458 raft_consensus.cc:2955] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.435774  5344 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:30.436303  5344 raft_consensus.cc:697] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:30.437203  5344 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:30.468091  5476 raft_consensus.cc:993] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:30.468689  5476 raft_consensus.cc:1081] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:30.470259  4000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36530
I20260709 12:27:30.481576  4000 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:30.482015  4000 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:30.452898  5513 log.cc:927] Time spent T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:27:30.476817  3926 raft_consensus.cc:2955] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.495652  4573 raft_consensus.cc:2955] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.498576  4569 raft_consensus.cc:2955] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.470767  5511 raft_consensus.cc:2955] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.505020  5476 raft_consensus.cc:1064] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:30.508239  5476 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:30.525530  3928 raft_consensus.cc:2955] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.539649  4000 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:30.542721  4000 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:30.543942  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:30.544888  3931 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:30.545552  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:30.546514  3848 raft_consensus.cc:3055] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:30.546559  3854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:27:30.546932  3848 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:30.547226  3854 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:30.547640  3854 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.547770  3848 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:30.548897  3848 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:30.551391  3849 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:30.557996  3848 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:30.559518  3739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6017f50df9e3498d929adc22812d22cf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:30.559276  3754 catalog_manager.cc:5697] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.560508  3969 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:30.564445  3931 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:30.570511  3854 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:30.569490  3752 catalog_manager.cc:5697] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 3 to 4, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 4 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:30.568163  3755 catalog_manager.cc:5697] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.568815  5473 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:27:30.632373  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 52999us
I20260709 12:27:30.646960  3854 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:30.647825  4569 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:30.649230  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:30.650010  4000 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.651626  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:30.652165  3926 raft_consensus.cc:3055] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:30.652441  3926 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:30.653366  3926 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:30.655038  3926 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.656728  4000 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:30.658216  5342 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:30.662042  5473 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:30.665915  3822 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:30.667665  5458 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:30.668923  4000 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:30.669128  5458 raft_consensus.cc:697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:30.666999  5473 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:30.670084  5458 consensus_queue.cc:237] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:30.677260  3848 raft_consensus.cc:2955] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.682682  3854 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:30.694483  5527 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:30.697293  5524 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:30.664949  3926 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:30.730821  5527 raft_consensus.cc:2955] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.733281  3752 catalog_manager.cc:5697] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.735783  4000 raft_consensus.cc:2955] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.748678  3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 6017f50df9e3498d929adc22812d22cf with delete_type TABLET_DATA_TOMBSTONED (TS 073f84fcc295417f9bcc1eea29d2bb58 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43294
I20260709 12:27:30.761385  5534 tablet_replica.cc:333] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:27:30.764310  3848 raft_consensus.cc:2955] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.775797  3755 catalog_manager.cc:5697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 2 to 3, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 3 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.776372  4569 raft_consensus.cc:2955] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.762594  5534 raft_consensus.cc:2243] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.782794  5534 raft_consensus.cc:2272] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.783600  3754 catalog_manager.cc:5697] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.786566  5534 ts_tablet_manager.cc:1916] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:30.802181  4000 consensus_queue.cc:237] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:30.805037  5534 ts_tablet_manager.cc:1929] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:30.805560  5534 log.cc:1199] T 6017f50df9e3498d929adc22812d22cf P 073f84fcc295417f9bcc1eea29d2bb58: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/wals/6017f50df9e3498d929adc22812d22cf
I20260709 12:27:30.808171  3740 catalog_manager.cc:5028] TS 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): tablet 6017f50df9e3498d929adc22812d22cf (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:30.808642  4569 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:30.811694  3926 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:30.812446  5528 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:30.814896  5473 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:30.816613  4000 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:30.824846  3924 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:30.826915  4573 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:30.829433  3926 raft_consensus.cc:2955] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.832415  5472 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:30.839241  3854 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:30.843030  4570 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:30.843894  3848 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:30.844581  5342 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:30.851168  5435 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:30.857275  5344 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:30.825570  5511 raft_consensus.cc:2955] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.858096  5509 raft_consensus.cc:2955] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.847648  3753 catalog_manager.cc:5697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 1 to 2, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 2 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:30.875108  3997 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:30.883571  3741 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 383a24e3cada4485922ab39de63b4de9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:30.881827  3854 raft_consensus.cc:2955] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.895889  4571 raft_consensus.cc:2955] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.896481  4572 raft_consensus.cc:2955] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.905720  5342 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:30.923221  3753 catalog_manager.cc:5697] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 4, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.912348  3752 catalog_manager.cc:5697] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 3 to 4, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New cstate: current_term: 1 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.938879  5524 raft_consensus.cc:2955] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.955000  3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d772c24bae14b138d4062798651f82f with delete_type TABLET_DATA_TOMBSTONED (TS 073f84fcc295417f9bcc1eea29d2bb58 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43294
I20260709 12:27:30.956724  5534 tablet_replica.cc:333] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:27:30.957140  3840 tablet_service.cc:1558] Processing DeleteTablet for tablet 383a24e3cada4485922ab39de63b4de9 with delete_type TABLET_DATA_TOMBSTONED (TS 4eedd844c09d456ca0b3614490dd1dbb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42036
I20260709 12:27:30.956403  4002 raft_consensus.cc:2955] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.957854  5534 raft_consensus.cc:2243] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.958899  5534 raft_consensus.cc:2272] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.963110  3741 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8d772c24bae14b138d4062798651f82f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:30.971979  4572 raft_consensus.cc:2955] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:30.980886  5534 ts_tablet_manager.cc:1916] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:31.020578  4002 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:31.025847  5537 tablet_replica.cc:333] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:27:31.027139  5537 raft_consensus.cc:2243] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:31.026950  5535 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:27:31.029649  5537 raft_consensus.cc:2272] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:31.032817  3752 catalog_manager.cc:5697] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 4 to 5, VOTER 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) evicted. New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:31.034070  3740 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c5bc554f69c94b9887b24097921bd77e with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:31.047462  5534 ts_tablet_manager.cc:1929] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:31.047979  5534 log.cc:1199] T 8d772c24bae14b138d4062798651f82f P 073f84fcc295417f9bcc1eea29d2bb58: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/wals/8d772c24bae14b138d4062798651f82f
I20260709 12:27:31.048913  3840 tablet_service.cc:1558] Processing DeleteTablet for tablet c5bc554f69c94b9887b24097921bd77e with delete_type TABLET_DATA_TOMBSTONED (TS 4eedd844c09d456ca0b3614490dd1dbb not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42036
I20260709 12:27:31.051431  3740 catalog_manager.cc:5028] TS 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): tablet 8d772c24bae14b138d4062798651f82f (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:31.053637  5537 ts_tablet_manager.cc:1916] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:31.080605  5537 ts_tablet_manager.cc:1929] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:27:31.081067  5537 log.cc:1199] T 383a24e3cada4485922ab39de63b4de9 P 4eedd844c09d456ca0b3614490dd1dbb: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/wals/383a24e3cada4485922ab39de63b4de9
I20260709 12:27:31.082892  5537 tablet_replica.cc:333] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:27:31.082830  3739 catalog_manager.cc:5028] TS 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): tablet 383a24e3cada4485922ab39de63b4de9 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:31.084146  5537 raft_consensus.cc:2243] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:31.084833  5537 raft_consensus.cc:2272] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:31.087930  5537 ts_tablet_manager.cc:1916] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:31.100330  5537 ts_tablet_manager.cc:1929] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:27:31.100832  5537 log.cc:1199] T c5bc554f69c94b9887b24097921bd77e P 4eedd844c09d456ca0b3614490dd1dbb: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/wals/c5bc554f69c94b9887b24097921bd77e
I20260709 12:27:31.102460  3739 catalog_manager.cc:5028] TS 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): tablet c5bc554f69c94b9887b24097921bd77e (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:27:31.130206  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:31.168134  3997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:31.168897  3997 raft_consensus.cc:606] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:31.171406  3926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:31.171869  3926 raft_consensus.cc:606] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:31.174585  3848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:31.175055  3848 raft_consensus.cc:606] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:31.175114  3926 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:31.176208  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:31.176801  5458 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:31.177588  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:31.178388  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:31.190701  3997 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:31.192668  5519 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:31.225414  3848 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:31.226835  5472 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:31.239465  3926 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:31.240952  5435 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:31.327718  5458 raft_consensus.cc:993] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:31.328194  5458 raft_consensus.cc:1081] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:27:31.329685  4571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42526
I20260709 12:27:31.330219  4571 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:31.330544  4571 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:31.341650  5527 raft_consensus.cc:993] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:31.342160  5527 raft_consensus.cc:1081] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:31.343952  3997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36516
I20260709 12:27:31.344442  3997 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:31.344758  3997 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:31.348430  4571 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:31.352514  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:31.353073  3854 raft_consensus.cc:3055] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:31.353355  3854 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:31.354193  3997 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:31.354528  3854 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:31.355558  3854 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:31.360953  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:31.361513  3848 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:31.362311  4571 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:31.365477  3854 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:31.366601  4536 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:31.367385  5345 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:31.367784  5345 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:31.368485  5345 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:31.375316  3848 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:31.382308  3997 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:31.385110  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:31.390782  4000 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:31.401304  4000 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:31.405195  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:31.406371  5528 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:31.406898  5528 raft_consensus.cc:697] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:31.405567  3752 catalog_manager.cc:5697] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 3 to 4, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 4 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:31.407748  5528 consensus_queue.cc:237] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:31.413988  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:31.414583  3928 raft_consensus.cc:3055] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:31.414883  3928 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:31.415663  3928 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:31.417227  3928 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:31.441259  3928 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:31.463032  5550 raft_consensus.cc:993] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:31.463562  5550 raft_consensus.cc:1081] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:31.470781  3924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:27:31.471366  3924 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:31.471742  3924 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:31.478019  3752 catalog_manager.cc:5697] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 2 to 3, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 3 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:31.482949  3924 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:31.485852  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:31.486032  3924 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:31.486197  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:31.486430  3854 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:31.486789  4000 raft_consensus.cc:3055] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:31.487067  4000 raft_consensus.cc:740] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:31.487713  4000 consensus_queue.cc:260] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:31.488881  4000 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:31.493815  3854 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:31.494905  3895 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:31.495544  5344 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:31.496068  5344 raft_consensus.cc:697] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:31.496266  4000 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:31.497054  5344 consensus_queue.cc:237] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:31.566339  3755 catalog_manager.cc:5697] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 2, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.799176  4000 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:27:31.800473  5345 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:31.817675  3848 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:27:31.819454  5345 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:31.856226  3931 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:31.858546  5549 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:31.869576  3848 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:31.871081  5549 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:31.957870  4000 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:31.960307  5524 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:31.971625  3854 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:31.973115  5344 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.124730  3848 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:32.130885  4000 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:32.130887  3931 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:27:32.131539  3822 consensus_peers.cc:597] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5c03e098f9a45cd94c52ada1bc9fa11. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.132694  5458 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:32.133531  5519 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:32.143465  5412 raft_consensus.cc:2955] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:32.145594  3926 raft_consensus.cc:2955] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:32.151696  4000 raft_consensus.cc:2955] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:32.161732  3931 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:32.166178  3753 catalog_manager.cc:5697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index -1 to 3, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 2 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:32.187175  3854 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:27:32.188794  3897 consensus_peers.cc:597] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95a53a95fd9f44e59c1b1615b9281948. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.188810  5344 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:32.190506  4000 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:27:32.192986  5344 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:32.207844  5527 raft_consensus.cc:2955] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:32.221235  4000 raft_consensus.cc:2955] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:32.237552  3854 consensus_queue.cc:237] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:32.243459  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:32.247257  3755 catalog_manager.cc:5697] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index -1 to 5, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 4 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:32.264132  3926 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:27:32.265506  3822 consensus_peers.cc:597] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2cd145ac0c9d4f1fbf7e300e3d5cd972. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.268210  4002 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:32.269845  5458 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.271632  5412 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.283463  3854 raft_consensus.cc:2955] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:32.288254  5458 raft_consensus.cc:2955] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:32.316893  3931 raft_consensus.cc:2955] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:32.333695  4000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:32.334828  4000 raft_consensus.cc:606] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:32.340862  3926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "455f8427897049759001979ea81adec1"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:32.341022  3755 catalog_manager.cc:5697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:32.341717  3926 raft_consensus.cc:606] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:32.344256  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:32.346531  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:27:32.350391  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 48769.1us
I20260709 12:27:32.356031  4000 raft_consensus.cc:2955] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:32.357992  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:32.369765  3854 consensus_queue.cc:237] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
W20260709 12:27:32.379875  3822 consensus_peers.cc:597] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb -> Peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Couldn't send request to peer f3cab225ecb7488386a1a19239498cfe. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eadf6ff4956f47ff8a85f77d02584a0d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.380942  4000 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:32.382467  5582 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.385345  3926 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:27:32.387275  5458 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:32.406008  5582 raft_consensus.cc:2955] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:32.407899  3926 raft_consensus.cc:2955] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:32.410337  3997 raft_consensus.cc:2955] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:32.429569  3755 catalog_manager.cc:5697] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index -1 to 2, NON_VOTER f3cab225ecb7488386a1a19239498cfe (127.2.157.4) added. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } } }
I20260709 12:27:32.444149  5548 raft_consensus.cc:993] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:32.444653  5548 raft_consensus.cc:1081] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:32.446847  3926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:27:32.447444  3926 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:32.447835  3926 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:32.455947  3926 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:32.458333  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:32.459013  3848 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:32.460891  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:32.461472  3997 raft_consensus.cc:3055] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:32.461771  3997 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:32.462571  3997 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:32.463419  3997 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:32.467219  3848 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:32.467382  3926 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:32.467957  3854 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:32.476960  3997 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:32.488557  3897 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:32.489452  5524 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:32.490444  5524 raft_consensus.cc:697] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:32.491391  5524 consensus_queue.cc:237] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:32.516921  3753 catalog_manager.cc:5697] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 3 to 4, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 4 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:32.695431  5587 ts_tablet_manager.cc:933] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:32.699820  5587 tablet_copy_client.cc:323] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.2:42279
I20260709 12:27:32.701705  3942 tablet_copy_service.cc:140] P 073f84fcc295417f9bcc1eea29d2bb58: Received BeginTabletCopySession request for tablet 95a53a95fd9f44e59c1b1615b9281948 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:54068)
I20260709 12:27:32.702258  3942 tablet_copy_service.cc:161] P 073f84fcc295417f9bcc1eea29d2bb58: Beginning new tablet copy session on tablet 95a53a95fd9f44e59c1b1615b9281948 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:54068: session id = f3cab225ecb7488386a1a19239498cfe-95a53a95fd9f44e59c1b1615b9281948
I20260709 12:27:32.708317  3942 tablet_copy_source_session.cc:215] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:32.711530  5587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a53a95fd9f44e59c1b1615b9281948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:32.722790  5589 ts_tablet_manager.cc:933] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:32.729565  5587 tablet_copy_client.cc:806] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:32.730278  5587 tablet_copy_client.cc:670] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:32.738392  5587 tablet_copy_client.cc:538] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:32.756455  5587 tablet_bootstrap.cc:492] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:32.764438  5591 ts_tablet_manager.cc:933] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:32.768354  5589 tablet_copy_client.cc:323] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.1:32843
I20260709 12:27:32.770841  3867 tablet_copy_service.cc:140] P 4eedd844c09d456ca0b3614490dd1dbb: Received BeginTabletCopySession request for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:40038)
I20260709 12:27:32.771426  3867 tablet_copy_service.cc:161] P 4eedd844c09d456ca0b3614490dd1dbb: Beginning new tablet copy session on tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:40038: session id = f3cab225ecb7488386a1a19239498cfe-2cd145ac0c9d4f1fbf7e300e3d5cd972
I20260709 12:27:32.772203  5591 tablet_copy_client.cc:323] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.1:32843
I20260709 12:27:32.774156  3866 tablet_copy_service.cc:140] P 4eedd844c09d456ca0b3614490dd1dbb: Received BeginTabletCopySession request for tablet d5c03e098f9a45cd94c52ada1bc9fa11 from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:40038)
I20260709 12:27:32.774744  3866 tablet_copy_service.cc:161] P 4eedd844c09d456ca0b3614490dd1dbb: Beginning new tablet copy session on tablet d5c03e098f9a45cd94c52ada1bc9fa11 from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:40038: session id = f3cab225ecb7488386a1a19239498cfe-d5c03e098f9a45cd94c52ada1bc9fa11
I20260709 12:27:32.780428  3867 tablet_copy_source_session.cc:215] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:32.787369  5594 ts_tablet_manager.cc:933] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Initiating tablet copy from peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:32.805305  5589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:32.807950  5587 tablet_bootstrap.cc:492] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:32.808939  5587 tablet_bootstrap.cc:492] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:32.809659  5587 ts_tablet_manager.cc:1403] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.016s
I20260709 12:27:32.813376  5587 raft_consensus.cc:359] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:32.816341  5587 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:32.816987  5587 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:32.820793  3866 tablet_copy_source_session.cc:215] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:32.824528  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c03e098f9a45cd94c52ada1bc9fa11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:32.824337  5587 ts_tablet_manager.cc:1434] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:27:32.835220  3942 tablet_copy_service.cc:342] P 073f84fcc295417f9bcc1eea29d2bb58: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-95a53a95fd9f44e59c1b1615b9281948 received from {username='slave'} at 127.0.0.1:54068
I20260709 12:27:32.835680  3942 tablet_copy_service.cc:434] P 073f84fcc295417f9bcc1eea29d2bb58: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-95a53a95fd9f44e59c1b1615b9281948 on tablet 95a53a95fd9f44e59c1b1615b9281948 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:32.846498  5527 raft_consensus.cc:993] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:32.848482  5524 raft_consensus.cc:1081] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:27:32.851099  4000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "455f8427897049759001979ea81adec1"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36516
I20260709 12:27:32.851639  4000 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:32.852001  4000 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:32.852698  5594 tablet_copy_client.cc:323] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: tablet copy: Beginning tablet copy session from remote peer at address 127.2.157.1:32843
I20260709 12:27:32.854463  3866 tablet_copy_service.cc:140] P 4eedd844c09d456ca0b3614490dd1dbb: Received BeginTabletCopySession request for tablet eadf6ff4956f47ff8a85f77d02584a0d from peer f3cab225ecb7488386a1a19239498cfe ({username='slave'} at 127.0.0.1:40038)
I20260709 12:27:32.854965  3866 tablet_copy_service.cc:161] P 4eedd844c09d456ca0b3614490dd1dbb: Beginning new tablet copy session on tablet eadf6ff4956f47ff8a85f77d02584a0d from peer f3cab225ecb7488386a1a19239498cfe at {username='slave'} at 127.0.0.1:40038: session id = f3cab225ecb7488386a1a19239498cfe-eadf6ff4956f47ff8a85f77d02584a0d
I20260709 12:27:32.859367  5589 tablet_copy_client.cc:806] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:32.859943  5589 tablet_copy_client.cc:670] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:32.865588  5589 tablet_copy_client.cc:538] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:32.869238  5591 tablet_copy_client.cc:806] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:32.869817  5591 tablet_copy_client.cc:670] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:32.872701  4000 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:32.876065  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:32.876389  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:32.877004  3931 raft_consensus.cc:3055] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:32.877353  3931 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:32.876572  4572 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:32.878863  5591 tablet_copy_client.cc:538] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:32.881474  3866 tablet_copy_source_session.cc:215] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:32.882512  3931 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:32.885329  4000 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:32.883731  3931 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:32.904433  4572 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:32.905181  5594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eadf6ff4956f47ff8a85f77d02584a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:32.906720  3971 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:32.907595  5549 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:32.908092  5549 raft_consensus.cc:697] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:32.908932  5549 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:32.920164  3931 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:32.905179  5589 tablet_bootstrap.cc:492] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:32.926519  5591 tablet_bootstrap.cc:492] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:32.950613  5594 tablet_copy_client.cc:806] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:32.951304  5594 tablet_copy_client.cc:670] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:32.955986  5594 tablet_copy_client.cc:538] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:32.963196  3753 catalog_manager.cc:5697] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 2 to 3, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 3 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:32.969377  3848 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:32.971027  5344 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:33.006887  5594 tablet_bootstrap.cc:492] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Bootstrap starting.
I20260709 12:27:33.016950  3997 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:33.024719  5527 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:27:33.082399  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 55177.4us
I20260709 12:27:33.092386  5589 tablet_bootstrap.cc:492] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:33.093457  5589 tablet_bootstrap.cc:492] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:33.094321  5589 ts_tablet_manager.cc:1403] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.189s	user 0.020s	sys 0.011s
W20260709 12:27:33.169374  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 69524us
I20260709 12:27:33.237788  5589 raft_consensus.cc:359] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:33.238920  5589 raft_consensus.cc:740] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:33.239715  5589 consensus_queue.cc:260] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
W20260709 12:27:33.248660  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 83535.3us
I20260709 12:27:33.262252  5589 ts_tablet_manager.cc:1434] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.137s	user 0.009s	sys 0.000s
W20260709 12:27:33.264142  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 129030us
W20260709 12:27:33.291751  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 105442us
W20260709 12:27:33.306531  5591 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.081s	user 0.004s	sys 0.000s
I20260709 12:27:33.319860  5591 tablet_bootstrap.cc:492] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:33.320937  5591 tablet_bootstrap.cc:492] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:33.333105  3866 tablet_copy_service.cc:342] P 4eedd844c09d456ca0b3614490dd1dbb: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-2cd145ac0c9d4f1fbf7e300e3d5cd972 received from {username='slave'} at 127.0.0.1:40038
I20260709 12:27:33.333652  3866 tablet_copy_service.cc:434] P 4eedd844c09d456ca0b3614490dd1dbb: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-2cd145ac0c9d4f1fbf7e300e3d5cd972 on tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:33.321782  5591 ts_tablet_manager.cc:1403] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.396s	user 0.021s	sys 0.010s
I20260709 12:27:33.348520  5591 raft_consensus.cc:359] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:33.349906  5591 raft_consensus.cc:740] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:33.350724  5591 consensus_queue.cc:260] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:33.354279  5591 ts_tablet_manager.cc:1434] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:27:33.356989  3866 tablet_copy_service.cc:342] P 4eedd844c09d456ca0b3614490dd1dbb: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-d5c03e098f9a45cd94c52ada1bc9fa11 received from {username='slave'} at 127.0.0.1:40038
I20260709 12:27:33.357424  3866 tablet_copy_service.cc:434] P 4eedd844c09d456ca0b3614490dd1dbb: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-d5c03e098f9a45cd94c52ada1bc9fa11 on tablet d5c03e098f9a45cd94c52ada1bc9fa11 with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:33.374364  5594 tablet_bootstrap.cc:492] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:27:33.374826  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 188688us
I20260709 12:27:33.375865  5594 tablet_bootstrap.cc:492] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Bootstrap complete.
I20260709 12:27:33.376722  5594 ts_tablet_manager.cc:1403] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Time spent bootstrapping tablet: real 0.370s	user 0.054s	sys 0.075s
I20260709 12:27:33.379782  4571 raft_consensus.cc:1217] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 12:27:33.380518  5594 raft_consensus.cc:359] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:33.381743  5594 raft_consensus.cc:740] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Initialized, Role: LEARNER
I20260709 12:27:33.382563  5594 consensus_queue.cc:260] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:33.385583  5594 ts_tablet_manager.cc:1434] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:27:33.387390  3866 tablet_copy_service.cc:342] P 4eedd844c09d456ca0b3614490dd1dbb: Request end of tablet copy session f3cab225ecb7488386a1a19239498cfe-eadf6ff4956f47ff8a85f77d02584a0d received from {username='slave'} at 127.0.0.1:40038
I20260709 12:27:33.387795  3866 tablet_copy_service.cc:434] P 4eedd844c09d456ca0b3614490dd1dbb: ending tablet copy session f3cab225ecb7488386a1a19239498cfe-eadf6ff4956f47ff8a85f77d02584a0d on tablet eadf6ff4956f47ff8a85f77d02584a0d with peer f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:33.450997  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:34.363824  5625 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.364538  5625 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.367129  5625 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.367395  5626 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.368139  5626 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.371272  5626 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.386549  5626 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.387163  5626 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.389035  5626 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.389712  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:34.425393  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:34.448529  5582 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.452085  5582 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.454739  5582 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.470139  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:34.474845  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1317) took 1015 ms. Trace:
I20260709 12:27:34.496740  5582 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.497776  5582 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.497067  5625 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.503654  5633 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:34.505380  5633 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.507854  5633 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.516913  5628 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:34.517592  5628 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.520382  5628 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.520915  3754 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51804 (request call id 324) took 1095 ms. Trace:
I20260709 12:27:34.521059  5625 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.523993  5625 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.525071  3752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51802 (request call id 325) took 1124 ms. Trace:
I20260709 12:27:34.526196  5582 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.478153  3848 rpcz_store.cc:276] 0709 12:27:33.459766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.474058 (+1014292us) service_pool.cc:224] Handling call
0709 12:27:34.474355 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:34.474530 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:34.474560 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:34.474601 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:34.474631 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.474684 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:34.474788 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:34.525540  3752 rpcz_store.cc:276] 0709 12:27:33.400301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.401565 (+  1264us) service_pool.cc:224] Handling call
0709 12:27:34.524825 (+1123260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1070560,"reported_tablets":1}
I20260709 12:27:34.521598  3754 rpcz_store.cc:276] 0709 12:27:33.425251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.425395 (+   144us) service_pool.cc:224] Handling call
0709 12:27:34.520666 (+1095271us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:27:34.520921  5628 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.535849  5628 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.538161  5628 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.539352  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:34.545648  5635 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.546309  5635 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.548803  5635 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.553325  5632 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.554031  5632 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.559796  5632 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:34.574831  4571 raft_consensus.cc:1217] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:34.576093  5625 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.576687  5625 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.580642  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:34.582504  5625 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.589059  5580 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:34.589623  5580 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.591480  3755 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39516 (request call id 216) took 1264 ms. Trace:
I20260709 12:27:34.595779  3755 rpcz_store.cc:276] 0709 12:27:33.326885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.327076 (+   191us) service_pool.cc:224] Handling call
0709 12:27:34.591389 (+1264313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29217,"reported_tablets":1}
I20260709 12:27:34.602669  5582 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:34.603303  5582 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.591923  5580 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.605013  5580 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.605541  5582 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.593482  4573 raft_consensus.cc:1217] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:27:34.615072  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:34.623767  5636 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.625310  5582 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.626080  5582 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.627020  5581 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.627586  5581 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.627833  5624 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.628554  5624 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.631302  5582 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.631505  5624 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.632091  5581 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.635813  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:34.637418  5634 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:34.637843  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:34.638341  5634 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.640810  5634 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.642715  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:34.644640  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:34.645665  4572 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:34.647578  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:34.647810  5582 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.648347  5582 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.605690  5580 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.650658  5582 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.654248  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:34.654819  3753 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51798 (request call id 314) took 1306 ms. Trace:
I20260709 12:27:34.655198  3753 rpcz_store.cc:276] 0709 12:27:33.348683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.355035 (+  6352us) service_pool.cc:224] Handling call
0709 12:27:34.654761 (+1299726us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1185417,"reported_tablets":1}
I20260709 12:27:34.660080  5582 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:34.660771  5582 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.663012  4571 raft_consensus.cc:1217] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:27:34.664669  5582 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.665117  5581 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.665666  5581 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.667271  5641 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.667717  5581 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.667801  5641 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.672752  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:34.673729  4572 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:27:34.708304  5629 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.709064  5629 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.711624  5629 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.712699  5637 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.713312  5637 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.715790  5637 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.732548  5625 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.733321  5625 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.734681  5639 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.735347  5639 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.735947  5625 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.743687  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:34.751899  5625 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.752717  5625 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.755681  5625 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.760776  5646 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.763510  5625 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.764222  5625 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.766779  5625 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.767673  5637 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.768307  5637 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.797235  5647 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.798040  5647 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.800836  5647 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:34.802022  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 56803.4us
I20260709 12:27:34.816323  5648 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.816869  5648 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.650698  5580 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.822933  5580 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:34.823464  5580 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.829121  5634 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:34.829723  5634 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.836836  5634 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.837747  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:34.840112  5631 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:34.761457  5646 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.840705  5631 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:34.841392  5630 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.841681  5637 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.841964  5630 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.845441  5638 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.847399  5646 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.850262  5630 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:34.851071  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:34.851612  5630 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.852165  5630 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.854315  5630 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.854776  5630 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:34.855191  5639 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.856756  5631 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:34.858150  5631 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:34.858609  5631 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.860126  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:34.860533  5631 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.863749  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:34.865060  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:34.865931  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:34.624616  5636 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.855218  5630 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.869472  5630 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:34.872907  5636 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.873323  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:34.874740  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:34.875075  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:34.876565  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:34.881850  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 63623.1us
I20260709 12:27:34.882895  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:34.669869  5641 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.886754  5580 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:34.882872  5638 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.945264  5639 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.030349  5639 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.031484  5638 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:34.985894  5640 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:35.032734  5639 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:35.032526  5640 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.994812  5651 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.034618  5640 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:35.034129  5651 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.037029  5651 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:27:35.096989  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac440 after lost signal to thread 2679
W20260709 12:27:35.098114  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4780 after lost signal to thread 3789
W20260709 12:27:35.099645  3786 debug-util.cc:398] Leaking SignalData structure 0x7b0800039620 after lost signal to thread 3881
W20260709 12:27:35.099948  3786 debug-util.cc:398] Leaking SignalData structure 0x7b0800039600 after lost signal to thread 3882
W20260709 12:27:35.101104  3786 debug-util.cc:398] Leaking SignalData structure 0x7b0800035dc0 after lost signal to thread 3956
W20260709 12:27:35.102183  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0540 after lost signal to thread 4030
W20260709 12:27:35.103324  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08001437e0 after lost signal to thread 4598
I20260709 12:27:35.131189  5645 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:35.131834  5645 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.133864  5652 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.133927  5645 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:35.134063  5638 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:35.134495  5652 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.134778  5645 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:35.134857  5638 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.135478  5645 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.136160  5652 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:35.133415  5651 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:35.137286  5638 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:35.137732  5645 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:35.137463  5651 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.138360  5645 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:35.138996  5645 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.140295  5651 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:35.141600  5645 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:35.164839  5655 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.165544  5655 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:35.167943  5655 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:35.168162  5624 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:35.168721  5624 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.170401  5624 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:35.168224  5654 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.171370  5654 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:34.963819  5581 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.172890  5654 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:35.172636  5581 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.175685  5624 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:35.176201  5624 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:34.937279  5636 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:35.177708  5636 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.178212  5624 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:35.179891  5636 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:34.983785  5632 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:35.180724  5632 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.181497  5581 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:35.182737  5632 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:35.188500  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.201279  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.202456  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.202683  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.203554  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.205458  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.205562  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.206156  3853 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:35.206259  3854 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:35.207182  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.208343  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.210327  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.211544  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.212257  5652 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.212610  5642 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:35.212891  5652 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:35.213150  5642 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.215307  5652 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:35.215389  5642 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:35.217612  5651 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.218168  5651 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.218485  5652 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.219113  5652 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.220197  5651 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:35.220669  5651 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:35.221171  5652 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:35.221081  5651 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.222048  5645 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:35.222558  5645 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.222957  5651 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:35.224494  5645 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:35.224859  3969 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:35.225310  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.225391  5629 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:35.225901  3969 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:35.227234  5631 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:35.227648  5631 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.228024  5631 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:35.225978  3853 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:35.226696  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.235301  5642 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:35.235729  5642 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.236150  5642 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:35.236610  5631 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.225999  5629 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.238636  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.238812  5631 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:35.240091  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.240576  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.240697  3852 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:35.241144  3849 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:27:35.245368  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:35.247462  5629 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:35.248311  5651 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:35.248723  5651 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.249073  5651 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:35.249534  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:35.250109  3849 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:35.257570  5651 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.224970  5645 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:35.259727  5642 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.297348  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.293604  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.357355  3998 raft_consensus.cc:2393] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 4: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:35.294134  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.286578  5657 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:35.358474  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.316949  3822 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.359372  5625 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.360004  4004 raft_consensus.cc:1240] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:35.267593  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.360427  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.360641  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:35.293146  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.361486  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.315312  5629 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:35.263633  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.380721  5645 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.269448  4572 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:35.382157  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.287729  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.383416  4001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "455f8427897049759001979ea81adec1"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:35.272192  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.262313  5648 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:35.318097  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.364387  3822 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.387269  5622 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.387977  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.274355  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.387925  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:35.389724  5656 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:35.390148  5656 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:35.390184  3822 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.266412  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.311973  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.390909  5656 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:35.391188  5623 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.362079  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.377866  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.358779  5657 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:34.965041  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 117690us
I20260709 12:27:35.273765  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.358503  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.401130  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.401784  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:34.965135  5582 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.404367  5582 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.405026  4536 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:35.405336  3854 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:35.261106  3969 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:35.406618  5632 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.280066  5634 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:35.289067  5627 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:35.268124  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.291010  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.361965  5625 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:35.265349  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.264776  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.279438  3923 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:35.293421  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.375823  5642 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:35.259835  5651 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:35.384209  4001 raft_consensus.cc:606] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:35.272648  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.301436  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.267773  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.409935  5634 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.463374  3927 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:27:35.464655  5634 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:35.465065  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.410576  5627 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.466554  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.467701  5627 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:35.467765  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.469076  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.410768  5629 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.471254  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.471530  5629 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:35.411893  5657 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:35.472407  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.413307  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.473654  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.413821  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.474308  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:35.474738  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.475055  5652 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.414111  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.475701  3970 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:35.475775  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.476452  5652 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.414773  5625 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:35.477350  5625 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:35.477452  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.478731  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:35.480062  3970 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:35.480837  5652 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.420620  5637 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.482466  5637 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.407368  5582 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:35.421617  3849 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:35.422302  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.426555  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.488794  3932 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:35.489699  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:35.490398  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.427807  3822 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.491688  3857 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:35.492268  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 64521.4us
I20260709 12:27:35.493181  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.431830  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.493490  5582 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.414423  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:35.439250  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 178199us
I20260709 12:27:35.431936  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.494906  3969 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:35.446928  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.447206  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.447118  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.496431  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.447960  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.447422  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.497444  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.448571  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.447746  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.498279  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.454612  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.498885  5652 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:35.427330  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.499302  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.439517  5642 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:35.430073  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.430383  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.500386  5642 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.500741  3970 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:35.433493  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.434091  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.445165  5644 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:27:35.502066  3926 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:35.439740  5645 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:35.502864  5630 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.499449  5652 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.503693  5652 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:35.500869  5642 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:35.456054  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.493213  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.455869  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.497555  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.505234  3969 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:35.427649  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.413115  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.455596  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.509970  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.511047  3822 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.448042  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.494235  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.458640  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.495819  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.476877  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:27:35.443243  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 105415us
I20260709 12:27:35.447418  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.431057  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.513366  5654 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.446709  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.499764  3930 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:35.428109  5656 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.517232  5656 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:35.496981  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:35.520768  4538 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.522193  4538 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:35.522964  5648 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.523613  5632 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.446053  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.526643  5656 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:35.531699  3971 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.532155  3969 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:35.533452  3969 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:35.535101  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:35.538040  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:35.541389  5641 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:35.541963  5641 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:35.542366  5641 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:35.542503  5650 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:35.542820  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.543011  5650 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:35.543339  5638 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:27:35.544137  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:35.543959  5650 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.543022  5657 raft_consensus.cc:1064] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:35.545598  5632 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:35.547514  5657 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.550611  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.550833  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.552073  3971 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.552352  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.541452  5631 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.553696  4538 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.557140  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.557542  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.558043  4538 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.559377  4538 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.560192  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.561520  4538 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:35.553695  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.556017  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.566108  5648 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.566211  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.566531  5630 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.529853  5582 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:35.572913  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:35.568145  3969 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:35.567835  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:35.578114  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.579794  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:35.580358  5625 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.581357  3821 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.582398  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:35.583259  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:35.564230  5651 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.584266  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:35.570472  5632 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.569106  5638 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.606156  5582 raft_consensus.cc:1064] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:35.608639  5652 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.600294  5654 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.605125  5650 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.608587  5582 consensus_queue.cc:237] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.601097  3821 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.613202  5641 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.616290  5643 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.617420  5641 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:35.613343  5642 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:35.618696  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:35.619923  5642 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:35.584266  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.598444  5637 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:35.622213  5654 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:35.622548  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:35.621860  3848 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:35.622884  5623 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.624398  5625 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:35.583338  5648 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.624958  3822 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.626976  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:35.627883  5625 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.628566  5652 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:35.621493  3821 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.629594  5625 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.630101  3821 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.631126  5625 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.629349  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:35.634270  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 77188.7us
I20260709 12:27:35.635270  3971 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.639055  5625 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.641312  5656 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:35.584327  5658 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:35.643002  3821 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.640352  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:35.644006  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 44924.3us
I20260709 12:27:35.646577  5654 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:35.647905  5656 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.647876  5654 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:35.647146  5652 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.650365  5654 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:35.650342  3971 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.649428  3821 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.655282  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:35.660467  3821 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.660496  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.658033  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.661284  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:35.662139  5622 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.656795  5658 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:35.670719  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 68546.1us
I20260709 12:27:35.672801  3821 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.686946  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.688678  3821 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.690047  3821 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.690145  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:35.691977  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.689566  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:35.681674  5641 raft_consensus.cc:993] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:35.695096  3969 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:35.698263  4003 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:35.700815  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:35.701292  4567 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:35.701913  5656 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:35.692652  5581 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:35.703367  5581 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:35.695838  5650 consensus_queue.cc:1059] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:27:35.695200  5634 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.692972  5580 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:35.678015  5582 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.685706  5627 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:35.685840  5622 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.696063  5623 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.722891  5622 raft_consensus.cc:1064] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:35.736517  3969 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:35.738672  5650 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:35.739380  5650 raft_consensus.cc:3055] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:35.739693  5650 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:35.740471  5650 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.744246  3969 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:35.741689  5650 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:35.748765  5630 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:35.751500  5622 consensus_queue.cc:237] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:35.742651  5623 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:35.748541  5638 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.749300  3755 catalog_manager.cc:5697] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 2 to 3, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 3 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:35.742693  5642 consensus_queue.cc:1175] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f3cab225ecb7488386a1a19239498cfe" responder_term: 3 status { last_received { term: 3 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 3 index: 6 } }
I20260709 12:27:35.762066  5661 consensus_queue.cc:1059] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:35.763317  5637 raft_consensus.cc:3055] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:35.763731  5637 raft_consensus.cc:740] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:35.764578  5637 consensus_queue.cc:260] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:35.785557  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 52136.6us
W20260709 12:27:35.787024  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 97044.1us
I20260709 12:27:35.789145  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.792407  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:35.818133  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.802702  5637 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:35.826934  5581 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:35.830494  5581 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:35.830880  5581 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:35.832621  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 45582.8us
I20260709 12:27:35.833837  3821 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.833979  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.835237  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.814880  5657 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.836323  3897 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:35.840835  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:35.805025  5654 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:35.852948  5625 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.843520  5629 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.851833  5645 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:35.871655  3854 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:35.873521  3856 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:35.879047  3928 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:35.854453  5654 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:35.882551  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:35.864437  5657 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.886114  3856 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:35.891227  3895 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:35.940912  5668 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:27:35.892256  5652 raft_consensus.cc:1081] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:35.894969  5627 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:35.883103  5650 consensus_queue.cc:1059] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 12:27:35.951191  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 69048.5us
I20260709 12:27:35.896404  5660 consensus_queue.cc:1059] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
W20260709 12:27:35.970039  5672 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:27:35.971940  5660 raft_consensus.cc:3055] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:35.963155  3821 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:35.980547  3928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "455f8427897049759001979ea81adec1"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:27:35.981549  3928 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:35.981953  3928 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:35.952149  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 97874.3us
W20260709 12:27:35.995035  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 59749.8us
I20260709 12:27:35.996232  5654 raft_consensus.cc:1064] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:35.999851  3895 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:36.000308  3878 debug-util.cc:398] Leaking SignalData structure 0x7b08001178e0 after lost signal to thread 2679
W20260709 12:27:36.001303  3878 debug-util.cc:398] Leaking SignalData structure 0x7b0800145900 after lost signal to thread 3789
W20260709 12:27:35.993815  5673 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:27:36.004608  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:35.983753  5660 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:27:36.008383  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 46655.9us
W20260709 12:27:36.009593  5671 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:27:36.013060  3895 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:36.014744  3895 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:36.016584  3895 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:36.016865  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 180604us
I20260709 12:27:36.023236  3895 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:36.024678  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:36.025151  4003 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:36.026381  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:36.013831  5634 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:36.028379  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:36.034385  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:36.032274  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:36.011099  5656 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:36.027462  3878 debug-util.cc:398] Leaking SignalData structure 0x7b0800232ac0 after lost signal to thread 3881
I20260709 12:27:36.048002  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:36.050483  4570 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 4 LEARNER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:36.025530  5657 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:36.028467  5627 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:36.037559  5629 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:36.016124  5661 consensus_queue.cc:1059] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:27:36.104321  5627 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:36.105047  5661 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:36.105436  5661 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:27:36.050275  3878 debug-util.cc:398] Leaking SignalData structure 0x7b0800115720 after lost signal to thread 3882
I20260709 12:27:36.106334  5661 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:36.107688  5661 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:36.107797  3878 debug-util.cc:398] Leaking SignalData structure 0x7b08000a7c40 after lost signal to thread 3956
W20260709 12:27:36.109256  3878 debug-util.cc:398] Leaking SignalData structure 0x7b0800100560 after lost signal to thread 4030
W20260709 12:27:36.111353  3878 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb140 after lost signal to thread 4598
I20260709 12:27:36.099282  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:36.125488  5667 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 12:27:36.122236  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:36.151356  3932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:36.103183  5656 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:27:36.154201  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 127891us
I20260709 12:27:36.205703  3895 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:36.206629  3998 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
W20260709 12:27:36.211555  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 56123.3us
W20260709 12:27:36.214589  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 90912.7us
W20260709 12:27:36.215973  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 60512.1us
I20260709 12:27:36.215286  4537 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:36.224363  3895 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:36.220515  5642 raft_consensus.cc:3055] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:36.154659  5648 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:36.228210  4537 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:36.216279  5689 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:36.227802  5642 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:36.227283  5639 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:36.122032  5660 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:36.233477  5643 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:36.207836  5581 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.228578  5681 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:36.256507  5581 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:36.262635  5642 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.264587  5642 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:36.270674  5639 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.273187  4565 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 LEARNER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:36.238229  5632 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:36.274820  5632 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:36.275311  5632 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:36.250288  5661 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:36.233099  5648 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.279157  5648 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:36.152926  5654 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.251021  5643 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:36.287467  5643 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:36.290024  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 46130.2us
I20260709 12:27:36.289090  3928 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.273573  5639 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:36.312939  3928 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:27:36.314709  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 86580.3us
I20260709 12:27:36.314859  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:36.315474  4537 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:36.316150  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:36.321779  3932 raft_consensus.cc:606] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:36.322227  3932 raft_consensus.cc:614] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:27:36.321978  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 274080us
W20260709 12:27:36.324414  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 111756us
I20260709 12:27:36.329744  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:36.247300  5676 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:27:36.327751  3897 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:36.327929  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:36.344024  5683 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:27:36.343885  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 119605us
I20260709 12:27:36.344573  5683 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.343595  3897 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:36.350857  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:36.361518  5684 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:36.361732  3924 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:36.361786  5689 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:36.371461  5580 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:27:36.362932  5658 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:27:36.418681  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 51911.1us
I20260709 12:27:36.367535  5698 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:36.367856  5634 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:27:36.377086  5658 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
W20260709 12:27:36.457456  5696 log.cc:927] Time spent T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:27:36.458021  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:36.447331  5639 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:36.451442  5688 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:36.466938  5639 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.500851  5639 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:36.471792  3930 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:36.500327  5643 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.459429  5683 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:36.518733  5643 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:36.467759  5689 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:27:36.520340  5688 raft_consensus.cc:3055] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:36.520838  5688 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:36.537828  5658 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:36.521951  5688 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.532500  5632 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.588680  4569 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:36.594832  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:36.599761  3998 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:36.605921  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:36.607892  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:36.608855  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:36.594524  3854 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:36.579485  5702 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:27:36.609807  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:36.614706  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:36.600687  5582 raft_consensus.cc:2955] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:36.615756  3925 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:36.617483  5705 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:36.618124  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 249220us
I20260709 12:27:36.617419  5648 consensus_queue.cc:1059] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:36.619501  5648 raft_consensus.cc:3055] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:36.619848  5648 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:36.623648  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:36.624308  3998 raft_consensus.cc:3055] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:36.624615  3998 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:36.625481  3998 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.627485  3998 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:36.628557  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:36.629769  4005 raft_consensus.cc:1240] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:36.632099  5690 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:36.635087  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:36.635780  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:36.636121  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:36.636516  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:36.637069  5678 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:27:36.637403  3997 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:36.638011  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:36.636307  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:36.639482  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:36.639549  5674 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:36.637476  3925 raft_consensus.cc:2955] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:36.640823  4537 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:36.643237  5674 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:36.643899  5648 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.645190  5648 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:36.650929  4566 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:36.652952  3998 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:36.651960  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:36.666191  3854 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:36.667768  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:36.640301  5632 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:36.671959  5660 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:36.683534  5663 consensus_queue.cc:1059] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:27:36.689656  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:36.678757  5641 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:27:36.683779  5637 consensus_queue.cc:1059] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:27:36.694195  5661 consensus_queue.cc:1059] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:27:36.685148  5707 consensus_queue.cc:1059] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:27:36.712616  5629 raft_consensus.cc:3055] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:36.715793  5629 raft_consensus.cc:740] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:36.715878  3930 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:27:36.716066  5637 raft_consensus.cc:3055] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:36.716513  5637 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:36.716753  5629 consensus_queue.cc:260] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:36.717377  5637 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:36.718035  5629 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:36.700145  5681 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:36.718756  5637 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:36.722571  5693 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:36.721385  5681 raft_consensus.cc:697] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:36.727648  5682 raft_consensus.cc:3055] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:36.737944  5682 raft_consensus.cc:740] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:27:36.738641  5709 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:27:36.747210  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:36.740204  5681 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.738847  5682 consensus_queue.cc:260] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:36.760667  5682 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:36.771023  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.785362  5688 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:36.798218  3753 catalog_manager.cc:5697] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 3 to 4, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 4 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:36.807307  4002 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:36.808821  4538 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:36.811558  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:36.815073  3999 raft_consensus.cc:2393] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 4: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:27:36.815971  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.821723  3970 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:36.828214  3970 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:36.832428  5644 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:36.837824  5687 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:36.842320  4567 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 LEARNER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:36.843214  3755 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51804 (request call id 325) took 1118 ms. Trace:
I20260709 12:27:36.827538  5660 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:36.849448  3897 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:36.852566  5629 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:36.852967  5629 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:36.853132  5708 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:36.843681  5663 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:36.858986  5625 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:36.853338  5629 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:36.843566  3755 rpcz_store.cc:276] 0709 12:27:35.724800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.725554 (+   754us) service_pool.cc:224] Handling call
0709 12:27:36.843153 (+1117599us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:36.009599 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:36.010304 (+   705us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:36.010338 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:27:36.010355 (+    17us) tablet.cc:662] Decoding operations
0709 12:27:36.010672 (+   317us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:36.014227 (+  3555us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:36.016924 (+  2697us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:27:36.043773 (+ 26849us) tablet.cc:701] Row locks acquired
0709 12:27:36.043797 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:27:36.097540 (+ 53743us) write_op.cc:270] Start()
0709 12:27:36.119249 (+ 21709us) write_op.cc:276] Timestamp: P: 1783600056053516 usec, L: 0
0709 12:27:36.121464 (+  2215us) op_driver.cc:348] REPLICATION: starting
0709 12:27:36.237199 (+115735us) log.cc:844] Serialized 535 byte log entry
0709 12:27:36.577849 (+340650us) op_driver.cc:464] REPLICATION: finished
0709 12:27:36.740915 (+163066us) write_op.cc:301] APPLY: starting
0709 12:27:36.742935 (+  2020us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:36.743031 (+    96us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:36.743170 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:36.773194 (+ 30024us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:36.780075 (+  6881us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:27:36.787487 (+  7412us) write_op.cc:312] APPLY: finished
0709 12:27:36.806181 (+ 18694us) log.cc:844] Serialized 23 byte log entry
0709 12:27:36.809287 (+  3106us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:36.814574 (+  5287us) write_op.cc:454] Released schema lock
0709 12:27:36.815549 (+   975us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":11867,"reported_tablets":4,"spinlock_wait_cycles":415744,"child_traces":[["op",{"apply.queue_time_us":155662,"apply.run_cpu_time_us":2358,"apply.run_wall_time_us":98953,"num_ops":1,"prepare.queue_time_us":218044,"prepare.run_cpu_time_us":17259,"prepare.run_wall_time_us":342500,"raft.queue_time_us":80024,"raft.run_cpu_time_us":15102,"raft.run_wall_time_us":134173,"replication_time_us":454388,"thread_start_us":441816,"threads_started":4,"wal-append.queue_time_us":130027}]]}
I20260709 12:27:36.853722  5708 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:36.880614  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:27:36.917677  5710 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:27:36.883106  5674 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:36.880692  5625 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:27:36.978252  3999 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:27:36.976512  4002 raft_consensus.cc:2955] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:36.986380  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 101816us
I20260709 12:27:36.981743  5680 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.002919  5680 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:37.007822  4566 raft_consensus.cc:2955] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:37.076366  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:37.049332  5581 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:27:37.086437  5651 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:37.099660  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:37.105804  3851 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:37.140345  4005 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:37.203560  3895 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:37.204732  5681 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:37.205148  5681 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:37.205488  5681 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:37.210731  5708 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:37.212009  5708 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:37.212956  5681 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:37.126667  5651 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:37.216053  5681 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:37.216655  5651 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:37.218078  5680 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:37.227783  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:37.228438  3853 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:37.250893  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 114183us
I20260709 12:27:37.258356  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:37.259987  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:37.267753  4002 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:37.268784  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:37.269419  3998 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:37.169858  5629 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:37.254019  4569 raft_consensus.cc:2955] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:37.241027  5687 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:37.251773  5642 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.262416  5703 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:37.332358  5703 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:37.311686  5687 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:37.335744  5703 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:37.336997  5687 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:37.319145  5642 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:37.344558  5629 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:37.362712  5714 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 12:27:37.361836  3753 catalog_manager.cc:5697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:37.381202  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 104008us
I20260709 12:27:37.425377  5641 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.425546  3853 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:27:37.426071  5641 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:37.426800  3998 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:27:37.430912  5641 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:37.430802  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:37.430814  3895 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:37.431834  4572 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:37.432268  5645 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:37.432941  5645 raft_consensus.cc:697] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:37.433372  3971 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:37.434389  5641 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:37.434829  5641 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:37.436944  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:37.370900  5642 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:37.434062  5645 consensus_queue.cc:237] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:37.441845  5641 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:37.453725  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:37.440918  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:37.461911  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:37.463428  3854 raft_consensus.cc:2393] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 2: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:37.463428  3853 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 4: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:27:37.464437  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 176867us
I20260709 12:27:37.448684  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:37.467310  4572 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:27:37.473666  5688 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:27:37.479507  3851 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 2: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:37.463835  5642 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.481990  5642 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:37.492559  5581 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.500367  5581 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:37.504951  5641 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:37.515230  5683 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.515918  5683 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:37.518494  5683 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:27:37.519553  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 243670us
I20260709 12:27:37.520349  3969 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:37.522313  5683 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:37.527379  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:37.528088  3856 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:37.530083  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:37.530366  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:37.530949  3852 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:37.530083  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:37.531638  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:37.531855  3850 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:37.530018  4004 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:27:37.533324  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:37.537323  4006 raft_consensus.cc:2368] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5.
W20260709 12:27:37.539459  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 100736us
I20260709 12:27:37.512195  4001 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:37.545441  3998 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:37.545537  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:37.549731  4569 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:27:37.547189  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:37.502776  5581 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:37.560163  5680 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:37.548748  5642 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:37.572196  4569 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:27:37.573693  3971 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:37.574793  5663 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:37.575340  5660 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:37.575425  5663 raft_consensus.cc:697] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:37.575947  5660 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:37.576498  5660 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:37.552860  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:37.578105  4571 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:27:37.555959  3852 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:27:37.559062  3897 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:37.576926  5663 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:37.604303  5728 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:37.607582  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:37.605253  5728 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:37.608489  3931 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:37.508242  5641 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:37.618202  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:37.618973  3925 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:37.607399  5734 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:37.658367  5734 raft_consensus.cc:697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:37.660174  3927 raft_consensus.cc:2955] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:37.678547  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:37.661391  5734 consensus_queue.cc:237] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:37.689325  3970 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:37.698710  3925 raft_consensus.cc:2955] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:37.713776  5683 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:37.724211  5683 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:37.724720  5683 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:37.702095  5644 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:37.726881  5644 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:37.729521  5644 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:37.731670  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:37.738508  3931 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:27:37.783850  5676 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:37.790798  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 47703.1us
I20260709 12:27:37.791354  5642 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.793283  5642 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:37.796031  5642 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:37.725273  5582 raft_consensus.cc:2955] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:37.797477  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:37.798255  3852 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:37.799482  3969 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:27:37.802991  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 113778us
I20260709 12:27:37.807173  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:37.811117  4538 leader_election.cc:400] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5.
I20260709 12:27:37.811602  4538 leader_election.cc:403] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:37.806676  5729 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:37.784365  5676 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:37.783872  5660 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:37.845289  5674 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:27:37.866689  3822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.025s	sys 0.013s
I20260709 12:27:37.863250  5660 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:27:37.867146  3822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.025s	sys 0.013s
W20260709 12:27:37.872814  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 615948us
I20260709 12:27:37.882758  3925 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:27:37.885015  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:37.885325  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:37.885819  3852 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:37.823359  5729 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:37.814865  5737 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5.
I20260709 12:27:37.863919  5674 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:37.889668  5729 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:37.903867  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:37.904657  3857 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:37.929316  3755 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51798 (request call id 316) took 1056 ms. Trace:
I20260709 12:27:37.929757  3755 rpcz_store.cc:276] 0709 12:27:36.872866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.879837 (+  6971us) service_pool.cc:224] Handling call
0709 12:27:37.281438 (+401601us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400046ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f41090 00007fe051fdff3a 00007fe057d95e9c 00007fe057e9404e 00007fe0563552a4 00007fe056355232 00007fe056355161 00007fe0563550dc 00007fe056354392 00007fe05031248c 00007fe0503118c6
0709 12:27:37.929252 (+647814us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":873,"reported_tablets":1,"spinlock_wait_cycles":543661824}
I20260709 12:27:37.940038  5728 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:37.925282  3848 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:37.959532  5688 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:27:37.962613  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:37.961171  5674 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:37.987816  5722 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.988368  5722 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:37.981652  3852 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:37.998734  4569 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:37.992483  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:38.000819  5750 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:37.978849  5676 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:38.001619  5750 raft_consensus.cc:697] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:38.002770  5750 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:38.035780  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:38.036607  4569 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:27:38.071460  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 98743.3us
I20260709 12:27:38.074841  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:38.077149  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:38.080629  4569 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:38.085922  4538 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:38.088533  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:38.102299  3853 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:38.084801  5676 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:38.113159  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 93025.1us
I20260709 12:27:38.119038  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:38.120569  5676 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:38.090018  5643 raft_consensus.cc:2764] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:27:38.130069  5676 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:38.008905  5654 raft_consensus.cc:2955] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:38.108263  5678 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:38.140090  4571 raft_consensus.cc:2955] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:38.128522  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:38.188861  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 73835.2us
I20260709 12:27:38.127980  5682 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:27:38.182559  5722 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:38.202334  5625 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.215806  5625 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:38.218283  5625 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:38.199577  5674 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.190595  4567 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:38.166299  5683 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:38.160705  5678 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:38.259701  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 107425us
I20260709 12:27:38.261724  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:38.268198  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:38.268872  3852 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:27:38.236053  5674 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:38.279580  3895 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:38.294929  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:38.295655  4003 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:38.294977  3997 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:38.295674  4006 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:38.309839  5755 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:27:38.310925  5678 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:38.301568  5644 consensus_meta.cc:287] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.008s
I20260709 12:27:38.298100  5629 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:27:38.320729  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 158577us
I20260709 12:27:38.324637  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:38.326195  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:38.327147  3928 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:38.335093  3821 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:27:38.318665  5754 log.cc:927] Time spent T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:27:38.334535  5704 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:38.304028  5645 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:27:38.339027  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:27:38.338850  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 180619us
I20260709 12:27:38.335023  5629 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.318879  5688 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:38.321798  5644 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:38.396761  5683 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:38.343750  5686 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:38.415280  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:38.421944  5686 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:38.454850  5686 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:38.416289  5690 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:38.458391  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:38.459201  3857 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:38.467278  5644 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:38.467082  5690 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:38.460619  4536 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:27:38.417946  5757 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.151s	user 0.003s	sys 0.003s
I20260709 12:27:38.418521  5629 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:38.487053  5727 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:38.487604  5727 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.488044  5727 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:38.490747  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:38.491848  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:38.492774  3999 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:38.494010  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:38.472995  5758 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:27:38.494668  3997 raft_consensus.cc:2368] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4.
I20260709 12:27:38.496865  3822 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:38.497157  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:38.455930  5678 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:38.493049  3998 raft_consensus.cc:2955] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:38.495834  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:38.497682  3925 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:38.499277  3928 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:38.439667  5688 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:38.508193  3925 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:38.500588  5674 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:38.512434  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:38.513371  5683 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:38.513844  5683 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:38.514776  5683 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:38.519681  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:38.520376  3930 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:38.520496  3928 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:27:38.508951  5737 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.521495  5737 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:38.523478  5737 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:38.480336  5629 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:38.528290  5629 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:38.531872  3970 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:38.500793  5764 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:38.549134  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:38.550120  4001 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:38.553234  4538 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:38.545099  5761 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:38.582062  5729 consensus_meta.cc:287] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.011s
I20260709 12:27:38.547515  5690 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:38.584188  5704 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:38.972692  5761 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:38.974524  5704 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:39.021831  5751 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:27:38.973431  5748 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:38.863047  5727 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:38.865319  5729 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:39.166766  5704 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.268934  5688 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.271528  5727 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:39.274359  5729 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:39.275470  4004 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:39.234565  5648 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.227996  5748 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:39.288868  5748 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:39.249691  5761 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:39.293395  5648 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:39.307025  5686 consensus_meta.cc:287] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.852s	user 0.010s	sys 0.002s
I20260709 12:27:39.307713  5686 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:39.319593  5686 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.324313  5676 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.325240  5676 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.328891  5676 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.368466  5663 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.369092  5663 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.371203  5663 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:27:39.372956  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 862482us
I20260709 12:27:39.305748  5648 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.361944  5722 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.365671  5676 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.378664  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:39.387598  5648 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.390480  5674 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:39.390758  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.402763  5781 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:39.403275  5781 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.403578  5674 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.405402  5734 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.405754  5674 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.405937  5734 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.408567  5734 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.378213  5704 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.410247  5648 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.410832  5704 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.412622  5648 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.398495  5738 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:39.414139  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:39.414755  3926 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:39.414680  5738 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.391772  5776 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.417222  5648 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.421172  5648 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.388240  5676 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:39.405339  5781 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.386809  5722 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:39.430660  5764 consensus_meta.cc:287] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.886s	user 0.012s	sys 0.000s
I20260709 12:27:39.444172  3926 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:27:39.446821  3857 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:39.450594  5781 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.442591  5678 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:39.455113  5678 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.457278  5678 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.440809  5764 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:39.458809  5781 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:39.459378  5676 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.445410  5734 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.460506  5734 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:39.462510  5734 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.467082  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.467942  5722 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.468384  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.469271  5738 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:39.469190  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.470116  3997 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:39.434053  5677 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:39.470875  5677 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:39.472043  5781 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:39.472529  3753 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51802 (request call id 330) took 2380 ms. Trace:
I20260709 12:27:39.472865  5677 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.449329  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:39.431978  5776 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.474828  5734 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:39.478070  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:39.478730  4005 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.478467  5734 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.481141  5734 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.483409  5776 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.484504  5648 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:39.485448  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:39.486281  3926 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:39.487931  3822 leader_election.cc:400] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4.
I20260709 12:27:39.489864  5622 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:39.490001  5781 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.491554  5648 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.492270  5648 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.490331  5622 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:39.493244  5622 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.472916  3753 rpcz_store.cc:276] 0709 12:27:37.091979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.092209 (+   230us) service_pool.cc:224] Handling call
0709 12:27:37.180810 (+ 88601us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b5400046ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f41090 00007fe051fdff3a 00007fe057d95e9c 00007fe057e9404e 00007fe0563552a4 00007fe056355232 00007fe056355161 00007fe0563550dc 00007fe056354392 00007fe05031248c 00007fe0503118c6
0709 12:27:39.472441 (+2291631us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:37.703383 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:37.704007 (+   624us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:37.704042 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:27:37.704067 (+    25us) tablet.cc:662] Decoding operations
0709 12:27:37.704411 (+   344us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:37.704486 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:37.704520 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:27:37.704696 (+   176us) tablet.cc:701] Row locks acquired
0709 12:27:37.704716 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:27:37.704848 (+   132us) write_op.cc:270] Start()
0709 12:27:37.704965 (+   117us) write_op.cc:276] Timestamp: P: 1783600057704804 usec, L: 0
0709 12:27:37.704989 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:27:37.705734 (+   745us) log.cc:844] Serialized 591 byte log entry
0709 12:27:37.855146 (+149412us) op_driver.cc:464] REPLICATION: finished
0709 12:27:38.098191 (+243045us) write_op.cc:301] APPLY: starting
0709 12:27:38.098271 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:38.098373 (+   102us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:38.118264 (+ 19891us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:38.118488 (+   224us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:38.118651 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:27:38.118695 (+    44us) write_op.cc:312] APPLY: finished
0709 12:27:38.118879 (+   184us) log.cc:844] Serialized 23 byte log entry
0709 12:27:38.119050 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:38.119133 (+    83us) write_op.cc:454] Released schema lock
0709 12:27:38.119175 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:38.119572 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:38.119605 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":52626688,"child_traces":[["op",{"apply.queue_time_us":220125,"apply.run_cpu_time_us":1894,"apply.run_wall_time_us":21318,"num_ops":1,"prepare.queue_time_us":337684,"prepare.run_cpu_time_us":2867,"prepare.run_wall_time_us":13546,"replication_time_us":108231,"thread_start_us":510134,"threads_started":2}]]}
I20260709 12:27:39.491542  5781 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:39.494719  5648 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.496796  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:39.497278  4567 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:39.497394  3932 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:39.499521  4567 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:39.503525  5781 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:39.504875  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:39.505544  4567 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:27:39.508324  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:39.508911  4566 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:27:39.509236  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:39.511185  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:39.512666  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:39.511210  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.508931  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.515667  3926 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:27:39.518224  3971 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:39.518548  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:39.519979  3926 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:39.522619  5641 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:39.523406  5748 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:39.525077  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:39.525458  5748 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:39.515694  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:39.526257  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:39.512445  3970 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:39.528851  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:39.526641  5654 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:39.530413  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:39.530498  5654 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.532773  5654 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.530970  5658 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:39.533205  5648 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:39.533309  5658 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:39.533743  5658 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.525853  5748 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.533766  5648 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.535398  5748 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:39.536979  5648 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.527419  3930 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:27:39.539712  4536 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:39.542052  5788 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:39.542537  5622 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:39.544268  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.545737  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:39.546288  3856 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:39.543551  4005 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:39.548484  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.548822  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.550489  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.551569  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:39.551435  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:39.555419  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.555537  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.556377  3999 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:27:39.556434  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.555835  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.546922  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:39.559420  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:39.560122  4001 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.562417  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:39.563339  4567 raft_consensus.cc:2368] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3.
I20260709 12:27:39.564601  5734 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.565122  5734 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:39.565383  3856 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:39.566821  4536 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:39.567214  5734 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.567615  5697 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:39.570257  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:39.570523  5697 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:39.570916  4565 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:27:39.571969  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:39.572712  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.568925  4538 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:39.574031  5788 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.544626  5622 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.571404  5697 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.576575  5676 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:39.585749  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:39.579402  4001 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:39.580579  5658 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.583451  5781 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:39.576162  4538 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:39.589267  4538 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:39.591701  5682 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.590266  5781 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:39.592479  5682 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.587548  5688 raft_consensus.cc:2764] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:27:39.587852  5787 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.598007  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1413) took 1072 ms. Trace:
I20260709 12:27:39.584851  5707 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:39.598917  3850 rpcz_store.cc:276] 0709 12:27:38.524206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.595367 (+1071161us) service_pool.cc:224] Handling call
0709 12:27:39.595711 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:39.595879 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:39.595900 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:39.595941 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:39.595969 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.596027 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:39.596127 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:39.598969  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:39.596932  5646 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:39.601841  5646 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.602577  5658 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.602980  3927 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 3: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:39.587031  5676 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.604048  5646 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.596319  5788 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:39.604763  5676 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.604843  5788 raft_consensus.cc:697] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:39.590736  5643 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.596035  5750 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:39.597694  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:39.606163  5750 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.590595  5641 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.605837  5788 consensus_queue.cc:237] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.617717  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:39.622501  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:39.622717  3853 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:39.623104  3924 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.610710  5686 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:39.624717  5641 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.626799  5641 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.631103  3924 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:39.610198  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 1360) took 1271 ms. Trace:
I20260709 12:27:39.634430  3927 rpcz_store.cc:276] 0709 12:27:38.338552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.338742 (+   190us) service_pool.cc:224] Handling call
0709 12:27:39.610003 (+1271261us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400305cd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:39.610127 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2896603520}
I20260709 12:27:39.614182  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:39.610984  5646 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:39.639467  5646 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.598328  5622 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:39.640462  5622 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.618687  5748 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.619968  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1412) took 1096 ms. Trace:
I20260709 12:27:39.607244  5690 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:39.617731  5781 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:39.595259  5787 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.635373  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1409) took 1112 ms. Trace:
I20260709 12:27:39.766103  5690 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:39.643381  3854 rpcz_store.cc:276] 0709 12:27:38.523920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.618929 (+1095009us) service_pool.cc:224] Handling call
0709 12:27:39.619351 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:39.619562 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:39.619600 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:39.619655 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:39.619698 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.619769 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:39.619895 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:39.645797  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 47310.5us
I20260709 12:27:39.767684  5787 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.768229  5787 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:39.768906  3897 leader_election.cc:400] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3.
I20260709 12:27:39.769354  3897 leader_election.cc:403] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:39.770135  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:39.648798  3853 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:39.634003  5682 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.612182  5750 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.646670  5646 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:39.678220  5791 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:39.699327  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:40.000422  5791 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.001124  3927 raft_consensus.cc:2368] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4.
I20260709 12:27:40.002867  5791 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.702654  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.004433  3931 raft_consensus.cc:2368] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
I20260709 12:27:39.719630  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:39.721870  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:39.723645  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:39.748061  5582 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:40.008136  5582 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.756567  5686 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:39.758703  5794 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.761195  5795 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:40.010147  5686 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.010243  5794 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.010689  5795 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.012210  5686 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:40.012435  5794 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.012714  5795 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.761714  5632 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:40.013037  5582 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.013438  5632 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.015378  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.016022  4569 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:40.016222  5632 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.766330  3848 rpcz_store.cc:276] 0709 12:27:38.523064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.524535 (+  1471us) service_pool.cc:224] Handling call
0709 12:27:38.524814 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:38.524965 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:38.524994 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:38.525033 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:38.525058 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:38.525103 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:39.635308 (+1110205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:40.017693  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:40.017978  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.018558  5582 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:40.018952  5582 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:40.019295  5582 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:40.020035  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.020671  4566 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:39.616401  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:40.021577  3852 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:27:39.768666  5787 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.772756  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1410) took 1249 ms. Trace:
I20260709 12:27:39.774559  5678 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:40.026604  3853 rpcz_store.cc:276] 0709 12:27:38.523329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.617426 (+1094097us) service_pool.cc:224] Handling call
0709 12:27:39.772687 (+155261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:40.026782  5678 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.027740  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.027930  5787 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.646559  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.028636  3850 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:40.028800  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.029039  5678 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.779392  5690 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.785715  5797 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.029536  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.029954  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.030623  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.031024  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.031658  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.032106  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.032734  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.033203  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:39.783628  5796 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:39.793449  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:27:39.807147  5770 log.cc:927] Time spent T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 1.287s	user 0.000s	sys 0.006s
I20260709 12:27:39.798365  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.034986  3856 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:39.808841  5798 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:39.810527  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.035888  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 1887) took 1720 ms. Trace:
I20260709 12:27:39.814881  5799 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:40.035934  5798 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.821898  5581 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:40.036461  4006 rpcz_store.cc:276] 0709 12:27:38.315057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.315216 (+   159us) service_pool.cc:224] Handling call
0709 12:27:38.337457 (+ 22241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:38.337767 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:38.337793 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:38.341017 (+  3224us) log.cc:844] Serialized 26 byte log entry
0709 12:27:38.510957 (+169940us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:38.510984 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:38.511037 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:39.805741 (+1294704us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:27:40.035575 (+229834us) raft_consensus.cc:1685] finished
0709 12:27:40.035596 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:40.035802 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77184,"raft.queue_time_us":862,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4355,"spinlock_wait_cycles":26505600,"thread_start_us":88974,"threads_started":1,"wal-append.queue_time_us":124023}
I20260709 12:27:40.037490  5581 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:39.822696  5801 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:40.038640  5798 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.038513  5801 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.041024  5801 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.833979  5623 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:39.844344  5802 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:39.882490  3897 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:40.041746  5623 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:40.042249  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 159855us
I20260709 12:27:40.041817  5797 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3.
I20260709 12:27:40.043181  5797 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:40.043656  3897 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:40.044085  5623 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:39.843503  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.044598  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:40.044872  3854 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:39.650769  5622 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.911684  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:39.611179  5707 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.036679  5799 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:39.919077  4004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36516 (request call id 1879) took 1842 ms (client timeout 1530 ms). Trace:
I20260709 12:27:39.924005  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:39.924443  5804 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:39.943594  5780 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:39.945494  5736 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.947176  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:39.954743  3821 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.507s (SENT)
I20260709 12:27:39.981992  5748 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:39.992879  3754 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51804 (request call id 327) took 2549 ms. Trace:
I20260709 12:27:40.050995  3754 rpcz_store.cc:276] 0709 12:27:37.443631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.443816 (+   185us) service_pool.cc:224] Handling call
0709 12:27:39.992808 (+2548992us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61985,"reported_tablets":2,"spinlock_wait_cycles":9472}
I20260709 12:27:39.994441  5761 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:40.051441  5804 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.051980  5581 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:40.034132  5796 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.054345  3822 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:40.055478  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.019225  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.026149  5791 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:40.028332  5582 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:39.795164  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.041843  5802 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:39.903667  5764 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:39.923904  5790 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:40.047482  3855 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:40.061123  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:40.047267  4004 rpcz_store.cc:269] 0709 12:27:38.076859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.076951 (+    92us) service_pool.cc:224] Handling call
0709 12:27:39.918812 (+1841861us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540021b1d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:39.918961 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2753768704}
I20260709 12:27:40.046983  5797 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:40.048369  3926 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:40.035888  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.049273  5799 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:40.049407  5646 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:40.047117  3849 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:40.050280  4536 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:40.052229  5761 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.071900  3855 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:40.059463  5680 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:40.058696  5796 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:40.065724  3897 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:40.033754  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.068113  5797 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:40.029557  5678 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:40.051052  5780 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.067715  5791 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:40.092172  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 137457us
I20260709 12:27:40.056044  5736 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.190104  5804 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.172112  5707 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.190897  5736 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:40.190831  5748 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:40.191701  5748 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.192998  3895 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:40.195264  3895 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:40.033793  3853 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.093991  3856 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:27:40.137712  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:40.200070  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.055946  4568 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:40.137079  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.204514  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.068894  5581 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:40.200443  4569 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:40.201808  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.202252  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.194061  5707 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:40.206301  3924 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:40.215417  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.206291  3923 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:40.100845  3852 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
W20260709 12:27:40.208623  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 142971us
I20260709 12:27:40.210207  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.211737  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.212960  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.213935  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:40.214186  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.215751  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.216711  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.072849  5764 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:40.257674  3852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1408) took 1728 ms (client timeout 1502 ms). Trace:
I20260709 12:27:40.260927  3853 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:40.072988  5790 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.263180  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.204118  5797 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:40.199792  5804 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:40.275926  5764 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.276835  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.267589  5808 consensus_queue.cc:1059] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:27:40.243362  5680 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:40.282327  5680 raft_consensus.cc:697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:40.283735  5808 raft_consensus.cc:3055] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:40.283557  5680 consensus_queue.cc:237] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.284425  5750 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:40.284940  5750 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.285295  3752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39516 (request call id 220) took 2481 ms. Trace:
I20260709 12:27:40.285704  3752 rpcz_store.cc:276] 0709 12:27:37.803999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.804117 (+   118us) service_pool.cc:224] Handling call
0709 12:27:38.099447 (+295330us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400046ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f41090 00007fe051fdff3a 00007fe057d95e9c 00007fe057e9404e 00007fe0563552a4 00007fe056355232 00007fe056355161 00007fe0563550dc 00007fe056354392 00007fe05031248c 00007fe0503118c6
0709 12:27:40.285228 (+2185781us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67380,"reported_tablets":1,"spinlock_wait_cycles":617395456}
I20260709 12:27:40.287067  5750 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:40.287547  5750 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:40.288184  5660 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:40.288658  5660 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:40.289053  5660 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.903157  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:40.266088  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.211321  5697 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:40.089330  5646 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.216078  5748 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:40.136049  5582 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.211829  5761 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.284178  5808 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:40.287994  5750 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:40.258252  3852 rpcz_store.cc:269] 0709 12:27:38.522783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.616065 (+1093282us) service_pool.cc:224] Handling call
0709 12:27:40.251401 (+635336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:40.195266  5678 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.267266  3924 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:40.300669  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.301213  3822 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:40.215742  5778 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:40.296103  4569 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:40.207042  5682 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:40.293911  4536 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:40.258695  5683 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:40.304957  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:40.301740  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.306149  3924 raft_consensus.cc:2368] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6.
I20260709 12:27:40.306262  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.306403  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:40.306977  3926 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:40.309419  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.310662  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:27:40.303052  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 139258us
I20260709 12:27:40.312680  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.315865  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.320765  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.321533  3926 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:40.322151  5682 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.323202  5646 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:40.324065  5750 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.324227  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:40.339112  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.340068  3821 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:40.341269  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:40.341410  3821 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:40.341970  4004 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:40.342689  3821 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:40.345929  5690 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:40.346028  5582 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:40.346123  5623 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:40.346695  5623 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:40.314203  5683 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.347287  5623 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.348829  5683 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.314410  5778 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.350853  5791 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.313855  5736 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:40.330399  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.353477  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.354015  3852 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:40.353122  5736 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:40.354954  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.355425  5790 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.334932  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.356180  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.357065  5678 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.357352  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.352964  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.357955  3930 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:40.336066  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.337284  5682 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:40.314194  5801 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:40.317926  5795 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:40.338048  5802 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:40.346729  5690 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:40.378080  5690 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:40.378520  5690 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.340121  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:40.326032  5808 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.355166  5736 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.360137  3848 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 3: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:40.363327  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.363778  5778 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.363349  5795 raft_consensus.cc:697] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:40.331655  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:40.367182  4536 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:40.367645  5697 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:27:40.368937  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 155135us
I20260709 12:27:40.372069  3929 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:40.409013  3970 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:40.372699  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:40.373719  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:40.374539  5682 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:40.362445  5801 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:40.411279  3970 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:40.411847  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:40.351222  5660 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.392024  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.387253  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.413061  5808 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.413269  3930 raft_consensus.cc:2368] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
I20260709 12:27:40.396574  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:40.396814  3821 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:40.397128  3926 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:40.404366  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:27:40.405594  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 46919us
I20260709 12:27:40.416159  4537 leader_election.cc:400] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6.
I20260709 12:27:40.416496  4537 leader_election.cc:403] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:40.340127  5780 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:40.412587  3931 raft_consensus.cc:2368] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4.
I20260709 12:27:40.419118  3821 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:40.424567  3821 leader_election.cc:400] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
I20260709 12:27:40.427156  3821 leader_election.cc:403] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:40.410156  5697 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.410486  5738 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:40.414333  5801 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.417990  5646 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:40.421449  5798 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:40.424810  5748 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:40.432056  5780 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:27:40.442946  3821 leader_election.cc:400] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4.
I20260709 12:27:40.470209  3821 leader_election.cc:403] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:27:40.425081  5654 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:40.428262  5734 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.473237  5734 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.476343  5734 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:40.471228  5654 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:40.477828  5654 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.479152  5660 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:40.451838  5623 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.436365  5738 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:40.424721  5761 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:40.433632  5644 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:40.453012  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.484289  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:40.495981  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 969016us
I20260709 12:27:40.485051  3853 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:40.427815  5778 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:27:40.442462  5693 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
I20260709 12:27:40.488009  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.508149  4573 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:27:40.516821  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.492475  5798 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4.
I20260709 12:27:40.495378  5738 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.527254  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:40.493121  5644 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:40.492961  5761 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:40.538666  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.527776  5795 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.518038  5750 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:27:40.515410  5703 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 12:27:40.543394  5644 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:40.540849  5761 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:40.543952  3854 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:40.616048  3895 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:40.617013  5623 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.559960  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.618954  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.562433  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:40.545691  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.623171  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.564116  5581 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:40.626400  5581 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.563506  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.577503  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:40.542292  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 146927us
W20260709 12:27:40.607266  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:40.631520  4537 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:40.605324  3753 catalog_manager.cc:5697] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:40.617007  5787 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:40.634684  5787 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:40.636840  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.637051  4537 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:40.635182  5787 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:40.547610  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:40.642189  4537 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:40.635792  3753 catalog_manager.cc:5697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 2, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:40.645185  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 224064us
I20260709 12:27:40.646446  3753 catalog_manager.cc:5697] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:40.650429  4537 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:40.649070  3753 catalog_manager.cc:5697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 3 to 4, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:40.651144  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 228416us
I20260709 12:27:40.566452  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.647918  5736 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.578773  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.682080  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.682359  3969 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:40.682694  3970 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:40.643651  5646 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:40.646386  5703 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:40.684156  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:40.687361  3932 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:27:40.655828  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0380 after lost signal to thread 2679
I20260709 12:27:40.693012  3969 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:40.588424  5690 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.654079  5704 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:40.643563  5797 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.683367  5632 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:40.698266  5683 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:40.645948  5748 consensus_queue.cc:1059] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:27:40.706755  4567 raft_consensus.cc:1240] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:40.726864  3970 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:40.726416  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 71302.2us
I20260709 12:27:40.720182  3853 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:40.707548  5737 consensus_queue.cc:1059] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:40.686573  5654 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.748826  5654 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:40.750313  5697 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.752950  5697 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:27:40.741386  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08000f37c0 after lost signal to thread 3789
I20260709 12:27:40.754619  4571 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:40.755043  3953 debug-util.cc:398] Leaking SignalData structure 0x7b080030eec0 after lost signal to thread 3881
W20260709 12:27:40.756138  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3ca0 after lost signal to thread 3956
W20260709 12:27:40.757172  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08002bfa60 after lost signal to thread 4030
W20260709 12:27:40.757437  3953 debug-util.cc:398] Leaking SignalData structure 0x7b08002bfc60 after lost signal to thread 4031
I20260709 12:27:40.764477  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:40.766919  3897 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:40.769239  3928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:27:40.770530  5780 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6.
I20260709 12:27:40.770617  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.771574  5790 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:40.778357  3897 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:40.779951  3928 raft_consensus.cc:606] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:40.786504  5791 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:40.791133  5736 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:40.734926  5644 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.795305  5644 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:27:40.798892  5822 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.073s	user 0.004s	sys 0.000s
I20260709 12:27:40.799883  5797 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:40.800226  5683 raft_consensus.cc:697] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:27:40.800315  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 73541.7us
I20260709 12:27:40.802304  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.806733  3970 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:40.808125  3857 raft_consensus.cc:1275] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:40.809791  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:40.810837  3932 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:40.719247  5820 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:40.733284  5814 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:40.821449  3897 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:40.823626  3897 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:40.827033  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 81808.9us
I20260709 12:27:40.828047  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:40.830683  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:40.842628  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:40.844686  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:40.839071  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:40.814297  5660 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:40.849758  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 156805us
I20260709 12:27:40.819453  5824 raft_consensus.cc:3055] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:40.769657  5801 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.837204  3822 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:40.817389  5820 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:27:40.852403  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 45759us
I20260709 12:27:40.855765  3970 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:40.825592  5797 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:40.848987  3953 debug-util.cc:398] Leaking SignalData structure 0x7b080017ad00 after lost signal to thread 4598
I20260709 12:27:40.834936  5680 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:40.833971  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:40.822517  5761 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.891080  3970 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:40.893853  3897 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:40.859339  5820 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:40.895210  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.894115  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.897782  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:40.898936  5761 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:40.899840  3853 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:27:40.875810  5682 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:40.853209  5824 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:40.855113  5737 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:27:40.851410  5697 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:27:40.916991  5703 raft_consensus.cc:3055] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:40.917418  5703 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:40.874110  5581 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:40.918926  5808 consensus_meta.cc:287] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.005s
I20260709 12:27:40.919566  5581 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.875407  5791 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.921490  5791 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.923642  5791 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:40.842756  5790 consensus_queue.cc:1059] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:27:40.911266  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:40.924821  5682 raft_consensus.cc:697] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:40.926155  5682 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:40.930037  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 92857.7us
I20260709 12:27:40.900533  5678 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:40.849694  5582 consensus_queue.cc:1059] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:27:40.940160  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:40.940810  5582 raft_consensus.cc:3055] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:40.941176  5582 raft_consensus.cc:740] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:40.884616  5660 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:40.913906  5813 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.941954  5582 consensus_queue.cc:260] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:40.916046  5680 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:40.915880  5683 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:40.852829  5689 consensus_queue.cc:1059] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:27:40.936807  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:27:40.908180  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 81454.1us
I20260709 12:27:40.966739  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:40.886870  5646 consensus_queue.cc:1059] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:27:40.945765  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:40.947340  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:40.948676  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:40.912616  5690 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:40.952311  3999 raft_consensus.cc:1275] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:40.942550  5738 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:40.974972  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:40.955184  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:27:40.950057  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 95436.1us
W20260709 12:27:40.961537  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 230835us
I20260709 12:27:40.976670  3971 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:40.963258  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 60229.4us
I20260709 12:27:40.964763  3969 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:40.949159  5680 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:40.924836  5790 raft_consensus.cc:3055] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:40.974785  3853 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:40.981146  4000 raft_consensus.cc:2393] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 2: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:40.986398  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:40.986589  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:40.981256  3999 raft_consensus.cc:2955] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:40.988119  4536 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:40.989233  4536 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:40.990756  5697 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:40.991425  5832 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:27:40.991732  5821 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:27:40.995774  4000 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:40.995658  3853 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:41.000742  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:41.002856  4569 raft_consensus.cc:1240] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:40.971568  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:41.005396  4572 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:40.980799  5582 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:40.982319  5680 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.982888  3851 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:41.012280  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:40.985786  5814 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:40.983085  5790 raft_consensus.cc:740] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:40.993685  5826 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:41.030500  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 86388.5us
W20260709 12:27:41.040876  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 55207.2us
I20260709 12:27:40.994689  5787 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:41.055956  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 69623.1us
I20260709 12:27:41.057667  3971 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:41.022919  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:41.037137  5644 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:40.974975  5824 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.023027  5736 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:41.065418  4000 raft_consensus.cc:1240] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:41.062234  5826 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:41.092649  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:41.036866  5689 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:27:41.042680  5791 consensus_queue.cc:1059] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:27:41.095361  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:41.103494  4002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:41.104488  4002 raft_consensus.cc:606] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:27:41.096572  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 61211.8us
I20260709 12:27:41.103434  5644 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:41.105242  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:41.065685  5801 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:41.105952  3851 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:41.105674  5644 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.108120  5644 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:27:41.104672  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 67337us
I20260709 12:27:41.109278  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:41.110627  3897 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:41.031015  5744 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:27:41.062129  5790 consensus_queue.cc:260] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:41.112998  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.011013  5703 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:41.118659  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 63103.1us
I20260709 12:27:41.097839  5824 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:41.080742  5840 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:41.126616  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:41.091199  5736 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.121438  5845 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:41.141222  4000 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:41.139154  4565 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:27:41.141376  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:41.132755  5682 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:41.103183  5826 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.143867  5844 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:41.143803  5690 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:41.150528  5703 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:41.146049  5738 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:41.176370  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:41.178022  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:41.186302  5688 raft_consensus.cc:3055] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:41.154713  5682 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.176581  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:41.224287  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:41.167657  5690 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:41.153623  5814 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
W20260709 12:27:41.272372  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.319962  5820 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.321597  4006 raft_consensus.cc:1240] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:41.322891  5736 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:41.323899  3851 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:41.325322  5682 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:41.328734  3849 raft_consensus.cc:1240] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:41.335516  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:41.335855  4536 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:41.186764  5688 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:41.340531  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:41.340094  3854 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:41.346864  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:41.347520  3999 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:41.363538  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:41.371999  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.332469  5844 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:41.274067  5826 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:41.343199  5736 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:41.332726  5845 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:41.340094  5654 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:41.341039  5787 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:41.380954  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:27:41.422734  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 292770us
I20260709 12:27:41.381968  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:41.382858  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:41.384862  3924 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:41.424362  3822 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:41.424958  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:41.383682  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:41.415970  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:41.425577  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:41.416240  3923 raft_consensus.cc:1240] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:27:41.381176  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:41.429723  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:27:41.431674  5842 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:27:41.417634  5844 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:41.427291  5654 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.396777  5689 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:27:41.434023  5848 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:27:41.439858  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:27:41.441287  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 330728us
I20260709 12:27:41.442230  3928 raft_consensus.cc:2393] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 2: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:41.443306  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:41.433732  5654 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:41.443980  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:41.427826  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:41.446336  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.448176  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:41.427783  5736 raft_consensus.cc:697] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:41.434291  5844 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:41.462756  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:41.461572  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.494612  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:41.441386  5689 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:41.441286  5688 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.528239  5855 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:41.528708  5849 raft_consensus.cc:993] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:27:41.539743  5853 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:41.516741  5683 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:41.098127  5761 consensus_queue.cc:1175] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4eedd844c09d456ca0b3614490dd1dbb" responder_term: 4 status { last_received { term: 4 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: [3.5-3.5]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:27:41.598625  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.448312  5845 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.605448  5689 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:41.588845  5820 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:41.608314  5844 raft_consensus.cc:1081] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
W20260709 12:27:41.620290  5850 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:27:41.623010  5689 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.623960  5853 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:27:41.632519  5680 consensus_meta.cc:287] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.000s
I20260709 12:27:41.606105  5690 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:41.523761  5736 consensus_queue.cc:237] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.616717  5688 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:41.608896  5855 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.637904  5689 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.643855  5853 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:41.662705  5689 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:41.672502  5855 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:41.646859  5845 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:41.641947  5680 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:41.687702  3932 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:41.692412  5813 consensus_meta.cc:287] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.750s	user 0.004s	sys 0.009s
I20260709 12:27:41.693019  5813 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:41.697292  5824 consensus_meta.cc:287] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.000s
I20260709 12:27:41.698434  3997 raft_consensus.cc:2410] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:41.701256  5680 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:41.703540  5703 consensus_meta.cc:287] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.000s
I20260709 12:27:41.704528  4571 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:41.728590  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 586) took 1215 ms. Trace:
I20260709 12:27:41.731455  4000 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:41.731623  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:41.733057  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:41.733801  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:41.734956  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:41.735919  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:41.733772  4004 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:41.737349  3998 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:41.732434  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:41.729075  4569 rpcz_store.cc:276] 0709 12:27:40.507321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.620715 (+113394us) service_pool.cc:224] Handling call
0709 12:27:40.620935 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:41.003450 (+382515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.722117 (+718667us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54005b5c54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:41.722315 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877795072}
I20260709 12:27:41.728114  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:41.743980  4538 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:41.744500  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:41.746282  4568 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:27:41.746699  4568 pending_rounds.cc:85] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 5
I20260709 12:27:41.746965  4568 pending_rounds.cc:107] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.6
I20260709 12:27:41.747270  4568 raft_consensus.cc:2917] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Aborting config change with OpId 4.6: Aborted: Op aborted by new leader
I20260709 12:27:41.747691  4568 raft_consensus.cc:2889] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:41.748127  5703 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:41.749655  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:41.755756  5703 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:41.756265  5703 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:41.756731  5703 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:41.749982  5864 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:41.751163  5813 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.758810  5813 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.762429  5744 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:41.763249  5813 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:41.765450  5864 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.816766  5813 consensus_queue.cc:1059] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:41.818378  5813 raft_consensus.cc:3055] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:41.826577  5660 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:27:41.831251  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:41.834396  4568 raft_consensus.cc:1240] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:41.844275  5864 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:41.827046  5813 raft_consensus.cc:740] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:41.849583  5813 consensus_queue.cc:260] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.851854  5813 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:41.846071  5827 raft_consensus.cc:3055] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:41.858361  5827 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:27:41.858560  5852 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.431s	user 0.014s	sys 0.017s
I20260709 12:27:41.859177  5827 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.860069  5827 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:41.861124  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:41.847177  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:41.864157  4570 raft_consensus.cc:2393] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:41.866154  5703 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.870004  5703 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:41.872203  5780 raft_consensus.cc:3055] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:41.872547  5853 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:41.872614  5780 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:41.873554  5790 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:41.873653  5780 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.875016  5780 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:41.917210  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:41.920588  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:27:41.934731  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 588042us
W20260709 12:27:41.940081  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:41.940299  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 515873us
W20260709 12:27:41.943208  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:41.772218  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 309563us
I20260709 12:27:41.941833  3822 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:41.947335  3897 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:41.950372  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:41.951511  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.951385  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 1942) took 1011 ms. Trace:
I20260709 12:27:41.951864  3857 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:41.954371  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:41.955350  4000 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:41.956808  5623 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:41.957974  5623 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:41.963194  5623 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:41.964324  5623 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:41.967034  5623 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:41.968103  5644 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:41.969213  5761 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:27:41.973348  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.952055  3932 rpcz_store.cc:276] 0709 12:27:40.939444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.939586 (+   142us) service_pool.cc:224] Handling call
0709 12:27:40.939844 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:41.688264 (+748420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.950646 (+262382us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54000d5f54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:41.951073 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1719257344}
I20260709 12:27:41.978223  5837 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:41.978129  5813 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:41.979550  5761 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:41.982144  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.984678  5644 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:41.986356  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:41.986898  3854 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:41.987789  5644 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:41.994894  5791 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:41.995741  3897 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:41.996294  5855 raft_consensus.cc:1064] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
W20260709 12:27:41.996819  5855 raft_consensus.cc:1068] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Unable to promote non-voter f3cab225ecb7488386a1a19239498cfe: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:27:41.992564  5780 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:42.007529  5780 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.003502  5853 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:41.993826  5674 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:41.998307  5790 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:27:42.019270  5674 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.028142  5780 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:42.029241  5761 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:42.030905  5674 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:42.042773  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.042836  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:41.996192  5791 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.053290  3970 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:42.054203  3849 raft_consensus.cc:1240] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:42.055485  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:42.055727  5813 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:42.056777  3855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:27:42.057214  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.057605  3855 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:42.058003  3855 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:42.058633  5791 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:42.060191  5738 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:42.060984  5738 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.062002  3895 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:42.063143  5791 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:42.063328  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.063632  5791 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:42.064079  5791 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:42.072856  5738 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:42.074395  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 76609.3us
I20260709 12:27:42.082692  3855 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:42.085654  5825 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:42.085794  5819 consensus_queue.cc:1059] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:42.087195  5813 raft_consensus.cc:3055] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:42.087673  5813 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:42.091464  3752 catalog_manager.cc:5697] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 1 to 3, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 3 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:42.089195  5813 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:42.096714  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.097054  5813 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:42.099750  3970 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:42.101097  5855 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:42.105710  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:42.105814  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.106508  3999 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:42.095109  3753 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51802 (request call id 331) took 1845 ms. Trace:
I20260709 12:27:42.107872  3852 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:42.116129  4000 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
W20260709 12:27:42.125293  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 183756us
I20260709 12:27:42.127468  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:42.128085  4005 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:42.128652  4570 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:42.130461  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 1914) took 1183 ms. Trace:
I20260709 12:27:42.130986  4005 rpcz_store.cc:276] 0709 12:27:40.946688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.951083 (+  4395us) service_pool.cc:224] Handling call
0709 12:27:41.174892 (+223809us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b58001b3f98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056fb0fc0 00007fe056f9b929 00007fe056f9b3d2 00007fe050512bd4
0709 12:27:42.028874 (+853982us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b58001b3f98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2e9c 00007fe04eeb2a5b 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056fb0fc0 00007fe056f9b929 00007fe056f9b3d2 00007fe050512bd4
0709 12:27:42.122260 (+ 93386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:42.128691 (+  6431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:42.130161 (+  1470us) spinlock_profiling.cc:243] Waited 90.5 ms on lock 0x7b54000c4750. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:42.130361 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221547904}
I20260709 12:27:42.146723  3855 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:42.154163  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.117100  3752 catalog_manager.cc:5697] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:42.153091  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:42.142234  5623 consensus_queue.cc:1059] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:27:42.162686  5623 raft_consensus.cc:3055] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:42.163190  5623 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:42.167143  3851 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:27:42.160120  5853 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.170892  5853 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.174213  5674 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:42.174975  3970 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:42.175657  5674 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.176523  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.176685  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:42.177230  3850 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:27:42.178109  5761 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:42.178220  5813 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:42.154261  3971 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:42.182865  5855 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:42.183358  5855 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:42.183885  5855 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:42.186100  4566 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:42.186889  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:42.187806  3930 raft_consensus.cc:3055] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:42.188197  3930 raft_consensus.cc:740] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:42.187961  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:42.189746  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:42.173367  3752 catalog_manager.cc:5697] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:42.191105  3925 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:42.192451  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.108847  3753 rpcz_store.cc:276] 0709 12:27:40.249717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.249987 (+   270us) service_pool.cc:224] Handling call
0709 12:27:40.569341 (+319354us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b5400010810. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb3640 00007fe057d8a846 00007fe057e9490e 00007fe0563552a4 00007fe056355232 00007fe056355161 00007fe0563550dc 00007fe056354392 00007fe05031248c 00007fe0503118c6
0709 12:27:42.094859 (+1525518us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:40.723366 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:40.724234 (+   868us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:40.724283 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:27:40.724310 (+    27us) tablet.cc:662] Decoding operations
0709 12:27:40.725067 (+   757us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:40.730172 (+  5105us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:40.730210 (+    38us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:27:40.781746 (+ 51536us) tablet.cc:701] Row locks acquired
0709 12:27:40.781772 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:27:40.782007 (+   235us) write_op.cc:270] Start()
0709 12:27:40.782170 (+   163us) write_op.cc:276] Timestamp: P: 1783600060781951 usec, L: 0
0709 12:27:40.782206 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:27:40.783084 (+   878us) log.cc:844] Serialized 1794 byte log entry
0709 12:27:40.979191 (+196107us) op_driver.cc:464] REPLICATION: finished
0709 12:27:41.187175 (+207984us) write_op.cc:301] APPLY: starting
0709 12:27:41.190441 (+  3266us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:41.225310 (+ 34869us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:41.229839 (+  4529us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:41.272717 (+ 42878us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:41.272955 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:27:41.273026 (+    71us) write_op.cc:312] APPLY: finished
0709 12:27:41.317663 (+ 44637us) log.cc:844] Serialized 41 byte log entry
0709 12:27:41.317868 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:41.318034 (+   166us) write_op.cc:454] Released schema lock
0709 12:27:41.318103 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:41.318487 (+   384us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:41.318519 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2885,"reported_tablets":6,"spinlock_wait_cycles":7126144,"child_traces":[["op",{"apply.queue_time_us":189659,"apply.run_cpu_time_us":3822,"apply.run_wall_time_us":134914,"num_ops":4,"prepare.queue_time_us":37140,"prepare.run_cpu_time_us":37995,"prepare.run_wall_time_us":160577,"raft.queue_time_us":61430,"raft.run_cpu_time_us":19145,"raft.run_wall_time_us":151771,"replication_time_us":196802,"thread_start_us":307586,"threads_started":4,"wal-append.queue_time_us":132531}]]}
I20260709 12:27:42.194761  5623 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:42.196040  3822 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:42.196751  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:27:42.197173  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 46748.9us
I20260709 12:27:42.197821  5827 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:42.197919  5791 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:42.198383  5674 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:42.217490  5827 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:42.218024  5827 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:42.218201  5581 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:42.189213  3930 consensus_queue.cc:260] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:42.220185  3930 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:42.199174  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.224606  5791 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:42.224675  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:42.229276  4572 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:27:42.202967  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:42.201124  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:42.229736  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:42.230420  3999 raft_consensus.cc:2410] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:42.230360  3851 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:42.230618  5853 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:42.230793  5831 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:42.203568  4570 raft_consensus.cc:1240] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:42.224815  5738 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:42.231985  5674 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:42.232579  5738 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.200129  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:42.235719  5831 consensus_queue.cc:1059] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:42.237461  5738 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:42.238173  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.208057  3970 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:42.239205  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.239672  5857 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:42.239923  3928 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:42.240088  3970 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:42.241261  5764 raft_consensus.cc:3055] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:42.241683  5764 raft_consensus.cc:740] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:42.243220  5857 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:42.242820  5764 consensus_queue.cc:260] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:42.243544  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.244302  3932 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:42.244318  5764 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:42.247049  3822 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:42.248016  5833 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:42.249221  5827 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.241549  3970 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:42.252875  3930 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:42.261263  4003 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:42.262123  3928 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:27:42.262563  3928 pending_rounds.cc:85] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 5
I20260709 12:27:42.262830  3928 pending_rounds.cc:107] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.6
I20260709 12:27:42.263242  3928 raft_consensus.cc:2917] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Aborting config change with OpId 4.6: Aborted: Op aborted by new leader
I20260709 12:27:42.263954  3928 raft_consensus.cc:2889] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:42.265345  5738 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:42.288980  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:42.283959  5761 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:42.266129  5738 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.301476  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:42.300134  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:42.306206  3822 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:42.308787  5727 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:42.308943  5674 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:42.287714  5853 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:42.318068  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.303097  5791 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.320329  5833 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:42.327386  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:42.325309  3897 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:42.309461  5727 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.332747  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.334314  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:42.334441  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:42.335414  3822 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:42.337083  3822 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:42.338152  5867 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:42.309624  5674 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.345358  5693 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:42.369657  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:42.351444  5853 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.347635  5791 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:42.378100  3822 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:42.381084  3821 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:27:42.386024  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 144586us
I20260709 12:27:42.393595  5808 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:42.393939  5582 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:42.394510  5582 raft_consensus.cc:697] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:42.402978  5690 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:42.404421  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.392206  5827 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:42.408552  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 47050.8us
I20260709 12:27:42.411217  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:42.414134  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:42.418746  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 102158us
I20260709 12:27:42.421182  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.428988  5802 consensus_queue.cc:1059] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:27:42.431082  5736 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.430318  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:42.435102  5582 consensus_queue.cc:237] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:42.439543  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:42.441179  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.451105  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.451897  3852 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
W20260709 12:27:42.453256  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.442629  5761 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:42.466849  5738 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:42.442878  5853 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:42.468411  5791 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:42.468997  5876 log.cc:927] Time spent T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.075s	user 0.004s	sys 0.000s
W20260709 12:27:42.466136  5871 log.cc:927] Time spent T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:27:42.445739  5736 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.456578  3895 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:27:42.548837  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 92330.2us
W20260709 12:27:42.504276  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 89074.5us
I20260709 12:27:42.466970  5761 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:42.470667  5727 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:42.510119  3969 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:27:42.553892  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 113011us
I20260709 12:27:42.544281  5644 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:27:42.561077  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 113355us
I20260709 12:27:42.566329  5857 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:42.566939  5857 raft_consensus.cc:697] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:42.567951  5857 consensus_queue.cc:237] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:42.561940  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 138164us
I20260709 12:27:42.578754  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:42.579828  5831 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:42.580235  3822 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:42.581729  5623 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:42.581845  5581 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:42.582605  5690 consensus_queue.cc:1059] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:42.580243  5831 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:42.584481  5831 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:42.551620  5813 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:42.589725  5813 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:42.589833  5674 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:42.591858  5813 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:42.594810  5644 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.553578  5853 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:42.614404  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:42.616482  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 58530.8us
W20260709 12:27:42.597061  5878 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:27:42.618377  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:42.621165  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 61032.2us
I20260709 12:27:42.618422  5582 consensus_queue.cc:1059] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:27:42.612264  5853 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.615988  5780 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:42.633662  3822 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:42.628540  5808 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:42.597666  5761 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.642741  5808 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.660707  5808 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:42.661214  5790 raft_consensus.cc:3055] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:42.661651  5790 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:42.662665  5790 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.666935  5867 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:42.666779  5682 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:42.668192  5646 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:42.668251  5644 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:42.669003  5644 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:42.668913  5646 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.671424  5646 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:42.637495  5853 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:42.671859  5581 raft_consensus.cc:3055] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:42.699112  5581 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:42.700232  5581 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.703985  3969 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:42.701747  5581 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:42.710767  5813 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:27:42.710988  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 97299.2us
I20260709 12:27:42.712210  3822 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:42.713215  5678 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:42.694082  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 45567.1us
I20260709 12:27:42.721822  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:42.697453  5736 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:42.724825  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 106713us
I20260709 12:27:42.669682  5644 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.735325  5791 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.741840  5791 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.742144  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.742236  5799 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:42.742986  3851 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 3: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:42.743045  5799 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:42.744196  5791 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:42.747601  5644 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:42.686064  5855 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.745573  5799 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:42.755309  3997 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:42.756662  5654 raft_consensus.cc:3055] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:42.758052  5761 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:42.685328  5780 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.763507  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.779008  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.765643  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.762504  5853 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:42.766997  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:42.767573  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.768029  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:42.768735  5831 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.733650  5790 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:42.787358  5780 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:42.790454  5678 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:42.779656  5654 raft_consensus.cc:740] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:42.792706  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:42.795116  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.793462  5654 consensus_queue.cc:260] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.798123  5654 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:42.799759  5831 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:42.800340  3852 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:42.770376  3969 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:42.770577  3970 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:42.771366  5855 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:42.772447  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:42.774360  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:27:42.782439  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 51224.5us
W20260709 12:27:42.783246  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 51164.9us
I20260709 12:27:42.816985  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.819834  5813 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:42.820870  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 50415.2us
I20260709 12:27:42.820950  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.821767  3924 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:42.825269  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.827620  3857 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:42.829195  5855 consensus_queue.cc:1059] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:42.830271  5855 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:42.831212  5855 raft_consensus.cc:3055] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:42.831552  5855 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:42.832432  5855 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:42.834684  3970 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:42.835572  5887 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:42.835934  5887 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:42.836267  5887 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:42.837323  5813 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:42.837633  3895 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:42.839277  5682 raft_consensus.cc:993] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:42.840447  5682 raft_consensus.cc:1081] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:27:42.844544  5887 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.847749  5887 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:42.847563  5738 consensus_queue.cc:1059] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:42.852528  5790 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:42.853032  5790 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.853411  5790 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:42.852562  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:42.853332  5736 raft_consensus.cc:3055] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:42.856176  5736 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:42.857400  5736 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.858964  5736 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:42.863605  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.865800  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:27:42.869612  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 99320.6us
I20260709 12:27:42.873147  3926 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:27:42.875118  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:42.874948  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.885251  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:42.890203  3932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:27:42.891026  3932 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:42.891435  3932 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:42.891330  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:42.892568  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:42.895041  5892 log.cc:927] Time spent T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:27:42.890141  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:42.900310  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:42.885565  5855 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:42.918238  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:27:42.918704  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.906486  5857 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:42.923297  5682 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:42.924221  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.924397  5853 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:42.927022  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:42.927606  3852 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:42.928507  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:42.929872  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:42.908859  5738 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:42.934212  5738 raft_consensus.cc:697] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:42.935250  5738 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.937218  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:42.937932  4574 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:42.938664  4570 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:42.943406  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.944975  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:42.947322  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:42.947450  3897 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:42.954571  3932 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:42.959062  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:42.959419  3932 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:42.959671  3857 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:42.965989  5734 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:42.967085  5734 raft_consensus.cc:3055] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:42.967434  5734 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:42.945781  4568 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:42.968245  5734 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.969591  5734 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:42.971024  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 57038us
I20260709 12:27:42.916666  5887 consensus_queue.cc:1059] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:27:42.977020  5780 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.977566  5780 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:42.978470  5887 raft_consensus.cc:3055] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:42.978883  5887 raft_consensus.cc:740] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:42.979753  5780 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:42.979682  5887 consensus_queue.cc:260] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:42.983525  3897 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:42.962061  5837 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:42.985124  5853 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:42.985559  5853 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:42.986131  5853 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:42.990975  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:42.991705  3851 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:42.991686  3857 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:43.000859  3852 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:42.997699  3895 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:42.995368  4536 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:43.007746  3895 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:43.009697  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:43.012902  3929 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:43.016708  5646 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:43.014613  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 107970us
I20260709 12:27:43.017122  5646 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:43.013379  5837 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:43.017668  5646 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.017869  5837 raft_consensus.cc:697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:43.019119  5837 consensus_queue.cc:237] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:43.024096  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:43.024261  5790 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.015208  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:43.032169  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:43.033447  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:43.046802  3926 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:43.013806  5791 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:43.054387  5791 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:43.055581  5791 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:43.068753  5790 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:43.069458  5887 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.071732  5853 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.040350  5831 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:27:43.085938  5644 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:43.086304  3897 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.086817  5644 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:43.087749  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 44412us
I20260709 12:27:43.090090  5880 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:43.091185  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.094049  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:43.094844  4001 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:43.096766  5761 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:43.102690  3969 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.110463  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.110989  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:43.111357  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:43.112974  3969 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.077180  5853 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:43.119822  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:43.120611  4002 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.131152  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:43.131853  4001 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:43.132229  4001 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:43.132521  5646 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.118460  5831 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.140750  4003 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:43.142402  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:43.143167  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:43.143661  3852 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.118633  5880 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:43.149333  3897 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.133129  4001 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:43.163086  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.135216  5831 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.150099  5734 consensus_queue.cc:1059] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:27:43.126144  5761 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:43.181667  3857 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 3: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:43.165868  5900 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.183818  5888 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.184366  5890 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:43.186866  5644 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:43.188931  3852 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:43.162575  5902 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.191459  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.178614  5682 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:43.216056  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:43.216857  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:43.240842  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:43.249567  4537 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.222272  5734 raft_consensus.cc:3055] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:43.221997  5888 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:43.222633  5827 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:43.239318  5880 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:43.256704  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 142433us
I20260709 12:27:43.214550  5890 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:43.221832  5682 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.245743  5646 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:43.260269  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.253531  5734 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:43.265664  5738 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:43.279640  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:43.281108  5906 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:27:43.283738  4002 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:43.287079  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:43.263403  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 136288us
I20260709 12:27:43.289072  3851 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:43.289304  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:43.294919  5831 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:43.263345  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:43.299595  3999 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.219771  5900 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.303879  5890 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:43.305107  5682 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:43.305931  4003 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:27:43.306306  4003 pending_rounds.cc:85] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 4
I20260709 12:27:43.306548  4003 pending_rounds.cc:107] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:27:43.306799  4003 raft_consensus.cc:2889] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:43.307231  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:43.308094  4006 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:27:43.309157  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:43.309394  5887 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:43.309989  5887 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.312101  5761 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:43.312263  5887 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:43.313158  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:43.266589  5888 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:43.315939  5888 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:43.317858  5887 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:43.321749  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:43.322353  3853 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.323045  3895 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:43.323928  5915 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.324540  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:43.324951  5853 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:43.277946  5734 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:43.325416  5853 raft_consensus.cc:697] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:43.278869  5827 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.327718  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:43.327100  3969 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.331179  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:43.333930  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:43.335585  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:43.347733  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:43.350703  4570 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:43.351778  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:43.354527  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:43.330837  5761 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.305761  5900 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:43.357587  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:43.385968  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.351300  5827 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.347018  5915 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.389230  5853 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.402956  5808 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:43.406453  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:43.409103  3999 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:43.412652  3853 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
W20260709 12:27:43.415524  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 252514us
I20260709 12:27:43.415867  4536 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:43.416380  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.429832  4006 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:43.432600  3822 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:27:43.433903  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 146862us
I20260709 12:27:43.434451  3897 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:43.436980  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.435060  4537 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.433817  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:43.445996  4005 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 2: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:43.438776  5780 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.441056  5917 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.432807  5646 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:43.450837  3999 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:43.451087  5646 raft_consensus.cc:697] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:43.451859  5827 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:43.452967  5646 consensus_queue.cc:237] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.454640  5682 raft_consensus.cc:1064] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: attempting to promote NON_VOTER f3cab225ecb7488386a1a19239498cfe to VOTER
I20260709 12:27:43.455253  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:43.436502  5654 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:43.456903  5837 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.458138  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:43.458846  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:43.459326  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:43.460346  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:43.483367  4538 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:43.476302  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:43.478279  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:43.470331  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.484939  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:43.474902  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:43.492650  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:43.497642  3970 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.491725  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.501443  5727 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:43.504097  4001 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.506083  5885 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.507643  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:43.496783  5920 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.510972  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:43.512027  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.514040  4005 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:43.482349  5654 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:43.515710  5654 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.519373  3848 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:43.522269  4002 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 2: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:27:43.524127  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 53925.1us
I20260709 12:27:43.527082  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.528477  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:43.530634  3969 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.535619  3970 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.537762  3970 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.525564  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:43.546612  4536 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:43.541572  5857 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.552904  3752 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39516 (request call id 221) took 2595 ms. Trace:
I20260709 12:27:43.555611  5888 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:43.556263  4001 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:43.539803  3970 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.577970  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:43.592752  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 161242us
I20260709 12:27:43.593652  3897 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.596253  3969 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.569262  5736 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:27:43.575403  5901 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.567780  5761 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.575579  5890 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:43.579635  5888 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:43.586226  5915 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:43.592224  5678 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.550365  5682 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.608763  5915 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:43.639189  5915 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.597543  5857 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.600661  5880 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:43.650293  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 56746.3us
I20260709 12:27:43.651188  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.639119  5727 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:43.660334  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 60173.7us
I20260709 12:27:43.662379  5915 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.663187  5917 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:43.666316  5764 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.666875  5764 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:43.669430  5764 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:43.673705  5915 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:27:43.675189  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.675586  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.678645  3970 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.690999  3970 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.686960  3753 catalog_manager.cc:5697] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 3 to 5, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 5 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:43.694392  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 168935us
I20260709 12:27:43.693713  3753 catalog_manager.cc:5697] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 4 to 6, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 6 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:43.695371  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.695986  3753 catalog_manager.cc:5697] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 2 to 3, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 3 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:43.696936  5885 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:43.697026  3822 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:43.698506  5885 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:43.699052  5885 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:43.698302  3753 catalog_manager.cc:5697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:27:43.699540  5885 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:43.695374  5734 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:43.554879  3752 rpcz_store.cc:276] 0709 12:27:40.957770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.957968 (+   198us) service_pool.cc:224] Handling call
0709 12:27:41.412601 (+454633us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400046ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f41090 00007fe051fdff3a 00007fe057d95e9c 00007fe057e9404e 00007fe0563552a4 00007fe056355232 00007fe056355161 00007fe0563550dc 00007fe056354392 00007fe05031248c 00007fe0503118c6
0709 12:27:43.552802 (+2140201us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:42.441535 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:42.598664 (+157129us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:42.598739 (+    75us) write_op.cc:435] Acquired schema lock
0709 12:27:42.598768 (+    29us) tablet.cc:662] Decoding operations
0709 12:27:42.613475 (+ 14707us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:42.629068 (+ 15593us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:42.631168 (+  2100us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:27:42.670790 (+ 39622us) tablet.cc:701] Row locks acquired
0709 12:27:42.670844 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:27:42.671078 (+   234us) write_op.cc:270] Start()
0709 12:27:42.671257 (+   179us) write_op.cc:276] Timestamp: P: 1783600062670977 usec, L: 0
0709 12:27:42.671300 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:27:42.718223 (+ 46923us) log.cc:844] Serialized 1284 byte log entry
0709 12:27:43.045710 (+327487us) op_driver.cc:464] REPLICATION: finished
0709 12:27:43.246755 (+201045us) write_op.cc:301] APPLY: starting
0709 12:27:43.256356 (+  9601us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:43.273823 (+ 17467us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:43.299939 (+ 26116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:43.300476 (+   537us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:43.300763 (+   287us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:27:43.300807 (+    44us) write_op.cc:312] APPLY: finished
0709 12:27:43.301082 (+   275us) log.cc:844] Serialized 35 byte log entry
0709 12:27:43.301263 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:43.301355 (+    92us) write_op.cc:454] Released schema lock
0709 12:27:43.301412 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:43.301798 (+   386us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:43.301827 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":541872,"reported_tablets":6,"spinlock_wait_cycles":319921536,"child_traces":[["op",{"apply.queue_time_us":138614,"apply.run_cpu_time_us":2492,"apply.run_wall_time_us":64078,"num_ops":3,"prepare.queue_time_us":148289,"prepare.run_cpu_time_us":8193,"prepare.run_wall_time_us":306842,"raft.queue_time_us":76911,"raft.run_cpu_time_us":11773,"raft.run_wall_time_us":155406,"replication_time_us":336431,"thread_start_us":173097,"threads_started":4,"wal-append.queue_time_us":12155}]]}
I20260709 12:27:43.706852  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.707569  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:43.709481  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:43.710469  3928 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:43.723672  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:43.692966  5813 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.692529  5890 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:43.745091  3897 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.703004  5901 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.724581  3854 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:43.742494  3739 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4eedd844c09d456ca0b3614490dd1dbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:43.748528  3754 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51798 (request call id 317) took 3248 ms. Trace:
I20260709 12:27:43.749786  4538 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.712881  5581 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:43.750152  3754 rpcz_store.cc:276] 0709 12:27:40.499842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.499993 (+   151us) service_pool.cc:224] Handling call
0709 12:27:43.748324 (+3248331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9479,"reported_tablets":4}
I20260709 12:27:43.753700  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:43.718709  5916 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.692412  5917 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:27:43.760473  4538 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:43.761168  4002 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:27:43.748916  5921 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:43.763852  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:43.753954  5727 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:43.751844  5853 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:43.754087  5790 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:43.743227  5761 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:27:43.759510  5780 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.765424  5827 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:43.795006  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 46159.7us
I20260709 12:27:43.775935  5736 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:43.811739  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 64899.6us
I20260709 12:27:43.769172  5738 consensus_queue.cc:1059] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:27:43.796250  5790 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:43.822991  4537 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:27:43.823939  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 108730us
W20260709 12:27:43.827778  5924 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:43.834383  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:43.770998  5916 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.834884  3854 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:43.835966  3997 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:43.836813  5916 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:43.837692  4536 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:43.838506  5738 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:43.838954  5738 raft_consensus.cc:697] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:43.840237  5727 raft_consensus.cc:3055] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:43.839872  5738 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.840627  5727 raft_consensus.cc:740] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:43.841418  5727 consensus_queue.cc:260] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.842377  5736 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.842527  5727 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.844065  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:43.844707  4570 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.786214  5654 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:43.778613  5921 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:43.854312  5912 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.247s	user 0.004s	sys 0.002s
I20260709 12:27:43.855508  5921 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:43.859318  3925 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
W20260709 12:27:43.864595  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 100857us
I20260709 12:27:43.863164  5678 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 12:27:43.870882  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.883303  3997 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:43.890829  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:43.891789  3928 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.900357  3856 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:43.901994  3856 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:43.903439  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:43.904072  3856 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:43.862483  5790 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:43.913220  3932 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:27:43.906558  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:43.914633  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 86061.4us
I20260709 12:27:43.915341  3850 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:43.906215  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:43.918169  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:43.921041  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:43.898177  5581 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:43.922051  4568 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:43.922232  5581 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:43.913676  5927 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.148s	user 0.001s	sys 0.001s
I20260709 12:27:43.925161  3971 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:43.892480  5736 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:27:43.928396  3895 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:43.929019  5925 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:43.955232  5885 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:43.956089  5925 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:43.956525  5925 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:43.956880  5925 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.929836  5934 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:43.935927  4567 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
W20260709 12:27:43.958401  5892 log.cc:927] Time spent T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 12:27:43.981228  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 56145.1us
W20260709 12:27:43.987160  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 61031.2us
I20260709 12:27:43.980620  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:27:44.007903  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 92384.4us
I20260709 12:27:44.035247  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:44.036082  3998 raft_consensus.cc:2393] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 3: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:44.043572  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:27:44.050387  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 72569.5us
I20260709 12:27:44.050750  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:43.987331  5581 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:44.060860  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:44.062597  3929 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:44.060990  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:44.027447  5813 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:44.062835  4003 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:44.118166  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:44.124202  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 61064us
I20260709 12:27:44.142350  4570 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:44.151075  3897 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:44.152992  5922 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:27:44.156858  4003 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:44.157346  5654 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:44.161401  3856 consensus_queue.cc:237] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:44.064576  5885 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:44.069236  5813 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:44.181852  5911 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:44.158007  5931 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.142s
I20260709 12:27:44.213646  5911 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:44.183943  5813 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:44.183599  5917 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:44.171620  5934 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:44.253306  5951 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.253924  5951 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:44.256052  5951 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:44.214502  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:44.289897  3848 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:44.270696  5654 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.310408  5780 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.311137  5780 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:44.284089  4565 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:44.284751  5853 raft_consensus.cc:3055] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:44.290789  5917 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:44.291193  5880 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:44.322561  5654 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:44.332168  5954 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:27:44.332581  4568 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:44.332705  5917 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:44.323410  5853 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:44.328917  5780 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:44.337255  5925 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:44.267048  5934 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:44.345588  4565 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
W20260709 12:27:44.377732  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 80147.4us
W20260709 12:27:44.378302  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 60628us
I20260709 12:27:44.379073  3822 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:44.382117  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 85263.3us
I20260709 12:27:44.359016  5947 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:44.390424  4003 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:44.404708  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:44.405411  3854 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:44.405901  5908 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.406395  5908 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:44.406919  3997 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:44.408454  5908 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:44.409670  5948 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.410219  5948 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:44.350553  5880 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:44.412252  5941 log.cc:927] Time spent T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.265s	user 0.003s	sys 0.001s
I20260709 12:27:44.385797  5581 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:44.445833  3928 consensus_meta.cc:287] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.003s
I20260709 12:27:44.459174  3928 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:44.388679  5837 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:27:44.472791  5911 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:44.472990  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:44.473603  3850 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:27:44.470041  5808 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:44.475764  5808 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:44.480860  5808 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:44.482067  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:44.445010  5791 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:27:44.482990  4565 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 2: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:44.478091  5880 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:44.490254  5925 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:44.493275  5934 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:44.440822  5947 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:44.462975  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 70694us
I20260709 12:27:44.507674  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:44.510680  3969 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:44.512070  3928 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:44.512910  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:44.515605  3848 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:44.513706  3927 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:44.521862  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:44.522513  3927 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:44.522672  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:44.523408  3930 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:27:44.527058  4574 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 LEARNER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:44.505539  5948 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:44.524753  5887 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:44.548432  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:44.558277  5961 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:27:44.561442  4006 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:27:44.557565  5966 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:44.580680  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:44.581588  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:44.582175  3925 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:27:44.582967  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:44.585268  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:44.585986  3852 raft_consensus.cc:2368] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4.
I20260709 12:27:44.586776  3821 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:44.587764  5939 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:44.588133  5939 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:44.588449  5939 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:44.595608  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:44.598549  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:44.599371  3852 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:44.606531  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:44.607429  3856 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:44.610206  3854 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:44.547801  5887 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:44.537508  5857 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:27:44.615427  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:44.618767  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:44.619714  4002 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 2: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:44.547513  5925 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:27:44.630378  5928 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:44.631171  5928 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:44.637387  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:44.614992  5887 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:44.651418  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:44.646451  5928 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:44.733057  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:44.733539  5944 log.cc:927] Time spent T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.578s	user 0.000s	sys 0.002s
I20260709 12:27:44.621433  5908 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 12:27:44.617974  5813 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:44.769618  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:44.770427  4565 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:27:44.613345  5966 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:44.771375  5837 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:44.772368  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 129414us
I20260709 12:27:44.772557  5966 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:44.774272  5813 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:44.780877  3932 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:44.782655  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:44.791489  5939 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:44.794656  5939 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:44.794699  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:44.795579  3925 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:44.799893  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 262436us
I20260709 12:27:44.802863  5950 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.803457  5950 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:44.807469  3739 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4eedd844c09d456ca0b3614490dd1dbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:44.809420  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 105030us
I20260709 12:27:44.809666  3852 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:44.817610  3925 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:44.827088  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:44.850354  5950 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:44.885598  3895 leader_election.cc:400] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4.
I20260709 12:27:44.886054  3895 leader_election.cc:403] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:44.834565  5920 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:27:44.835521  5917 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:27:44.897871  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:44.903872  3998 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 3: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:44.897670  3895 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:44.907709  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:44.908443  3925 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:27:44.892424  5950 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.912842  3895 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:44.916388  3895 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:44.905725  5971 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:44.917968  4538 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:44.921468  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:44.911700  5961 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:44.924122  5934 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:44.931054  5934 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:44.931492  5934 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:44.932695  5972 log.cc:927] Time spent T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:27:44.926249  5837 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:27:44.924966  5928 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:44.923761  5791 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:44.916947  5950 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:45.019448  5950 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:44.970747  5887 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:45.077014  4000 raft_consensus.cc:2368] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4.
I20260709 12:27:45.079435  4536 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:45.096746  5887 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:45.103988  3857 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:45.121397  3852 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:45.139948  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:45.140645  3850 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:45.140964  5934 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:45.116390  5791 raft_consensus.cc:697] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:45.142153  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:27:45.145344  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 100066us
I20260709 12:27:45.148146  3857 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:45.117604  5736 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:45.148895  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:45.152644  4005 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:45.149379  3822 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:45.153988  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:45.154678  3855 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:45.150660  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:45.156519  3849 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.159243  5926 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:45.159754  5926 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:45.160619  5926 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:45.162014  5986 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:45.162535  5986 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:45.163517  5880 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.164075  5880 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:45.164582  5986 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:45.165220  3849 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:45.167817  5880 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:45.174284  3897 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:45.131206  5928 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:45.176148  5880 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:45.186448  5880 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:45.150990  5964 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:45.187613  5964 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:45.151046  5736 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.195905  5736 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:45.202873  5947 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:45.170751  5791 consensus_queue.cc:237] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:45.219277  5920 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:45.219789  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:45.220431  3926 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:45.220131  5952 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:45.221320  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:45.223080  5885 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:45.226869  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:45.230576  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:45.231312  4003 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:45.221390  5934 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:45.236304  5853 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:45.242107  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 55959.6us
I20260709 12:27:45.241571  5885 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:45.275528  5853 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:45.326917  5964 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:45.319810  5885 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:45.347520  5654 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:45.348637  4574 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:45.301841  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:45.358858  4005 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:45.364727  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:45.365480  4000 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.389180  5964 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:45.389622  5908 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:45.389760  5964 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:45.390304  5908 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:45.392457  5964 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:45.392570  5908 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:45.393245  5908 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:45.393616  3925 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:45.395869  4000 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:45.394191  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:45.398599  3857 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:45.399201  3927 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
W20260709 12:27:45.407747  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 258429us
W20260709 12:27:45.409906  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 151907us
I20260709 12:27:45.425052  3821 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:45.427145  3969 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:45.410795  3970 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:45.434671  3969 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:45.381768  5963 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.435307  3970 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:45.443992  3969 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:45.452551  3853 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:45.424974  5966 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:45.433771  5971 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4.
I20260709 12:27:45.443436  5958 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:45.434386  5827 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:45.443429  5855 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:45.444453  5947 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:45.442684  5887 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:45.445710  5888 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:45.452924  5951 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:45.491750  4570 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:27:45.499542  5947 raft_consensus.cc:697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:45.460500  5950 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:45.501448  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:45.470813  5988 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:45.504962  3932 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:45.479755  5958 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.503618  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:45.507966  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:45.510046  4574 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:27:45.491773  5951 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.458393  5938 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:27:45.447463  5963 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:45.513906  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 59411.4us
I20260709 12:27:45.519675  5952 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:45.520578  5988 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: NON_VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: true } }
I20260709 12:27:45.521550  5951 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:45.494956  5827 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:45.512784  5958 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.496680  5887 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:45.532825  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:45.480178  5855 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:45.470204  5966 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:45.525446  4568 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:45.584070  5808 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:45.531704  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:45.526295  5947 consensus_queue.cc:237] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:45.967530  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:27:45.811648  5999 log.cc:927] Time spent T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 12:27:45.978785  4570 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:45.866755  5988 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:45.806865  5990 log.cc:927] Time spent T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 12:27:45.961805  5991 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:45.980914  5808 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:45.862386  3897 leader_election.cc:400] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4.
I20260709 12:27:45.981717  5991 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:45.983100  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 124883us
I20260709 12:27:45.662199  5934 raft_consensus.cc:476] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 12:27:45.982324  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:45.984982  4574 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:27:45.987910  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:45.814880  5989 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:27:45.990945  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:45.991851  3999 raft_consensus.cc:2410] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:45.959684  6011 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:45.815915  5996 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:27:45.992682  6011 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:45.995258  6011 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:45.995628  5887 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:27:45.583923  5980 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:27:45.664652  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:46.000699  3753 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51804 (request call id 328) took 3123 ms. Trace:
I20260709 12:27:45.880030  5917 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 12:27:45.565097  5952 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.001076  3753 rpcz_store.cc:276] 0709 12:27:42.894049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:42.894300 (+   251us) service_pool.cc:224] Handling call
0709 12:27:46.000634 (+3106334us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:43.825759 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:43.862463 (+ 36704us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:43.862499 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:27:43.862517 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:43.866697 (+  4180us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:43.866796 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:43.866837 (+    41us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:27:43.867346 (+   509us) tablet.cc:701] Row locks acquired
0709 12:27:43.867372 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:27:43.867562 (+   190us) write_op.cc:270] Start()
0709 12:27:43.867749 (+   187us) write_op.cc:276] Timestamp: P: 1783600063867504 usec, L: 0
0709 12:27:43.867789 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:27:43.868652 (+   863us) log.cc:844] Serialized 1729 byte log entry
0709 12:27:44.322884 (+454232us) op_driver.cc:464] REPLICATION: finished
0709 12:27:44.475174 (+152290us) write_op.cc:301] APPLY: starting
0709 12:27:44.475263 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:44.475413 (+   150us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:44.475500 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:44.476144 (+   644us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:44.476321 (+   177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:27:44.476368 (+    47us) write_op.cc:312] APPLY: finished
0709 12:27:44.519625 (+ 43257us) log.cc:844] Serialized 41 byte log entry
0709 12:27:44.519810 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:44.519925 (+   115us) write_op.cc:454] Released schema lock
0709 12:27:44.519977 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:44.520340 (+   363us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:44.520376 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":119431,"apply.run_cpu_time_us":2623,"apply.run_wall_time_us":55933,"num_ops":4,"prepare.queue_time_us":110645,"prepare.run_cpu_time_us":4000,"prepare.run_wall_time_us":43234,"replication_time_us":432791,"spinlock_wait_cycles":3968,"thread_start_us":155178,"threads_started":2}]]}
I20260709 12:27:46.004297  5952 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:45.925417  5958 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:46.006562  5855 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:46.007910  4003 raft_consensus.cc:2368] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4.
W20260709 12:27:46.015523  3822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.080s	sys 0.131s
W20260709 12:27:46.016027  3822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.080s	sys 0.131s
I20260709 12:27:46.016193  4570 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:45.978195  3857 raft_consensus.cc:2393] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 3: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:46.019945  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:46.009793  3755 catalog_manager.cc:5697] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 3, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 3 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:27:45.589756  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:46.021533  3997 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 2: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:46.027160  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:46.027865  3926 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:45.979789  5966 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:46.029928  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:46.028080  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:46.021167  3755 catalog_manager.cc:5697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:46.032603  3755 catalog_manager.cc:5697] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.812691  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:45.810781  5998 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 12:27:46.035231  3854 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:46.038650  3755 catalog_manager.cc:5697] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 3 to 4, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 4 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.575549  5790 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:27:45.662214  5956 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 12:27:45.766744  5736 consensus_meta.cc:287] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
W20260709 12:27:45.866019  5997 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:27:46.042255  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 165308us
I20260709 12:27:46.052578  4537 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:46.053470  5971 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:46.056175  5791 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:46.059896  5734 raft_consensus.cc:3055] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:46.061050  5855 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:45.905658  5963 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:45.867692  5827 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:46.068586  6011 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.069049  5971 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.067350  5790 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.049559  5991 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:45.864326  5970 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:46.068866  5734 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:27:46.128845  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 596065us
I20260709 12:27:46.119036  3929 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:46.089599  5950 raft_consensus.cc:697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:46.089565  5970 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.133201  5908 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.133594  5950 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.133754  5908 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.082216  5922 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:45.928181  5951 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:46.072960  5738 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:46.073067  5947 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:46.092554  3822 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:46.080391  6005 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.084404  5888 raft_consensus.cc:697] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:46.090981  3821 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:46.069319  5736 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.179742  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:46.182545  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:46.186626  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 90403.2us
W20260709 12:27:46.186347  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 95499.6us
I20260709 12:27:46.188287  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:46.190930  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:46.122380  5958 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:46.192196  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:46.194859  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:46.195215  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 59309.7us
I20260709 12:27:46.195827  3970 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:46.196667  3854 raft_consensus.cc:1240] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:46.122738  5966 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:46.203305  4536 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:46.118700  5880 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:46.116678  5963 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:46.127677  5855 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:46.217352  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:46.125795  6003 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:46.210291  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:46.211524  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:46.223287  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:46.223428  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:46.214906  3928 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:46.193871  5948 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:46.086625  6011 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.226034  3855 raft_consensus.cc:2393] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 5: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:46.195837  5831 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:46.235457  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:46.236333  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:46.240640  3854 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:46.214115  5734 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.212437  5970 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:46.263489  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:46.281870  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:46.282721  4003 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:27:46.283929  3897 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:46.284490  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:46.183851  5738 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.267901  4565 raft_consensus.cc:2368] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6.
I20260709 12:27:46.300480  3897 leader_election.cc:400] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4.
I20260709 12:27:46.301462  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:46.304075  3897 leader_election.cc:403] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:46.238005  5908 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:46.304426  4000 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 4: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:46.244215  5855 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:46.198836  5947 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.241047  5880 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.241575  5831 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:46.263979  5971 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:46.178216  5922 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.237212  6003 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:46.279273  5966 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:46.343240  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 140080us
W20260709 12:27:46.305488  5996 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:27:46.299345  6013 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:46.380649  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:46.085211  6004 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:46.382483  6004 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:46.382994  6004 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:46.213765  5992 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:46.376255  5948 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:46.396122  5948 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.314911  5855 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:46.240782  5963 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:46.197978  6005 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.318832  5831 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:46.319432  5791 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:46.339902  5947 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:46.340360  6011 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:46.342410  5880 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:46.339315  5951 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:46.422783  5855 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:46.433676  6028 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:46.435767  6003 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:46.435951  5963 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:46.436416  5988 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:46.437348  4570 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 2: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:46.432636  5934 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.437911  5966 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:46.438090  6005 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:46.429358  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2002) took 1198 ms. Trace:
I20260709 12:27:46.419365  6021 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:46.498988  6021 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.306628  5928 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 12:27:46.309247  5888 consensus_queue.cc:237] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:46.452589  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 253386us
I20260709 12:27:46.451254  5950 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:46.452149  5988 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.591620  5727 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:46.592202  5727 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.592525  5991 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:46.593065  5991 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.537122  5791 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4.
I20260709 12:27:46.476666  5934 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.501868  6021 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:46.447799  6028 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:46.658504  5736 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:46.681283  6026 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:46.839761  5727 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:46.843182  5738 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:46.625546  5950 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.848467  5992 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:46.866102  5988 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:46.866292  6028 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:46.867651  5992 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.875805  5991 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:46.858299  6026 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.884320  5950 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:46.869370  5855 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:46.894289  5992 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:47.135936  6038 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 12:27:47.137737  6026 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:46.852298  6004 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:47.073463  5831 consensus_meta.cc:287] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.631s	user 0.005s	sys 0.005s
I20260709 12:27:47.429936  5831 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:47.472019  5934 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:47.656670  5855 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:47.691483  6004 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:48.114084  6025 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:27:48.154570  5831 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:48.206302  6042 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.003s	sys 0.005s
W20260709 12:27:48.206908  6042 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.003s	sys 0.005s
W20260709 12:27:46.381460  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 178702us
I20260709 12:27:48.470127  3895 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:48.471506  3821 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.247s	user 0.009s	sys 0.023s
W20260709 12:27:48.471936  3821 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.248s	user 0.009s	sys 0.023s
I20260709 12:27:48.471621  6045 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:48.475950  6046 consensus_queue.cc:1059] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:48.476861  6045 raft_consensus.cc:3055] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:48.477254  6045 raft_consensus.cc:740] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:48.478118  6045 consensus_queue.cc:260] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:48.479176  6045 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:48.484684  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:48.488095  6047 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:48.488922  6047 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.491739  6047 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.494454  6047 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:48.495187  6047 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:48.496220  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 2.1157e+06us
I20260709 12:27:48.497493  3822 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:48.497851  6047 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.498826  3822 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:48.500330  5987 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:48.501516  3822 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:48.502352  5987 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:48.502725  5987 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.503073  5987 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:48.503340  6049 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:48.505290  6049 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:48.506382  3822 connection.cc:256] RPC call timeout handler was delayed by -2.6099249359999703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 12:27:48.506880  3822 connection.cc:256] RPC call timeout handler was delayed by -1.6998507409998638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
I20260709 12:27:48.499574  6048 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:48.507251  5799 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:48.507388  6049 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:48.507544  6048 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:48.508189  5947 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:48.508729  5947 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.510089  6048 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:48.510573  6048 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:48.510946  5947 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.511054  6048 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.518671  6032 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:48.518960  6048 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.519330  5790 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.519233  6032 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.520309  5987 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.521291  6032 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.521788  6032 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:48.523460  6032 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:48.524703  4570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 668) took 2314 ms (client timeout 1891 ms). Trace:
I20260709 12:27:48.524789  5831 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.525342  5831 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:48.525175  4570 rpcz_store.cc:269] 0709 12:27:46.209851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.210045 (+   194us) service_pool.cc:224] Handling call
0709 12:27:48.524473 (+2314428us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540052c454. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:48.524607 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488061312}
I20260709 12:27:48.527369  5831 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.528463  5734 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:48.525585  6032 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:48.522987  5987 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.566352  6022 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:48.566707  5831 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:48.566947  6022 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.567276  5831 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.567495  5948 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:48.568137  5948 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.569180  5831 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.569211  6022 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.572026  5831 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:48.572690  6022 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:48.575675  6022 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.573582  5963 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:48.576629  5963 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.578766  5963 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.581175  6022 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.574663  6003 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.581766  6003 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.572546  5831 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.571295  5948 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.774545  5831 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.574038  5987 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:48.776127  5987 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:48.593044  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:48.604549  6051 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:48.778818  6051 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:48.779582  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:48.605242  6052 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:48.780507  6052 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.780974  6051 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:48.610630  6053 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:48.781687  6053 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.613288  6054 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:48.782934  6054 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.783967  6053 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:48.785156  6054 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:48.614440  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:48.786087  3855 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:48.787075  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:48.788194  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:48.788806  3855 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:48.615892  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:48.790562  4570 raft_consensus.cc:2410] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:48.617072  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:48.627323  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:48.791484  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:48.627938  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:48.792048  4570 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:27:48.792263  4569 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:48.793025  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:48.651258  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:48.795421  4572 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:48.795879  3895 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:48.796813  3895 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:27:48.656157  3854 consensus_meta.cc:287] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 2.415s	user 0.010s	sys 0.002s
I20260709 12:27:48.801026  3854 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
W20260709 12:27:48.801543  3854 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1514) took 2566 ms (client timeout 1910 ms). Trace:
W20260709 12:27:48.657493  3822 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.539s (SENT) [suppressed 4 similar messages]
I20260709 12:27:48.802536  5799 raft_consensus.cc:2764] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:27:48.803331  5734 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:48.803761  5734 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:48.804169  5922 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:48.805281  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:48.666914  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2009) took 2451 ms. Trace:
I20260709 12:27:48.809628  3848 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:48.789613  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:48.676266  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:48.681721  6057 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:48.804172  5734 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:48.814175  6057 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:48.817323  4565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 666) took 2825 ms (client timeout 1686 ms). Trace:
I20260709 12:27:48.682749  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 462) took 2521 ms. Trace:
I20260709 12:27:46.497736  4001 rpcz_store.cc:276] 0709 12:27:45.230130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.232753 (+  2623us) service_pool.cc:224] Handling call
0709 12:27:45.234943 (+  2190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:45.319117 (+ 84174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:45.319159 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:45.319734 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 12:27:45.491428 (+171694us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:45.978406 (+486978us) log.cc:844] Serialized 14 byte log entry
0709 12:27:46.298709 (+320303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.298817 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:46.371212 (+ 72395us) raft_consensus.cc:1685] finished
0709 12:27:46.371239 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:46.428114 (+ 56875us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":290463,"prepare.queue_time_us":54243,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":308349,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":22357,"thread_start_us":678142,"threads_started":3,"wal-append.queue_time_us":189988,"wal-append.run_cpu_time_us":9429,"wal-append.run_wall_time_us":1608086}
I20260709 12:27:48.706960  5808 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.725963  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1511) took 2529 ms. Trace:
W20260709 12:27:48.732017  3853 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40038 (request call id 466) took 2352 ms (client timeout 2203 ms). Trace:
W20260709 12:27:48.743396  3896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.362s	user 0.015s	sys 0.077s
W20260709 12:27:48.749325  3897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.443s	user 0.027s	sys 0.015s
I20260709 12:27:48.791955  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:48.643496  6055 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:48.811204  3895 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:27:48.804198  3854 rpcz_store.cc:269] 0709 12:27:46.235447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.236073 (+   626us) service_pool.cc:224] Handling call
0709 12:27:48.801476 (+2565403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:48.812990  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:48.813526  5987 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:48.819995  6052 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:48.835379  4572 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:48.820580  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:48.890580  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 79458.1us
I20260709 12:27:48.889703  3856 rpcz_store.cc:276] 0709 12:27:46.162753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.163470 (+   717us) service_pool.cc:224] Handling call
0709 12:27:46.163874 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:46.344207 (+180333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:46.344251 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:46.344310 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:46.344354 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:48.682434 (+2338080us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400019ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:48.682483 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:48.682653 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414139648}
W20260709 12:27:48.889986  3853 rpcz_store.cc:269] 0709 12:27:46.380140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.380334 (+   194us) service_pool.cc:224] Handling call
0709 12:27:48.731767 (+2351433us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b54000640d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:48.731910 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5402085632}
I20260709 12:27:48.894989  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:48.898871  3854 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:48.892885  3896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.512s	user 0.021s	sys 0.081s
W20260709 12:27:48.895184  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 237716us
I20260709 12:27:48.903349  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:48.896479  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:48.809958  3926 rpcz_store.cc:276] 0709 12:27:46.215571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.215714 (+   143us) service_pool.cc:224] Handling call
0709 12:27:46.216032 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:46.430059 (+214027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:46.430093 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:46.430145 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:46.430180 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:48.666596 (+2236416us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54001635d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:48.666649 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:48.666808 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491768192}
I20260709 12:27:48.893357  6048 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:48.909657  4567 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:27:48.910194  6048 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:48.910313  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:48.910646  6048 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:48.911065  3856 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 3: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:48.912156  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:48.888917  5734 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.891139  3857 rpcz_store.cc:276] 0709 12:27:46.196002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.196125 (+   123us) service_pool.cc:224] Handling call
0709 12:27:46.196358 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:48.724010 (+2527652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:48.724049 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:48.724097 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:48.724132 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:48.725640 (+  1508us) spinlock_profiling.cc:243] Waited 2.53 s on lock 0x7b54002ed954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:48.725685 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:48.725858 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5812553984}
I20260709 12:27:48.916580  3856 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:48.889894  3848 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:27:48.918851  3895 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:27:48.920917  3897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.615s	user 0.027s	sys 0.024s
W20260709 12:27:48.921465  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 2.61505e+06us
I20260709 12:27:48.922304  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:48.907729  3822 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:48.926658  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 467) took 2528 ms. Trace:
I20260709 12:27:48.926919  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:48.927158  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:48.927470  3853 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:48.927075  3857 rpcz_store.cc:276] 0709 12:27:46.398003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:48.925866 (+2527863us) service_pool.cc:224] Handling call
0709 12:27:48.926200 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:48.926360 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:48.926394 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:48.926441 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:48.926469 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:48.926518 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:48.926609 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:48.791947  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:48.946424  3853 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
W20260709 12:27:48.934758  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 2.39815e+06us
I20260709 12:27:48.953804  3897 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:48.894582  5808 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:48.939194  3739 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4eedd844c09d456ca0b3614490dd1dbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:48.958868  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:48.924731  5734 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:48.926007  6022 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:48.926147  6057 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:27:48.817749  4565 rpcz_store.cc:269] 0709 12:27:45.992172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.019652 (+ 27480us) service_pool.cc:224] Handling call
0709 12:27:48.817109 (+2797457us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400488ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:48.817245 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436972928}
W20260709 12:27:49.011268  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 2.47553e+06us
I20260709 12:27:48.930058  6045 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:48.932279  6050 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:49.016623  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 52668.6us
I20260709 12:27:49.002355  3856 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:27:48.956507  6046 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.893826  6055 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:48.959429  5808 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:49.009130  6051 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:49.023259  6050 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:48.968775  5790 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:48.960289  6047 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:48.958387  6049 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:48.978617  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.029922  5808 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:49.015545  5734 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:49.024470  6059 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:49.029462  6046 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.030148  6051 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:49.035447  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:49.046805  6048 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.048831  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.050060  5987 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:49.050511  5987 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:49.036206  6049 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.018643  6045 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:49.050931  5987 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.060199  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:49.060941  3925 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:49.053603  6059 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:48.962188  5963 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:49.046839  6051 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:49.066140  5963 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:49.066648  5963 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:49.040900  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 122158us
I20260709 12:27:49.044476  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:27:49.068835  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 105109us
I20260709 12:27:49.058458  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:49.070617  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:49.074071  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:27:49.076227  3898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.685s	user 0.036s	sys 0.043s
W20260709 12:27:49.076700  3898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.685s	user 0.036s	sys 0.043s
I20260709 12:27:49.077682  6062 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:49.078816  6061 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.081167  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:49.078178  6062 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.081820  3925 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:27:49.086057  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:49.083398  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.084380  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:49.087172  3929 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:49.081426  6061 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.086344  5654 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:49.083822  3854 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:27:49.088536  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:49.060168  4567 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:49.056183  6045 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:49.083892  6059 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:49.042364  5734 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:49.143841  5734 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:49.132462  6061 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.133710  6003 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.043742  6050 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:49.051242  6055 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.054373  6049 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.137959  3929 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:49.163146  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.164728  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.138434  5654 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:49.150717  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.151203  3924 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:49.152282  6032 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:49.171777  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:49.172452  3924 raft_consensus.cc:2368] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:27:49.161509  3930 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:49.173146  3932 raft_consensus.cc:2393] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:49.166514  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:49.086551  6027 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:49.095260  6063 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.178324  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.172600  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:49.087608  4568 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:49.176504  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:49.168335  5922 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.186595  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.215720  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:49.188701  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:49.216459  3930 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:49.191097  6062 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.191224  5654 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:49.170774  6046 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.184525  6063 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.221313  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:49.221809  6048 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.222054  5922 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.162988  5963 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.181869  6027 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.237576  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:49.209129  6051 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.253695  5987 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.258893  6054 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:49.259557  6012 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:27:49.260111  4538 connection.cc:256] RPC call timeout handler was delayed by -1.4208294349996322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
I20260709 12:27:49.260831  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.261584  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.280244  3924 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:49.281260  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.281916  3924 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:49.170782  6052 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:49.263048  3822 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:49.215229  3932 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:49.263653  3929 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:49.285856  5963 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.205350  5808 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:49.269840  6063 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.267663  5948 raft_consensus.cc:2955] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:49.288211  5808 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:49.288856  3926 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:49.289816  6052 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.292104  6052 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:49.274866  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 159262us
I20260709 12:27:49.277459  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:49.292636  6052 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:49.292698  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.294732  4005 raft_consensus.cc:1240] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:49.293298  3851 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 2: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:49.294814  5922 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:49.293429  3927 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
W20260709 12:27:49.310720  4538 connection.cc:256] RPC call timeout handler was delayed by -1.2462294349998047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
W20260709 12:27:49.311281  4538 connection.cc:256] RPC call timeout handler was delayed by -1.2327294349997828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
I20260709 12:27:49.310775  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.309424  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:49.314181  4568 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.314630  6027 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.293592  3895 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:49.329036  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:27:49.329726  4537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.487s	user 0.021s	sys 0.031s
I20260709 12:27:49.335940  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:49.337522  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.341464  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.342267  4574 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:49.345223  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.356663  3854 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:27:49.357971  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 49865.5us
I20260709 12:27:49.322897  6060 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:49.362368  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:49.362968  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:49.363087  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.365936  4572 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
W20260709 12:27:49.368400  4537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.526s	user 0.022s	sys 0.031s
I20260709 12:27:49.370518  3850 raft_consensus.cc:2410] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:27:49.371250  4537 connection.cc:256] RPC call timeout handler was delayed by -1.415953387999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
I20260709 12:27:49.371301  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:49.371763  4537 connection.cc:256] RPC call timeout handler was delayed by -1.2815111369995975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 12:27:49.372079  4537 connection.cc:256] RPC call timeout handler was delayed by -1.0404643869997017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
I20260709 12:27:49.372208  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:49.372864  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.376031  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.377928  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 1969) took 3152 ms. Trace:
I20260709 12:27:49.378405  4005 rpcz_store.cc:276] 0709 12:27:46.211792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.211909 (+   117us) service_pool.cc:224] Handling call
0709 12:27:46.212169 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:49.308248 (+3096079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:49.364263 (+ 56015us) spinlock_profiling.cc:243] Waited 3.08 s on lock 0x7b540021a7d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:49.364483 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7088817536}
I20260709 12:27:49.383963  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.384792  3932 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:49.298036  6012 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.388439  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.279381  6054 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:49.387863  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 198447us
I20260709 12:27:49.358417  5963 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:49.392208  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:49.394008  4569 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.293285  6052 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.394258  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.357787  5987 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.324522  5734 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:49.393254  4537 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:49.395037  3821 leader_election.cc:400] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:27:49.392694  4536 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:49.442137  3821 leader_election.cc:403] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:27:49.395809  3930 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:49.444972  6068 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:49.446674  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:49.446336  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 53146.9us
I20260709 12:27:49.453315  4572 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
W20260709 12:27:49.453796  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 62098.7us
I20260709 12:27:49.454838  3821 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:49.396698  3927 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:27:49.440111  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.457211  4573 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:27:49.457315  3927 pending_rounds.cc:85] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 5
I20260709 12:27:49.457741  3927 pending_rounds.cc:107] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:27:49.458062  3927 raft_consensus.cc:2889] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:49.403035  3929 raft_consensus.cc:1240] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:49.446962  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.459841  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.399734  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.460949  3924 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:49.445654  6068 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:49.467358  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:49.466418  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.468426  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.470499  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:49.468158  3932 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:49.387264  6060 raft_consensus.cc:697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:49.393837  5963 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:49.448746  5831 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:49.474473  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:49.392324  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.476173  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.439625  6057 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.488723  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.395874  6050 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:49.463564  5790 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:49.388010  5799 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 12:27:49.455811  5808 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:27:49.508723  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 102594us
I20260709 12:27:49.512996  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:49.513029  3932 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
W20260709 12:27:49.551189  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 158554us
I20260709 12:27:49.556140  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.518318  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.474097  6032 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:27:49.509434  5654 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:49.506275  5963 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:49.597249  4574 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:49.507170  6063 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:49.514072  6060 consensus_queue.cc:237] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:49.594208  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 81351.1us
W20260709 12:27:49.597344  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 74446us
I20260709 12:27:49.607569  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.524027  5734 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:49.520290  5922 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:49.599570  6066 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 12:27:49.528473  4568 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:49.539239  6057 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:49.722939  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 113118us
I20260709 12:27:49.512368  5831 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:49.738870  3897 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:49.600286  5808 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.523805  5790 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.595557  6062 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:27:49.584796  4595 debug-util.cc:398] Leaking SignalData structure 0x7b08002bdac0 after lost signal to thread 2676
I20260709 12:27:49.769802  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.740599  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.521463  4566 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:49.742213  3897 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:49.607208  6051 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.774152  3897 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:49.744704  6061 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:49.761101  3930 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:49.770905  4571 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:27:49.541507  6050 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:49.758754  6070 log.cc:927] Time spent T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:27:49.734018  5922 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:49.797960  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:49.798164  5922 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:49.739739  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:49.757083  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.759238  6062 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:49.802929  6062 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:49.769362  4595 debug-util.cc:398] Leaking SignalData structure 0x7b08002bdb40 after lost signal to thread 2679
W20260709 12:27:49.804356  4595 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd440 after lost signal to thread 3789
W20260709 12:27:49.805615  4595 debug-util.cc:398] Leaking SignalData structure 0x7b08003b4400 after lost signal to thread 3881
I20260709 12:27:49.807422  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:49.807901  4595 debug-util.cc:398] Leaking SignalData structure 0x7b08003b44e0 after lost signal to thread 3882
I20260709 12:27:49.808058  3856 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:27:49.808506  5963 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.811535  5922 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.608489  6068 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.775934  6049 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:49.779023  5808 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.779979  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:49.826577  3848 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:27:49.780531  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.782753  5831 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:49.787364  5790 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.788589  6057 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:49.788729  6054 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:49.780578  6047 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:49.773666  5948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:42036 (request call id 82) took 5852 ms. Trace:
I20260709 12:27:49.794454  6012 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:49.795965  4569 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
W20260709 12:27:49.812382  4595 debug-util.cc:398] Leaking SignalData structure 0x7b0800390f20 after lost signal to thread 3956
I20260709 12:27:49.834617  3856 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:49.831614  5948 rpcz_store.cc:276] 0709 12:27:43.915345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.915639 (+   294us) service_pool.cc:224] Handling call
0709 12:27:44.180005 (+264366us) log.cc:844] Serialized 487 byte log entry
0709 12:27:45.058864 (+878859us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b540028a620. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f50142 00007fe051f30eaa 00007fe051f37d53 00007fe051f37cd9 00007fe051f37c69 00007fe051f37c31 00007fe051f36dfd 0000000000388634 0000000000388479 00007fe04eeea475
0709 12:27:45.199557 (+140693us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b540028a620. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f57b26 00007fe051f5149a 00007fe051f50714 00007fe051f30eaa 00007fe051f37d53 00007fe051f37cd9 00007fe051f37c69 00007fe051f37c31 00007fe051f36dfd 0000000000388634
0709 12:27:49.767786 (+4568229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28513,"raft.queue_time_us":16583,"raft.run_cpu_time_us":8240,"raft.run_wall_time_us":1505533,"spinlock_wait_cycles":12516096,"thread_start_us":79609,"threads_started":1,"wal-append.queue_time_us":178341,"wal-append.run_cpu_time_us":1826,"wal-append.run_wall_time_us":1065679}
W20260709 12:27:49.837002  4595 debug-util.cc:398] Leaking SignalData structure 0x7b080039a440 after lost signal to thread 3957
I20260709 12:27:49.825152  6049 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:49.837621  3739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eadf6ff4956f47ff8a85f77d02584a0d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:49.838089  6049 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:49.838158  4595 debug-util.cc:398] Leaking SignalData structure 0x7b0800224ce0 after lost signal to thread 4030
W20260709 12:27:49.838526  4595 debug-util.cc:398] Leaking SignalData structure 0x7b080035b6a0 after lost signal to thread 4031
W20260709 12:27:49.776661  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 321904us
I20260709 12:27:49.829200  4536 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:49.820745  6050 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:49.843235  4595 debug-util.cc:398] Leaking SignalData structure 0x7b0800116ec0 after lost signal to thread 4598
W20260709 12:27:49.843633  4595 debug-util.cc:398] Leaking SignalData structure 0x7b080024b480 after lost signal to thread 4599
W20260709 12:27:49.844112  4595 debug-util.cc:398] Leaking SignalData structure 0x7b080037e5a0 after lost signal to thread 5855
W20260709 12:27:49.844424  4595 debug-util.cc:398] Leaking SignalData structure 0x7b0800299fa0 after lost signal to thread 5887
I20260709 12:27:49.850447  5901 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.850554  5922 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:49.854264  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:49.857406  3924 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:49.852721  4595 debug-util.cc:398] Leaking SignalData structure 0x7b0800105680 after lost signal to thread 5901
I20260709 12:27:49.858884  3821 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:49.851001  5901 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:49.861450  6052 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:49.853482  6012 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:49.873725  6062 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:49.874974  4595 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7f60 after lost signal to thread 5911
I20260709 12:27:49.883401  3821 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:49.884814  5831 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:49.885262  5831 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:49.885638  5831 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:49.885825  5950 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.886312  5950 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:49.888908  5950 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:49.895017  5901 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:49.859483  5963 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.893354  6075 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:49.901716  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.902002  6057 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:49.902941  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.903389  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.903564  3923 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:49.903815  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.904157  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.904407  3930 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:49.904585  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.904734  3925 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:49.905432  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:49.899325  6075 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:49.908124  6075 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:49.914878  3932 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 3: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:49.913430  3753 catalog_manager.cc:5697] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 2 to 5, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 5 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:49.915535  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:49.916776  3821 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:49.879909  4565 raft_consensus.cc:2955] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:49.896404  6052 consensus_queue.cc:1059] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:27:49.918828  6052 raft_consensus.cc:3055] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:49.883342  6012 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:49.919154  6052 raft_consensus.cc:740] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:49.919348  6012 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:49.897208  5947 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:49.909832  3755 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51802 (request call id 332) took 6133 ms. Trace:
I20260709 12:27:49.916340  3753 catalog_manager.cc:5697] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 1 to 2, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 2 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:27:49.927693  3753 catalog_manager.cc:5697] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 2 to 3, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 3 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:49.929479  3753 catalog_manager.cc:5697] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 2 to 4, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 4 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:49.931481  3753 catalog_manager.cc:5697] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 1 to 4, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 4 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:49.934906  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:49.941331  4537 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:49.942888  3753 catalog_manager.cc:5697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 3 to 4, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 4 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:27:49.936758  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:49.944907  3753 catalog_manager.cc:5697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:49.946774  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:49.920193  5963 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:49.947630  5963 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:49.948015  5963 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:49.952749  6073 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:49.952836  4537 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:49.953271  6073 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:49.924846  6057 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:49.924517  5947 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:49.953835  4537 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:49.940100  5948 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:27:49.955528  5922 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:49.968392  5922 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:49.968739  5922 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:49.955722  6027 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:49.970239  5928 consensus_queue.cc:1059] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:49.956933  6052 consensus_queue.cc:260] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:49.971360  3969 connection.cc:256] RPC call timeout handler was delayed by -1.3054806089999147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
I20260709 12:27:49.971769  5928 raft_consensus.cc:3055] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:49.972157  5928 raft_consensus.cc:740] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:49.961843  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:49.972842  3969 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:49.973592  4537 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:49.954295  6057 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:49.974606  6057 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:49.974025  5916 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:49.970453  6027 raft_consensus.cc:697] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:49.978837  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:27:49.978931  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 44095.8us
I20260709 12:27:49.973163  5928 consensus_queue.cc:260] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.976642  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:49.958035  5947 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:49.981455  6059 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:49.981606  6069 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:49.946607  3753 catalog_manager.cc:5697] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:49.962600  4595 debug-util.cc:398] Leaking SignalData structure 0x7b08003a42e0 after lost signal to thread 5958
I20260709 12:27:49.986472  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:49.976694  6049 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:49.988893  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:49.995267  4571 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:49.991734  6020 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:49.983279  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.985183  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:49.997342  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:49.997589  4572 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:49.985406  3897 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:49.972046  6052 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:49.953851  6073 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:49.962040  5920 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:49.920202  3755 rpcz_store.cc:276] 0709 12:27:43.776275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.776540 (+   265us) service_pool.cc:224] Handling call
0709 12:27:49.909737 (+6133197us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:46.316066 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:46.390677 (+ 74611us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:46.390727 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:27:46.390754 (+    27us) tablet.cc:662] Decoding operations
0709 12:27:46.391516 (+   762us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:46.391622 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:46.391663 (+    41us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:27:46.392171 (+   508us) tablet.cc:701] Row locks acquired
0709 12:27:46.392197 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:27:46.392388 (+   191us) write_op.cc:270] Start()
0709 12:27:46.392528 (+   140us) write_op.cc:276] Timestamp: P: 1783600066392330 usec, L: 0
0709 12:27:46.392557 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:27:46.393494 (+   937us) log.cc:844] Serialized 1677 byte log entry
0709 12:27:47.499832 (+1106338us) op_driver.cc:464] REPLICATION: finished
0709 12:27:48.165627 (+665795us) write_op.cc:301] APPLY: starting
0709 12:27:48.165744 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:48.165998 (+   254us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:48.166165 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:48.166915 (+   750us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:48.167212 (+   297us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:27:48.167290 (+    78us) write_op.cc:312] APPLY: finished
0709 12:27:48.191378 (+ 24088us) log.cc:844] Serialized 41 byte log entry
0709 12:27:48.414223 (+222845us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:48.414335 (+   112us) write_op.cc:454] Released schema lock
0709 12:27:48.414386 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:48.414884 (+   498us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:48.414910 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":782869,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":665415,"apply.run_cpu_time_us":6061,"apply.run_wall_time_us":249237,"num_ops":4,"prepare.queue_time_us":169780,"prepare.run_cpu_time_us":19039,"prepare.run_wall_time_us":543862,"raft.queue_time_us":600704,"raft.run_cpu_time_us":9615,"raft.run_wall_time_us":708118,"replication_time_us":1106985,"thread_start_us":1306973,"threads_started":5,"wal-append.queue_time_us":703636,"wal-append.run_cpu_time_us":11407,"wal-append.run_wall_time_us":2208246}]]}
I20260709 12:27:49.982074  5938 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:49.978034  6011 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:49.962993  6062 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:49.978148  5887 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:49.978325  5855 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:27:49.999414  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 73081.7us
I20260709 12:27:50.006148  5974 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:49.981827  6030 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:49.982378  6059 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:49.996459  6069 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:50.010313  3928 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:49.963210  5831 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.001657  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:50.016248  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:49.991336  5948 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:49.994674  6005 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:50.011412  5964 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:49.996743  5888 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:50.000573  5950 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.016204  3926 raft_consensus.cc:2955] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:50.021127  6002 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:50.022321  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:50.003459  5901 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:50.004087  5971 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:49.981930  5916 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.006394  5857 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:50.072849  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:50.073087  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 1.05792e+06us
I20260709 12:27:50.072880  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:50.103092  3930 raft_consensus.cc:2410] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:27:50.072707  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 95886.5us
I20260709 12:27:50.054757  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:50.008116  5900 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:50.008613  5938 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:50.010294  6011 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:50.014206  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:50.080323  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:50.012898  5682 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:50.029219  6059 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:50.031061  6069 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:50.080981  5974 raft_consensus.cc:697] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:27:50.085161  6083 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:27:50.080335  6005 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:50.132990  6005 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:50.083531  5948 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:50.134666  5974 consensus_queue.cc:237] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:50.012562  5963 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:50.075982  5853 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:27:50.135490  6081 log.cc:927] Time spent T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:27:50.135757  5853 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:50.136227  5853 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:50.098505  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:50.137516  3853 raft_consensus.cc:2393] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 3: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:50.111692  3848 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:50.086737  5964 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.096583  5950 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.112110  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:50.114154  6023 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:50.102299  3971 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:50.118338  6011 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:50.134588  5948 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.073015  6027 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.122287  5682 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.217152  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.145174  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.028955  6020 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.094581  5888 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:50.036083  3897 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:50.119197  5938 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:50.098959  5901 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:50.183403  3853 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:50.019182  5928 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:50.238540  3855 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:50.238535  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:50.033751  6030 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.141729  6062 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:50.127882  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 627) took 1064 ms. Trace:
I20260709 12:27:50.262042  4565 rpcz_store.cc:276] 0709 12:27:49.058783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:49.079220 (+ 20437us) service_pool.cc:224] Handling call
0709 12:27:49.879373 (+800153us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b58000d5c98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2eee 000000000036eb39 00007fe056f261e0 00007fe056fef0c4 00007fe056fef131 00007fe056fb0fc0 00007fe056f9b929 00007fe056f9b3d2 00007fe050512bd4
0709 12:27:49.879542 (+   169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:49.879786 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:49.973472 (+ 93686us) log.cc:844] Serialized 14 byte log entry
0709 12:27:50.084354 (+110882us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.086933 (+  2579us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:50.095896 (+  8963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.110286 (+ 14390us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.118348 (+  8062us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6825,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":35333888,"thread_start_us":96444,"threads_started":1,"wal-append.queue_time_us":46758}
I20260709 12:27:50.114734  5857 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:50.239919  6031 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:50.114856  6002 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:50.286579  4572 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:50.236240  4003 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:50.118134  5900 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.242163  5971 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:50.214241  6021 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:50.255570  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.018913  5887 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.018577  5855 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:50.281946  4000 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
W20260709 12:27:50.283365  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 269223us
W20260709 12:27:50.241637  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 205703us
I20260709 12:27:50.141413  6023 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.315186  3897 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:50.288987  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 186762us
I20260709 12:27:50.292392  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.293578  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.319171  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.300215  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:50.301028  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 214107us
I20260709 12:27:50.305989  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.310075  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:50.317823  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.322626  4005 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:50.323457  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.320310  4004 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:50.323539  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:50.324656  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.327630  5887 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.328773  6048 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:50.329373  5855 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:50.330610  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.331763  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.332326  3997 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:50.333135  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.299968  5963 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:50.330526  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.324049  4005 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:50.334944  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.341527  4003 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:50.342327  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.333676  3997 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:50.336499  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.344054  4004 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:27:50.343997  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.328454  5922 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.348438  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.348845  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.349407  4005 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:50.349572  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.349471  3897 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:50.350471  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.351019  4005 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:50.321565  3821 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:50.342912  4003 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:50.309358  5831 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.316625  5682 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.362155  3971 leader_election.cc:400] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6.
I20260709 12:27:50.315874  6021 raft_consensus.cc:697] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:50.368314  3971 leader_election.cc:403] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:50.381091  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.327670  5900 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.335208  5950 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.384429  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.386423  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.388255  3997 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
W20260709 12:27:50.388808  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 67317.8us
I20260709 12:27:50.390218  3928 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:27:50.368516  6047 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:50.367719  5916 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.355192  4001 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:50.418723  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.418991  6012 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.419993  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.420701  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.421087  6012 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:50.421161  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.421785  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.423012  5857 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:50.408131  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.367889  5855 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:50.409803  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.435810  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.436442  3999 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:50.411733  5888 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:50.412609  5964 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.412240  6021 consensus_queue.cc:237] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:50.415021  6075 consensus_meta.cc:287] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.016s
I20260709 12:27:50.417133  6057 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.427587  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.421291  3998 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:50.377668  6020 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:27:50.438074  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 69770.9us
I20260709 12:27:50.391288  6076 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:50.459849  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:50.426113  6047 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:50.446566  3997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "611a21088f764ac6bf8767713d911869"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:27:50.436749  6084 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:50.466879  3997 raft_consensus.cc:606] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:50.436889  4001 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
W20260709 12:27:50.470707  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 87826.2us
W20260709 12:27:50.471617  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 122252us
I20260709 12:27:50.475075  3999 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:50.469528  3854 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:50.463764  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:50.479612  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:50.488628  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.488758  3897 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:50.489303  3999 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:50.491554  5922 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:50.491694  6068 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.492185  6068 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.454514  5900 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:27:50.494515  5900 raft_consensus.cc:3055] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:50.494668  6057 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.494863  5900 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:50.495702  5900 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:50.496800  5900 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:50.448120  5950 consensus_queue.cc:1059] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:27:50.498397  5950 raft_consensus.cc:3055] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:50.498473  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.498787  5950 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:50.499643  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.497354  5853 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.445212  5855 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:50.448393  6005 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.462119  6075 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.468822  6047 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:50.508800  4004 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
W20260709 12:27:50.509846  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.493378  6073 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.469869  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:50.509773  3999 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
W20260709 12:27:50.505548  4571 consensus_meta.cc:287] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.013s
I20260709 12:27:50.489549  6076 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:50.514168  4571 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:50.514963  3856 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:50.515537  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.512884  5971 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:50.517294  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.516618  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.501331  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:50.518553  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.514434  5682 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6.
I20260709 12:27:50.517120  5971 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:50.535516  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:50.536290  3853 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:50.536597  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.519088  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:50.519891  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.521153  6005 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:50.521751  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:50.522158  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:27:50.513695  5901 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:50.523254  6073 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:50.526093  4573 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:50.527987  6023 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.528029  5853 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.530010  3999 raft_consensus.cc:2376] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5. Re-sending same reply.
I20260709 12:27:50.551431  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.552147  3999 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:50.552821  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.528954  4003 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:50.539541  3897 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:50.522336  4569 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:50.555830  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:50.499573  5950 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.542408  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:50.547427  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:50.541854  3852 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:50.562737  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:50.512020  6100 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:50.483232  6084 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:50.554082  6102 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:27:50.561689  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:50.569758  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:50.565420  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.576748  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.577270  3852 raft_consensus.cc:1240] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:50.564738  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:50.555533  4568 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 4: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:50.573554  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:50.536036  6076 raft_consensus.cc:697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:50.571715  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:50.564042  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:50.564388  6060 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:50.574159  6062 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:50.609370  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:50.609582  6062 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.611153  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:50.618073  6045 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:50.619436  4004 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:50.621532  4002 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:27:50.623492  3932 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:50.623857  4571 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 5: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:50.568643  5853 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:50.636963  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.627461  3822 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:50.618630  6045 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:50.622694  5831 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:50.622753  6074 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:50.624584  5950 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:50.647713  3822 leader_election.cc:336] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.539s (SENT)
W20260709 12:27:50.660111  3822 leader_election.cc:336] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.542s (SENT)
I20260709 12:27:50.653281  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.647055  6076 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.655751  6074 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:50.638026  5853 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:50.665972  3997 raft_consensus.cc:2368] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5.
I20260709 12:27:50.638779  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:50.658563  6097 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:50.678702  6062 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.679530  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:50.678570  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.681053  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.682374  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.683326  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:50.685461  6059 consensus_meta.cc:287] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.014s
I20260709 12:27:50.674599  5853 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:50.703413  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:50.707821  3932 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:50.702739  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.712683  3998 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:27:50.725818  6045 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.730188  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:50.730664  6104 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:27:50.731456  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.732005  4565 raft_consensus.cc:2368] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5.
I20260709 12:27:50.732556  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.733141  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:50.734689  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:50.735751  3821 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:50.735925  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:50.658546  5831 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:50.740206  5947 consensus_meta.cc:287] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.758s	user 0.022s	sys 0.003s
I20260709 12:27:50.740697  5947 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.741803  5831 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:50.710697  6059 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.746176  3925 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 4: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:50.747009  6059 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.747542  5938 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.748651  3850 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:50.749205  6057 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:50.726078  5971 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:50.750665  6075 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.751555  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:50.768231  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.769060  3998 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:50.753748  3851 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:50.754971  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:50.733637  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.771811  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:50.771351  3997 raft_consensus.cc:2376] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4. Re-sending same reply.
I20260709 12:27:50.772867  5958 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:50.776662  5799 raft_consensus.cc:3055] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:50.776877  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:50.777105  5799 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:50.767413  6051 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:50.770085  3971 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:50.770119  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:50.771415  6069 consensus_meta.cc:287] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.000s
I20260709 12:27:50.782274  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.786300  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.787302  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.781252  5831 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:50.788468  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.789614  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.790277  3997 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 3: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:27:50.781716  6103 log.cc:927] Time spent T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:27:50.778017  5799 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.792884  5799 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:50.791917  5916 raft_consensus.cc:2955] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 5 to 7, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:50.782017  5855 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:50.798532  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.775935  5853 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:50.800777  3850 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:50.800335  6075 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:50.802871  6075 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:50.805102  6030 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.805409  6075 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:50.778316  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:50.806226  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:50.806824  3852 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:50.809513  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:50.793251  6052 consensus_meta.cc:287] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.783s	user 0.008s	sys 0.015s
I20260709 12:27:50.784866  6031 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:50.818764  3998 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:50.819057  4574 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:50.798800  5831 raft_consensus.cc:697] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:50.796914  6069 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.912918  4570 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:50.881640  3822 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:50.913894  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.922806  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.877766  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:50.900175  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.878799  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:50.819849  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.925907  3997 raft_consensus.cc:2393] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:27:50.913980  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 344246us
I20260709 12:27:50.877847  3999 raft_consensus.cc:2410] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:50.929697  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:50.810314  5928 consensus_meta.cc:287] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.555s	user 0.004s	sys 0.012s
I20260709 12:27:50.934136  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.935087  4003 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:27:50.818552  5974 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.002s	sys 0.031s
I20260709 12:27:50.943495  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.943199  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.951745  4572 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 1. Current term is 2. Ops: []
W20260709 12:27:50.878724  6011 consensus_meta.cc:287] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.696s	user 0.007s	sys 0.004s
I20260709 12:27:50.961429  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.932309  6076 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:50.962518  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.889837  5853 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:50.908587  6049 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.966477  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:50.868606  5947 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:50.907318  6084 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:27:50.962026  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 75625.5us
W20260709 12:27:50.960731  5974 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.006s	sys 0.034s
I20260709 12:27:50.970674  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.974491  4570 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 4: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:50.827584  6064 consensus_queue.cc:1059] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.139s
I20260709 12:27:50.970057  6011 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.982203  5831 consensus_queue.cc:237] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:50.985158  6087 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.698s	user 0.004s	sys 0.001s
I20260709 12:27:50.986415  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:50.840134  6047 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:50.996903  4537 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:50.993474  3998 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:50.994201  4005 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:50.999433  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:50.995214  6089 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.025s	sys 0.043s
I20260709 12:27:51.002200  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.990468  6069 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.007234  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.004455  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:51.004431  6089 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.025s	sys 0.043s
I20260709 12:27:51.010164  6113 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:51.011869  6002 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:51.014278  4566 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:51.025076  6068 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.003896  6105 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:51.026657  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.027576  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:50.994707  5916 consensus_queue.cc:1059] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:27:51.026050  6074 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:51.041862  6116 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:27:50.998955  6084 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:27:51.045439  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.056951  4006 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:51.058877  6011 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:51.034698  6049 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:51.041958  6113 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:51.047835  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 94098.1us
I20260709 12:27:51.050076  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.062040  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.064419  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.068220  6113 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:51.068621  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.068801  6110 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:51.069381  6110 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.071625  6110 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:51.065909  3897 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.073992  3897 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.063230  6064 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:51.078750  6064 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:51.073009  6100 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:51.080896  6064 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.082284  6047 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:51.051671  6105 raft_consensus.cc:697] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:51.083520  6105 consensus_queue.cc:237] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.047092  6002 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:27:51.086583  6002 raft_consensus.cc:3055] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:51.086967  6002 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:51.087803  6002 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.089226  6002 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.089744  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.090427  4000 raft_consensus.cc:2376] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3. Re-sending same reply.
I20260709 12:27:51.090818  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:51.091427  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.091980  3853 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:51.093842  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.094699  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:51.095909  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.096866  3925 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:51.096942  4536 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.098912  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.099045  6052 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:51.115671  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.115383  6102 consensus_queue.cc:1059] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:27:51.100761  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.061838  6049 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:51.117538  6054 consensus_queue.cc:1059] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:51.119153  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.102398  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.109601  3926 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:27:51.099627  3925 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 5: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:51.100826  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.120692  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.118676  6054 raft_consensus.cc:3055] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:51.122216  6054 raft_consensus.cc:740] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:51.122627  5922 raft_consensus.cc:3055] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:51.123021  5922 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:51.123153  6054 consensus_queue.cc:260] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.123865  5922 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.125042  5922 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:51.121688  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.128600  6054 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:51.130862  6047 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:51.133946  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.135896  3897 leader_election.cc:400] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5.
I20260709 12:27:51.136286  3897 leader_election.cc:403] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:27:51.106376  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.145867  3822 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:51.119957  3926 pending_rounds.cc:85] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 2
I20260709 12:27:51.149433  3926 pending_rounds.cc:107] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:27:51.149894  4005 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:51.150424  3926 raft_consensus.cc:2889] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:51.152998  3822 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:51.154606  3897 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.155857  3897 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.093604  6110 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:51.157411  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.161185  3854 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:51.157907  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.097596  6060 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.139756  6064 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:51.163516  6047 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:51.166199  6091 log.cc:927] Time spent T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.799s	user 0.006s	sys 0.000s
I20260709 12:27:51.166682  5938 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:51.167908  6048 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:51.168061  3895 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:51.168392  6048 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:51.168844  6048 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:51.171099  4569 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:27:51.160279  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:51.169811  3895 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:51.173058  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.174662  3822 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:51.160104  6045 raft_consensus.cc:2764] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:27:51.177771  3822 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:51.178977  3897 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.180374  3897 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.182626  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 489) took 1240 ms. Trace:
I20260709 12:27:51.185057  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.186679  4538 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:51.187201  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.159482  6110 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:51.151506  5799 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.183071  3851 rpcz_store.cc:276] 0709 12:27:49.934327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:49.935062 (+   735us) service_pool.cc:224] Handling call
0709 12:27:49.982458 (+ 47396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.771042 (+788584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:51.174684 (+403642us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b54002eed54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:51.174921 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1746171648}
I20260709 12:27:51.188982  3970 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.182370  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:51.188869  5963 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:51.196995  4567 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 3: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:51.197117  6060 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:51.197806  6060 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:51.198272  6060 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.140131  6068 consensus_queue.cc:1059] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:27:51.200834  6059 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:51.201252  6059 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:51.201613  6059 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.159597  5947 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.157344  5831 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:51.158612  6113 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5.
I20260709 12:27:51.203727  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:51.205956  4538 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:51.222312  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 52565.1us
I20260709 12:27:51.181125  5938 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.176903  6049 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.188947  5971 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:51.232211  6023 raft_consensus.cc:3055] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:51.204962  6073 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:51.238075  4538 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.206518  6011 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:51.195356  5948 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:51.202517  5900 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:51.257910  4566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 642) took 1271 ms. Trace:
I20260709 12:27:51.241115  5971 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.204982  6110 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:51.202829  6045 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:51.218389  6057 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:51.271415  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.217314  6075 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:51.245602  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 64251.8us
I20260709 12:27:51.251339  4538 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:51.279677  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.258965  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.259755  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.260637  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.261703  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.239691  6105 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:51.287016  3897 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.233848  6060 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:51.217865  5799 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:51.242434  6055 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.241101  6023 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:27:51.268785  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 65177.9us
I20260709 12:27:51.252193  5928 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:51.242784  6073 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:51.245294  6011 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:51.170962  6076 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:27:51.253209  5853 raft_consensus.cc:3055] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:27:51.290123  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.303131  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.294267  6105 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:51.305325  3850 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:51.266242  5971 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:51.294978  6095 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.306855  6095 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.300884  6012 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:51.297335  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 46081.1us
I20260709 12:27:51.299925  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:51.319042  5799 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.321557  3897 leader_election.cc:400] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5.
I20260709 12:27:51.299873  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:51.331313  3822 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:51.332127  6076 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:51.332765  6076 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.321002  6128 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:51.338761  6128 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:51.270035  6045 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:51.340387  6045 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.339872  6128 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.303659  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.268373  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.306304  6105 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:51.258375  4566 rpcz_store.cc:276] 0709 12:27:49.986728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:49.990081 (+  3353us) service_pool.cc:224] Handling call
0709 12:27:50.010295 (+ 20214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:51.047343 (+1037048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:51.257601 (+210258us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54006de7d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:51.257799 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308291456}
I20260709 12:27:51.308715  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.303134  6011 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.282730  6048 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:51.302446  6073 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:51.360119  6048 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.310024  6023 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.302650  6122 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:51.322764  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.323251  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.323555  6100 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.364398  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.323900  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.365713  6047 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:51.327099  6060 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.366393  6047 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:51.338860  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.321451  6095 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:51.342948  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:51.367378  6073 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.343195  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.344019  5799 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:51.370769  6068 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:51.370093  4574 raft_consensus.cc:2955] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 5 to 7, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:51.371449  6068 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.371872  6068 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.372128  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:51.372072  6105 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.305456  5853 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:51.376374  5853 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.377350  6048 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:51.377767  5853 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:51.377827  6105 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.379478  5799 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:51.379964  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:51.381407  5799 raft_consensus.cc:3055] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:51.381794  5799 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:51.381438  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:51.382591  4571 raft_consensus.cc:2393] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 2: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:51.382642  5799 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.381794  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:51.383917  5799 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:51.350065  6127 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:51.353085  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:51.390578  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.390906  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:51.393039  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.393612  3929 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:51.317423  5971 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:51.354250  3856 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:51.363977  6100 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:51.344285  5916 raft_consensus.cc:3055] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:51.443306  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.444308  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:27:51.274017  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 81694.6us
I20260709 12:27:51.373775  4572 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:51.374366  4567 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:51.373034  4566 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:51.345845  6110 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:51.395094  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:51.469117  3930 raft_consensus.cc:2393] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 2: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:51.395905  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.397298  6068 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:51.469524  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:51.470198  3849 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:51.398211  6045 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:51.405509  6069 raft_consensus.cc:3055] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:51.406320  4537 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:51.407939  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.409996  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:27:51.473803  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 65925.1us
I20260709 12:27:51.410669  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.474396  4570 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:51.474819  3850 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:51.391244  3931 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:51.475417  6073 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.475463  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.476126  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.423591  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.477684  3821 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:51.421451  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.423458  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.481413  3924 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:51.482465  3924 raft_consensus.cc:1240] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:51.436668  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:51.424256  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.484910  4568 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:51.485208  4001 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:51.421322  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:51.423759  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.426056  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.486778  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.487028  3928 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:51.419381  6011 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.487772  4573 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:51.438791  6075 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.427660  6102 consensus_queue.cc:1059] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:27:51.440502  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:51.428398  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.441840  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.442457  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.447355  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:51.430426  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.495698  3932 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:51.431257  4571 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:51.433631  3895 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:27:51.490710  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 84479.3us
W20260709 12:27:51.496806  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 63255.7us
I20260709 12:27:51.425469  3852 raft_consensus.cc:2955] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 5 to 7, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:51.452503  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.447489  3970 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.492825  3851 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:51.498576  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 51152.1us
I20260709 12:27:51.457196  4572 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:51.461423  4569 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:51.417804  6023 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.489712  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.451161  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.502597  4005 raft_consensus.cc:2376] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4. Re-sending same reply.
I20260709 12:27:51.504503  5947 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:51.504874  6068 raft_consensus.cc:3055] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:51.505415  6068 raft_consensus.cc:740] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:51.505018  5947 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.489550  6122 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:51.506299  6068 consensus_queue.cc:260] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.507478  5947 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:51.507694  6011 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.510919  6110 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.442970  5916 raft_consensus.cc:740] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:51.430655  5971 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.494052  3971 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.505167  6046 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:51.385480  6059 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:51.489990  3931 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:51.473387  6069 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:51.515118  3926 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:51.514912  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.516049  3929 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:51.513830  3849 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
W20260709 12:27:51.525786  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 48213.3us
I20260709 12:27:51.539350  3854 raft_consensus.cc:1240] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5. Ops: []
W20260709 12:27:51.540671  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.533735  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.494421  6073 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:51.500898  5857 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:51.559068  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 77277.2us
I20260709 12:27:51.560034  3970 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.563959  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:51.565214  3739 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4eedd844c09d456ca0b3614490dd1dbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:51.554914  6068 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.569402  3897 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.571470  3970 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.531628  6055 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.530718  6046 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:51.553623  6054 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.574721  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:51.545686  6125 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:51.501938  6075 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:51.576324  3969 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.574234  6084 raft_consensus.cc:2764] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:27:51.551977  6073 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.578780  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.580430  3821 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.574713  5948 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:27:51.581449  6051 consensus_queue.cc:1059] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:27:51.577265  3897 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.604053  3930 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:51.605509  3970 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.610317  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.612128  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:51.615141  3969 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.615368  3970 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.616513  4537 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:51.553409  5958 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:27:51.574903  5974 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.578279  6050 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:51.567413  5855 consensus_queue.cc:1059] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:27:51.599591  6021 raft_consensus.cc:2764] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:27:51.573172  6127 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:27:51.628703  6075 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.619565  5900 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:51.630365  6045 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.623934  6011 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:51.631297  6011 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.631669  5948 raft_consensus.cc:3055] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:51.632251  5948 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:51.631688  6011 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:51.634769  6110 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:51.636485  4003 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:51.638031  4537 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.553983  6027 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:27:51.616804  6073 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:51.604079  6046 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.572273  6031 consensus_queue.cc:1059] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:27:51.618999  6122 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:27:51.672444  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 57119.6us
I20260709 12:27:51.622736  6030 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.625312  6032 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:51.688153  5950 raft_consensus.cc:3055] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:51.688742  5950 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:51.689813  5950 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.604945  5682 consensus_queue.cc:1059] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 12:27:51.691959  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 76897us
I20260709 12:27:51.692744  3969 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.684162  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:51.686210  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 105950us
I20260709 12:27:51.601130  6097 consensus_queue.cc:1059] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:27:51.662606  6084 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:51.662298  5922 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:51.696590  3821 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:51.693571  5682 raft_consensus.cc:3055] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:51.579180  5916 consensus_queue.cc:260] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.707300  3969 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:51.708591  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.666808  6125 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.707434  3821 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:51.710542  6125 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:51.711032  5900 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:51.711464  5900 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:51.711841  6125 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.712242  6051 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:51.710106  6032 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:51.633352  5948 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.617204  6069 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.714687  3970 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.717947  6032 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:51.711886  5900 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:51.713581  5682 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:51.726024  6030 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:51.726553  6051 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:51.666517  6110 consensus_queue.cc:1059] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:27:51.713593  3969 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.745043  3970 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.753752  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:51.753674  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:51.754629  3857 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:27:51.755442  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:51.761162  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:51.756206  3926 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:27:51.742780  6100 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.762315  6074 consensus_queue.cc:1059] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:51.763156  6110 raft_consensus.cc:3055] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:51.763616  6110 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:51.764705  6110 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.749014  6125 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:51.766110  3929 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:51.712498  6140 consensus_queue.cc:1059] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
W20260709 12:27:51.767151  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 57245.7us
I20260709 12:27:51.771873  5855 raft_consensus.cc:3055] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:51.772293  5855 raft_consensus.cc:740] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:51.749042  6032 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.779572  3970 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.769923  3821 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:51.773135  5855 consensus_queue.cc:260] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.780462  6125 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:51.751197  5950 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:51.789412  5682 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:51.790431  6131 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:27:51.810577  3970 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:51.815356  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 45541.5us
I20260709 12:27:51.816598  6075 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:51.757588  5963 consensus_queue.cc:1059] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:27:51.794744  6059 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:51.826696  5963 raft_consensus.cc:3055] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:51.827209  5963 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:51.828204  5963 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:51.812371  6031 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.822347  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.818698  6075 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.823984  6140 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:51.829588  5963 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:51.816409  6136 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:51.804149  6051 raft_consensus.cc:3055] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:51.819157  6125 consensus_queue.cc:1059] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:27:51.877738  6051 raft_consensus.cc:740] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:51.831770  6075 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:51.865958  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:51.852486  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.859004  3970 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.846055  6128 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:51.849820  6059 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:51.817526  6030 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:27:51.817253  6110 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:51.864838  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.853770  6031 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:51.857651  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.811875  5948 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:51.845386  6137 raft_consensus.cc:3055] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:51.877135  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.878248  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.915704  3854 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:51.879216  6125 consensus_queue.cc:1243] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Peer 4eedd844c09d456ca0b3614490dd1dbb log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:27:51.900673  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:51.863986  6073 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.903441  4574 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:51.913617  6137 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:51.906037  5971 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:27:51.923878  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.922727  3970 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.904465  5857 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:51.931841  5958 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:51.912649  4001 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:51.939991  4573 raft_consensus.cc:2368] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4.
I20260709 12:27:51.899029  6011 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:51.908982  5974 consensus_queue.cc:1059] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:27:51.952898  5958 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:51.959916  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:51.942036  5971 raft_consensus.cc:697] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:51.908878  6051 consensus_queue.cc:260] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:51.969945  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.972705  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.973469  4003 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 4: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:51.976327  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.977059  3999 raft_consensus.cc:2393] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 2: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:51.976606  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.976687  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.978159  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.978425  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.979526  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.980377  3998 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:51.980491  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.982182  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:51.982594  6055 raft_consensus.cc:3055] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:51.982875  4002 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:51.982993  6055 raft_consensus.cc:740] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:51.983798  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.984267  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.974589  6143 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:51.981702  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:51.953474  6101 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:27:51.992516  3931 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:51.997143  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.999989  3931 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:52.003015  4574 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:52.003307  5971 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.006718  4003 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:52.008015  3929 raft_consensus.cc:1240] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:52.002031  3932 raft_consensus.cc:2955] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 5 to 7, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:51.989868  6051 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:52.011782  4538 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:52.012844  4538 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:52.013756  6147 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:52.006359  5947 raft_consensus.cc:3055] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:52.016263  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:52.016538  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:52.024072  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:52.024655  6144 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:52.017361  4538 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:52.017995  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:52.026785  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:52.018483  3997 raft_consensus.cc:3055] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:52.029389  3997 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:52.025532  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:52.031466  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:52.040056  4538 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:52.044692  4538 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:52.051158  4538 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:51.991567  6046 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.047592  6125 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.021667  5947 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:52.070791  4538 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:52.053180  6054 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:52.071470  6125 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.072777  6011 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:52.057464  3997 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.014693  5799 consensus_queue.cc:1059] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:27:52.043045  6144 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:52.048095  6147 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:27:52.077199  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:52.087984  3931 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:51.991853  6137 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.053681  6095 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:52.084196  3926 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:52.077724  5900 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.056998  5928 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:52.088600  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:52.092455  3932 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:52.053472  6138 consensus_queue.cc:1059] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:27:52.094383  6136 raft_consensus.cc:3055] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:52.094770  6136 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:52.095592  5947 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.095752  6136 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.096841  5947 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.097673  6136 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:52.099694  5900 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:52.100871  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:52.105666  3932 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:52.109735  4002 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:52.111943  3997 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.113746  4002 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:27:52.114225  4002 pending_rounds.cc:85] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 4
I20260709 12:27:52.047319  6143 consensus_queue.cc:1059] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:27:52.120761  6046 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:52.123615  6125 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:52.125100  6143 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:52.125537  6143 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:52.114516  4002 pending_rounds.cc:107] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:27:52.117871  6110 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:52.132902  3931 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:52.131676  4002 raft_consensus.cc:2889] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:52.139645  6110 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:52.142119  6151 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:27:52.090706  6073 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:52.174088  6076 raft_consensus.cc:3055] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:52.174772  6076 raft_consensus.cc:740] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:52.176017  6076 consensus_queue.cc:260] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.126492  6143 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.189272  5916 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.193365  6110 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:52.139359  6075 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:52.207759  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:52.211470  6032 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:52.213027  6142 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 12:27:52.214913  6032 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:52.216094  6055 consensus_queue.cc:260] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.217176  6075 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:52.217363  6055 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.225119  5682 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:52.243566  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 172834us
I20260709 12:27:52.291842  3853 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:52.296767  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:52.333743  3848 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:52.342469  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:52.348469  5958 raft_consensus.cc:3055] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:52.349133  5958 raft_consensus.cc:740] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:52.351054  5958 consensus_queue.cc:260] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.302520  3931 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:52.359089  5974 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:52.360262  5974 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.370059  5916 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:52.371434  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:52.372248  3930 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:52.376310  5950 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:52.376606  3932 raft_consensus.cc:1240] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:27:52.371114  5916 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.377182  5950 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:52.378168  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:52.384239  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:52.385489  3926 raft_consensus.cc:2393] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:52.385778  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:52.387354  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:52.388147  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:52.389210  3854 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 5: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:52.393872  5855 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:52.399206  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:52.399104  4538 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:52.400758  5857 consensus_queue.cc:1059] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:52.401121  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:52.401995  5958 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:52.315025  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:52.315656  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:52.404543  3852 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:52.404632  5654 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.407274  5857 raft_consensus.cc:3055] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:52.407697  5857 raft_consensus.cc:740] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:52.409101  5857 consensus_queue.cc:260] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.402261  3853 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:52.405670  5654 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.410662  5857 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:52.402256  5916 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:52.411994  3895 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:52.413167  5654 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:52.419245  5974 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:52.421175  4001 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:27:52.422655  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:52.423748  5950 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:52.424857  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:52.426622  4004 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:27:52.427130  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:52.402673  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:52.430866  5900 consensus_queue.cc:1059] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:52.432317  3969 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:52.433948  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 54295us
I20260709 12:27:52.445787  3852 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:52.478516  4003 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:27:52.472319  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 57544.3us
W20260709 12:27:52.471951  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 66099.5us
I20260709 12:27:52.471881  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:52.457197  3930 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:27:52.464015  4570 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:52.468930  3897 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:27:52.474814  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 63176us
I20260709 12:27:52.467594  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:52.493480  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:52.462642  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:52.499884  4006 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:52.312537  3997 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:52.476584  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:52.509379  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:52.509441  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 54810.1us
I20260709 12:27:52.469273  6055 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.466374  6136 raft_consensus.cc:3055] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:52.510589  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:52.513936  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 45334.2us
I20260709 12:27:52.473430  6069 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:52.478317  6046 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:52.473639  6012 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:52.465404  5900 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:52.514598  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:52.530980  3932 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:27:52.473279  6054 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:52.258476  6076 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:52.257588  6143 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:52.534533  4569 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
W20260709 12:27:52.539270  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 138339us
I20260709 12:27:52.467331  3754 catalog_manager.cc:5697] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 4 to 5, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 5 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:52.543345  4005 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:52.544288  6046 raft_consensus.cc:697] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:27:52.546052  6021 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:27:52.547153  4537 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:52.548393  5922 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:52.550034  3928 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:52.549580  6055 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.550171  6048 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:52.550949  6048 raft_consensus.cc:697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:52.551087  5922 raft_consensus.cc:697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:52.552228  6048 consensus_queue.cc:237] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:52.556447  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:52.557247  3997 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:52.551085  3853 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:52.555965  4536 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:52.517383  6136 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:52.560105  3895 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:52.563854  3969 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:52.552471  6055 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:52.578130  6139 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:52.579320  4002 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:52.581368  6054 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:52.582810  6054 raft_consensus.cc:697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:27:52.583320  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 106865us
I20260709 12:27:52.584286  3822 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:27:52.584937  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 57882.7us
I20260709 12:27:52.554286  6073 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 12:27:52.598007  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:52.593559  3821 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:52.601194  3848 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:52.607776  3930 raft_consensus.cc:2393] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 3: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:52.585827  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:52.585820  3753 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51798 (request call id 318) took 6337 ms. Trace:
I20260709 12:27:52.571624  5958 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:52.618040  6128 raft_consensus.cc:2764] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:27:52.618394  6011 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:52.619192  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 81640.1us
I20260709 12:27:52.593327  6051 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:52.621192  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 53585.7us
I20260709 12:27:52.623672  4538 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:52.589135  6137 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:52.630195  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 44436.6us
I20260709 12:27:52.620353  5958 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:52.545774  6046 consensus_queue.cc:237] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:52.632197  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:52.639869  6102 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:52.552402  5922 consensus_queue.cc:237] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:52.641750  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 56099.1us
I20260709 12:27:52.584905  6054 consensus_queue.cc:237] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.641923  5958 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:52.656147  3822 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:52.657212  6102 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.659289  6051 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:52.659591  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 56850.7us
I20260709 12:27:52.660632  4538 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:52.651158  3821 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:52.662103  6012 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:52.663271  5900 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.663991  5900 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.586778  6136 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.650732  5654 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.671317  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:52.648609  6101 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:52.667296  5963 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:52.654183  6139 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:52.674418  3897 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:52.667343  6073 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:52.675665  3895 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:52.682008  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:52.683185  6102 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:52.685360  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:52.686405  3856 raft_consensus.cc:2393] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 4: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:52.686053  5654 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.668520  5855 consensus_queue.cc:1059] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:27:52.688793  3998 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:52.693715  6101 raft_consensus.cc:697] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:52.694983  6101 consensus_queue.cc:237] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.701598  3999 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:52.676427  5963 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.706611  4538 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:52.711591  6012 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:52.713371  6012 raft_consensus.cc:697] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:52.714639  6012 consensus_queue.cc:237] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.709733  6048 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:52.718587  6050 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:52.719218  6048 raft_consensus.cc:697] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:52.719422  6128 consensus_queue.cc:1059] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:52.720341  6048 consensus_queue.cc:237] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.720897  6050 raft_consensus.cc:3055] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:52.721366  6050 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:52.706043  5963 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:52.724403  4571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 664) took 1163 ms. Trace:
I20260709 12:27:52.707044  6073 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:52.727819  6068 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.612546  3753 rpcz_store.cc:276] 0709 12:27:46.247900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.248048 (+   148us) service_pool.cc:224] Handling call
0709 12:27:52.585544 (+6337496us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:50.252666 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:50.253204 (+   538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:50.253240 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:27:50.253258 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:50.256147 (+  2889us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:50.256237 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:50.256284 (+    47us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:27:50.257142 (+   858us) tablet.cc:701] Row locks acquired
0709 12:27:50.257165 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:27:50.257350 (+   185us) write_op.cc:270] Start()
0709 12:27:50.257489 (+   139us) write_op.cc:276] Timestamp: P: 1783600070257287 usec, L: 0
0709 12:27:50.257518 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:27:50.295690 (+ 38172us) log.cc:844] Serialized 3186 byte log entry
0709 12:27:50.899972 (+604282us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe04eecd0ac 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b
0709 12:27:51.388237 (+488265us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b1800362320. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:27:51.488131 (+ 99894us) op_driver.cc:464] REPLICATION: finished
0709 12:27:51.667654 (+179523us) write_op.cc:301] APPLY: starting
0709 12:27:51.667753 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:51.668002 (+   249us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:51.668061 (+    59us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:51.669464 (+  1403us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:51.669761 (+   297us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:27:51.669830 (+    69us) write_op.cc:312] APPLY: finished
0709 12:27:51.670220 (+   390us) log.cc:844] Serialized 65 byte log entry
0709 12:27:51.670439 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:51.670595 (+   156us) write_op.cc:454] Released schema lock
0709 12:27:51.670658 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:51.704493 (+ 33835us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:51.713109 (+  8616us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":418,"reported_tablets":19,"spinlock_wait_cycles":40448,"child_traces":[["op",{"apply.queue_time_us":179282,"apply.run_cpu_time_us":3511,"apply.run_wall_time_us":16195,"num_ops":8,"prepare.queue_time_us":243835,"prepare.run_cpu_time_us":74535,"prepare.run_wall_time_us":792158,"raft.queue_time_us":91529,"raft.run_cpu_time_us":49584,"raft.run_wall_time_us":132383,"replication_time_us":1230444,"spinlock_wait_cycles":61515776,"thread_start_us":1153427,"threads_started":4,"wal-append.queue_time_us":721035,"wal-append.run_cpu_time_us":36050,"wal-append.run_wall_time_us":1305746}]]}
I20260709 12:27:52.728016  6073 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.728618  6068 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.744657  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:52.745113  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:52.745509  3930 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:52.724814  4571 rpcz_store.cc:276] 0709 12:27:51.560761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:51.561098 (+   337us) service_pool.cc:224] Handling call
0709 12:27:51.561451 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:51.561788 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:51.561814 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:51.703145 (+141331us) spinlock_profiling.cc:243] Waited 918 us on lock 0x7b18001083a0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeb82a6 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a
0709 12:27:52.227034 (+523889us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b2c000201b8. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:27:52.227515 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:27:52.630468 (+402953us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:52.641546 (+ 11078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:52.641655 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:52.723982 (+ 82327us) raft_consensus.cc:1685] finished
0709 12:27:52.724003 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:52.724186 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":380,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":10722,"spinlock_wait_cycles":12285056,"thread_start_us":334766,"threads_started":1,"wal-append.queue_time_us":419103}
I20260709 12:27:52.749245  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:52.735018  6068 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:52.760768  3897 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:52.758881  3856 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:52.773587  6174 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:52.780805  5916 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.781270  4001 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:52.781642  5916 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.784757  4000 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:52.786034  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:52.787153  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:52.788076  5916 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:52.769829  6064 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:27:52.796489  3848 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.806706  5900 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:52.807960  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:52.808624  3930 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:52.809981  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:52.811889  3821 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:52.812012  3970 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:52.813452  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 62351.6us
I20260709 12:27:52.820039  5900 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:52.824440  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 56039.3us
I20260709 12:27:52.825309  6139 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:27:52.831223  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 180015us
W20260709 12:27:52.838652  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 157438us
I20260709 12:27:52.817829  6174 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:52.830651  6055 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:52.849438  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:52.850133  6174 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:52.853289  6174 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:52.832387  6136 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:52.866117  6032 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.866933  6032 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.878306  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:52.878613  6074 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:52.879577  5922 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:52.880065  5922 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:52.880455  5922 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:52.837966  6051 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:27:52.878371  6032 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:52.883747  5654 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:52.888031  3852 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:52.869647  6055 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.814757  6050 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:52.924793  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 81191.6us
I20260709 12:27:52.919890  6055 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:52.921119  6137 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:52.922335  6128 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:27:52.942545  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 95676.3us
I20260709 12:27:52.943295  3822 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:52.944499  6139 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:52.945175  6139 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.947659  6139 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:52.950006  6032 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:52.959805  6032 raft_consensus.cc:697] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:52.960873  6032 consensus_queue.cc:237] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.961486  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:52.964564  6128 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.965618  6174 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.967054  6128 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:52.967988  6174 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:52.935292  6050 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:52.971565  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:52.975046  6048 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:52.975956  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:52.947824  6137 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:52.986053  4536 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:52.981769  4001 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:52.950795  3822 leader_election.cc:400] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4.
I20260709 12:27:52.926313  5958 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:52.988125  3822 leader_election.cc:403] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:52.997527  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:52.976303  5963 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.003855  5682 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.985471  5900 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:52.948185  6139 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:52.993618  6012 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:53.004526  5682 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.014216  5963 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:52.997272  6128 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.952276  6126 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 12:27:53.006853  5900 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:53.000775  6011 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:53.010152  5922 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.019125  5958 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.014783  3895 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:53.014803  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:53.003151  6174 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:53.044421  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:53.044978  3931 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:53.024096  6012 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.029788  5900 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:53.056229  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:53.059506  3999 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:53.050981  6012 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:53.030318  6011 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.043391  6128 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.046715  6174 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.072152  6076 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4.
I20260709 12:27:53.072234  5853 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:53.119942  5853 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.120524  6174 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.075718  6052 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.122443  5682 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.122202  6052 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.123322  6191 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.123919  6191 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.124643  6052 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.076203  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:53.076661  6186 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:53.125470  4573 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:27:53.125674  6186 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.126801  5853 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.128450  6186 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.077235  4566 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:53.079933  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:53.129544  4574 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 4: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:53.081630  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:53.082901  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:53.130676  6052 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:53.084009  3971 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:53.131258  6052 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:53.131986  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 48236.9us
I20260709 12:27:53.133291  3971 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:53.076694  6069 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:27:53.133862  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:53.134246  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.088357  6137 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.135349  6021 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:53.090252  6054 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.087415  6128 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.136458  6054 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.137601  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.138337  3856 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:53.138891  6054 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.139148  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:53.099229  5922 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.050763  6139 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.139750  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.099084  6011 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.140476  3929 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:27:53.139753  3998 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:53.104969  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.141723  6139 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.142258  3928 raft_consensus.cc:2393] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:53.142823  3969 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:53.144114  6143 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:53.144625  6143 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.145076  6143 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:53.145722  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:53.147353  5922 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:53.147740  5922 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:53.148177  5922 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:53.111845  6110 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:53.113689  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:53.115921  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:53.117653  3930 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:27:53.118217  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 167787us
I20260709 12:27:53.130892  4572 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 4: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:53.160526  6076 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:53.165510  3971 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:53.168095  5958 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:53.169593  6191 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.171324  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:53.172112  3853 raft_consensus.cc:2393] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 4: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:53.173015  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.173662  3854 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:27:53.174548  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.175702  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.176052  6069 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.176334  3849 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:27:53.176569  6069 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.177363  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.178687  6069 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.181779  4536 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:53.182919  4536 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:53.183606  6054 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:53.183846  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.184159  6054 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.184643  3852 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 3: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:53.185421  4536 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:53.186163  6011 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:53.186589  3856 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:53.186779  6011 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.184618  6054 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:53.187459  6011 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:53.190305  6068 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:53.194361  6157 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:53.144146  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.104707  6055 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.202935  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:53.203184  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:53.203765  4572 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:53.214612  3999 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:53.221366  4570 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:27:53.222064  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:53.222325  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:53.223233  3931 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:53.224751  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:53.225564  4570 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:27:53.226850  3848 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:53.228399  3969 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:53.144121  6052 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.261191  6191 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.261770  5958 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:53.262181  3821 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:53.262481  6191 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.266381  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:53.273909  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:53.274938  4005 raft_consensus.cc:2393] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:53.281229  3999 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:27:53.281733  3999 pending_rounds.cc:85] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 4
I20260709 12:27:53.286641  4005 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:53.290498  6012 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.279965  6032 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.273118  5958 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:53.293453  6032 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.259606  6186 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:53.294592  5958 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.295058  6186 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.298374  6012 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.298516  6011 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.299422  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:53.300132  3856 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:53.280444  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:53.306062  4574 raft_consensus.cc:2393] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:53.310477  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.311450  3928 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:53.313027  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:53.313637  4570 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:53.315101  6051 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:53.316193  3822 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:53.268522  6110 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.281991  3999 pending_rounds.cc:107] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:27:53.328447  3999 raft_consensus.cc:2889] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:53.272492  6101 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.231911  6054 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.334893  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:53.335695  3928 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:53.324887  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:53.324878  3821 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:53.307312  5963 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:53.320940  5900 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.344493  4566 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:27:53.366802  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 315326us
I20260709 12:27:53.339641  6069 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 12:27:53.373150  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 358429us
I20260709 12:27:53.389411  5900 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.336081  6143 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.360165  6032 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.361207  6055 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.411723  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:53.398468  3897 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:53.413458  3931 raft_consensus.cc:2393] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 3: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:53.395277  4570 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:53.345803  6101 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:53.415899  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 187619us
I20260709 12:27:53.342007  6110 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.341564  6051 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.414664  4567 raft_consensus.cc:2393] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:53.421772  3897 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:53.425293  6188 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:53.425897  5654 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.415946  6074 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:53.422859  6032 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.438323  6032 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.437227  5654 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.440392  6032 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.425691  6075 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:53.428295  6110 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.429868  4004 raft_consensus.cc:2368] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:27:53.423461  6046 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:53.436259  6054 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.422583  6139 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:53.466590  6139 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.410614  6191 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.414988  6136 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:53.427016  6187 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:27:53.443769  5900 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:53.448182  5654 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.455710  6143 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.465073  6046 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:53.459697  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:53.446473  6188 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.433305  6186 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.429361  6050 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:53.474040  6136 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.476253  6069 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:53.467069  6139 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:53.456874  6074 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:53.502161  3931 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:53.510558  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 185758us
I20260709 12:27:53.475178  6011 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.474737  6190 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.576854  6050 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:53.591938  6198 log.cc:927] Time spent T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:27:53.541254  6046 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:53.594074  6194 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.130s
I20260709 12:27:53.489986  5900 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.602959  5857 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.604099  6143 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:53.625231  5857 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.625347  6143 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.627518  5857 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.627595  6136 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.628105  6143 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.628186  6136 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:53.604676  6190 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.629108  5900 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.628890  6136 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.629915  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:53.578606  5682 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:53.630421  6190 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.609339  6051 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.543396  5963 raft_consensus.cc:697] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:53.582135  6069 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.611838  6050 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.613214  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:53.576162  6186 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.614395  6032 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.614812  6075 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:53.616379  5922 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.544193  6191 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:53.546766  5916 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.639364  3928 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:27:53.652235  3931 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:27:53.630771  5682 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.615051  6046 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:53.658418  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 333618us
W20260709 12:27:53.676489  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 254803us
I20260709 12:27:53.680887  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:53.681552  3848 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:27:53.682564  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.683236  3928 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:27:53.684916  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:53.685622  3853 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:53.692552  3856 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:53.695678  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:53.696694  3822 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:53.666899  5654 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:53.694581  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.700196  4536 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:53.701942  4570 raft_consensus.cc:2393] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 3: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:53.701874  3857 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:53.706554  3822 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:53.711429  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.678578  6110 raft_consensus.cc:2764] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:27:53.718816  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.721822  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:53.722091  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:53.722536  4570 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:53.724083  3971 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:53.667104  6051 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:27:53.684278  6021 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:53.731421  3926 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:53.688388  6068 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.738374  6055 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:53.743572  6054 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:53.757918  6136 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.716985  6075 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:53.759460  6201 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:27:53.760087  6075 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.688243  6032 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.678234  6191 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.762007  6209 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.762696  6209 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.763545  6191 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.765028  6209 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.766408  3927 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:53.766664  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.767355  3930 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:27:53.767520  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.768007  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.768904  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:53.769620  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:53.743933  6046 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.770397  3852 raft_consensus.cc:2368] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:27:53.716713  6074 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 12:27:53.771915  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:53.732044  5958 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:53.772365  5958 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.676859  6186 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.681537  5916 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.779078  6068 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.779963  6186 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.780588  5916 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.780812  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.781198  6068 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.781529  3926 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:53.781669  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.716446  6012 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:53.789388  3849 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:27:53.751072  4565 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:53.753963  6101 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.730434  6194 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:53.778537  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:53.750399  3931 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:53.793355  3853 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:27:53.772810  5958 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:53.798993  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.806250  3929 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:53.804162  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.807507  3926 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 3: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:53.804913  3923 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:53.807426  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:53.819576  4536 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:53.785158  6188 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.822714  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:53.822939  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.827711  3925 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:53.825871  3930 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:53.827829  3853 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:27:53.827883  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.808928  6194 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.801528  6012 raft_consensus.cc:697] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:53.806250  6137 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:53.829936  6219 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:53.838685  6194 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:53.835593  3857 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:27:53.852806  6219 raft_consensus.cc:697] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:53.843025  6032 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.846483  6069 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.853981  3895 leader_election.cc:400] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:27:53.850864  6190 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.853788  6219 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.854696  6190 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.855250  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:53.856690  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.857462  5971 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:53.852965  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.834250  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.859094  3857 raft_consensus.cc:2368] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:27:53.859215  3853 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:53.855331  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.862289  3932 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.863533  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.866277  3849 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:27:53.866509  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:53.902518  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:53.903095  4002 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:27:53.903378  6213 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:53.903538  4002 pending_rounds.cc:85] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 2
I20260709 12:27:53.903927  4002 pending_rounds.cc:107] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:27:53.904145  6213 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:53.905138  6068 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:53.903126  3997 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:27:53.905784  6068 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.906006  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:53.906457  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:53.907027  3998 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:53.907589  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:53.907972  6068 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.908217  3997 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:27:53.908394  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:53.867484  3925 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:53.909034  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:53.869900  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.909205  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:53.871152  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.909727  3997 raft_consensus.cc:2393] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 2: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:53.872040  3821 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:53.867211  6073 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:27:53.873005  3851 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:27:53.873344  6069 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:53.874024  6190 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.913127  3930 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:53.909073  4536 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:53.874532  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.874696  6055 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:53.865247  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:53.876123  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:53.875105  6021 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:53.875240  6210 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:53.930078  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.912320  6136 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:53.931658  6136 raft_consensus.cc:697] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:53.932579  6136 consensus_queue.cc:237] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.839471  6012 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.934358  3850 raft_consensus.cc:2368] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:27:53.913641  6101 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:53.935122  6101 raft_consensus.cc:697] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:53.936026  6101 consensus_queue.cc:237] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.936620  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.857930  5971 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:53.937386  5971 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:53.928153  6011 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:53.938746  6021 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.880604  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.940325  6210 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.940991  6021 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.774613  5963 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.941696  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:53.884639  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.888967  6032 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.890821  5916 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:53.892728  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:53.893155  6137 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:53.951993  6137 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.954119  5916 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:53.956457  5916 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.880280  5682 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:53.894250  6139 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:53.895509  4565 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:27:53.899220  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:53.959154  3999 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:27:53.904209  4002 raft_consensus.cc:2889] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:53.904381  4005 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:53.905206  4001 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:53.909816  3929 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:27:53.910156  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:53.961710  3998 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:53.911707  3821 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:53.815503  5922 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:53.868144  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:53.964115  3931 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:27:53.916051  3923 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:53.919584  3927 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:53.919849  3924 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:53.921100  3848 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:27:53.918376  3969 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:27:53.926909  4003 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.009s	sys 0.025s
I20260709 12:27:53.919543  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:53.939270  6011 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.942988  4536 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:53.880780  3856 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:53.944769  3853 raft_consensus.cc:2368] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
W20260709 12:27:53.966241  4003 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.009s	sys 0.025s
I20260709 12:27:53.881714  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.967434  3857 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:53.946048  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.948433  3932 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:53.950081  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:53.957995  3855 raft_consensus.cc:2368] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4.
W20260709 12:27:53.963201  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 51565.1us
W20260709 12:27:53.971724  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 53458.2us
W20260709 12:27:53.978415  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 58979.3us
I20260709 12:27:53.979481  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:53.984728  3850 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:53.985914  3821 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:53.987555  3821 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:53.990638  3897 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:53.992619  3848 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:27:54.018604  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:54.018479  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:54.019106  3969 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:53.974548  6055 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:54.020521  3969 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:53.949581  6032 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.025003  3931 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:27:54.026906  3897 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:53.976770  5682 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:53.974511  6011 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:54.019241  3856 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:54.036527  3969 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:54.040771  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:54.046923  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:53.984932  6190 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:54.050150  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:54.050614  3857 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:53.975544  6075 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:27:54.026669  6188 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:54.046041  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:54.057304  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:54.021206  6126 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:54.026556  6021 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:54.025153  6069 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:54.016036  6076 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:54.026463  6055 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.058418  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:54.079025  3897 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:54.070005  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:54.039043  5682 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.031992  6073 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:54.053301  6194 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:54.015777  6209 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:27:54.151609  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:54.067808  3969 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:54.075410  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:54.086089  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:54.159718  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 73737.1us
I20260709 12:27:54.057964  6137 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:54.058620  6210 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:54.055990  6190 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.065552  6188 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.177547  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:54.179159  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:54.082729  6076 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.074361  6126 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.152354  6050 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:54.195529  6205 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:54.155517  6055 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:54.189596  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:54.163897  6128 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:54.170387  6213 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:54.083269  5857 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:54.194893  6203 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:27:54.196269  6205 raft_consensus.cc:697] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:54.166909  5682 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:54.178169  6051 raft_consensus.cc:2955] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:54.223062  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:54.223999  6229 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:54.224417  6229 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:54.224821  6229 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:54.168545  6048 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:27:54.195621  6050 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.072860  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:54.075505  6143 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:27:54.217597  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:54.151208  5853 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:27:54.177685  6190 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:54.195175  6218 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:54.193645  6076 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:54.170197  6157 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:27:54.162909  6021 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.235423  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:54.224426  6230 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:54.237054  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:54.170691  6073 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.082597  6069 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.202189  6128 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:54.264777  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 277274us
W20260709 12:27:54.265374  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 104078us
I20260709 12:27:54.372860  3821 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:54.374112  3821 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:54.198732  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:54.209136  6126 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:54.228690  6110 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:54.321708  3929 raft_consensus.cc:2393] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 2: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:54.321938  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:54.209549  6231 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:54.391393  6231 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.218381  5916 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:54.185846  6188 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:54.241654  6050 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:54.280762  6213 raft_consensus.cc:697] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:54.320063  6139 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:54.377297  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:54.230258  5958 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.383457  3895 leader_election.cc:400] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:27:54.318385  4566 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
W20260709 12:27:54.378511  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 310812us
I20260709 12:27:54.386664  6205 consensus_queue.cc:237] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:54.389865  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:54.348551  6230 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:54.375490  6128 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:54.372834  5900 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.434741  3927 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:27:54.436493  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:54.437923  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:54.441074  6232 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.455993  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:54.379067  6074 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:54.463551  4574 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:54.396770  6209 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:54.467049  3895 leader_election.cc:403] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:54.463994  4572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.008s	sys 0.010s
I20260709 12:27:54.484663  6143 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:54.534143  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 150849us
I20260709 12:27:54.535354  3895 leader_election.cc:400] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:27:54.485953  4565 raft_consensus.cc:2368] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:27:54.523605  4006 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:27:54.527884  4572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.008s	sys 0.010s
W20260709 12:27:54.496364  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 322933us
I20260709 12:27:54.531985  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:54.539969  3927 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:54.532912  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:54.536536  3895 leader_election.cc:400] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:27:54.541972  3895 leader_election.cc:403] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:27:54.544842  3822 leader_election.cc:400] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:27:54.545410  3822 leader_election.cc:403] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:54.499924  6230 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:54.430076  5916 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.525053  6209 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.549417  3895 leader_election.cc:400] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4.
I20260709 12:27:54.547663  4572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 683) took 1234 ms. Trace:
I20260709 12:27:54.547362  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:54.525889  6074 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:54.561362  6244 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:27:54.563498  3895 leader_election.cc:403] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:54.538973  6191 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:27:54.559805  4572 rpcz_store.cc:276] 0709 12:27:53.313414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:53.315169 (+  1755us) service_pool.cc:224] Handling call
0709 12:27:53.315507 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:53.315717 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:53.704565 (+388848us) log.cc:844] Serialized 14 byte log entry
0709 12:27:54.547318 (+842753us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:54.547376 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:54.547425 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:54.547491 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:54.547609 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7738,"prepare.queue_time_us":338713,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"thread_start_us":1217053,"threads_started":2}
I20260709 12:27:54.526532  5900 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.563102  6209 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:54.585393  6226 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
W20260709 12:27:54.586491  6234 log.cc:927] Time spent T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 12:27:54.587307  6241 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:27:54.541230  6143 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:54.528709  6232 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.566594  6074 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:54.630249  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 64770us
I20260709 12:27:54.572484  6048 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4.
I20260709 12:27:54.637127  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:54.637799  3929 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
W20260709 12:27:54.647341  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 213932us
W20260709 12:27:54.601351  6239 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:27:54.598251  6238 log.cc:927] Time spent T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:27:54.595978  6246 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:54.670042  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 214103us
I20260709 12:27:54.589175  6073 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:54.583365  6231 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:54.595134  6069 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:54.598490  6242 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:27:54.674342  3927 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:27:54.595312  5853 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:27:54.601401  6188 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:54.662493  6051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:42036 (request call id 91) took 1987 ms. Trace:
I20260709 12:27:54.671387  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:54.599205  6216 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.119s
W20260709 12:27:54.702564  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 135341us
I20260709 12:27:54.706048  6136 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:27:54.680150  5971 consensus_meta.cc:287] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.742s	user 0.011s	sys 0.001s
I20260709 12:27:54.678898  6231 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.679912  6021 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:54.671417  6229 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:54.724063  3930 raft_consensus.cc:2368] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3.
I20260709 12:27:54.583292  6213 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:54.799985  6237 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.337s	user 0.000s	sys 0.008s
I20260709 12:27:54.673431  6246 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:54.715786  6136 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.727685  5958 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:54.789538  6232 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:54.825871  6188 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:54.784847  6263 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:54.715890  5963 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:54.808676  6055 consensus_meta.cc:287] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 12:27:54.815775  6245 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:54.812005  6054 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.847677  6055 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:54.848012  6054 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.836546  3998 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:54.850347  3851 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:27:54.836087  6249 log.cc:927] Time spent T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:27:54.850708  6054 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:54.723980  6231 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.844288  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:54.809543  6048 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:27:54.858453  3848 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:54.828365  6069 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:54.859601  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:54.862171  4536 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:54.860827  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:54.716413  5971 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.830420  6068 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:27:54.867059  6240 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 12:27:54.867372  6258 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:54.867606  6266 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:54.833069  6046 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:54.869973  6257 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:27:54.869853  3853 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:54.876700  4004 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:27:54.849753  6055 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:54.861582  5958 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.872395  3932 raft_consensus.cc:2955] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:54.866798  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:54.880040  3928 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:27:54.857326  5916 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:27:54.881800  6256 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:27:54.885622  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:54.865778  6143 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:54.906946  5900 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:54.907097  6246 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:27:54.908972  6011 consensus_meta.cc:287] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.856s	user 0.010s	sys 0.001s
I20260709 12:27:54.909374  6011 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.911816  6011 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:27:54.913638  6190 consensus_meta.cc:287] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.543s	user 0.005s	sys 0.004s
I20260709 12:27:54.895787  6253 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:27:54.897104  6264 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:54.694458  6051 rpcz_store.cc:276] 0709 12:27:52.663681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:52.668873 (+  5192us) service_pool.cc:224] Handling call
0709 12:27:52.794564 (+125691us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b540028d820. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f54520 00007fe051fddb42 00007fe051fdc800 00007fe051fd59fa 00007fe056f9d4c9 00007fe050519c54 00007fe050519be2 00007fe050519b11 00007fe050519a8c 00007fe050518d42
0709 12:27:52.821747 (+ 27183us) log.cc:844] Serialized 487 byte log entry
0709 12:27:53.108937 (+287190us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b540028d820. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f50142 00007fe051f30eaa 00007fe051f37d53 00007fe051f37cd9 00007fe051f37c69 00007fe051f37c31 00007fe051f36dfd 0000000000388634 0000000000388479 00007fe04eeea475
0709 12:27:54.637905 (+1528968us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6865,"raft.run_cpu_time_us":4567,"raft.run_wall_time_us":214846,"spinlock_wait_cycles":90222848,"thread_start_us":101313,"threads_started":1,"wal-append.queue_time_us":161376,"wal-append.run_cpu_time_us":1811,"wal-append.run_wall_time_us":1005267}
W20260709 12:27:54.900835  6262 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:27:54.870625  5963 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.875567  6046 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.889947  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:54.959841  4005 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:54.878321  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:54.921362  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:54.922469  4570 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:54.870797  6069 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.903095  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:54.942619  4574 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:27:54.872388  6068 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.914592  6136 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:54.928586  6011 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.973443  6252 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:54.973264  6011 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.973862  6252 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.974445  6252 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:54.975353  6011 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:54.956938  6264 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.961676  6259 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.977994  6264 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:54.868206  6263 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.980126  6263 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:27:54.982424  6254 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:27:54.881075  6126 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:54.900069  6050 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:54.977380  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54068 (request call id 512) took 1171 ms. Trace:
I20260709 12:27:54.868068  6258 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.899118  5958 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:54.893281  6266 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:54.995419  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:54.971583  6076 consensus_meta.cc:287] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 12:27:54.991712  3928 rpcz_store.cc:276] 0709 12:27:53.806235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:53.830941 (+ 24706us) service_pool.cc:224] Handling call
0709 12:27:54.977198 (+1146257us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b540031bad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:54.977296 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209254784}
I20260709 12:27:54.998909  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.006547  3854 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:27:55.009933  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:54.969786  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:55.013129  3855 raft_consensus.cc:2368] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5.
I20260709 12:27:54.935403  6190 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:55.017849  3924 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:55.023231  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:55.024029  3997 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:54.974467  6068 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:55.022459  4536 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:55.019733  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.031424  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:55.042084  4000 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:55.038992  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:54.969043  6128 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:54.994165  4567 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:55.048454  3931 raft_consensus.cc:2368] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4.
I20260709 12:27:55.042852  3997 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:27:55.053107  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:55.056926  4005 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:27:55.059660  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:55.061703  3854 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:55.074067  3923 raft_consensus.cc:2368] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5.
I20260709 12:27:55.065136  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 675) took 1037 ms. Trace:
I20260709 12:27:55.041923  6229 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:55.050199  6255 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:54.991562  6259 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:55.065631  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 514) took 1142 ms. Trace:
I20260709 12:27:55.041170  4001 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:55.067602  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:55.014693  6076 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:55.085182  4005 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:55.083469  3925 rpcz_store.cc:276] 0709 12:27:53.912311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:53.912808 (+   497us) service_pool.cc:224] Handling call
0709 12:27:53.927903 (+ 15095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:53.942054 (+ 14151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:53.942087 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:53.942635 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 12:27:54.215964 (+273329us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:54.216033 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:54.216140 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:55.054322 (+838182us) raft_consensus.cc:1685] finished
0709 12:27:55.054350 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:55.054503 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3552,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9182,"thread_start_us":257935,"threads_started":1,"wal-append.queue_time_us":542708}
W20260709 12:27:55.102699  6261 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:27:55.102473  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:55.064618  6263 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:55.100924  4000 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:27:55.074990  4573 rpcz_store.cc:276] 0709 12:27:54.028029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.039105 (+ 11076us) service_pool.cc:224] Handling call
0709 12:27:54.064353 (+ 25248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:54.064573 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:54.176499 (+111926us) log.cc:844] Serialized 14 byte log entry
0709 12:27:54.968220 (+791721us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b1800389f20. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b7723a 00007fe051fe1a2a
0709 12:27:55.064699 (+ 96479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:55.064798 (+    99us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:55.064866 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:55.064946 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:55.065069 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":110297,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":95,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":11962496,"thread_start_us":95648,"threads_started":1}
I20260709 12:27:55.119890  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:55.082314  6255 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:55.120676  4005 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:55.105599  6219 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:27:55.129527  6069 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:55.359831  6128 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:55.120189  6263 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:55.212358  6270 log.cc:927] Time spent T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.254s	user 0.000s	sys 0.003s
I20260709 12:27:55.181380  3853 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:55.178576  6136 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:55.383080  3739 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d5c03e098f9a45cd94c52ada1bc9fa11 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:55.383442  6136 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:55.189261  6275 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:27:55.267967  6259 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:27:55.215628  6209 consensus_meta.cc:287] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.560s	user 0.006s	sys 0.004s
I20260709 12:27:55.267127  6266 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:55.386287  6209 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:55.276156  6252 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:55.387545  3857 raft_consensus.cc:2393] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 3: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:55.387974  4574 raft_consensus.cc:2368] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3.
I20260709 12:27:55.389104  6252 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:55.130277  6126 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:55.390633  6209 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:55.359311  4001 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:55.391754  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.398252  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.432416  3857 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
W20260709 12:27:55.245009  4537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.773s (SENT) [suppressed 33 similar messages]
W20260709 12:27:55.284067  6269 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260709 12:27:55.288535  6074 consensus_meta.cc:287] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.638s	user 0.009s	sys 0.000s
W20260709 12:27:55.273141  6277 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:27:55.467857  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.454823  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.404404  6069 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:55.457850  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.157455  6231 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:55.459292  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.392067  6255 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:55.292371  5963 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:55.462124  6264 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:55.463593  6263 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:55.451990  6259 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:55.473059  6264 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:55.291783  5682 consensus_meta.cc:287] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.028s	user 0.003s	sys 0.007s
W20260709 12:27:55.466671  3932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.021s	sys 0.013s
I20260709 12:27:55.292613  6046 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:55.466159  3969 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:55.294412  6190 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:55.478807  6264 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:55.479161  6231 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:55.479550  6032 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:55.267798  6213 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:55.480477  6213 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:55.458580  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.483481  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.485591  6032 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:55.486284  6032 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:55.213240  5958 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:55.469540  3857 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:27:55.272425  6076 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:55.245437  6050 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:55.470222  6069 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:55.151171  6230 consensus_meta.cc:287] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
I20260709 12:27:55.491410  6230 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:55.475342  3932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.021s	sys 0.013s
I20260709 12:27:55.473356  6259 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:55.479570  6231 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:55.127432  5971 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:55.493894  6230 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:55.557798  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2116) took 1118 ms. Trace:
I20260709 12:27:55.558257  3971 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:55.559656  3971 leader_election.cc:400] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3.
I20260709 12:27:55.559192  3932 rpcz_store.cc:276] 0709 12:27:54.439552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.862416 (+422864us) service_pool.cc:224] Handling call
0709 12:27:54.872107 (+  9691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:54.872295 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:54.924064 (+ 51769us) log.cc:844] Serialized 14 byte log entry
0709 12:27:55.557501 (+633437us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:55.557545 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:55.557581 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:55.557638 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:55.557742 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1942,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":623398,"threads_started":1}
I20260709 12:27:55.560477  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.561714  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.562676  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:55.562788  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:55.563305  3997 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:55.563236  3969 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:55.512614  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 1507) took 1463 ms. Trace:
I20260709 12:27:55.498551  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:55.565949  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:55.499910  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.241163  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:55.568223  4572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 692) took 1021 ms. Trace:
I20260709 12:27:55.565419  3931 rpcz_store.cc:276] 0709 12:27:54.049702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.049872 (+   170us) service_pool.cc:224] Handling call
0709 12:27:55.512326 (+1462454us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54000d5054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:55.512530 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2293734144}
I20260709 12:27:55.520068  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 685) took 1262 ms. Trace:
I20260709 12:27:55.574005  4569 rpcz_store.cc:276] 0709 12:27:54.257491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.257698 (+   207us) service_pool.cc:224] Handling call
0709 12:27:55.519818 (+1262120us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54004880d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:55.519968 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574443776}
W20260709 12:27:55.516247  3924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 1514) took 1333 ms (client timeout 1759 ms). Trace:
I20260709 12:27:55.572997  4572 rpcz_store.cc:276] 0709 12:27:54.546667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.654508 (+107841us) service_pool.cc:224] Handling call
0709 12:27:54.673402 (+ 18894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:54.676910 (+  3508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:54.676928 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:54.704928 (+ 28000us) log.cc:844] Serialized 487 byte log entry
0709 12:27:54.871231 (+166303us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:54.871272 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:54.871337 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:55.504299 (+632962us) raft_consensus.cc:1685] finished
0709 12:27:55.504318 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:55.568165 (+ 63847us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280,"thread_start_us":84754,"threads_started":1,"wal-append.queue_time_us":330721}
W20260709 12:27:55.517197  3855 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1577) took 1538 ms (client timeout 1934 ms). Trace:
I20260709 12:27:55.576584  3850 raft_consensus.cc:2393] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 3: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:27:55.576099  3855 rpcz_store.cc:269] 0709 12:27:53.978588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:53.981844 (+  3256us) service_pool.cc:224] Handling call
0709 12:27:55.516919 (+1535075us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b54002a2bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:55.517090 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2284468096}
W20260709 12:27:55.575390  3924 rpcz_store.cc:269] 0709 12:27:54.182757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.182954 (+   197us) service_pool.cc:224] Handling call
0709 12:27:55.515965 (+1333011us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b5400196ed4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:55.516163 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888401664}
I20260709 12:27:55.469784  6074 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:55.583738  3848 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:27:55.572732  5682 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:55.575837  6190 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:55.584666  6190 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:55.586011  5682 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:55.586686  6190 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:55.586874  6128 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:55.587205  6190 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:55.587355  6128 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:55.587671  6190 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:55.589371  6128 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:55.589545  6046 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.590049  6046 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:55.590598  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:55.591207  4574 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:55.591868  6046 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:55.592280  3930 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 1512) took 1515 ms (client timeout 1857 ms). Trace:
I20260709 12:27:55.592710  4001 raft_consensus.cc:1240] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:27:55.592797  3849 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:55.576036  5857 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:55.493743  6069 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:55.511365  6110 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:55.582684  6259 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:55.593761  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:55.627080  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.603186  4574 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:55.617393  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:55.631947  4573 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:55.628178  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:55.627897  6012 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:55.593686  5857 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:27:55.616629  3822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.020s	sys 0.085s
W20260709 12:27:55.626817  3851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1574) took 1747 ms (client timeout 1759 ms). Trace:
W20260709 12:27:55.639609  3822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.020s	sys 0.086s
I20260709 12:27:55.637423  3997 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
W20260709 12:27:55.640269  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 995787us
W20260709 12:27:55.592716  3930 rpcz_store.cc:269] 0709 12:27:54.076706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.151232 (+ 74526us) service_pool.cc:224] Handling call
0709 12:27:55.592094 (+1440862us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b5400236ed4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:55.592220 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1306605440}
I20260709 12:27:55.519812  6136 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:27:55.639657  3851 rpcz_store.cc:269] 0709 12:27:53.878960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:53.928511 (+ 49551us) service_pool.cc:224] Handling call
0709 12:27:55.626590 (+1698079us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b5400191c54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:55.626734 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2027583872}
I20260709 12:27:55.644865  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:55.643654  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:55.647081  3856 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:55.572352  6231 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:55.647394  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.650085  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:55.578020  6230 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:55.652077  3850 raft_consensus.cc:2393] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 5: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:55.649303  3822 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:55.627671  6190 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:55.636023  6110 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:55.629025  4568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 691) took 1124 ms. Trace:
I20260709 12:27:55.662542  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:55.663293  3851 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:55.642649  5857 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:55.666889  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:55.668767  3997 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:55.669942  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 1516) took 1448 ms. Trace:
I20260709 12:27:55.675580  4573 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:55.676155  3997 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:55.673784  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.655728  6126 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:55.655521  6230 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:55.670351  3923 rpcz_store.cc:276] 0709 12:27:54.221175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.235117 (+ 13942us) service_pool.cc:224] Handling call
0709 12:27:55.669723 (+1434606us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54003061d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:55.669858 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1674378624}
I20260709 12:27:55.678974  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:55.667016  6213 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:55.683180  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:55.683678  6219 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:55.684244  6219 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:55.679621  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:55.691243  3997 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:55.642467  6012 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:55.645718  6055 consensus_queue.cc:1059] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:27:55.703500  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:55.704619  4569 raft_consensus.cc:2393] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:55.709730  3997 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:27:55.711030  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:55.711736  3997 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:27:55.717159  5971 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:55.722491  5971 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:55.726027  6252 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:55.726624  6252 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:55.719185  6186 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:27:55.691125  6230 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:55.662158  4568 rpcz_store.cc:276] 0709 12:27:54.504441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.562361 (+ 57920us) service_pool.cc:224] Handling call
0709 12:27:55.627905 (+1065544us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b58000d5c98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2eee 000000000036eb39 00007fe056f261e0 00007fe056fef0c4 00007fe056fef131 00007fe056fb0fc0 00007fe056f9b929 00007fe056f9b3d2 00007fe050512bd4
0709 12:27:55.628137 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:55.628389 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:55.628440 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:55.628523 (+    83us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:55.628576 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:55.628661 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:55.628813 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9878400}
I20260709 12:27:55.694186  6076 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:55.754971  6255 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:55.756150  6209 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:55.756742  6209 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:55.759227  6219 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:55.760831  4574 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:55.775103  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:55.780309  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2045) took 1888 ms. Trace:
I20260709 12:27:55.780730  4006 rpcz_store.cc:276] 0709 12:27:53.891953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:53.892086 (+   133us) service_pool.cc:224] Handling call
0709 12:27:53.892438 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:54.539487 (+647049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:55.780038 (+1240551us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b540030ff54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:55.780229 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1450781952}
I20260709 12:27:55.780825  6076 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:55.783361  3853 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:55.801657  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:55.802497  3848 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:55.801127  6255 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:55.829452  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 689) took 1476 ms. Trace:
I20260709 12:27:55.825516  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:55.826349  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:55.836310  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 591283us
I20260709 12:27:55.830030  4570 rpcz_store.cc:276] 0709 12:27:54.352855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.437573 (+ 84718us) service_pool.cc:224] Handling call
0709 12:27:55.829228 (+1391655us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54006de7d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:55.829379 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956137728}
I20260709 12:27:55.904625  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:55.907399  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 348) took 1117 ms. Trace:
I20260709 12:27:55.907920  4003 rpcz_store.cc:276] 0709 12:27:54.789536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.789658 (+   122us) service_pool.cc:224] Handling call
0709 12:27:54.913354 (+123696us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b58001b3f98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056fb0fc0 00007fe056f9b929 00007fe056f9b3d2 00007fe050512bd4
0709 12:27:54.913541 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:54.984129 (+ 70588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:54.984157 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:54.984196 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:54.984223 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:55.907087 (+922864us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b5400127354. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:55.907149 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:55.907324 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171135232}
I20260709 12:27:55.930564  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 351) took 1074 ms. Trace:
I20260709 12:27:55.931124  3998 rpcz_store.cc:276] 0709 12:27:54.856221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.856478 (+   257us) service_pool.cc:224] Handling call
0709 12:27:54.857834 (+  1356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:54.983850 (+126016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:54.983881 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:54.983927 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:54.983956 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:55.930275 (+946319us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400375854. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:55.930330 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:55.930482 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277877504}
I20260709 12:27:55.934903  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:55.909997  6052 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:55.979204  6219 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:55.978973  6069 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:55.917574  6253 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:56.010715  6219 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:56.016829  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 430190us
I20260709 12:27:56.017967  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:55.971127  6213 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:56.036536  3821 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:56.042246  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:56.043128  3821 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:56.043133  3923 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:56.044278  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:56.059190  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:56.059523  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:56.059289  4574 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:56.060304  3923 raft_consensus.cc:2393] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:56.061746  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:56.068887  3923 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:56.070930  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:56.072065  4004 raft_consensus.cc:2393] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:56.077420  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:56.077802  3930 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:56.067235  4569 raft_consensus.cc:2955] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:27:56.083277  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:56.084226  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:56.029666  6253 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:56.076077  3997 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:27:56.088379  6209 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:56.089088  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:56.090181  5857 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:56.043366  6050 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:56.059196  6055 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:56.095603  3929 raft_consensus.cc:2393] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:56.077600  6051 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:56.104617  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:56.106040  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:56.108767  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:56.099141  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:56.114357  4000 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:56.012894  6052 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:56.076725  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:56.013422  6069 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:56.112831  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:56.119462  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:56.059738  6213 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:56.113109  6050 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:56.124075  5853 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:56.112833  6055 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.125286  6069 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:56.126006  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:56.126886  3971 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:56.119447  4004 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:56.111181  6289 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:56.134150  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:56.136086  3998 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:56.140120  4006 raft_consensus.cc:2393] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:56.140882  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:56.156543  4574 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:27:56.160797  3931 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
W20260709 12:27:56.162081  3969 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.011s	sys 0.026s
W20260709 12:27:56.163952  3969 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.011s	sys 0.026s
W20260709 12:27:56.164371  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 560182us
I20260709 12:27:56.112334  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:27:56.166805  3855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.010s	sys 0.014s
W20260709 12:27:56.168016  3855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.010s	sys 0.015s
I20260709 12:27:56.168138  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:27:56.166564  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 350682us
I20260709 12:27:56.166222  3997 raft_consensus.cc:2393] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:56.148701  3930 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:27:56.173070  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:56.174937  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:56.140414  6055 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:56.138159  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:56.133165  6051 raft_consensus.cc:697] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:56.182606  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:56.158972  6272 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:56.179863  3848 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:27:56.185389  3928 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:27:56.179165  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:56.187633  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:56.188403  3929 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:56.131973  5971 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:56.150285  5857 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:27:56.207873  3895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.028s	sys 0.038s
I20260709 12:27:56.189431  3969 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:56.215919  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:56.150437  6076 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:56.151202  6032 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:56.242491  3895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.029s	sys 0.038s
I20260709 12:27:56.242496  4574 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
W20260709 12:27:56.243811  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 54454.2us
I20260709 12:27:56.248323  3969 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:56.184919  6245 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.259044  3969 leader_election.cc:400] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5.
I20260709 12:27:56.249348  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:56.264246  6245 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:56.264834  3929 raft_consensus.cc:2368] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3.
I20260709 12:27:56.266651  6245 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:56.267323  6245 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:56.268666  3969 leader_election.cc:403] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:56.207620  4566 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:27:56.271816  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:56.270196  3969 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:56.246568  6252 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:56.273850  3929 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:56.247361  6272 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:56.275496  6219 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:56.259260  6032 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:27:56.253075  5857 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:56.321769  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:27:56.330577  3851 consensus_meta.cc:287] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.663s	user 0.013s	sys 0.014s
I20260709 12:27:56.335752  3851 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
W20260709 12:27:56.338001  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 296494us
W20260709 12:27:56.339921  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 69814us
I20260709 12:27:56.341208  3969 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:27:56.348984  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 238295us
W20260709 12:27:56.320429  6284 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 12:27:56.250451  3930 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:27:56.308512  6287 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 12:27:56.316119  6230 consensus_meta.cc:287] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.026s
W20260709 12:27:56.308429  6110 consensus_meta.cc:287] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.639s	user 0.018s	sys 0.015s
I20260709 12:27:56.354628  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:56.355156  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:56.358879  3928 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
W20260709 12:27:56.359288  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 315102us
I20260709 12:27:56.309916  6052 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:56.310441  6253 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:56.309383  6213 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:56.362552  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:56.348716  5857 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:56.351465  6205 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:56.381554  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:56.347713  6245 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5.
I20260709 12:27:56.310274  6272 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:56.386608  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:56.391669  3897 leader_election.cc:400] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:27:56.392334  3929 raft_consensus.cc:2393] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 2: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:27:56.392477  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 50247.7us
I20260709 12:27:56.394292  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:56.395274  3897 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:56.397238  3970 leader_election.cc:400] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4.
I20260709 12:27:56.397686  3970 leader_election.cc:403] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:56.249174  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 613648us
W20260709 12:27:56.413578  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 184678us
I20260709 12:27:56.379086  6205 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.411705  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:56.423739  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:56.385903  5857 raft_consensus.cc:697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:56.360023  6230 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:56.362260  6110 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:56.441649  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 273888us
I20260709 12:27:56.447120  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:56.420471  5971 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:56.454726  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2095) took 1416 ms. Trace:
I20260709 12:27:56.453558  3971 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:56.386193  6253 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:27:56.430884  6205 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:56.436106  5853 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:56.460832  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 385607us
I20260709 12:27:56.471591  4000 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:56.422695  6291 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:56.456875  4005 rpcz_store.cc:276] 0709 12:27:55.038197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:55.389948 (+351751us) service_pool.cc:224] Handling call
0709 12:27:55.390331 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:55.395170 (+  4839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:55.395215 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:55.395666 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:27:55.864773 (+469107us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:55.864832 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:55.865197 (+   365us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:56.454430 (+589233us) raft_consensus.cc:1685] finished
0709 12:27:56.454462 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:56.454650 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4400,"raft.queue_time_us":14054,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":12613,"thread_start_us":408730,"threads_started":1,"wal-append.queue_time_us":615604}
I20260709 12:27:56.463083  3971 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:56.460127  3923 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:27:56.379913  6051 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:56.441772  6050 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:56.477157  4571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 677) took 2410 ms. Trace:
I20260709 12:27:56.495644  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:56.496465  4569 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:56.493335  4571 rpcz_store.cc:276] 0709 12:27:54.062134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.062391 (+   257us) service_pool.cc:224] Handling call
0709 12:27:54.077342 (+ 14951us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:54.077755 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:54.077796 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:54.654548 (+576752us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b18003b9c20. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeb82a6 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a
0709 12:27:55.514232 (+859684us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b2c000201b8. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:27:55.514949 (+   717us) log.cc:844] Serialized 26 byte log entry
0709 12:27:55.837674 (+322725us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:55.837739 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:55.837829 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:56.471925 (+634096us) raft_consensus.cc:1685] finished
0709 12:27:56.471956 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:56.472129 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":80681,"spinlock_wait_cycles":53800192,"thread_start_us":305736,"threads_started":1,"wal-append.queue_time_us":564352}
I20260709 12:27:56.464612  6245 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4.
I20260709 12:27:56.468679  5853 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.500674  3971 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:56.508893  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:56.515265  6139 raft_consensus.cc:3055] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:56.515815  6139 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:56.516845  6139 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:56.518165  6055 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:56.520053  4574 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:56.520906  6055 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:56.521282  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:56.522117  4566 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:56.506381  5853 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:56.493176  5971 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:56.527732  6110 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:56.477667  6302 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:27:56.531059  6230 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:56.499169  6310 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:56.532076  6310 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:56.532757  3754 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39516 (request call id 222) took 11251 ms (client timeout 15000 ms). Trace:
I20260709 12:27:56.499670  6268 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:56.534178  6268 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:56.534087  5857 consensus_queue.cc:237] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:56.497735  6291 raft_consensus.cc:697] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:56.535857  6291 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:56.534768  6268 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:56.538889  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 116790us
I20260709 12:27:56.500057  6050 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.540534  6311 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:56.540756  6297 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:27:56.542454  6272 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:56.544588  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:56.561859  3897 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:56.501368  3739 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4eedd844c09d456ca0b3614490dd1dbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:27:56.570750  3739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 69440.6us
W20260709 12:27:56.567569  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 178810us
I20260709 12:27:56.567451  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:56.573561  3848 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:56.573782  3970 leader_election.cc:400] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3.
I20260709 12:27:56.574746  3970 leader_election.cc:400] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5.
W20260709 12:27:56.565122  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 215328us
I20260709 12:27:56.575914  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:56.580891  3821 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:56.569685  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:56.560643  6230 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:56.582970  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:56.601414  3853 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:27:56.584352  6310 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:56.584435  6012 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:56.585788  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:56.586495  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:56.590297  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:56.563309  6126 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:27:56.588635  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 90541.8us
I20260709 12:27:56.589906  3854 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:56.593116  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:56.580891  3970 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:56.615561  3970 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:56.559894  6110 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:27:56.602820  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 102226us
I20260709 12:27:56.617668  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:56.623132  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:56.590497  6076 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:56.630096  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:56.607194  4536 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:56.590720  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:56.625089  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 201542us
I20260709 12:27:56.593953  6301 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.632993  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:56.559281  6050 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:56.621785  3971 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:56.604501  3821 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:56.635140  4536 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:56.564070  6139 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:56.601033  6230 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:56.640407  3970 leader_election.cc:400] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3.
I20260709 12:27:56.661809  3970 leader_election.cc:403] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:27:56.593762  6032 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:27:56.619884  6311 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:56.590636  6253 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:27:56.620121  6310 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:56.610059  6055 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:56.666069  3849 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
W20260709 12:27:56.676604  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 63032.5us
W20260709 12:27:56.691361  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 88947.6us
W20260709 12:27:56.533258  3754 rpcz_store.cc:269] 0709 12:27:45.281401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.281628 (+   227us) service_pool.cc:224] Handling call
0709 12:27:56.532647 (+11251019us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:52.756993 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:52.938614 (+181621us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:52.942834 (+  4220us) write_op.cc:435] Acquired schema lock
0709 12:27:52.946222 (+  3388us) tablet.cc:662] Decoding operations
0709 12:27:52.948939 (+  2717us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:52.949027 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:52.949055 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:27:53.024275 (+ 75220us) tablet.cc:701] Row locks acquired
0709 12:27:53.028792 (+  4517us) write_op.cc:260] PREPARE: finished
0709 12:27:53.028996 (+   204us) write_op.cc:270] Start()
0709 12:27:53.029189 (+   193us) write_op.cc:276] Timestamp: P: 1783600073028917 usec, L: 0
0709 12:27:53.029222 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:27:53.030030 (+   808us) log.cc:844] Serialized 530 byte log entry
0709 12:27:53.874907 (+844877us) op_driver.cc:464] REPLICATION: finished
0709 12:27:54.379018 (+504111us) write_op.cc:301] APPLY: starting
0709 12:27:54.430096 (+ 51078us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:54.466288 (+ 36192us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:54.529638 (+ 63350us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:54.598136 (+ 68498us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:54.598469 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:27:54.598539 (+    70us) write_op.cc:312] APPLY: finished
0709 12:27:54.598877 (+   338us) log.cc:844] Serialized 23 byte log entry
0709 12:27:54.599126 (+   249us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:54.599234 (+   108us) write_op.cc:454] Released schema lock
0709 12:27:54.599312 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:54.634263 (+ 34951us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:54.647138 (+ 12875us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":737697,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":388635,"apply.run_cpu_time_us":3010,"apply.run_wall_time_us":249907,"num_ops":1,"prepare.queue_time_us":155641,"prepare.run_cpu_time_us":40343,"prepare.run_wall_time_us":645352,"raft.queue_time_us":415446,"raft.run_cpu_time_us":12116,"raft.run_wall_time_us":191857,"replication_time_us":845512,"thread_start_us":770280,"threads_started":4,"wal-append.queue_time_us":411289,"wal-append.run_cpu_time_us":16083,"wal-append.run_wall_time_us":2162511}]]}
I20260709 12:27:56.643764  6052 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:56.722536  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 82971.7us
I20260709 12:27:56.644332  6320 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:56.726910  3855 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:56.662256  6289 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:56.622934  6126 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:56.717403  6012 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:56.704464  4536 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:56.631167  6110 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:56.636457  6076 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:56.665542  6230 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:56.674839  6258 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:56.743196  6310 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3.
I20260709 12:27:56.731254  6137 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:56.722869  6327 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:56.751034  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 46722.5us
I20260709 12:27:56.736655  6311 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:56.755908  6312 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:27:56.758174  6298 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:27:56.730654  6322 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:56.804585  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:27:56.765012  6314 log.cc:927] Time spent T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.132s	user 0.001s	sys 0.002s
I20260709 12:27:56.765702  6076 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:56.738459  6319 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:56.748234  6303 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:27:56.730511  6320 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:56.643226  6301 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:56.773082  6110 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:56.774111  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 133878us
I20260709 12:27:56.846453  3970 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:56.847810  3970 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:56.777964  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:56.805326  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:56.745957  6289 raft_consensus.cc:697] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:56.763438  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 567) took 1114 ms. Trace:
I20260709 12:27:56.750212  6074 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:56.746436  6012 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:56.788403  6316 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:56.782568  6311 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:56.870029  6311 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:56.846529  6319 raft_consensus.cc:697] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:56.785799  6321 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:56.844246  6190 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:56.874219  6321 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:56.874550  6190 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:56.876778  6321 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:56.849510  3970 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:56.845144  6320 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:56.860494  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:56.868089  6289 consensus_queue.cc:237] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:56.879760  6301 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:56.851169  3852 rpcz_store.cc:276] 0709 12:27:55.648816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:55.903880 (+255064us) service_pool.cc:224] Handling call
0709 12:27:55.904297 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:55.909135 (+  4838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:55.909183 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:55.918092 (+  8909us) log.cc:844] Serialized 26 byte log entry
0709 12:27:56.473934 (+555842us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:56.474067 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:56.474269 (+   202us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:56.763217 (+288948us) raft_consensus.cc:1685] finished
0709 12:27:56.763249 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:56.763375 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4180,"thread_start_us":461055,"threads_started":1,"wal-append.queue_time_us":646837}
I20260709 12:27:56.876960  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 699) took 1118 ms. Trace:
I20260709 12:27:56.821113  6322 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:56.882084  4573 rpcz_store.cc:276] 0709 12:27:55.758743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:55.758935 (+   192us) service_pool.cc:224] Handling call
0709 12:27:55.759296 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:55.759665 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:55.759698 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:56.054262 (+294564us) log.cc:844] Serialized 26 byte log entry
0709 12:27:56.345982 (+291720us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:56.346044 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:56.346145 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:56.876710 (+530565us) raft_consensus.cc:1685] finished
0709 12:27:56.876736 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:56.876890 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":419,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":256098,"threads_started":1,"wal-append.queue_time_us":375584}
W20260709 12:27:56.900692  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 207672us
I20260709 12:27:56.894634  6012 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:56.912627  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 308210us
I20260709 12:27:56.912113  3897 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:56.918534  3821 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:56.921273  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:56.922088  3930 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:56.922783  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:56.923728  3929 raft_consensus.cc:2410] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:27:56.926494  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:56.900399  6316 raft_consensus.cc:697] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:27:57.018819  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 333678us
I20260709 12:27:56.938899  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:57.040016  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:27:57.115065  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 493311us
I20260709 12:27:57.344656  6050 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:56.911998  6321 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.471s
I20260709 12:27:56.928287  3821 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:57.015312  6327 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:56.916086  6310 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:57.437820  3926 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:57.069550  5857 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:57.400556  6289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.011s	sys 0.022s
I20260709 12:27:57.441380  3931 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:56.926680  3929 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:27:57.486620  6268 consensus_meta.cc:287] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.926s	user 0.014s	sys 0.004s
I20260709 12:27:56.873260  6319 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:57.408314  4536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.017s	sys 0.027s
W20260709 12:27:57.380569  3848 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.022s	sys 0.050s
I20260709 12:27:57.494911  6336 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:27:57.515566  3848 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.024s	sys 0.053s
I20260709 12:27:57.007679  6333 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:57.445732  3822 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:27:57.461306  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 533092us
I20260709 12:27:57.467343  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:57.448937  6139 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:57.130229  6291 consensus_queue.cc:1059] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.328s
I20260709 12:27:57.479108  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:57.087954  6330 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:57.414650  6252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.009s
W20260709 12:27:57.468887  6311 consensus_meta.cc:287] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.598s	user 0.014s	sys 0.008s
W20260709 12:27:57.459300  6231 consensus_meta.cc:287] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.795s	user 0.010s	sys 0.024s
I20260709 12:27:57.494498  5857 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:57.130709  6339 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.407s
W20260709 12:27:57.479585  6205 consensus_meta.cc:287] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.007s	user 0.008s	sys 0.012s
W20260709 12:27:57.428568  6219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.001s	sys 0.008s
W20260709 12:27:57.513701  4536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.017s	sys 0.029s
I20260709 12:27:57.507807  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 575) took 1505 ms. Trace:
I20260709 12:27:57.493507  6310 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.555492  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:57.506070  6050 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:57.500795  6320 consensus_meta.cc:287] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.623s	user 0.013s	sys 0.004s
W20260709 12:27:57.497844  6289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.011s	sys 0.026s
W20260709 12:27:57.513533  6230 consensus_meta.cc:287] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.732s	user 0.013s	sys 0.000s
I20260709 12:27:57.511276  6268 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:57.557583  6231 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:57.557080  5857 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:57.214875  6322 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:57.554611  6252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.000s	sys 0.010s
W20260709 12:27:57.510576  5853 consensus_meta.cc:287] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.987s	user 0.014s	sys 0.006s
W20260709 12:27:57.636416  3898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.025s	sys 0.044s
I20260709 12:27:57.636227  5853 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:57.638629  5853 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:57.554682  6316 consensus_queue.cc:237] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:57.616493  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:57.642331  6340 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:57.496934  6126 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:57.561825  3849 rpcz_store.cc:276] 0709 12:27:56.002466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:56.073382 (+ 70916us) service_pool.cc:224] Handling call
0709 12:27:56.099080 (+ 25698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:56.681440 (+582360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:57.507462 (+826022us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54000550d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:57.507706 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303408896}
W20260709 12:27:57.561635  6219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.002s	sys 0.009s
W20260709 12:27:57.636801  3898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.025s	sys 0.044s
W20260709 12:27:57.561776  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 735653us
I20260709 12:27:57.623245  6230 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:57.644693  6335 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:27:57.644567  4003 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:57.617869  6310 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:57.614655  6323 raft_consensus.cc:3055] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:57.650215  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:57.653995  3930 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:57.580140  6341 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:57.656284  6339 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:57.561744  6332 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.686780  6332 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:57.561805  6330 raft_consensus.cc:697] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:57.556368  6139 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:57.664510  6012 consensus_meta.cc:287] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.002s
I20260709 12:27:57.667289  6268 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:57.671156  6231 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:57.613394  6205 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:57.662034  6323 raft_consensus.cc:740] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:57.557451  6311 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:57.698652  6330 consensus_queue.cc:237] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:57.700776  6311 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:57.685700  6230 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:57.696810  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1518) took 1531 ms. Trace:
I20260709 12:27:57.697914  6205 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:57.703239  3924 rpcz_store.cc:276] 0709 12:27:56.165742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:56.167838 (+  2096us) service_pool.cc:224] Handling call
0709 12:27:56.773906 (+606068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:56.774077 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:56.774101 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:56.774155 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:56.774184 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:56.774236 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:57.696615 (+922379us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54000ee7d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:57.696747 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1351673216}
I20260709 12:27:57.706199  6012 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:57.708315  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2104) took 1591 ms. Trace:
I20260709 12:27:57.708966  6012 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:57.708714  4000 rpcz_store.cc:276] 0709 12:27:56.116557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:56.116716 (+   159us) service_pool.cc:224] Handling call
0709 12:27:57.708086 (+1591370us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b540036e554. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:57.708225 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730958208}
I20260709 12:27:57.726718  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:57.727638  3924 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:57.728598  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:57.728863  3929 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:57.729236  3927 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:27:57.736589  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:57.738234  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:57.622663  6050 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:57.739631  3924 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:27:57.743142  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:27:57.747139  6337 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.880s	user 0.005s	sys 0.005s
I20260709 12:27:57.625242  6320 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:57.760721  3926 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:27:57.766534  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1602) took 1200 ms. Trace:
I20260709 12:27:57.783005  3855 rpcz_store.cc:276] 0709 12:27:56.566602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:56.566737 (+   135us) service_pool.cc:224] Handling call
0709 12:27:57.766259 (+1199522us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400191c54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:57.766450 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258325760}
I20260709 12:27:57.774117  6345 raft_consensus.cc:3055] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:27:57.778829  6326 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.690s	user 0.006s	sys 0.006s
I20260709 12:27:57.784413  6345 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:57.785645  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 717) took 1712 ms. Trace:
I20260709 12:27:57.786324  4570 rpcz_store.cc:276] 0709 12:27:56.073508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:56.081447 (+  7939us) service_pool.cc:224] Handling call
0709 12:27:56.081773 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:56.465921 (+384148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:56.466049 (+   128us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:56.482033 (+ 15984us) log.cc:844] Serialized 26 byte log entry
0709 12:27:56.640344 (+158311us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:56.640381 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:56.640450 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:57.778402 (+1137952us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b24003185a8. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ed709c4 00007fe04ed6eacb 00007fe04ef29dc9 00007fe04ef29a55 00007fe04ef2909d 00007fe051b5b10e 00007fe051b7288c 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221
0709 12:27:57.785278 (+  6876us) raft_consensus.cc:1685] finished
0709 12:27:57.785306 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:57.785579 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":279172,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":8310528,"thread_start_us":538063,"threads_started":2,"wal-append.queue_time_us":419693}
I20260709 12:27:57.789471  6323 consensus_queue.cc:260] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:57.793680  3925 raft_consensus.cc:2376] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6. Re-sending same reply.
I20260709 12:27:57.795172  6050 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:57.658757  6340 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:57.797962  6340 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:57.799899  6332 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:57.759915  6139 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:57.810094  6190 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:57.783967  6320 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:57.813115  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:57.814420  3926 raft_consensus.cc:2410] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:27:57.817059  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:57.817325  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:57.817982  3926 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:27:57.677850  6341 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:27:57.854734  4003 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2100) took 1763 ms (client timeout 1738 ms). Trace:
W20260709 12:27:57.863373  4003 rpcz_store.cc:269] 0709 12:27:56.090876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:56.093067 (+  2191us) service_pool.cc:224] Handling call
0709 12:27:57.854454 (+1761387us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400128754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:57.854633 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3502921600}
I20260709 12:27:57.857321  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:57.864923  3927 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:57.869656  6345 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:57.934239  6345 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:57.885092  6341 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:57.958348  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:57.964864  6336 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:57.882517  3753 catalog_manager.cc:5697] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:57.966487  6336 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:57.969358  3753 catalog_manager.cc:5697] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 4 to 6, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 6 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:57.980054  3970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.021s	sys 0.069s
W20260709 12:27:58.003899  3970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.021s	sys 0.069s
W20260709 12:27:58.004510  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 1.155e+06us
I20260709 12:27:58.005281  3970 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:58.008726  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:58.009567  6353 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:58.011041  6353 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:27:58.010996  3932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.009s	sys 0.025s
I20260709 12:27:58.012432  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 518) took 1092 ms. Trace:
I20260709 12:27:58.012797  3932 rpcz_store.cc:276] 0709 12:27:56.919717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:57.003106 (+ 83389us) service_pool.cc:224] Handling call
0709 12:27:57.003595 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:57.016928 (+ 13333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:57.016990 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:57.369137 (+352147us) log.cc:844] Serialized 26 byte log entry
0709 12:27:58.012070 (+642933us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:58.012122 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:58.012190 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:58.012245 (+    55us) raft_consensus.cc:1685] finished
0709 12:27:58.012256 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:58.012371 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15387,"raft.queue_time_us":97835,"raft.run_cpu_time_us":1452,"raft.run_wall_time_us":27864,"thread_start_us":517053,"threads_started":1,"wal-append.queue_time_us":556639}
I20260709 12:27:58.013854  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.014219  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.014559  4003 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:58.015211  4000 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:57.956861  5857 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:58.018311  3971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.000s	sys 0.049s
W20260709 12:27:58.018772  3971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.000s	sys 0.049s
I20260709 12:27:58.019665  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:58.021552  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:58.023748  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2035) took 1443 ms. Trace:
I20260709 12:27:58.026667  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:27:58.027311  3969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.014s	sys 0.017s
I20260709 12:27:58.024248  3848 rpcz_store.cc:276] 0709 12:27:56.580066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:56.636930 (+ 56864us) service_pool.cc:224] Handling call
0709 12:27:56.637293 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:56.754314 (+117021us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:57.516063 (+761749us) log.cc:844] Serialized 14 byte log entry
0709 12:27:57.979643 (+463580us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:57.979718 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:57.979780 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:58.023443 (+ 43663us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54002ed954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:58.023497 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:58.023657 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":809077,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":38548,"spinlock_wait_cycles":268528896,"thread_start_us":1191264,"threads_started":2,"wal-append.queue_time_us":460390}
W20260709 12:27:58.027693  3969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.014s	sys 0.017s
W20260709 12:27:58.028003  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 516546us
W20260709 12:27:58.028254  3822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.019s	sys 0.034s
W20260709 12:27:58.045174  3822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.020s	sys 0.034s
I20260709 12:27:58.045258  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:58.037199  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:58.038470  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.045950  4569 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 1.
I20260709 12:27:58.046519  3997 raft_consensus.cc:2393] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 3: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:58.047511  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:58.048143  3997 raft_consensus.cc:2376] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5. Re-sending same reply.
I20260709 12:27:58.048066  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:58.044641  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:58.039819  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.049022  4572 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:58.049371  3998 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 4: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:58.027315  4003 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:58.048529  3895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.302s	user 0.040s	sys 0.079s
W20260709 12:27:58.036434  3820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.018s	sys 0.036s
I20260709 12:27:58.045499  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:58.050731  3820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.018s	sys 0.036s
I20260709 12:27:58.052428  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.052510  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.053501  3998 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:58.053821  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:58.054128  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 154680us
I20260709 12:27:58.053514  4006 raft_consensus.cc:2393] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 2: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:58.055269  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:58.055488  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 609787us
W20260709 12:27:58.050374  3895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.312s	user 0.041s	sys 0.079s
W20260709 12:27:58.056967  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 1.32667e+06us
I20260709 12:27:58.051113  4570 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:27:58.056816  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.060699  4004 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:27:58.061926  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:58.062522  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:58.062667  3997 raft_consensus.cc:2393] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:58.062598  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.063934  4002 raft_consensus.cc:2393] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 2: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:58.064340  3848 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:58.065014  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:58.066025  3857 raft_consensus.cc:2368] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3.
I20260709 12:27:58.066102  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:58.066226  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:58.057540  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.067668  4000 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:58.068346  3928 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:58.004526  3753 catalog_manager.cc:5697] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d reported cstate change: config changed from index 5 to 7, f3cab225ecb7488386a1a19239498cfe (127.2.157.4) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.036302  6306 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.074190  3932 raft_consensus.cc:2393] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 4: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:58.027117  6353 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:58.078871  4006 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:58.076071  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:58.081971  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:58.082594  3849 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 1.
I20260709 12:27:58.081746  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:58.083480  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:58.082607  4001 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:58.085029  4001 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:58.086272  5857 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:58.087378  6139 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:58.088330  4537 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:58.089534  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:58.096870  4003 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:27:58.115590  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:58.102566  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:58.081722  3753 catalog_manager.cc:5697] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 2 to 4, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 4 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.099967  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:58.062047  6303 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:58.119949  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.127842  4004 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:27:58.121599  3897 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:58.128693  4569 raft_consensus.cc:3055] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:58.124894  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:58.129065  4569 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:58.079836  6310 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.095063  6353 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:58.097606  6055 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:58.130103  6050 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.146881  6050 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.148543  6307 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:58.149049  6050 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:58.131462  6218 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:27:58.096894  6327 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:58.151403  6327 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.119381  6352 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:58.155877  6352 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:58.157091  6320 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:58.157655  6320 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:58.131604  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:58.158769  4567 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:27:58.131799  6305 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:58.159801  6320 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:58.159909  6305 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:58.160364  6305 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:58.161119  6303 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.131948  6052 consensus_queue.cc:1059] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:27:58.071139  6357 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:58.133374  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:58.093662  6306 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.129832  4569 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.127628  6362 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.133754  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:58.164469  6255 consensus_queue.cc:1175] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "073f84fcc295417f9bcc1eea29d2bb58" responder_term: 5 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:58.165264  4574 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:58.134179  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:58.134814  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:58.168462  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:58.135409  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:58.170513  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:58.135987  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:58.163015  6357 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:58.171289  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 81832.4us
I20260709 12:27:58.153609  6327 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:58.087972  6139 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.131716  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:58.175009  4572 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:27:58.177771  3924 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:58.135761  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:58.176360  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.133011  6272 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:58.181708  4004 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:58.131305  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:27:58.171962  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 73945.9us
I20260709 12:27:58.184051  3971 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:58.172770  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 47070.5us
I20260709 12:27:58.146015  3897 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:58.136535  3999 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:27:58.171094  4570 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:58.175637  4537 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:58.187062  3822 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:27:58.195457  3972 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.015s	sys 0.020s
W20260709 12:27:58.196053  3972 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.015s	sys 0.020s
W20260709 12:27:58.197429  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 51491.1us
I20260709 12:27:58.099031  6032 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:58.198416  4537 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:58.202350  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:58.204315  4537 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:58.206264  3971 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:58.206632  4538 leader_election.cc:336] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.514s (SENT)
I20260709 12:27:58.205513  4537 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:58.202684  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:58.162714  6219 raft_consensus.cc:3055] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:58.228482  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:58.218814  4537 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:58.209570  4574 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:27:58.383674  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:27:58.303831  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 116889us
I20260709 12:27:58.319087  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.144526  6353 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:27:58.197676  6322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.011s	sys 0.028s
I20260709 12:27:58.385234  4004 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:27:58.143492  6310 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:58.207129  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:58.133213  6358 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:27:58.352813  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 146607us
I20260709 12:27:58.386523  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.386863  3971 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:58.173719  6252 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:58.386637  6358 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.387609  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.358402  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:58.388517  6252 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:58.194943  6272 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:58.389158  6252 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:58.390460  6358 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:58.390864  6272 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:58.359229  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.318087  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.392382  4006 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:58.393416  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.394234  4006 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:58.395270  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.396102  4006 raft_consensus.cc:2368] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:27:58.396944  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.169806  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:58.398875  4567 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:58.145730  6046 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:58.410276  6046 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:58.410992  6046 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:58.145262  6344 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:58.414239  6344 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.423585  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:58.424798  6101 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:58.397792  4006 raft_consensus.cc:2393] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:58.427013  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.428234  4006 raft_consensus.cc:2393] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:58.429255  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.430253  4006 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:27:58.431414  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.364223  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.465214  4000 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 3: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:58.466410  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.466753  4006 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:58.467167  4000 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 1.
I20260709 12:27:58.467806  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.468358  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:58.360109  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.366503  3924 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:27:58.195823  6313 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:58.308156  6319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.004s	sys 0.012s
I20260709 12:27:58.372681  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:58.385493  6322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.013s	sys 0.028s
W20260709 12:27:58.488106  6319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.004s	sys 0.012s
I20260709 12:27:58.488883  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.489145  6357 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:58.275701  6231 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:58.275105  6069 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:58.283679  6345 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:58.282891  6253 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:58.490285  6345 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.490339  6253 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:58.490761  6345 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:58.490825  6253 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:58.275476  6315 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:58.494081  6315 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:58.494496  6315 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:58.418045  6344 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:58.208156  6213 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:58.451395  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:58.365980  6330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.020s	sys 0.040s
W20260709 12:27:58.460827  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 74043.5us
I20260709 12:27:58.208112  6012 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:58.355170  6333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.003s	sys 0.011s
I20260709 12:27:58.463285  4570 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:27:58.469281  4000 raft_consensus.cc:2368] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:27:58.469156  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:58.318657  6268 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:58.284462  6219 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:58.138893  6055 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:58.307786  3821 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.010s	sys 0.005s
W20260709 12:27:58.520991  3821 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.012s	sys 0.005s
W20260709 12:27:58.521397  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 996863us
I20260709 12:27:58.522202  3821 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:58.199960  3897 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:58.489802  3997 raft_consensus.cc:2393] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:58.498344  6345 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:58.523586  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 323655us
I20260709 12:27:58.524127  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.525099  3997 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:27:58.499790  3971 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:58.176837  6351 consensus_queue.cc:1059] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.195s
I20260709 12:27:58.367599  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:58.358306  6327 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:27:58.503118  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:58.359596  6352 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:58.360538  6339 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:27:58.545102  3969 leader_election.cc:336] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 1.759s (SENT)
I20260709 12:27:58.373027  6320 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:58.526124  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.177712  6362 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:58.499137  6330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.020s	sys 0.041s
I20260709 12:27:58.469626  6369 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:27:58.516408  6333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.004s	sys 0.012s
W20260709 12:27:58.535163  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:58.624786  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 102694us
I20260709 12:27:58.626039  3897 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:58.538748  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:58.538832  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:58.626766  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:58.627306  3926 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:58.627596  3927 raft_consensus.cc:1813] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:58.657959  3927 raft_consensus.cc:2410] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:27:58.539762  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:58.658565  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:58.658910  3931 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:27:58.285264  6032 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.542220  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.662199  4002 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:58.663154  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.545135  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:58.506646  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.666424  4006 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:27:58.667520  4006 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:58.546367  3997 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:58.546134  3969 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:58.616832  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:58.617408  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:58.514140  6069 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:27:58.504427  6358 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:58.672441  6358 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:58.432432  6341 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.673028  6069 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.674990  6341 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:58.533345  5971 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:58.659250  3928 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:27:58.661755  6032 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:58.673034  6358 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:58.683488  6342 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:58.688367  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:58.689198  3856 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:27:58.694687  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:58.694986  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:58.695765  3850 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:27:58.502599  4567 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
W20260709 12:27:58.703392  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 431799us
I20260709 12:27:58.622751  6351 consensus_queue.cc:1243] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Peer 4eedd844c09d456ca0b3614490dd1dbb log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:27:58.709053  6368 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.700232  6213 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:58.690338  6365 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.652541  6306 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:58.687635  6358 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.707912  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:58.942866  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:58.943657  3857 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:27:58.693646  6336 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:58.945149  6336 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:58.940290  3998 raft_consensus.cc:1240] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:58.624682  6333 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:58.708189  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:58.951969  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:58.851326  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:58.781780  6231 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:58.656797  6369 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:58.828473  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:27:58.851637  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 403371us
I20260709 12:27:58.705941  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:58.766418  3970 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:58.965183  3822 leader_election.cc:336] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.582s (SENT)
I20260709 12:27:58.965620  3822 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:27:58.965790  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 199477us
W20260709 12:27:58.966596  3822 leader_election.cc:336] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.605s (SENT)
I20260709 12:27:58.966988  3822 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:58.968894  3970 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:58.855902  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:58.856443  6360 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.856966  6272 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:58.834954  6310 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:27:58.859737  6323 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:58.984081  3999 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:58.985051  6342 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:58.985143  6333 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:58.863722  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:58.846930  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:58.986268  3923 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:58.864781  4567 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:58.865897  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:58.869303  6382 log.cc:927] Time spent T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:27:58.975934  6361 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:58.869710  4565 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:58.767962  6303 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:58.720571  6032 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:27:58.704839  3854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.020s	sys 0.046s
W20260709 12:27:58.997105  3854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.022s	sys 0.055s
W20260709 12:27:58.870014  6370 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 12:27:58.870647  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:58.871793  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:58.849682  6345 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:58.847190  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:58.876164  3926 raft_consensus.cc:2410] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:58.876257  6315 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.779994  6339 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.616636  6327 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:58.548362  6305 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.878319  6139 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:58.786331  6320 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:58.880887  6362 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:58.882344  6055 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:58.850256  6205 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:58.851009  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 305920us
W20260709 12:27:58.832572  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 624871us
W20260709 12:27:59.022341  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:58.769948  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 563299us
W20260709 12:27:58.890101  3930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.018s
W20260709 12:27:59.023456  3930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.005s	sys 0.018s
I20260709 12:27:59.023861  4538 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:59.024273  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 539) took 1297 ms. Trace:
I20260709 12:27:59.024667  3930 rpcz_store.cc:276] 0709 12:27:57.727091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:57.729861 (+  2770us) service_pool.cc:224] Handling call
0709 12:27:57.730221 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:57.730424 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:58.307676 (+577252us) log.cc:844] Serialized 14 byte log entry
0709 12:27:59.023924 (+716248us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:59.023991 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:59.024041 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.024107 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:59.024219 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":286202,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"thread_start_us":1146410,"threads_started":2}
I20260709 12:27:58.890784  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:58.903946  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:59.033696  3930 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:59.035156  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:58.802342  6253 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.702993  6219 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:58.945648  6336 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:58.944723  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:59.043830  4005 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
W20260709 12:27:58.974761  3822 leader_election.cc:336] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.659s (SENT)
I20260709 12:27:58.939502  6368 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:59.046088  4571 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
W20260709 12:27:58.979715  6046 consensus_meta.cc:287] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.568s	user 0.006s	sys 0.005s
I20260709 12:27:58.969662  6340 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:58.995802  3970 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:58.940290  5971 raft_consensus.cc:697] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:59.003839  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:59.003995  3923 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
W20260709 12:27:59.089962  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 94244.4us
I20260709 12:27:58.996790  5857 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:58.991225  6209 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:59.003831  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:59.093772  3931 raft_consensus.cc:2393] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:58.941960  6213 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.015744  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:58.997479  6358 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:59.017640  4570 raft_consensus.cc:1240] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
W20260709 12:27:58.905589  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 279621us
I20260709 12:27:59.038667  3969 leader_election.cc:400] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3.
I20260709 12:27:59.039336  4538 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:59.106348  3969 leader_election.cc:403] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:27:59.044757  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 70040.9us
I20260709 12:27:58.970242  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:59.000645  6032 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:59.000290  6360 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.094743  4004 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:59.106070  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:59.112794  3856 raft_consensus.cc:1275] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:27:59.107153  3822 leader_election.cc:336] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.694s (SENT)
I20260709 12:27:59.104120  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:58.946590  6365 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:59.110381  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 71885.7us
I20260709 12:27:59.114835  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:59.115877  6365 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:59.043205  6319 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:27:59.114058  3822 leader_election.cc:336] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.839s (SENT)
I20260709 12:27:59.116482  3822 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:59.113067  3897 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:59.119050  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:27:59.097801  6308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.007s	sys 0.039s
I20260709 12:27:59.047420  6387 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:59.122020  3897 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:27:59.091226  6046 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.120326  6397 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:59.130451  6358 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:59.131014  6358 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:59.131294  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:59.131753  6258 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:59.131898  6320 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:59.131295  6046 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:59.132391  5857 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:59.132268  6258 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:59.133265  6258 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:59.133509  5857 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:59.054888  6245 consensus_queue.cc:1059] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:27:59.134990  6245 raft_consensus.cc:3055] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:59.135334  6245 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:27:59.135584  6315 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:59.136145  6245 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:59.131502  3926 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:59.137277  6245 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:59.132233  4568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 689) took 1112 ms. Trace:
I20260709 12:27:59.138458  4568 rpcz_store.cc:276] 0709 12:27:58.019538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.026740 (+  7202us) service_pool.cc:224] Handling call
0709 12:27:59.131133 (+1104393us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b58000d5c98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056f9d0a0 00007fe056f9c984 00007fe0505176d4 00007fe050517662
0709 12:27:59.132167 (+  1034us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25196416}
I20260709 12:27:59.131464  6358 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:59.140578  6258 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:27:59.142674  6395 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:27:59.055850  6390 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:59.144953  6258 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:59.147468  6213 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:27:59.151331  3822 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:59.154065  6361 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:59.154510  6361 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.154410  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:59.154980  6361 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:59.157227  4570 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:59.162664  6050 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.163216  6050 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:59.165431  6050 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:59.116886  6272 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3.
I20260709 12:27:59.167559  6305 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:59.167973  4569 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:59.042780  6205 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:59.170279  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:59.107306  6348 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:59.177170  4569 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:27:59.194772  4569 pending_rounds.cc:85] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 6
I20260709 12:27:59.195195  4569 pending_rounds.cc:107] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:27:59.195529  4569 raft_consensus.cc:2889] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:59.196338  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 712) took 1100 ms. Trace:
I20260709 12:27:59.179066  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:27:59.125774  6308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.007s	sys 0.039s
I20260709 12:27:59.133608  6253 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:59.196694  4569 rpcz_store.cc:276] 0709 12:27:58.096139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.096276 (+   137us) service_pool.cc:224] Handling call
0709 12:27:58.128575 (+ 32299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:58.376748 (+248173us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b58004508d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f330aa 00007fe051fb5447 00007fe051fcdfe7 00007fe051fcf7de 00007fe051fd9b49 00007fe051fda416 00007fe051fd6d8f 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4
0709 12:27:59.167553 (+790805us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54004883a0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f4ca1d 00007fe051f331a4 00007fe051fb5447 00007fe051fcdfe7 00007fe051fcf7de 00007fe051fd9b49 00007fe051fda416 00007fe051fd6d8f 00007fe051fd683e 00007fe056f9b419
0709 12:27:59.196089 (+ 28536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.196278 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1283128448}
I20260709 12:27:59.205164  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:27:59.121376  6219 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:59.216048  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:59.170390  6218 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:59.192242  6271 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:59.193517  6302 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:59.232290  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:59.220304  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:27:59.222901  3822 leader_election.cc:336] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.896s (SENT)
I20260709 12:27:59.250262  4570 raft_consensus.cc:2393] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 4: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:59.233719  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:59.250567  3822 leader_election.cc:336] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.933s (SENT)
I20260709 12:27:59.226760  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:59.251011  3822 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:59.227849  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36516 (request call id 2084) took 1051 ms. Trace:
I20260709 12:27:59.234395  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:27:59.252064  3822 leader_election.cc:336] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.967s (SENT)
I20260709 12:27:59.251819  4005 rpcz_store.cc:276] 0709 12:27:58.175978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.201362 (+ 25384us) service_pool.cc:224] Handling call
0709 12:27:59.227683 (+1026321us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54000c5154. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:59.227789 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1499475328}
I20260709 12:27:59.252612  4565 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:27:59.202690  6348 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:27:59.252952  3822 leader_election.cc:336] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 2.224s (SENT)
I20260709 12:27:59.229233  6271 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:59.253350  6348 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:59.253677  6271 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:59.254243  6126 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:59.234748  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:59.235438  6205 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:59.235572  4567 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:59.236963  5971 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.259109  3822 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:59.259882  6126 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:59.261583  3822 leader_election.cc:400] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:27:59.234046  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:59.239007  6358 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:59.232033  3852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:59.263561  3852 raft_consensus.cc:606] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:59.263970  3852 raft_consensus.cc:614] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:59.264396  6358 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:59.208072  6046 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.265132  6046 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.266076  6126 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:59.267668  6046 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:59.270529  3852 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:27:59.271195  3852 raft_consensus.cc:606] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:59.272469  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:59.272801  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:59.272851  6271 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:59.273947  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:59.274783  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:59.275894  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:59.276459  6046 consensus_queue.cc:1059] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:59.277070  6323 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:59.278030  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:59.278124  6190 raft_consensus.cc:3055] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:59.278692  6190 raft_consensus.cc:740] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:59.279330  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:59.279970  3930 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:27:59.279712  6190 consensus_queue.cc:260] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.281096  6190 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:59.281663  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:59.278874  3932 raft_consensus.cc:2393] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 2: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:27:59.278388  6323 raft_consensus.cc:3055] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:59.116498  6319 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.282534  6323 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:59.197152  6394 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:59.294849  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:27:59.310675  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:59.277153  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:59.215693  6050 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:27:59.314935  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 275696us
I20260709 12:27:59.204326  6242 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:27:59.221076  6330 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.230620  6332 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.322403  4538 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:59.212853  6303 consensus_queue.cc:1059] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:27:59.248183  6302 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:27:59.339876  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 213007us
I20260709 12:27:59.315989  6126 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:59.368485  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 46179us
I20260709 12:27:59.382884  4538 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:27:59.384548  4538 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:59.339279  6397 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:59.373963  6302 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:59.397166  6390 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:27:59.421370  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 317298us
I20260709 12:27:59.379309  6046 consensus_queue.cc:1059] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:27:59.397914  6271 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:59.388870  6391 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:59.374928  6332 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.435602  6397 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.324049  6139 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:27:59.376925  6255 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:59.403121  6402 log.cc:927] Time spent T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:27:59.375291  6126 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.325207  6050 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.369958  6330 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.394862  6369 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:59.416133  6327 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:27:59.393095  6323 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:59.437914  6069 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.035s	sys 0.056s
W20260709 12:27:59.500427  6069 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.035s	sys 0.056s
W20260709 12:27:59.500640  6405 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:27:59.372397  6359 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:59.414328  6339 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:59.415390  6368 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:59.502038  6387 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:59.475085  6271 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:59.506057  6400 log.cc:927] Time spent T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:27:59.506348  6271 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:59.507938  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2119) took 1137 ms. Trace:
I20260709 12:27:59.484695  6046 raft_consensus.cc:3055] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:59.438031  6315 consensus_queue.cc:1059] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:27:59.470176  6255 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:59.508414  4003 rpcz_store.cc:276] 0709 12:27:58.370310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.765245 (+394935us) service_pool.cc:224] Handling call
0709 12:27:58.801985 (+ 36740us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:58.854235 (+ 52250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:58.854273 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:58.854764 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:27:59.095357 (+240593us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:59.128732 (+ 33375us) log.cc:844] Serialized 14 byte log entry
0709 12:27:59.340565 (+211833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.340646 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:59.507726 (+167080us) raft_consensus.cc:1685] finished
0709 12:27:59.507747 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:59.507877 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":280042,"raft.queue_time_us":269973,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":7704,"thread_start_us":240221,"threads_started":1,"wal-append.queue_time_us":364156}
I20260709 12:27:59.488997  6340 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:59.399869  6361 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.491775  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:27:59.496665  3929 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:27:59.420184  6390 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:59.498410  3930 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:59.493520  6126 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:59.475616  6397 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.517823  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1540) took 1404 ms. Trace:
I20260709 12:27:59.578930  3925 rpcz_store.cc:276] 0709 12:27:58.113652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.113829 (+   177us) service_pool.cc:224] Handling call
0709 12:27:58.114325 (+   496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:58.123420 (+  9095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:58.123450 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:59.129142 (+1005692us) spinlock_profiling.cc:243] Waited 7.28 ms on lock 0x7b2c0005c0c8. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:27:59.129622 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:27:59.347402 (+217780us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:59.347435 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.347502 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:59.517481 (+169979us) raft_consensus.cc:1685] finished
0709 12:27:59.517501 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:59.517759 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8598,"raft.queue_time_us":20197,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"spinlock_wait_cycles":16750336,"thread_start_us":217417,"threads_started":1,"wal-append.queue_time_us":369576}
I20260709 12:27:59.518870  6330 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:59.538082  6055 raft_consensus.cc:3055] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:59.541306  6032 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:59.601644  3853 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:59.542068  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 173461us
I20260709 12:27:59.570608  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:27:59.585781  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 152719us
I20260709 12:27:59.604171  4538 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:59.508437  6271 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:27:59.563417  6406 log.cc:927] Time spent T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:27:59.545033  6046 raft_consensus.cc:740] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:27:59.575251  6390 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:59.612200  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:59.612416  4537 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:27:59.616490  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 45981.5us
I20260709 12:27:59.544747  6255 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:59.621131  6271 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:59.621284  6330 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:59.544971  6360 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:59.623924  4538 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:59.625026  3932 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:59.625695  4537 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:59.627810  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:27:59.636445  4571 raft_consensus.cc:2393] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 2: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:27:59.588418  6055 raft_consensus.cc:740] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:27:59.632448  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:59.637216  6101 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:59.641639  6101 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:27:59.641702  6055 consensus_queue.cc:260] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.643872  6101 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:59.617908  6357 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:59.640534  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:59.640836  6303 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:59.650436  6303 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:59.650965  6303 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:59.651113  6332 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:59.600143  6348 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.618377  6319 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:27:59.647939  3932 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:59.630177  6218 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:59.658017  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:59.585924  6368 consensus_queue.cc:1059] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:27:59.622840  6369 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:59.659040  6369 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:59.659548  6369 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:59.649564  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:59.660894  4537 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:59.653000  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:27:59.627887  6315 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:59.662015  4571 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:27:59.666961  3897 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:27:59.669450  5971 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:59.670017  5971 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.638514  6032 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:27:59.671726  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:59.626510  6409 consensus_queue.cc:1059] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:27:59.685074  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:59.695062  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2083) took 1519 ms. Trace:
W20260709 12:27:59.695964  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 324801us
I20260709 12:27:59.697762  6413 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:27:59.700726  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1619) took 1079 ms. Trace:
I20260709 12:27:59.701687  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:59.794220  3851 rpcz_store.cc:276] 0709 12:27:58.621231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.621505 (+   274us) service_pool.cc:224] Handling call
0709 12:27:58.694349 (+ 72844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:58.999505 (+305156us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:59.285567 (+286062us) log.cc:844] Serialized 14 byte log entry
0709 12:27:59.622612 (+337045us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:59.622670 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:59.622715 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.700534 (+ 77819us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b5400064ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:59.700572 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:59.700676 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4091,"prepare.queue_time_us":9262,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":6590,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6298,"spinlock_wait_cycles":701165440,"thread_start_us":611905,"threads_started":2,"wal-append.queue_time_us":371000}
I20260709 12:27:59.660248  6219 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:59.702220  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:59.703014  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:59.703183  6253 raft_consensus.cc:3055] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:59.703688  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:59.704888  4004 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: []
W20260709 12:27:59.689771  3848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1612) took 1624 ms (client timeout 1837 ms). Trace:
I20260709 12:27:59.671267  6319 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:59.638916  6271 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.639865  6330 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:27:59.781788  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 149439us
I20260709 12:27:59.785743  4574 raft_consensus.cc:1240] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:59.784016  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:59.786960  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:59.784911  3969 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:59.806124  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:59.806633  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:59.796032  4003 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:27:59.807154  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:27:59.787968  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 583) took 1697 ms. Trace:
W20260709 12:27:59.672856  6245 consensus_meta.cc:287] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.007s
W20260709 12:27:59.796196  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 121842us
I20260709 12:27:59.670521  5971 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:59.799242  3848 rpcz_store.cc:269] 0709 12:27:58.065751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.065864 (+   113us) service_pool.cc:224] Handling call
0709 12:27:59.689512 (+1623648us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540001a9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:59.689690 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2626208640}
I20260709 12:27:59.705428  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:59.798478  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 113138us
I20260709 12:27:59.814818  3969 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:27:59.801208  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:59.801144  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:59.670869  6306 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:59.817629  4005 raft_consensus.cc:2393] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:27:59.705746  4002 rpcz_store.cc:276] 0709 12:27:58.175702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.664064 (+488362us) service_pool.cc:224] Handling call
0709 12:27:58.664397 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:58.800474 (+136077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:58.800524 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:58.861854 (+ 61330us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b2c000e1568. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:27:58.862444 (+   590us) log.cc:844] Serialized 52 byte log entry
0709 12:27:59.019423 (+156979us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:59.091684 (+ 72261us) log.cc:844] Serialized 14 byte log entry
0709 12:27:59.318751 (+227067us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b1800411d00. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04ee64c0a 00007fe0585a4219 00007fe055eab58f 00007fe04eeea571 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd
0709 12:27:59.534999 (+216248us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b1800411d00. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:27:59.694276 (+159277us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b1800411d00. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04ee64c0a 00007fe0585a4219 00007fe04eeeca40 00007fe04eee74e4 00007fe04eee7455 00007fe0559cf3c7 00007fe051fe19a7 00007fe051ff10bf 00007fe051ff1038
0709 12:27:59.694523 (+   247us) log.cc:844] Serialized 14 byte log entry
0709 12:27:59.694751 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.694821 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:59.694859 (+    38us) raft_consensus.cc:1685] finished
0709 12:27:59.694869 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:59.694991 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":695764,"prepare.queue_time_us":662621,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":5938,"raft.queue_time_us":198310,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":8682,"spinlock_wait_cycles":245858048,"thread_start_us":156594,"threads_started":1,"wal-append.queue_time_us":281759}
I20260709 12:27:59.806566  6333 consensus_queue.cc:1059] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:59.808676  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2145) took 1139 ms. Trace:
I20260709 12:27:59.785442  6032 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.797288  4001 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:27:59.807765  3849 rpcz_store.cc:276] 0709 12:27:58.090870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.091794 (+   924us) service_pool.cc:224] Handling call
0709 12:27:58.127917 (+ 36123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:58.664872 (+536955us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:58.665165 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 12:27:58.926237 (+261072us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:58.926316 (+    79us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:58.926380 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.706826 (+780446us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b54000190d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:59.787429 (+ 80603us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:59.787911 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":206716,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":471,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":10846,"spinlock_wait_cycles":1234410368,"thread_start_us":260604,"threads_started":1,"wal-append.queue_time_us":298343}
I20260709 12:27:59.783267  6339 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.706084  6213 consensus_queue.cc:1059] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 12:27:59.823336  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:59.823932  4000 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:59.798488  6253 raft_consensus.cc:740] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:27:59.817142  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:59.817489  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:59.816673  4538 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:27:59.655279  6351 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:59.819169  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:59.821509  4001 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:59.811113  6397 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:59.822072  4005 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 1. Current term is 2. Ops: []
W20260709 12:27:59.833592  6416 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:27:59.833904  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:27:59.834728  6421 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:27:59.835393  4005 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:59.799342  6219 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:59.836489  6219 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:59.836728  6412 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 12:27:59.820140  3929 rpcz_store.cc:276] 0709 12:27:58.669774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.028033 (+358259us) service_pool.cc:224] Handling call
0709 12:27:59.028428 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:59.569488 (+541060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.808441 (+238953us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54002378d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:27:59.808618 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076126464}
I20260709 12:27:59.815608  3999 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:27:59.815583  6353 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:59.796005  6046 consensus_queue.cc:260] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.820271  6245 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:59.858166  4000 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:59.863796  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:59.865382  4004 raft_consensus.cc:1275] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:59.864699  4000 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:27:59.868628  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:27:59.855873  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:27:59.870998  4001 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:27:59.873624  3923 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:59.830178  6351 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:59.854101  6205 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:59.854171  6050 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:27:59.895623  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 45339.3us
I20260709 12:27:59.829602  6339 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.858634  6245 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:27:59.932107  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2089) took 1656 ms. Trace:
I20260709 12:27:59.932159  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:27:59.800750  6413 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.805096  6391 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:27:59.934485  3929 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:59.876152  6242 raft_consensus.cc:3055] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:59.874578  6361 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:59.937208  3822 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:59.934232  3997 rpcz_store.cc:276] 0709 12:27:58.276329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.670794 (+394465us) service_pool.cc:224] Handling call
0709 12:27:59.170730 (+499936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:59.170920 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:59.170946 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:59.170998 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:59.171031 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.171086 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:59.931942 (+760856us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b540007e9d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:27:59.932047 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137869056}
I20260709 12:27:59.883867  6268 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:27:59.891248  6258 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.898677  6351 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:59.953622  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:27:59.959708  4006 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:27:59.956919  6032 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:59.936731  6245 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:59.957088  6428 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:59.933228  6046 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:59.957628  6302 consensus_meta.cc:287] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.001s
I20260709 12:27:59.962847  3928 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:59.955140  6268 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:27:59.934103  6315 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:59.946362  6414 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.446s	user 0.025s	sys 0.035s
I20260709 12:28:00.008458  3926 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:28:00.008914  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:00.009550  3930 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:27:59.990466  3822 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:27:59.945048  6242 raft_consensus.cc:740] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:00.023244  6362 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:00.029733  3822 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:00.031314  6271 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:00.039845  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:00.049360  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:00.005386  6032 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:59.951105  6305 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:27:59.996618  6348 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:00.050211  3928 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:27:59.963508  6413 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:27:59.970362  6258 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.058081  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:00.031742  6362 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.944183  6253 consensus_queue.cc:260] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.005926  6302 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:00.077343  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:00.052670  6428 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:00.054041  6032 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:00.097179  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 591) took 1242 ms. Trace:
I20260709 12:28:00.096801  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:00.100004  3932 raft_consensus.cc:2393] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:00.093559  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:00.019683  6434 consensus_queue.cc:1059] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:28:00.107059  3923 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:00.097738  3857 rpcz_store.cc:276] 0709 12:27:58.854984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.056113 (+201129us) service_pool.cc:224] Handling call
0709 12:27:59.056550 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:59.095331 (+ 38781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:59.095357 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:59.095822 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 12:27:59.449838 (+354016us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:59.449865 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.449965 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:00.096895 (+646930us) raft_consensus.cc:1685] finished
0709 12:28:00.096922 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:00.097111 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":277093,"threads_started":1,"wal-append.queue_time_us":381126}
I20260709 12:28:00.033856  6360 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:28:00.075505  6362 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:00.073405  6242 consensus_queue.cc:260] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.103020  6032 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:00.091849  6428 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:00.104683  6348 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.122612  3929 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
W20260709 12:28:00.131423  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 314772us
W20260709 12:28:00.132666  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 344392us
W20260709 12:28:00.122537  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 183614us
I20260709 12:28:00.135038  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:00.135733  3997 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:28:00.118665  6258 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:00.103899  6219 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.128991  6428 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:00.154346  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:00.154987  4004 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:00.164117  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:00.168104  4573 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:00.153949  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:00.121431  6390 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.172729  6433 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:00.175431  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:00.176033  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:00.174787  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:00.176718  4004 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:00.174906  3932 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:28:00.173281  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:00.178666  4570 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:28:00.165992  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:00.164506  6302 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:00.181723  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:00.182847  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:00.184023  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:00.184391  4569 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:00.175491  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:00.186100  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 334103us
I20260709 12:28:00.139171  6348 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:00.187252  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:00.189529  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:00.189435  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:00.192762  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:00.178874  6339 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:00.172932  6330 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:00.197098  4570 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:28:00.199630  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:00.201613  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:00.205330  6272 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:00.205683  3971 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:00.205948  6272 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:00.206472  6360 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:00.208319  6272 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:00.208242  3971 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:00.202217  3848 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:00.188251  4565 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:00.182258  6342 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:28:00.175936  6433 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.185756  6050 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:28:00.215131  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:00.194049  4568 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:28:00.213513  6272 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:00.220184  3821 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:00.223130  6190 consensus_meta.cc:287] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.942s	user 0.007s	sys 0.007s
I20260709 12:28:00.233490  3895 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:00.209306  6245 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:00.247808  3821 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:00.248848  3895 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:00.222537  6272 raft_consensus.cc:697] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:00.213390  6428 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:00.251111  3895 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:00.252717  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 67426.5us
I20260709 12:28:00.267009  3998 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:00.247699  6268 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:00.270160  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 103504us
I20260709 12:28:00.270160  6219 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:00.253774  6342 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:28:00.267854  6255 consensus_meta.cc:287] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.000s
I20260709 12:28:00.264632  6447 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:00.318037  6272 consensus_queue.cc:237] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.305619  6333 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:00.323239  6245 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:00.323455  6101 raft_consensus.cc:993] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:28:00.324110  6333 raft_consensus.cc:1081] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:28:00.272245  6436 consensus_queue.cc:1059] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 12:28:00.305742  6368 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 12:28:00.337299  6394 consensus_meta.cc:287] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.013s	user 0.007s	sys 0.005s
I20260709 12:28:00.312055  6255 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.340329  6255 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:00.342830  6348 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:00.345122  6431 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:00.309703  6360 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:00.346014  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 80326.8us
I20260709 12:28:00.346300  6360 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:00.347959  6271 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:00.348362  6360 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:00.348907  6451 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:00.349422  6307 raft_consensus.cc:3055] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:00.349846  6307 raft_consensus.cc:740] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:00.349996  6451 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:00.350706  6433 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:00.348927  6209 raft_consensus.cc:3055] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:00.351305  6209 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:00.351372  6451 raft_consensus.cc:3055] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:00.351799  6451 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:00.352811  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 101887us
I20260709 12:28:00.347998  6302 consensus_queue.cc:1059] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:00.353698  3895 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:00.354727  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 107020us
W20260709 12:28:00.358963  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 159959us
I20260709 12:28:00.362545  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:00.337745  6394 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:00.352130  6209 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.432749  6209 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:00.388938  6362 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:00.437601  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:00.437845  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 75392.6us
I20260709 12:28:00.404598  4005 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:00.408285  6387 raft_consensus.cc:3055] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:00.410408  4572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 718) took 1543 ms. Trace:
I20260709 12:28:00.441790  4572 rpcz_store.cc:276] 0709 12:27:58.867029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.869521 (+  2492us) service_pool.cc:224] Handling call
0709 12:27:58.869850 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:59.127248 (+257398us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:59.435536 (+308288us) log.cc:844] Serialized 14 byte log entry
0709 12:27:59.633961 (+198425us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:59.634025 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:59.634069 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:00.410134 (+776065us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54004bbed4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:00.410192 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:00.410332 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90220,"prepare.queue_time_us":188842,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":13592,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6411,"spinlock_wait_cycles":591356288,"thread_start_us":393825,"threads_started":2,"wal-append.queue_time_us":351915}
W20260709 12:28:00.419343  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:00.426946  6348 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:00.427618  6353 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:00.427868  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:00.447335  4001 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:00.428725  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 728) took 1116 ms. Trace:
I20260709 12:28:00.425367  3970 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:00.432098  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:00.434288  3924 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:00.435510  3997 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:00.390843  6255 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:00.436709  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 48764.3us
W20260709 12:28:00.445134  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 97331.6us
I20260709 12:28:00.456401  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:00.450666  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 174995us
W20260709 12:28:00.435104  6369 consensus_meta.cc:287] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.761s	user 0.008s	sys 0.003s
I20260709 12:28:00.387849  6390 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:00.448123  4574 rpcz_store.cc:276] 0709 12:27:59.312239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.312429 (+   190us) service_pool.cc:224] Handling call
0709 12:27:59.312792 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:59.811512 (+498720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:00.428498 (+616986us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54006e7154. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:00.428669 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907583744}
I20260709 12:28:00.358834  6360 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:28:00.433794  6126 consensus_meta.cc:287] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.831s	user 0.002s	sys 0.008s
I20260709 12:28:00.526465  3997 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:00.485194  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:00.528155  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:00.441635  6387 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:00.530849  6387 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.532213  6387 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:00.534894  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 181308us
I20260709 12:28:00.536329  3895 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:00.538287  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 79408.8us
I20260709 12:28:00.541582  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:00.544075  3999 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:28:00.451412  6445 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:00.546036  3857 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:28:00.551674  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:00.556567  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:00.516115  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:00.557634  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:00.572556  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:00.556752  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:00.542701  6336 consensus_meta.cc:287] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.451s	user 0.010s	sys 0.004s
I20260709 12:28:00.456102  6268 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:00.588196  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:00.589241  3971 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.4:41095 timed out after 1.594s (SENT) [suppressed 33 similar messages]
I20260709 12:28:00.556413  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:00.592279  3932 raft_consensus.cc:1813] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:00.593268  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:00.594976  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:00.596081  3925 raft_consensus.cc:2410] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:28:00.596127  3932 raft_consensus.cc:2410] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:28:00.350742  6307 consensus_queue.cc:260] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:00.600266  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 49572.9us
I20260709 12:28:00.547149  6352 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:00.605057  4565 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:00.607618  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:00.609256  4565 raft_consensus.cc:2410] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:28:00.587721  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:00.618796  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:00.623476  6434 raft_consensus.cc:3055] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:00.624082  6434 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:00.628084  4006 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:00.629055  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:00.629190  4006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36530
I20260709 12:28:00.630362  4006 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:00.630995  4006 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:00.638175  4565 raft_consensus.cc:1813] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:00.639191  4565 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 2: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:00.640784  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:00.642318  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:00.647712  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:00.648352  6242 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:00.650277  6323 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:00.527395  6369 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:00.655783  6253 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:00.656364  6315 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:28:00.664208  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 207905us
I20260709 12:28:00.664856  6394 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:00.681296  6327 consensus_queue.cc:1059] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:00.580852  6427 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:00.673801  4538 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:00.550753  6445 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:00.676271  4565 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 5: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:28:00.678421  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 75627.7us
I20260709 12:28:00.651932  6055 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:00.457032  6353 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:00.688227  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:00.670780  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:00.453686  6342 consensus_queue.cc:1048] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.193s
I20260709 12:28:00.676801  4006 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:00.659502  6303 consensus_meta.cc:287] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.008s	user 0.011s	sys 0.002s
I20260709 12:28:00.692998  6307 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:00.625108  6434 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.547235  6126 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.710634  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:00.679173  5971 consensus_meta.cc:287] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.850s	user 0.011s	sys 0.000s
I20260709 12:28:00.680769  3897 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:00.456410  6348 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.588189  6447 consensus_queue.cc:1059] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 12:28:00.725107  6391 raft_consensus.cc:3055] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:00.725711  6424 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:00.715054  6445 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:00.730798  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:00.811650  6434 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:00.702759  6394 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.725486  4006 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:00.547336  6360 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:00.465214  6255 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.707847  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:00.729733  6351 consensus_meta.cc:287] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.734s	user 0.008s	sys 0.001s
I20260709 12:28:00.758205  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:00.714850  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:00.701525  6454 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:28:00.717298  6428 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:00.662247  6268 raft_consensus.cc:697] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:28:00.787132  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 106439us
I20260709 12:28:00.603037  6336 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:00.788796  6397 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.744099  6271 consensus_queue.cc:1048] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:28:00.794523  6327 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.779408  5971 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.798542  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:00.851756  4573 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:00.823419  6394 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:00.810624  6369 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:00.813036  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 102542us
I20260709 12:28:00.817634  4565 raft_consensus.cc:2376] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4. Re-sending same reply.
I20260709 12:28:00.549314  6451 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.846879  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:00.884192  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:00.787876  6420 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:28:00.847760  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 100389us
W20260709 12:28:00.847366  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 387987us
I20260709 12:28:00.812222  6431 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:00.784720  6391 raft_consensus.cc:740] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:00.828189  6447 consensus_queue.cc:1243] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:28:00.745193  6303 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:00.799278  6139 raft_consensus.cc:3055] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:00.857182  4538 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:00.918416  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:00.918431  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 61391us
W20260709 12:28:00.894375  3895 leader_election.cc:336] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 1.540s (SENT)
I20260709 12:28:00.898840  3821 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:00.844449  4567 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:00.925321  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:00.926184  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:00.844689  6351 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.897006  6420 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.939608  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:00.840801  6453 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:28:00.904902  6433 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:28:00.898823  6302 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:00.928297  4573 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:00.932575  4574 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:00.951840  3821 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:00.917609  6139 raft_consensus.cc:740] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:00.905128  6390 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:00.934237  3971 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:00.921298  6332 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:28:00.875249  6397 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.896692  6362 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:00.924542  6424 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:00.963776  4572 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:28:00.924365  6245 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.885849  6327 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.927366  6055 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:00.927155  6451 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:00.971647  4573 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:28:00.953792  6357 consensus_meta.cc:287] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 1.309s	user 0.009s	sys 0.005s
I20260709 12:28:00.950281  6420 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:01.056372  3849 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:00.983155  3971 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:01.061331  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 109626us
I20260709 12:28:01.085084  3821 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:00.970211  6302 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.904822  6427 consensus_queue.cc:1059] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.162s
I20260709 12:28:01.070585  6476 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.958163  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:01.054584  6413 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:00.982741  6352 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.950990  6450 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:01.096920  3821 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:01.097908  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 175874us
I20260709 12:28:01.055008  6126 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:01.066380  6464 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:01.074764  6424 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:01.117561  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 134518us
W20260709 12:28:01.086696  6032 consensus_meta.cc:287] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.947s	user 0.012s	sys 0.000s
I20260709 12:28:01.108163  3821 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:01.108733  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:01.108155  3895 leader_election.cc:336] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 1.783s (SENT)
I20260709 12:28:01.139170  3895 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:01.102559  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:01.118494  3971 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:01.088670  6357 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:01.091120  6302 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:01.091578  6205 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:01.134794  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 553) took 1864 ms. Trace:
I20260709 12:28:01.155014  3924 rpcz_store.cc:276] 0709 12:27:59.270239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.271248 (+  1009us) service_pool.cc:224] Handling call
0709 12:27:59.271552 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:00.449972 (+1178420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:01.134470 (+684498us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400367754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:01.134714 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2673640192}
I20260709 12:28:01.097288  6453 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:01.101722  6231 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:00.905376  6431 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:00.958621  6268 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.077055  6245 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:01.119331  6209 consensus_meta.cc:287] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.686s	user 0.012s	sys 0.000s
I20260709 12:28:01.116869  6055 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:01.119406  6424 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:01.153075  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 44973.5us
I20260709 12:28:01.116565  6352 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.096112  6362 consensus_queue.cc:1059] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:28:01.165643  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:01.187984  3925 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:00.970901  6391 consensus_queue.cc:260] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.137917  6464 raft_consensus.cc:697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:01.166529  6447 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:01.182585  3821 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:01.129468  6032 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.112619  6359 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:28:01.161242  6205 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:01.153718  6218 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:28:01.152164  6348 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:01.153057  4567 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:01.157119  3971 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:01.218006  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:01.218727  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 61712us
I20260709 12:28:01.194470  6431 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:01.125001  6450 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:01.199908  6467 log.cc:927] Time spent T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:28:01.184365  6055 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:01.195403  5971 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:01.174135  6255 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:01.212939  4568 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:01.179435  6336 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:01.238408  6126 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:01.254053  6466 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:28:01.101444  6476 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.258301  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.258651  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.179208  6473 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:01.187507  6440 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.202335  6352 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:01.219652  3971 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:01.267447  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 47862.3us
W20260709 12:28:01.231178  6460 log.cc:927] Time spent T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:28:01.268453  3971 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:01.238408  6316 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.236537  3925 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:01.237010  3853 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:01.196900  6447 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:01.208024  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2052) took 1035 ms. Trace:
I20260709 12:28:01.270332  3849 rpcz_store.cc:276] 0709 12:28:00.173036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:00.173282 (+   246us) service_pool.cc:224] Handling call
0709 12:28:00.184124 (+ 10842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:01.083839 (+899715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:01.207714 (+123875us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b5400019fd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:01.207946 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005415680}
W20260709 12:28:01.222918  6471 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:28:01.213725  6323 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:01.212533  6209 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:01.183393  6432 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.225476  6231 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:01.244827  6351 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:28:01.246609  6479 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:01.245100  6465 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 12:28:01.302110  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:01.302995  4572 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 3: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:01.258472  6272 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:01.247491  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:01.247442  6464 consensus_queue.cc:237] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:01.248723  6271 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.255774  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.322535  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:01.279538  6447 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:01.256659  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:01.289664  6348 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:01.254690  6101 raft_consensus.cc:3055] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:01.261236  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:01.239341  6055 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:01.264665  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:01.333065  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:01.334671  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.335517  3895 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:01.336154  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.280303  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.283344  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.340372  3855 raft_consensus.cc:2393] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 4: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:01.288193  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:01.341710  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:01.254243  6126 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.289253  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:01.243201  6242 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:01.294293  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:01.302878  6327 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:01.245143  6303 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:01.319520  6231 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:01.303424  3927 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:28:01.170975  6449 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:01.305266  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.327139  6348 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:01.306799  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:01.307228  3928 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:28:01.309031  6432 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.311333  6245 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:01.316831  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:01.314611  6413 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:28:01.318674  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.318818  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:01.266686  6255 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.319461  3930 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:01.387377  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:01.259459  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.323441  3856 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:01.268438  6369 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:01.324462  3925 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:01.281723  6362 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:01.262794  6473 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:01.256287  6428 consensus_queue.cc:1059] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:28:01.298105  4565 raft_consensus.cc:1240] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:01.323341  6272 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:01.347923  3851 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:28:01.425184  3851 pending_rounds.cc:85] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 4
I20260709 12:28:01.425468  3851 pending_rounds.cc:107] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:28:01.425740  3851 raft_consensus.cc:2889] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:01.315868  6268 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:01.328474  6271 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:01.328890  6101 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:01.354271  6476 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:01.381011  6449 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:01.354472  6424 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.355796  6361 raft_consensus.cc:3055] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:01.356769  4571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 732) took 1225 ms. Trace:
I20260709 12:28:01.356670  6302 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.285077  6440 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.358290  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:01.301558  4573 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:01.345503  3895 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:01.322281  6351 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.368348  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.306715  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.295569  6316 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:01.358803  6307 consensus_meta.cc:287] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.000s
I20260709 12:28:01.348577  6323 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:01.383842  3852 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:01.383109  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.388695  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:01.389537  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 107325us
I20260709 12:28:01.325703  6479 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.409085  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:01.492839  3928 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:01.373360  6348 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:01.347615  3850 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:01.370213  6397 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:01.428794  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:01.429118  3897 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:01.497327  4572 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 2: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:28:01.497602  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 68581.4us
I20260709 12:28:01.496088  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:01.477747  6483 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:28:01.455044  3856 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:28:01.437621  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.454666  4571 rpcz_store.cc:276] 0709 12:28:00.130966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:00.137013 (+  6047us) service_pool.cc:224] Handling call
0709 12:28:00.139484 (+  2471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:00.143888 (+  4404us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:00.400115 (+256227us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b1800378ac0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee7455 00007fe0559cf3c7 00007fe051fe19a7 00007fe051ff10bf 00007fe051ff1038
0709 12:28:00.742306 (+342191us) log.cc:844] Serialized 14 byte log entry
0709 12:28:00.999261 (+256955us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:01.354460 (+355199us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b2c000201b8. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:28:01.354863 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 12:28:01.355011 (+   148us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:01.355046 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:01.355124 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:01.356570 (+  1446us) raft_consensus.cc:1685] finished
0709 12:28:01.356588 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:01.356709 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18653,"prepare.queue_time_us":174688,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":56450,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":27756,"spinlock_wait_cycles":131387904,"thread_start_us":580116,"threads_started":2,"wal-append.queue_time_us":370301}
I20260709 12:28:01.427597  6473 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:01.451164  6336 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.400720  6369 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:01.392297  6255 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.479220  6476 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:01.462375  6101 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:01.451398  6449 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:01.474790  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:01.474866  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 129484us
I20260709 12:28:01.400254  6242 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:28:01.465904  6361 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:01.478169  3926 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:01.455264  6268 raft_consensus.cc:697] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:01.485061  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:01.487262  6253 consensus_meta.cc:287] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.782s	user 0.009s	sys 0.002s
I20260709 12:28:01.487039  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.479979  6351 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.476835  6245 consensus_queue.cc:1059] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:28:01.479614  3855 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:28:01.491171  4574 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
W20260709 12:28:01.472252  6394 consensus_meta.cc:287] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.577s	user 0.002s	sys 0.008s
I20260709 12:28:01.494750  3857 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:01.485716  6489 consensus_queue.cc:1059] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:28:01.428306  6362 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:01.501628  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.502681  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:01.503268  3850 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 5: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:01.540938  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:01.504665  6307 consensus_queue.cc:1059] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:28:01.542825  3849 raft_consensus.cc:1813] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:01.543545  3849 raft_consensus.cc:2410] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:28:01.544735  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.546233  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.506773  3930 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:01.490959  6032 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:01.508432  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:01.550700  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.500339  6454 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.501196  6451 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:01.522748  3854 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:28:01.524807  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:01.489274  6205 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:01.422742  6231 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.529616  4567 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:01.562723  6424 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:01.507555  6450 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:01.547281  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:01.566762  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:01.567297  3855 raft_consensus.cc:3055] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:01.507634  6336 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.548750  4573 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:28:01.554101  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:01.515791  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:01.530762  6101 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:01.573567  3928 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:01.576525  4537 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:01.567569  3855 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:01.456161  6490 consensus_queue.cc:1059] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:28:01.552601  6032 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.560356  6205 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:01.569375  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:01.533286  4565 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:01.503945  3851 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:01.600152  3851 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:01.600960  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:01.602365  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 730) took 2059 ms. Trace:
I20260709 12:28:01.602813  4569 rpcz_store.cc:276] 0709 12:27:59.542879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.546671 (+  3792us) service_pool.cc:224] Handling call
0709 12:27:59.547052 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:00.184728 (+637676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:01.602122 (+1417394us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b540045ecd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:01.602297 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1465330560}
I20260709 12:28:01.518229  6480 consensus_queue.cc:1059] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:28:01.612633  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:01.592106  6315 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:01.597204  6316 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:01.603039  6245 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:01.643548  6486 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:28:01.653033  3857 raft_consensus.cc:1240] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:28:01.568243  6454 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:01.618779  6271 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:01.544113  6394 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.602633  6032 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.567480  6268 consensus_queue.cc:237] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.558123  6361 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:01.659447  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 90184.4us
I20260709 12:28:01.673813  3931 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 4. Ops: []
I20260709 12:28:01.651742  6315 raft_consensus.cc:697] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:01.657768  6316 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:01.706866  6459 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.654345  6245 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:01.678507  6387 consensus_meta.cc:287] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 1.146s	user 0.014s	sys 0.002s
W20260709 12:28:01.860342  3971 leader_election.cc:336] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Timed out: RequestConsensusVote RPC to 127.2.157.4:41095 timed out after 1.529s (SENT)
I20260709 12:28:01.890597  3971 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:01.891304  3969 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:01.892450  3969 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:01.894022  4569 raft_consensus.cc:3055] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:01.894403  4569 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:28:01.720943  6445 consensus_meta.cc:287] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.909s	user 0.012s	sys 0.000s
W20260709 12:28:01.707520  6491 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:28:01.889706  6046 raft_consensus.cc:3055] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:01.710450  4565 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:01.898952  4569 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.762679  6242 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:01.813432  6479 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:01.840113  6362 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:01.826881  4566 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:01.855626  6351 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:01.707617  6440 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:01.932468  6434 consensus_meta.cc:287] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.102s	user 0.011s	sys 0.002s
I20260709 12:28:01.707278  6255 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:01.939754  3848 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:01.807766  6055 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:01.882020  6336 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:01.945112  3853 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:01.896225  6413 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:28:01.932063  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 267363us
I20260709 12:28:01.947486  4569 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:01.896600  6205 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:28:01.935565  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:01.927515  6445 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.888661  6361 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:01.933670  6394 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:01.930312  6046 raft_consensus.cc:740] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:01.895387  6459 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.823359  6315 consensus_queue.cc:237] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:01.949525  6497 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:02.013244  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 66893.3us
I20260709 12:28:01.944042  6351 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:02.005190  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 112792us
I20260709 12:28:02.040278  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:01.996692  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:02.027158  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 96325.5us
W20260709 12:28:02.057507  6447 consensus_meta.cc:287] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.000s
I20260709 12:28:02.058378  6340 raft_consensus.cc:3055] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:02.058911  6340 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:02.059878  6340 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.061147  6340 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:02.062888  6420 consensus_meta.cc:287] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.964s	user 0.009s	sys 0.002s
I20260709 12:28:02.062412  6046 consensus_queue.cc:260] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:02.063298  6420 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:02.064675  6055 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:02.066031  6420 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:02.068558  6454 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:02.016103  6336 consensus_queue.cc:1059] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:28:01.941757  6218 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.949642  6242 raft_consensus.cc:697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:01.709676  6316 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.021015  4569 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:28:02.014753  6413 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:02.033522  3857 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:02.015493  6032 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:02.013509  6479 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:02.030607  6495 log.cc:927] Time spent T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 12:28:02.089511  3856 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:28:02.099308  3856 pending_rounds.cc:85] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 4
I20260709 12:28:02.099581  3856 pending_rounds.cc:107] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:28:02.099808  3856 raft_consensus.cc:2889] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:02.033584  6205 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:02.037221  6440 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:02.093796  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 53605.9us
W20260709 12:28:02.086710  6348 consensus_meta.cc:287] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.584s	user 0.005s	sys 0.006s
I20260709 12:28:02.104432  3969 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:02.106236  3969 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:02.086886  6394 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:02.091534  6420 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:02.094339  6231 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:02.111778  3969 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:02.107195  6440 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.115852  6440 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:02.074165  6351 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.120388  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:02.093451  6218 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.122053  6245 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:02.127638  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:02.105826  6205 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:02.128582  6449 consensus_meta.cc:287] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.001s
I20260709 12:28:02.128782  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:02.129356  3930 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:02.129703  6505 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:02.129827  6205 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:02.131438  6353 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:02.139231  4568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 738) took 1700 ms. Trace:
I20260709 12:28:02.108548  6413 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:02.139636  4568 rpcz_store.cc:276] 0709 12:28:00.439252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:00.440312 (+  1060us) service_pool.cc:224] Handling call
0709 12:28:00.583536 (+143224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:01.258172 (+674636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:02.138981 (+880809us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b5400705154. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:02.139169 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1368769792}
I20260709 12:28:02.141592  6316 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:02.071095  6497 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.148269  6497 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:02.123813  6231 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:02.123684  3969 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:02.149242  6231 raft_consensus.cc:697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:02.150265  6231 consensus_queue.cc:237] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:02.151983  6484 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.920s	user 0.003s	sys 0.000s
I20260709 12:28:02.108731  6348 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.152526  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:02.153699  6205 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:02.154105  6348 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:02.154740  6459 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:02.155167  6348 consensus_queue.cc:1059] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:02.156117  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:02.122609  6508 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:02.156742  4006 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:02.124938  6139 consensus_queue.cc:260] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.159359  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:02.160077  3925 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:02.160791  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:02.161008  6245 raft_consensus.cc:3055] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:02.161369  3925 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:02.161415  6245 raft_consensus.cc:740] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:02.163350  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:02.102259  6479 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.164149  4565 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:02.165684  6479 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:02.165629  4537 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:02.166328  6242 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.167465  6316 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:02.167853  6316 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.168183  6316 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:02.168366  3998 raft_consensus.cc:1240] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:02.169476  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:02.170308  4006 raft_consensus.cc:2410] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:28:02.170184  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:02.170755  4005 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:02.162376  6245 consensus_queue.cc:260] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:02.171478  6245 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:02.173228  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:02.157684  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:02.175514  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:02.176134  3926 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:28:02.176899  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:02.177474  3926 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 1.
I20260709 12:28:02.177985  6302 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:02.178733  4537 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:02.178929  6445 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:00.754941  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:02.093508  6447 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:02.180840  6351 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:02.199960  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:02.206532  3998 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:02.186954  6497 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:02.188170  4537 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:02.188235  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:02.207839  4002 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:02.208889  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:02.209425  4005 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:02.177330  6316 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:02.189488  6473 consensus_meta.cc:287] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.688s	user 0.007s	sys 0.003s
I20260709 12:28:02.190497  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:02.181092  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:02.194530  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:02.216224  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:02.217001  3851 raft_consensus.cc:2410] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:28:02.195243  6360 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:02.174253  6348 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:28:02.197072  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:02.199231  4006 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
W20260709 12:28:02.203274  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:02.208232  4537 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:02.213938  3897 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:02.113574  6394 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.117743  6420 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:02.215190  3850 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:28:02.129001  6449 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.228873  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:02.227283  4537 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:02.231407  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:02.239835  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:02.240706  3854 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:02.227931  4005 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:02.229647  3926 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:02.210716  6497 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.226133  6302 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:02.273895  6205 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:02.274763  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 44302.4us
I20260709 12:28:02.275753  4537 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:02.296271  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:02.299114  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:02.303313  3924 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:02.303687  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:02.304672  3854 raft_consensus.cc:2393] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:02.313252  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:02.234864  6351 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:02.211467  6436 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:02.242905  6479 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:02.314317  3998 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:02.274294  6302 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.331997  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:02.331600  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:02.335412  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:02.275022  6497 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:02.273903  6501 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:02.338472  3849 raft_consensus.cc:2410] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:28:02.341182  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 120927us
I20260709 12:28:02.226061  6473 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.342689  3849 raft_consensus.cc:1240] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:02.343510  6427 consensus_queue.cc:1059] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:02.343812  6473 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:02.344480  4000 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:02.333925  6351 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.345597  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:02.335350  6479 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.346333  6479 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:02.346503  6420 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:02.242573  6342 consensus_queue.cc:1059] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 12:28:02.345695  6351 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:02.307562  6505 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.351433  4002 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:02.330050  6504 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:02.336992  4567 raft_consensus.cc:2393] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 5: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:02.359413  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:02.357188  3897 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:02.338725  6302 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:02.350246  6501 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.377266  6474 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:02.367048  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:02.350047  6447 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:02.350775  6436 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:02.380020  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:02.381063  6330 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:02.366261  6504 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.365991  6508 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:02.386943  6440 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:02.385910  6330 raft_consensus.cc:697] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:02.388499  6330 consensus_queue.cc:237] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.385845  6504 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:02.390029  6474 raft_consensus.cc:697] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:02.379714  6501 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:02.392771  4537 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:02.395088  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:02.398488  3997 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:02.416648  4003 raft_consensus.cc:1240] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:28:02.390552  6394 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:02.421706  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:02.422652  6511 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:02.416910  6255 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:28:02.425197  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 73377.3us
I20260709 12:28:02.413054  6440 raft_consensus.cc:697] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:02.366277  6505 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.440991  6449 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:02.430549  6316 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:02.430693  6511 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.439036  6436 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.443921  6511 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:02.445123  4002 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:02.445457  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:02.445938  4001 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 1. Current term is 2. Ops: []
W20260709 12:28:02.452280  6468 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 1.372s	user 0.000s	sys 0.001s
I20260709 12:28:02.454419  3897 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:02.454309  6440 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.457018  6449 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:02.457424  6449 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.457535  6505 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:02.457787  6449 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:02.462112  6303 raft_consensus.cc:3055] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:02.462530  6303 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:02.463357  6303 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:02.464355  6303 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:02.466629  6512 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:28:02.468541  6490 raft_consensus.cc:3055] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:02.468976  6490 raft_consensus.cc:740] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:02.472498  6449 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.427299  6255 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.474877  6427 raft_consensus.cc:3055] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:02.477098  6428 raft_consensus.cc:3055] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:02.478570  4004 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:28:02.479053  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1634) took 1055 ms. Trace:
I20260709 12:28:02.489343  3857 rpcz_store.cc:276] 0709 12:28:01.423266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.653856 (+230590us) service_pool.cc:224] Handling call
0709 12:28:01.669991 (+ 16135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:02.093203 (+423212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:02.478776 (+385573us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54001e7654. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:02.478991 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835578112}
I20260709 12:28:02.509635  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 567) took 1161 ms. Trace:
I20260709 12:28:02.510103  3931 rpcz_store.cc:276] 0709 12:28:01.348423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.366250 (+ 17827us) service_pool.cc:224] Handling call
0709 12:28:01.366616 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:01.676612 (+309996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:02.509398 (+832786us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54003066d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:02.509572 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705935104}
I20260709 12:28:02.503156  6255 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:02.512120  6437 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:02.470142  6490 consensus_queue.cc:260] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.532907  6351 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.537096  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:02.537686  3931 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:02.437569  6501 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.503278  6428 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:02.503207  6427 raft_consensus.cc:740] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:02.438917  6474 consensus_queue.cc:237] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:02.600041  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:02.565536  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:02.590699  3931 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:28:02.813751  3849 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:02.814456  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1638) took 1290 ms. Trace:
W20260709 12:28:02.812028  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 368271us
I20260709 12:28:02.806088  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 623) took 1314 ms. Trace:
I20260709 12:28:02.674526  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1627) took 1420 ms. Trace:
I20260709 12:28:02.814798  3849 rpcz_store.cc:276] 0709 12:28:01.523840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:02.467643 (+943803us) service_pool.cc:224] Handling call
0709 12:28:02.813565 (+345922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:02.814222 (+   657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:02.814400 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:28:02.692672  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:02.815726  3854 rpcz_store.cc:276] 0709 12:28:01.491909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:02.339878 (+847969us) service_pool.cc:224] Handling call
0709 12:28:02.351842 (+ 11964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:02.352145 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:28:02.428375 (+ 76230us) log.cc:844] Serialized 14 byte log entry
0709 12:28:02.429310 (+   935us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:02.429365 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:02.429407 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:02.429510 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:02.805822 (+376312us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5400054bd0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:02.806001 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":81942,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":95,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":26882304,"thread_start_us":62249,"threads_started":2,"wal-append.queue_time_us":1196}
W20260709 12:28:02.551050  6357 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:28:02.606479  6302 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.719861  6504 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.834445  6302 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:02.834556  6504 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:02.818848  6455 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:02.827852  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:02.635996  6255 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.828797  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:02.836724  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:02.828073  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:02.837216  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:02.830669  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:02.832293  6271 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:02.837585  3997 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:02.829579  6316 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.835983  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:02.830016  4537 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:02.839620  3931 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:02.836114  6519 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.829005  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:02.719352  6332 raft_consensus.cc:3055] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:02.837682  6451 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:02.850795  6519 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.850989  3931 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:02.851871  4572 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:28:02.851478  6451 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:02.853027  6519 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:02.854198  6069 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:02.838457  6316 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.855746  6046 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:02.857299  6316 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:02.858127  6508 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:02.858721  6508 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.860967  6508 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:02.861419  6508 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:02.862177  4569 raft_consensus.cc:2393] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 4: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:02.836666  6455 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.863092  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:02.864148  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:02.864475  6455 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:02.864840  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:02.865633  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:02.866189  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:02.809540  6272 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:02.842993  4571 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:02.838186  6271 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:02.552747  6427 consensus_queue.cc:260] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:02.871282  6271 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:02.873658  4571 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:02.550449  6351 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:02.806836  6490 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:02.813058  6501 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:02.848721  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:02.880652  4002 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:02.867960  4001 raft_consensus.cc:2393] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:02.850447  6332 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:02.882112  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:02.867789  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:02.606508  6479 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.878479  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:02.882959  4005 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:02.723341  6497 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.865108  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:02.896898  6332 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:02.883737  6069 raft_consensus.cc:697] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:02.551740  6428 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.868371  6508 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:02.961815  6451 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:02.997017  6332 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:02.998003  6428 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:03.063228  6255 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:03.066602  6497 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:03.068223  6479 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:03.088223  6508 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:02.817312  3848 rpcz_store.cc:276] 0709 12:28:01.253765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.258394 (+  4629us) service_pool.cc:224] Handling call
0709 12:28:02.674317 (+1415923us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b540030cfd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:02.674448 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1564783872}
I20260709 12:28:02.845119  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:02.887961  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:03.183681  3997 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:03.185987  3926 raft_consensus.cc:2393] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:03.185828  3970 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:03.188923  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 343725us
I20260709 12:28:02.901328  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:03.207892  4006 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:03.209295  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:03.210433  3931 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:03.212906  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:03.213932  3925 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:28:03.215369  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:03.215797  3970 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:03.217250  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:03.218494  3930 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:28:03.223026  4006 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:03.242666  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:03.206476  4005 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:28:03.244668  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:03.245429  4005 raft_consensus.cc:2376] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5. Re-sending same reply.
I20260709 12:28:03.246644  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:03.247985  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:03.248889  4568 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 5: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:03.249573  4005 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:28:03.242741  3853 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2076) took 1894 ms (client timeout 1644 ms). Trace:
I20260709 12:28:03.248718  4006 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:03.251001  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:03.255110  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2135) took 1043 ms. Trace:
I20260709 12:28:03.255818  6046 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:03.256628  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 565) took 1930 ms. Trace:
I20260709 12:28:03.258004  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36516 (request call id 2134) took 1048 ms. Trace:
I20260709 12:28:03.257536  6069 consensus_queue.cc:237] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.258880  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 716) took 2330 ms. Trace:
I20260709 12:28:03.226910  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:03.270380  6438 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:03.265642  4004 rpcz_store.cc:276] 0709 12:28:02.209376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:02.297378 (+ 88002us) service_pool.cc:224] Handling call
0709 12:28:03.257539 (+960161us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540036e054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:03.257779 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323264768}
I20260709 12:28:03.279794  6438 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.280678  6353 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:03.281219  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:03.261699  4003 rpcz_store.cc:276] 0709 12:28:02.211602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:02.306114 (+ 94512us) service_pool.cc:224] Handling call
0709 12:28:02.333970 (+ 27856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:02.417181 (+ 83211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:03.254376 (+837195us) spinlock_profiling.cc:243] Waited 82.4 ms on lock 0x7b54000f87d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:03.254834 (+   458us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189571456}
I20260709 12:28:03.264608  3924 rpcz_store.cc:276] 0709 12:28:01.325759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.368997 (+ 43238us) service_pool.cc:224] Handling call
0709 12:28:01.370452 (+  1455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:02.303785 (+933333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:03.256029 (+952244us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b54000eecd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:03.256371 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2144929664}
I20260709 12:28:03.283200  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:03.284406  4003 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:28:03.285306  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.286489  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:03.287508  6361 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:03.288172  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:03.288507  6361 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.290223  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1579) took 2146 ms. Trace:
I20260709 12:28:03.290661  3927 rpcz_store.cc:276] 0709 12:28:01.143510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.143695 (+   185us) service_pool.cc:224] Handling call
0709 12:28:01.165439 (+ 21744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:01.367435 (+201996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:03.233702 (+1866267us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002e3954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:03.290002 (+ 56300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303187200}
W20260709 12:28:03.261538  3853 rpcz_store.cc:269] 0709 12:28:01.348022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.368133 (+ 20111us) service_pool.cc:224] Handling call
0709 12:28:03.242138 (+1874005us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b540030cd54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:03.242384 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1081870720}
I20260709 12:28:03.296281  6508 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:03.296411  6361 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:03.297322  6508 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:03.297775  4573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 721) took 1909 ms (client timeout 1820 ms). Trace:
W20260709 12:28:03.298373  4573 rpcz_store.cc:269] 0709 12:28:01.388380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.473169 (+ 84789us) service_pool.cc:224] Handling call
0709 12:28:03.297330 (+1824161us) spinlock_profiling.cc:243] Waited 8.48 ms on lock 0x7b540055c8d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:03.297524 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19503488}
I20260709 12:28:03.300784  6190 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:03.289338  4005 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:03.267102  4574 rpcz_store.cc:276] 0709 12:28:00.928322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:00.973441 (+ 45119us) service_pool.cc:224] Handling call
0709 12:28:00.973733 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:01.532801 (+559068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:03.258374 (+1725573us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b5400705b54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:03.258657 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1160492288}
I20260709 12:28:03.302834  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:03.303735  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1629) took 2024 ms. Trace:
I20260709 12:28:03.304162  3856 rpcz_store.cc:276] 0709 12:28:01.279144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.555526 (+276382us) service_pool.cc:224] Handling call
0709 12:28:01.555777 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:02.100207 (+544430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:03.303056 (+1202849us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b540001a9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:03.303452 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1225760000}
I20260709 12:28:03.301681  6190 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:03.306574  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:03.307130  6449 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:03.308553  6190 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:03.308732  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:03.309672  3857 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:28:03.309656  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:03.310905  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:03.311946  3849 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:03.312155  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:03.313781  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:03.314656  3849 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
W20260709 12:28:03.315618  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 97904.1us
I20260709 12:28:03.316679  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:03.317596  6357 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.318617  6357 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.301918  6438 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:03.322775  4006 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:28:03.316567  3970 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:03.298393  6508 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:03.344913  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:03.338721  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 149447us
I20260709 12:28:03.350190  4001 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:03.356251  4005 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:03.348658  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:03.365579  3854 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:03.346391  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:03.367565  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.369614  3848 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:03.372474  4004 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:03.316696  6190 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:03.379384  3931 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:28:03.348371  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:03.354487  3855 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:03.341804  4537 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:03.385000  3853 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:03.339442  6432 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:03.386059  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:03.392943  3857 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:03.356751  6253 raft_consensus.cc:3055] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:03.400336  4003 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:03.411397  6508 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:03.414294  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 97915.1us
I20260709 12:28:03.416659  3970 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:03.417099  6357 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:03.418339  4001 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 2. Current term is 3. Ops: []
W20260709 12:28:03.419715  4002 consensus_meta.cc:287] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.008s
I20260709 12:28:03.420287  4002 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:03.421149  6369 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:03.418390  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.400054  6253 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:03.425451  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2129) took 1223 ms. Trace:
I20260709 12:28:03.425212  6253 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.426494  6253 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:03.429011  3854 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:03.429069  6218 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:03.398224  6353 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:03.433985  6508 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:03.438206  6427 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:03.435838  3855 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:28:03.430380  4000 rpcz_store.cc:276] 0709 12:28:02.202329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:02.202448 (+   119us) service_pool.cc:224] Handling call
0709 12:28:02.202718 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:02.344856 (+142138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:03.424926 (+1080070us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400310954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:03.425244 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325600128}
I20260709 12:28:03.445571  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:03.457360  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 162325us
W20260709 12:28:03.458889  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 190466us
I20260709 12:28:03.476944  3853 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:03.480331  6271 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:03.481295  6271 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:03.482568  3969 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:03.484077  6271 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:03.484256  3969 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:03.485194  6360 raft_consensus.cc:2764] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:28:03.486090  4537 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:03.487164  6387 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:03.487530  6387 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.487874  6387 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:03.487802  4537 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:03.490607  6307 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:03.491084  6307 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.491463  6307 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:03.514271  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 762) took 2013 ms. Trace:
I20260709 12:28:03.514726  4570 rpcz_store.cc:276] 0709 12:28:01.500892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.587860 (+ 86968us) service_pool.cc:224] Handling call
0709 12:28:03.297590 (+1709730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:03.298471 (+   881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:03.298499 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:03.299241 (+   742us) log.cc:844] Serialized 26 byte log entry
0709 12:28:03.383670 (+ 84429us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:03.383733 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:03.393960 (+ 10227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:03.512854 (+118894us) raft_consensus.cc:1685] finished
0709 12:28:03.512878 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:03.513812 (+   934us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b540055c8d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:03.514079 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1758,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":367,"spinlock_wait_cycles":3922061696,"thread_start_us":72280,"threads_started":1,"wal-append.queue_time_us":153866}
I20260709 12:28:03.522970  4536 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:03.523965  6218 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:03.524439  6218 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:03.524885  6218 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:03.490618  3855 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
W20260709 12:28:03.534693  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.537014  6437 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:03.537760  6437 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:03.539084  6437 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.541682  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:03.543903  6348 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:03.544569  6348 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:03.546967  6218 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:03.551018  3855 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1641) took 1975 ms (client timeout 2172 ms). Trace:
W20260709 12:28:03.551626  3855 rpcz_store.cc:269] 0709 12:28:01.559019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.566527 (+  7508us) service_pool.cc:224] Handling call
0709 12:28:03.353429 (+1786902us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4c0014a340. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0502a3a20 00007fe0502b4a29 00007fe05027a644 00007fe0502a1f2d 00007fe0502a1b93 00007fe051fd218b 00007fe051fd2cb5 00007fe051fcdf30 00007fe051fcf7de 00007fe051fdb27c 00007fe056f9cb17
0709 12:28:03.534190 (+180761us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25316096}
I20260709 12:28:03.562479  3897 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:03.564487  3857 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:28:03.567695  3969 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:03.573530  3997 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:03.608369  6316 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:03.608743  6271 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:03.609272  6271 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.609834  6271 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:03.609952  3895 connection.cc:256] RPC call timeout handler was delayed by -1.0558077030000277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
W20260709 12:28:03.610916  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.610553  6307 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:03.611366  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:03.611770  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:03.612178  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.613823  6494 raft_consensus.cc:3055] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:03.614373  6494 raft_consensus.cc:740] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:03.615710  6494 consensus_queue.cc:260] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.617358  6494 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:03.620152  6272 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:03.545719  6348 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:03.609218  6316 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.624419  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 767) took 1468 ms. Trace:
I20260709 12:28:03.572875  6218 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:03.622350  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 95228us
W20260709 12:28:03.625994  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 101496us
I20260709 12:28:03.637800  6332 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.638578  6332 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:03.639536  6307 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:03.641228  6332 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:03.663798  4536 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:03.672477  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 122561us
I20260709 12:28:03.677832  6353 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:03.634665  6473 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:28:03.624859  4567 rpcz_store.cc:276] 0709 12:28:02.155582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:02.172937 (+ 17355us) service_pool.cc:224] Handling call
0709 12:28:03.623994 (+1451057us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54006a3954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:03.624234 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232103296}
I20260709 12:28:03.684034  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:03.680903  4536 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:03.687376  6271 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.689143  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:03.698225  6435 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:03.698143  6480 consensus_queue.cc:1059] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:28:03.698849  6126 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:03.698997  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 143783us
I20260709 12:28:03.700191  3969 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:03.702158  6268 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:03.701496  6271 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:03.708050  6069 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:03.708154  6549 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:28:03.709429  6550 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:03.712080  6332 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:03.712484  6332 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.712798  6332 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:03.694967  6387 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.715541  6394 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:03.715698  6480 raft_consensus.cc:3055] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:03.716012  6387 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:03.716271  6480 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:03.717298  4536 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:03.718108  6487 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:03.709301  6345 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:03.718710  6487 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.720242  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:03.721000  3931 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:03.722858  3923 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:03.723903  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:03.724699  3927 raft_consensus.cc:2393] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:03.726243  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:03.726920  3924 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:28:03.717551  6480 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.727483  6435 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:03.704797  6548 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:28:03.704686  3969 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:03.729004  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:03.731391  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:03.716234  6394 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.732131  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:03.728653  6435 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.734365  4573 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 3. Ops: []
I20260709 12:28:03.734932  3928 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:28:03.735042  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:03.735421  6139 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:03.735999  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:03.736717  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 73485.2us
I20260709 12:28:03.736905  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:03.769662  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 65116.1us
I20260709 12:28:03.791329  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:03.796727  4570 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:03.797645  3931 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
W20260709 12:28:03.800977  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:03.767630  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 50481.5us
I20260709 12:28:03.768141  6394 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:03.768824  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2167) took 2412 ms. Trace:
I20260709 12:28:03.769268  6487 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:03.769943  6272 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:28:03.776751  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.781261  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:03.783916  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:03.784965  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:03.764040  4569 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:03.813179  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:03.814077  3997 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:28:03.820107  4536 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:03.821291  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.820901  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:03.830111  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:03.842182  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.815295  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:03.850312  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:03.857364  3895 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:03.862349  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 45692.9us
I20260709 12:28:03.856956  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:03.804260  3932 rpcz_store.cc:276] 0709 12:28:01.324614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.349855 (+ 25241us) service_pool.cc:224] Handling call
0709 12:28:01.350251 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:01.350694 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:01.350737 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:03.548363 (+2197626us) spinlock_profiling.cc:243] Waited 9.29 ms on lock 0x7b2c0005c0c8. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:28:03.548954 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:28:03.681539 (+132585us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:03.692520 (+ 10981us) log.cc:844] Serialized 14 byte log entry
0709 12:28:03.696450 (+  3930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:03.706586 (+ 10136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:03.706635 (+    49us) raft_consensus.cc:1685] finished
0709 12:28:03.730300 (+ 23665us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:03.737119 (+  6819us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2209,"prepare.queue_time_us":11426,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":13768,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":11069,"spinlock_wait_cycles":31224064,"thread_start_us":132145,"threads_started":1,"wal-append.queue_time_us":128843}
I20260709 12:28:03.873289  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:03.867868  3927 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
W20260709 12:28:03.882684  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 78763.9us
I20260709 12:28:03.889703  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:03.891831  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:03.892982  4005 raft_consensus.cc:2393] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 5: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:28:03.940441  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.965178  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54068 (request call id 581) took 1494 ms. Trace:
I20260709 12:28:03.971763  6438 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:03.972446  6438 raft_consensus.cc:697] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:28:03.974193  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.974761  3997 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:28:03.974531  6332 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.863952  4567 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:28:03.976497  3931 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:03.977506  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:03.982360  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 167608us
I20260709 12:28:03.970383  3926 rpcz_store.cc:276] 0709 12:28:02.396357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:02.396483 (+   126us) service_pool.cc:224] Handling call
0709 12:28:03.851450 (+1454967us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b54000dc354. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:03.891069 (+ 39619us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1749176192}
I20260709 12:28:03.983938  3927 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 4: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:03.989558  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:03.986225  4536 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:03.963610  6480 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:03.968008  6255 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:28:03.998010  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 114620us
I20260709 12:28:03.996714  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:03.999625  3928 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
W20260709 12:28:04.002982  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.003997  6271 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:04.005224  6492 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:04.006117  3822 connection.cc:256] RPC call timeout handler was delayed by -1.3921522790001291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
I20260709 12:28:04.005955  6492 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:04.006718  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:04.007155  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:04.007403  3822 connection.cc:256] RPC call timeout handler was delayed by -1.0281098119999115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
W20260709 12:28:04.007686  3822 connection.cc:256] RPC call timeout handler was delayed by -1.0172658210003647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
I20260709 12:28:04.008332  6126 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:04.008987  6126 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:03.999429  6345 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:04.010746  6552 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:28:04.010524  6345 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.011374  6126 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:04.011961  6126 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:04.012923  6345 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:04.012645  6126 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.014149  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:04.014394  6492 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:04.024164  3895 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.026413  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.026564  3895 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:04.027374  3927 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 4: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:04.028689  3927 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:04.029243  6391 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:03.968328  6394 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:04.031615  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.032342  3855 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:04.033259  3856 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:04.034552  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.036399  3925 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:04.037001  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:04.037649  3853 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:04.042235  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:04.042886  3926 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:28:04.043426  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.044335  3849 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 5: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:03.973516  6438 consensus_queue.cc:237] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:04.045969  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 52469.1us
I20260709 12:28:04.047487  4538 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:04.055029  3928 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 12:28:04.029677  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.056301  6440 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:04.056599  6307 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:04.057372  6307 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:04.058588  6440 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:04.059042  6440 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:04.059137  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 62611.5us
I20260709 12:28:04.059495  6440 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:04.060371  6332 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:04.061937  6459 consensus_queue.cc:1059] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:04.062865  6253 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:04.063237  6459 raft_consensus.cc:3055] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:04.063648  6459 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:04.064594  6459 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.066494  6126 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:04.078934  3853 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
W20260709 12:28:04.070504  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 44100.8us
I20260709 12:28:04.070832  3854 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:04.069507  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.041745  4569 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:04.081640  4569 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:04.081831  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:04.078224  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:04.088143  3848 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:04.098621  3926 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:04.097671  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.100571  3849 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:04.105386  3852 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 2.
I20260709 12:28:04.102355  4536 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:04.103677  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.111768  6213 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:04.113184  6454 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.113693  6454 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.065805  6459 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:04.121987  3923 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:04.103406  6435 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:04.108909  6218 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:04.129484  6480 raft_consensus.cc:2764] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:28:04.122741  6069 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:04.141932  4536 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:04.139453  3895 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.136262  6218 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:04.149549  6508 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:04.138392  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:04.138823  6069 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.161370  6069 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:04.164554  6543 log.cc:927] Time spent T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.472s	user 0.004s	sys 0.000s
I20260709 12:28:04.165663  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 405) took 1306 ms. Trace:
I20260709 12:28:04.166034  4006 rpcz_store.cc:276] 0709 12:28:02.858794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:03.361705 (+502911us) service_pool.cc:224] Handling call
0709 12:28:03.384903 (+ 23198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:03.405392 (+ 20489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:03.405431 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:03.406116 (+   685us) log.cc:844] Serialized 26 byte log entry
0709 12:28:03.573345 (+167229us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:03.573401 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:03.573492 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:04.163873 (+590381us) spinlock_profiling.cc:243] Waited 9.3 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:04.165391 (+  1518us) raft_consensus.cc:1685] finished
0709 12:28:04.165411 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:04.165608 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3666,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":236,"spinlock_wait_cycles":21385472,"thread_start_us":165189,"threads_started":1,"wal-append.queue_time_us":242656}
I20260709 12:28:04.153795  6213 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:04.168066  6213 raft_consensus.cc:697] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:04.169078  6213 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.169595  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.147984  6549 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.158556  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.160017  4567 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 4: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:04.149992  6307 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.174211  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:04.174858  4005 raft_consensus.cc:2376] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3. Re-sending same reply.
W20260709 12:28:04.176493  4566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 751) took 3551 ms (client timeout 1529 ms). Trace:
W20260709 12:28:04.177253  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.177628  6255 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:04.178267  6255 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:04.179508  3854 raft_consensus.cc:2393] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 3: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:28:04.185106  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 58631.2us
I20260709 12:28:04.155489  6394 raft_consensus.cc:2764] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:28:04.154181  6218 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:04.187294  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.188010  3997 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:04.190320  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:04.195993  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.196185  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:04.176951  4566 rpcz_store.cc:269] 0709 12:28:00.625145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:00.673668 (+ 48523us) service_pool.cc:224] Handling call
0709 12:28:04.176153 (+3502485us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54006e6754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:04.176302 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1587916672}
I20260709 12:28:04.197067  4006 raft_consensus.cc:2376] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3. Re-sending same reply.
I20260709 12:28:04.198460  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.199121  3997 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:04.200731  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.194418  3851 raft_consensus.cc:2376] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7. Re-sending same reply.
I20260709 12:28:04.207878  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:04.214753  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.215749  3997 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:04.190775  6555 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.228518  3895 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:04.230432  3969 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:04.232335  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.233239  4006 raft_consensus.cc:2376] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5. Re-sending same reply.
W20260709 12:28:04.237622  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 50983us
W20260709 12:28:04.239979  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.262892  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:04.263553  4006 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:04.209695  6271 consensus_queue.cc:1059] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 12:28:04.266992  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 125138us
I20260709 12:28:04.186761  6549 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.209854  6508 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.262687  3822 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:04.257290  6272 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:04.227627  6555 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:04.272107  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 79964.4us
I20260709 12:28:04.274111  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:04.275666  3851 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:04.277509  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.264214  6394 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:04.282429  4005 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:28:04.277313  6348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.017s	sys 0.014s
I20260709 12:28:04.285338  4003 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:04.272172  6272 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:04.286003  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 71541.5us
I20260709 12:28:04.293437  3895 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:04.296770  6562 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:04.287855  6272 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:04.298982  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:04.299423  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.301578  6492 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:04.302196  6492 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.304368  6492 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:04.286275  6348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.017s	sys 0.014s
I20260709 12:28:04.282354  6435 raft_consensus.cc:697] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:04.314047  4003 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:04.319481  4006 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
W20260709 12:28:04.320628  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.323137  6567 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:28:04.324334  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 87659.3us
W20260709 12:28:04.327782  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 90906.9us
I20260709 12:28:04.330219  3970 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:04.330651  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:04.333364  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.291656  6559 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:04.338555  4006 raft_consensus.cc:1240] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:04.340106  4000 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:28:04.342062  4003 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:28:04.345088  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.344651  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:04.348304  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 54960.7us
I20260709 12:28:04.328897  6492 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.337186  6394 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:04.353628  3970 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.354256  6494 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:04.354839  6494 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.350500  6213 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:04.355831  6213 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.356877  6494 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:04.351912  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:04.366127  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.369480  6549 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:04.369689  6271 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:04.378021  3895 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.371377  6316 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:04.372932  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.378571  6272 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.388513  6550 raft_consensus.cc:3055] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:04.389010  6550 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:04.375352  6218 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.357800  6213 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:04.364570  6492 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.390179  3850 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:04.390512  6555 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:04.391826  6492 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:04.381242  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:04.382740  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.350837  6567 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:04.391639  4536 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:04.361614  6559 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:04.397075  6435 consensus_queue.cc:237] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.399224  6562 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:04.401173  6562 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:04.401672  6562 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:04.408278  6315 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.408846  6315 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:04.392055  6563 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:28:04.437681  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:04.445008  4000 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 4: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:04.440855  6345 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:04.431581  6440 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.442035  4565 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:04.443672  6069 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.452468  6345 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.455695  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.455924  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:04.456316  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 89686.8us
I20260709 12:28:04.455262  6440 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:04.457267  3926 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:04.458035  6440 consensus_queue.cc:1059] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:04.458921  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.460461  3928 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:04.456012  6345 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.462699  3925 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:28:04.462934  6332 raft_consensus.cc:3055] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:04.463376  6332 raft_consensus.cc:740] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:04.463743  6345 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:04.456013  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 109830us
I20260709 12:28:04.458210  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.456418  3853 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:04.461676  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.455312  3897 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.475396  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.476038  3931 raft_consensus.cc:1813] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:04.476712  3931 raft_consensus.cc:2410] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:28:04.485518  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.486423  3855 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:04.367022  6548 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:04.447320  6494 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:04.504208  3853 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:04.495620  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.496227  6069 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:04.505681  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 48558.6us
I20260709 12:28:04.453315  6272 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:04.516579  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 163015us
I20260709 12:28:04.396241  6559 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.518326  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:04.520190  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 64955.8us
I20260709 12:28:04.517850  3970 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:04.464298  6332 consensus_queue.cc:260] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.510421  6345 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:04.430575  6550 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.531244  3931 raft_consensus.cc:1240] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:04.529476  4538 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:04.538769  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:04.539716  3857 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:04.533737  3895 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.539404  3897 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:04.545517  3970 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:04.546000  6190 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:04.546515  3924 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:04.546849  6555 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:04.547012  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.547286  6555 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.547359  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.547891  6555 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:04.552495  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.553192  3970 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:04.543048  6069 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:04.556427  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:04.554533  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 63816.2us
I20260709 12:28:04.540675  6348 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:04.558213  3849 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:04.537312  6271 raft_consensus.cc:697] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:04.559484  6548 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:28:04.543056  6272 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:04.560518  6578 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:04.562428  6332 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:04.563912  6069 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.564817  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.565546  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:04.571827  3854 raft_consensus.cc:2393] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 5: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:04.537547  6494 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:04.572948  3853 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:04.567925  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.572481  3924 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:28:04.559152  6559 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:04.554401  6394 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:04.573308  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:04.573956  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.574311  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:04.577396  3927 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 2.
I20260709 12:28:04.574489  3897 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:04.575171  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.579994  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.581223  4537 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:04.566854  6348 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:04.584465  6348 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:04.585230  3970 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.568053  6190 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:04.586715  3856 raft_consensus.cc:2393] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 5: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:04.586572  6190 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:04.588168  6190 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:04.588558  6190 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:04.573058  6272 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.589046  6190 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:04.590902  6272 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:04.591267  6569 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:28:04.591537  6272 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:04.592960  6245 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:04.593122  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.593847  6245 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:04.594329  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.594964  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:04.562431  6576 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:04.598986  3853 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:04.599891  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.600911  3924 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:04.602506  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:04.603236  4570 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:04.604542  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.604779  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.605669  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.606686  3927 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:04.608485  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.609287  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:04.610147  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.576619  6549 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:04.612730  4002 raft_consensus.cc:2368] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7.
I20260709 12:28:04.594374  6245 raft_consensus.cc:697] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:04.613705  3928 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 1. Current term is 3. Ops: []
W20260709 12:28:04.614078  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 45993.7us
I20260709 12:28:04.614409  3849 raft_consensus.cc:2393] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 4: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:28:04.614615  6342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.094s	user 0.007s	sys 0.020s
I20260709 12:28:04.614920  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.607820  6255 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:04.615689  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 75306.3us
I20260709 12:28:04.617744  6069 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:04.617990  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.618171  6573 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:04.618316  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:04.622134  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 102483us
I20260709 12:28:04.623025  6487 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.667198  6487 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.667738  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.669258  6487 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:04.625716  6570 consensus_queue.cc:1059] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:28:04.670512  3857 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:04.670588  6570 raft_consensus.cc:3055] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:04.623574  6494 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:04.671139  6570 raft_consensus.cc:740] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:04.672120  6570 consensus_queue.cc:260] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.623948  3821 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:04.673866  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:04.674156  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 50279.2us
W20260709 12:28:04.674490  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.613731  3932 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:04.625429  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.627676  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.675634  3854 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:28:04.632436  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.634804  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:04.632462  6245 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.689395  6353 raft_consensus.cc:3055] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:04.689977  6353 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:04.691041  6353 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.692286  6353 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:04.596340  6435 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:04.637935  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:04.693738  4006 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:28:04.639523  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:04.694752  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.695320  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:04.696244  4006 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:28:04.639694  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.697614  6494 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:04.697721  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.698081  6494 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:04.698346  3929 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:04.698487  6494 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:04.699018  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.699206  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.699820  3929 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:04.596832  6394 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:04.700394  6394 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:04.676113  4536 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:04.702579  3970 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:04.683820  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.703735  3927 raft_consensus.cc:2393] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:04.626420  6549 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.643728  3969 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:04.647660  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.646216  4570 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:04.654004  3897 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.656227  6255 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:04.657110  6271 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.666500  4538 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:04.679817  3895 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.625437  6567 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 12:28:04.718204  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 74549.8us
I20260709 12:28:04.718348  3932 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
W20260709 12:28:04.642298  6342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.206s	user 0.008s	sys 0.020s
I20260709 12:28:04.683780  6508 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:04.687023  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:04.687310  6555 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.647183  6576 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:04.706969  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.707530  6573 raft_consensus.cc:697] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:04.700583  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:04.705651  3927 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:04.712374  3821 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:04.714185  6570 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:04.716743  6549 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:04.716507  6473 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:04.714145  6435 raft_consensus.cc:697] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:04.727414  6255 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:04.741048  6584 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:04.742079  6492 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:04.742296  6126 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:04.742522  6492 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.743060  6492 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:04.744122  6435 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.743199  6255 raft_consensus.cc:697] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:04.746766  6255 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.728488  6342 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:04.718240  6069 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:04.737524  3895 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.677361  6345 raft_consensus.cc:697] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:04.751765  4004 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:04.709578  6562 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.756934  6272 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:28:04.764642  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 98215.5us
I20260709 12:28:04.765904  4538 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:04.774184  6345 consensus_queue.cc:237] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.777472  6315 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:04.777527  6253 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:04.751247  6473 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:04.784852  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 78006.3us
I20260709 12:28:04.787299  4574 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:04.767135  6069 raft_consensus.cc:697] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:04.750973  3969 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:04.769232  6508 raft_consensus.cc:3055] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:04.781914  6332 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:04.780673  6473 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:04.807852  6190 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.809077  3926 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:04.810055  6348 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.800376  3822 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:04.801498  6555 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:04.792443  3821 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:04.799660  3739 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4eedd844c09d456ca0b3614490dd1dbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:04.814325  4538 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:04.815023  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 92127.2us
I20260709 12:28:04.820478  3856 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:04.816920  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:04.828132  3969 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:04.833124  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.834457  4538 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:04.836210  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:04.838146  6315 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:04.838981  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:04.838791  6576 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.839598  3848 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:04.840623  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:04.842163  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:04.830229  6245 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:04.842835  6245 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:04.843241  6245 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:04.846001  6272 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:04.846226  6190 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:04.846593  6272 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:04.847551  6272 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.850104  6497 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:04.849995  6394 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.850718  6497 raft_consensus.cc:697] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:04.852794  3857 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:04.812033  6348 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:04.858348  6069 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:04.863894  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:04.730937  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 77074us
I20260709 12:28:04.865371  6126 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:04.865562  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:04.866423  4005 raft_consensus.cc:2393] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 5: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:04.867563  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.867463  6190 consensus_queue.cc:1059] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:04.861451  6253 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:04.874279  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:04.864533  4006 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
W20260709 12:28:04.861969  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 91372.2us
I20260709 12:28:04.877442  4538 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:04.812124  6562 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:04.878870  3999 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:04.794975  6508 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:04.817796  6506 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:04.885429  3969 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:04.810420  6494 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.830833  6316 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:28:04.914763  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 119560us
W20260709 12:28:04.916107  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 48631.6us
I20260709 12:28:04.881350  6126 raft_consensus.cc:697] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:04.851644  6497 consensus_queue.cc:237] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.022769  3855 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 1. Current term is 3. Ops: []
W20260709 12:28:04.938778  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.908707  6555 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:28:05.062522  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 175398us
W20260709 12:28:05.077831  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.917197  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:04.887272  6568 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:28:05.080225  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:05.082304  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 244930us
W20260709 12:28:05.088840  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 171700us
W20260709 12:28:05.096143  3852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2080) took 3571 ms (client timeout 1805 ms). Trace:
I20260709 12:28:04.919000  6253 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:04.880234  6473 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:05.038765  4565 consensus_meta.cc:287] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.004s
W20260709 12:28:05.096557  3852 rpcz_store.cc:269] 0709 12:28:01.516418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.524517 (+  8099us) service_pool.cc:224] Handling call
0709 12:28:05.072479 (+3547962us) spinlock_profiling.cc:243] Waited 2.49 s on lock 0x7b5400190354. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:05.087704 (+ 15225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5734833536}
I20260709 12:28:05.075641  6427 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:05.109550  3822 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:05.113278  4565 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:05.113830  6579 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.114307  6570 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:05.114845  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:05.118825  3897 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:05.122246  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:05.123502  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:05.124361  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:05.126652  6508 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.127943  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:05.132053  6218 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:05.137168  6126 consensus_queue.cc:237] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:05.229941  3928 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:04.921257  6506 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.187s
I20260709 12:28:05.139447  6332 raft_consensus.cc:3055] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:05.086824  6555 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:05.092674  6480 raft_consensus.cc:3055] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:05.157333  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:05.255555  3850 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:05.220979  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 146481us
I20260709 12:28:05.223383  3929 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:05.102916  6583 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:28:05.224452  3923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.090s	sys 0.230s
W20260709 12:28:05.429528  3923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.091s	sys 0.230s
W20260709 12:28:05.245563  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 330980us
I20260709 12:28:05.255206  6480 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:05.233741  6570 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:04.919945  6573 consensus_queue.cc:237] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:05.351598  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:05.153892  6253 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:05.389424  3925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.034s	sys 0.061s
W20260709 12:28:05.531997  3925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.034s	sys 0.065s
I20260709 12:28:05.325138  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:05.358093  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:05.399645  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 280875us
I20260709 12:28:05.239179  6348 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.534219  3897 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:05.414940  6069 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.034s	sys 0.028s
I20260709 12:28:05.351456  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:05.257289  6139 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:05.224077  6360 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:05.250619  6332 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:05.257565  6555 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:05.322379  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:05.554675  4005 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:05.427518  3852 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:05.235877  6568 raft_consensus.cc:697] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:05.240173  6549 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.362888  3856 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:28:05.338914  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:05.282256  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:05.400538  6576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.021s	sys 0.032s
I20260709 12:28:05.401753  6508 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:05.443325  4006 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:05.466886  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:05.570308  3923 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:05.467983  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:05.470019  6580 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:28:05.474334  3998 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:05.474787  6586 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.441483  6506 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.475209  6585 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:05.531901  6253 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.547708  6348 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:05.671873  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:05.585134  6480 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:05.674124  4003 raft_consensus.cc:2393] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:05.674382  6480 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:05.675467  6342 consensus_queue.cc:1175] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34711da9380944d2969a2bc3e203db3d" responder_term: 3 status { last_received { term: 3 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 3 index: 3 } }
I20260709 12:28:05.670771  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:05.640389  4565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 727) took 2812 ms (client timeout 1855 ms). Trace:
W20260709 12:28:05.676988  4565 rpcz_store.cc:269] 0709 12:28:02.827953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:02.829685 (+  1732us) service_pool.cc:224] Handling call
0709 12:28:05.640077 (+2810392us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b540053d254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:05.640299 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3620138880}
I20260709 12:28:05.620584  3925 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:28:05.630327  3923 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:28:05.439663  6492 consensus_meta.cc:287] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.696s	user 0.008s	sys 0.003s
I20260709 12:28:05.493793  3850 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:05.443753  4569 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:05.700727  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2165) took 1102 ms. Trace:
I20260709 12:28:05.509889  4566 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5. Ops: []
W20260709 12:28:05.513331  6592 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 12:28:05.513763  6588 log.cc:927] Time spent T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260709 12:28:05.749723  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1603) took 1094 ms. Trace:
I20260709 12:28:05.750469  6492 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:05.750986  3755 catalog_manager.cc:5697] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:05.750276  3924 rpcz_store.cc:276] 0709 12:28:04.655704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:04.710056 (+ 54352us) service_pool.cc:224] Handling call
0709 12:28:04.710326 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:04.710600 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:04.710633 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:04.720987 (+ 10354us) log.cc:844] Serialized 26 byte log entry
0709 12:28:04.827666 (+106679us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:04.863940 (+ 36274us) log.cc:844] Serialized 14 byte log entry
0709 12:28:04.864151 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:04.864228 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:05.749451 (+885223us) raft_consensus.cc:1685] finished
0709 12:28:05.749473 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:05.749642 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13531,"prepare.queue_time_us":13471,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":11771,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":3729,"thread_start_us":67223,"threads_started":1,"wal-append.queue_time_us":366065}
I20260709 12:28:05.256863  6579 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:05.655522  6593 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.506s	user 0.003s	sys 0.000s
I20260709 12:28:05.526479  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:05.763098  4572 raft_consensus.cc:1813] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:05.763814  4572 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 3: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:05.555378  4570 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
W20260709 12:28:05.547448  6069 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.034s	sys 0.028s
I20260709 12:28:05.559445  3822 leader_election.cc:400] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7.
W20260709 12:28:05.560207  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:05.791326  3822 leader_election.cc:403] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:28:05.565701  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:05.559501  3929 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:28:05.572234  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:05.580293  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 217896us
I20260709 12:28:05.549062  6583 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:05.586747  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:05.669601  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2177) took 1106 ms. Trace:
W20260709 12:28:05.588394  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:05.631551  3930 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:28:05.794396  3926 rpcz_store.cc:276] 0709 12:28:04.563602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:04.569525 (+  5923us) service_pool.cc:224] Handling call
0709 12:28:04.592723 (+ 23198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:04.809460 (+216737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:05.669334 (+859874us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540031bfd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:05.669529 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497124096}
W20260709 12:28:05.490391  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 52344.2us
W20260709 12:28:05.565593  6576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.021s	sys 0.032s
I20260709 12:28:05.641737  4571 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:28:05.638901  4005 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:05.701195  4004 rpcz_store.cc:276] 0709 12:28:04.598035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:04.598169 (+   134us) service_pool.cc:224] Handling call
0709 12:28:04.598464 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:04.760752 (+162288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:05.700470 (+939718us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540032c654. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:05.700662 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351981952}
I20260709 12:28:05.713433  6610 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:05.744886  6550 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:05.745147  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:05.588800  6568 consensus_queue.cc:237] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:05.746017  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:05.746412  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:05.583545  6360 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.588694  6332 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.588584  6567 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.559288  6454 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:05.522248  6597 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:28:05.755470  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 744) took 1173 ms. Trace:
W20260709 12:28:05.589564  6604 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:28:05.590356  6602 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:28:05.524451  6570 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:05.569089  6139 raft_consensus.cc:697] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:05.760428  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 422) took 1535 ms. Trace:
I20260709 12:28:05.582062  6548 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:05.596571  6245 consensus_meta.cc:287] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.753s	user 0.009s	sys 0.000s
I20260709 12:28:05.766566  6253 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:05.771338  6440 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.773142  6271 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:05.773624  3925 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:05.774677  3924 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:05.778599  6612 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.779162  6213 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:05.559764  6272 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:05.622022  6549 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:05.796065  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 476117us
I20260709 12:28:05.798117  4536 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:05.594511  6473 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:05.799630  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:05.801127  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:05.873034  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 75032us
W20260709 12:28:05.802070  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 75261.2us
I20260709 12:28:05.805919  6494 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:05.853330  6570 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.816373  3857 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
W20260709 12:28:05.817597  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:05.824904  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2089) took 1264 ms. Trace:
I20260709 12:28:05.876368  3855 rpcz_store.cc:276] 0709 12:28:04.560217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:04.562105 (+  1888us) service_pool.cc:224] Handling call
0709 12:28:04.711014 (+148909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:05.038783 (+327769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:05.815841 (+777058us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b540027a454. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:05.824681 (+  8840us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540027a450. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:05.824835 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1058093696}
I20260709 12:28:05.801451  3895 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:05.827716  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:05.830613  4006 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:28:05.878566  4006 pending_rounds.cc:85] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 5
I20260709 12:28:05.878815  4006 pending_rounds.cc:107] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:28:05.855831  6548 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.879077  4006 raft_consensus.cc:2889] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:05.831104  3926 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:28:05.880466  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:05.880610  6548 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:05.881163  3926 raft_consensus.cc:2393] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:05.844923  6610 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.882107  6255 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:05.882771  6576 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:05.883780  6610 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:05.884271  6609 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.875418  6272 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.884797  6609 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.862083  6440 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.886775  6272 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:05.792243  4567 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:28:05.835871  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:05.887257  6571 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.887802  6571 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.888525  6440 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:05.835461  4574 rpcz_store.cc:276] 0709 12:28:04.582105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:04.582255 (+   150us) service_pool.cc:224] Handling call
0709 12:28:04.584510 (+  2255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:04.787706 (+203196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:05.755175 (+967469us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54004cbdd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:05.755384 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":457600768}
I20260709 12:28:05.888785  4005 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
W20260709 12:28:05.836549  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 295052us
I20260709 12:28:05.838306  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:05.839051  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:05.796326  6583 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:05.890539  3932 raft_consensus.cc:2410] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:28:05.826578  6126 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7.
I20260709 12:28:05.894506  6571 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:05.830528  6618 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:28:05.860060  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:05.841303  6427 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.761327  6506 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.873713  4536 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:05.812431  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:05.859077  4566 raft_consensus.cc:2410] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:28:05.886862  6609 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:05.843799  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:05.889321  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:05.889830  3822 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:05.936584  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 46825.8us
I20260709 12:28:05.937693  3822 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:05.890389  6213 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.938663  6394 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:05.938450  6139 consensus_queue.cc:237] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:05.938966  3822 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:05.939235  6394 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.893409  3926 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:28:05.854483  6600 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:28:05.894104  6583 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:05.847013  3998 rpcz_store.cc:276] 0709 12:28:04.225332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:04.225506 (+   174us) service_pool.cc:224] Handling call
0709 12:28:04.828888 (+603382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:05.584927 (+756039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:05.675633 (+ 90706us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b5400128c54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:05.754873 (+ 79240us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b5400128c50. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:05.760342 (+  5469us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082313984}
I20260709 12:28:05.753048  6586 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:05.837280  6559 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:28:05.877223  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:05.916126  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:05.898042  4002 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:28:05.931437  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 135410us
W20260709 12:28:05.967069  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 89893.4us
I20260709 12:28:05.968247  3895 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:05.923322  6126 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.944427  4569 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:28:05.946859  4574 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:28:05.854406  6245 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:05.956185  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 82531.4us
I20260709 12:28:05.969838  3895 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:05.835572  6567 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.980379  3926 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:28:05.979849  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 105120us
W20260709 12:28:05.981599  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 103405us
I20260709 12:28:05.929790  6624 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:05.986073  4573 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:28:05.898226  6271 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:05.996909  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 119172us
I20260709 12:28:05.973994  6307 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:05.976475  6454 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:05.998626  4001 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:28:05.930107  6570 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.995270  4536 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:05.963426  6440 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:28:05.956384  6394 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:05.982877  6494 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:05.940034  6427 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:06.014317  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 44571us
I20260709 12:28:06.002359  6428 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:05.988687  6630 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:06.020804  6577 raft_consensus.cc:2764] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:28:06.021045  6620 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.021617  6342 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.021584  6620 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.022215  6342 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:06.023370  6391 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:06.023900  6391 raft_consensus.cc:697] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:06.024837  3855 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:28:06.024780  6391 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.025807  3925 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:28:05.876291  6612 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:05.983984  6126 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:06.005971  6213 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:06.034574  3971 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:06.049793  3854 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:05.989205  6508 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:28:05.999008  6387 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:28:06.016243  6307 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:06.044643  6437 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:28:06.060776  6511 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:28:06.008684  6494 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:06.061815  6494 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:06.062157  6579 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.062731  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:06.063534  4005 raft_consensus.cc:2393] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 4: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:06.032452  6255 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:28:06.008280  6348 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:06.016072  6492 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:06.058363  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.066335  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:06.006358  6562 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:28:06.070246  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:06.071713  3849 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:28:06.079313  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.081708  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.055032  6585 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:06.083282  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.087102  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.095155  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.097757  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.098804  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.099736  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.050940  6487 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:28:06.076855  6348 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:06.098866  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.103152  6605 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.103297  6567 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:06.103547  6616 log.cc:927] Time spent T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:28:06.083520  6511 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:06.094364  6622 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:06.125058  6605 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.127686  6605 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.128947  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:06.105352  6623 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:28:06.133147  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 604) took 1042 ms. Trace:
W20260709 12:28:06.106312  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:06.107903  6555 consensus_meta.cc:287] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.001s
I20260709 12:28:06.107925  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.108884  6620 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.109315  3855 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:06.110392  3926 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:06.111517  6600 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.111451  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:06.112686  6628 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:28:06.113251  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 607) took 1005 ms. Trace:
I20260709 12:28:06.153766  4000 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
W20260709 12:28:06.113760  6627 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:28:06.157136  6550 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.157711  6550 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:06.158547  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:06.159251  4002 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:28:06.160413  6550 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:06.162434  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.162875  6586 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:06.154312  3931 rpcz_store.cc:276] 0709 12:28:05.108209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:05.553830 (+445621us) service_pool.cc:224] Handling call
0709 12:28:05.567962 (+ 14132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:05.838121 (+270159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:05.838168 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:05.852721 (+ 14553us) log.cc:844] Serialized 26 byte log entry
0709 12:28:05.978303 (+125582us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:05.978340 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:05.978413 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:06.112931 (+134518us) raft_consensus.cc:1685] finished
0709 12:28:06.112955 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:06.113155 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40076,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":358402,"threads_started":2,"wal-append.queue_time_us":228192}
I20260709 12:28:06.161684  6600 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.115998  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:06.119226  3854 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:28:06.082145  6473 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:28:06.119097  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.121363  6612 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:06.110378  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.122551  6570 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.094501  6601 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:06.045469  6630 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.123690  6394 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:06.123360  6307 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.133631  3927 rpcz_store.cc:276] 0709 12:28:05.090506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:05.090683 (+   177us) service_pool.cc:224] Handling call
0709 12:28:05.104960 (+ 14277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:05.352698 (+247738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:05.352746 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:05.382834 (+ 30088us) log.cc:844] Serialized 26 byte log entry
0709 12:28:05.803230 (+420396us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:05.803286 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:05.841974 (+ 38688us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54000efbd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:05.842040 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:06.132797 (+290757us) raft_consensus.cc:1685] finished
0709 12:28:06.132830 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:06.133077 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67716,"raft.queue_time_us":67922,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":36242,"spinlock_wait_cycles":334892928,"thread_start_us":364618,"threads_started":1,"wal-append.queue_time_us":454317}
I20260709 12:28:06.138576  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.136094  4538 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:06.114375  6625 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.136s	user 0.004s	sys 0.000s
I20260709 12:28:06.144551  6271 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.146915  3852 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 2.
I20260709 12:28:06.150718  4569 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:06.151907  3997 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:28:06.157008  4004 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:28:06.079399  6316 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:28:06.171948  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 56095.9us
W20260709 12:28:06.175815  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 236918us
I20260709 12:28:06.147037  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.186327  3848 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
W20260709 12:28:06.187034  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 51086.6us
I20260709 12:28:06.144623  6583 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:06.154888  6555 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:06.210469  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.351358  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.209792  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.352313  3928 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:06.351364  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:06.190387  4571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 738) took 2202 ms. Trace:
W20260709 12:28:06.278366  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:06.171134  6567 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:06.354130  4571 rpcz_store.cc:276] 0709 12:28:03.988157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:03.988320 (+   163us) service_pool.cc:224] Handling call
0709 12:28:05.641280 (+1652960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:05.799013 (+157733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:06.186399 (+387386us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b540053d250. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:06.190303 (+  3904us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3780604672}
I20260709 12:28:06.360760  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.361428  3927 raft_consensus.cc:1813] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:06.312135  6639 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:28:06.362016  3927 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 3: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:28:06.312377  6621 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.108s	user 0.000s	sys 0.004s
I20260709 12:28:06.312599  6550 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.363104  3969 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:06.365691  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:06.215255  6126 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:06.181006  6630 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.373313  3969 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:06.360628  6511 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:06.360455  6620 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.347966  6494 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:06.366475  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:06.211720  6506 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.283586  6348 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:06.222752  6245 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:06.176731  4568 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:06.370697  3928 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:06.362759  6605 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.210711  6637 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:06.190682  6387 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:06.424007  6245 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.376706  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.424912  6332 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:06.424690  6245 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.425421  3848 raft_consensus.cc:2410] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:28:06.427361  6245 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.379406  3928 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:06.428560  3928 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:06.429481  3928 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:06.435561  6494 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:06.436589  6348 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:06.437912  3848 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:28:06.438987  6348 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:06.440290  6213 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.441041  6615 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:06.441509  4536 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:06.377368  3925 raft_consensus.cc:2393] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:06.376967  3970 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:06.379895  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:06.444098  3855 raft_consensus.cc:2368] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9.
W20260709 12:28:06.444267  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 80179.2us
I20260709 12:28:06.366236  6459 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:28:06.375399  6511 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.381670  6555 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:06.446265  6511 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:06.448024  6218 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:06.449007  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 776) took 1020 ms. Trace:
I20260709 12:28:06.361126  6315 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:28:06.449440  4567 rpcz_store.cc:276] 0709 12:28:05.428224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:05.430677 (+  2453us) service_pool.cc:224] Handling call
0709 12:28:06.448784 (+1018107us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b540052bcd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:06.448906 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395512064}
I20260709 12:28:06.452011  6315 raft_consensus.cc:3055] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:06.452410  6315 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:06.452724  6345 raft_consensus.cc:3055] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:06.453135  6345 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:06.454089  6345 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.454659  6615 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:06.455367  6345 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:06.441180  6213 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:06.388407  3753 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51804 (request call id 329) took 13316 ms (client timeout 15000 ms). Trace:
I20260709 12:28:06.370364  6550 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.366699  6568 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:28:06.389228  3755 catalog_manager.cc:5697] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:06.378196  6567 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:06.390511  6454 raft_consensus.cc:3055] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:06.393646  3997 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.375296  6609 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:06.397358  6638 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:06.471663  6638 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:06.471856  3755 catalog_manager.cc:5697] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 4, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 4 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:06.472657  6638 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.397157  6605 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.365338  6570 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:28:06.398262  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.398591  6641 consensus_queue.cc:1059] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:06.379317  6620 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:06.400768  6640 log.cc:927] Time spent T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:28:06.401360  6600 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:06.482265  6647 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:06.479038  6641 consensus_queue.cc:1243] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:28:06.467428  6567 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:06.483402  6567 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:06.484148  6620 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.475142  6609 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.485355  6609 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:06.375514  6126 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:06.410128  3971 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.4:41095 timed out after 2.016s (SENT) [suppressed 18 similar messages]
I20260709 12:28:06.411613  3822 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:06.412436  6360 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.412662  6583 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:06.414565  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:06.509071  3969 leader_election.cc:400] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9.
I20260709 12:28:06.509409  3969 leader_election.cc:403] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:28:06.414784  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:06.413235  6473 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:06.440300  6508 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:06.442878  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.377616  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:06.444567  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 67670.1us
I20260709 12:28:06.515345  3852 raft_consensus.cc:1813] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:06.515935  3852 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 3: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:06.516090  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:06.445724  6612 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:06.442692  6637 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.463696  6550 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:06.458180  3753 rpcz_store.cc:269] 0709 12:27:53.072115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:53.076842 (+  4727us) service_pool.cc:224] Handling call
0709 12:27:53.392338 (+315496us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400046ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f41090 00007fe051fdff3a 00007fe057d95e9c 00007fe057e9404e 00007fe0563552a4 00007fe056355232 00007fe056355161 00007fe0563550dc 00007fe056354392 00007fe05031248c 00007fe0503118c6
0709 12:28:06.388157 (+12995819us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:58.864570 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:58.865093 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:58.865129 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:27:58.865141 (+    12us) tablet.cc:662] Decoding operations
0709 12:27:58.865725 (+   584us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:58.865783 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:58.865808 (+    25us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:27:58.866228 (+   420us) tablet.cc:701] Row locks acquired
0709 12:27:58.866253 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:27:58.866383 (+   130us) write_op.cc:270] Start()
0709 12:27:58.866490 (+   107us) write_op.cc:276] Timestamp: P: 1783600078866334 usec, L: 0
0709 12:27:58.866516 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:27:58.867186 (+   670us) log.cc:844] Serialized 1734 byte log entry
0709 12:27:59.817680 (+950494us) op_driver.cc:464] REPLICATION: finished
0709 12:28:00.312351 (+494671us) write_op.cc:301] APPLY: starting
0709 12:28:00.314417 (+  2066us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:00.387134 (+ 72717us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:00.540855 (+153721us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:00.656913 (+116058us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:00.657175 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:28:00.657249 (+    74us) write_op.cc:312] APPLY: finished
0709 12:28:00.662948 (+  5699us) log.cc:844] Serialized 41 byte log entry
0709 12:28:00.663137 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:00.663232 (+    95us) write_op.cc:454] Released schema lock
0709 12:28:00.663278 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:00.663663 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:00.663727 (+    64us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6400,"reported_tablets":17,"spinlock_wait_cycles":612564864,"child_traces":[["op",{"apply.queue_time_us":452462,"apply.run_cpu_time_us":3641,"apply.run_wall_time_us":364446,"num_ops":4,"prepare.queue_time_us":688662,"prepare.run_cpu_time_us":43786,"prepare.run_wall_time_us":244057,"raft.queue_time_us":188431,"raft.run_cpu_time_us":17620,"raft.run_wall_time_us":377201,"replication_time_us":951025,"thread_start_us":975153,"threads_started":4,"wal-append.queue_time_us":362529,"wal-append.run_cpu_time_us":12401,"wal-append.run_wall_time_us":2380386}]]}
I20260709 12:28:06.453343  6315 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.470837  6576 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:06.473424  3755 catalog_manager.cc:5697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 5, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 5 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:06.466212  6348 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:06.510027  3853 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:06.467597  6454 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:06.512122  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:06.519348  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 107832us
W20260709 12:28:06.521488  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:06.523150  6633 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.525368  3970 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:06.527827  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.531446  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.544704  3927 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:06.516713  6139 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:06.543974  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:06.550411  4000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2166) took 1937 ms (client timeout 2164 ms). Trace:
W20260709 12:28:06.552485  4000 rpcz_store.cc:269] 0709 12:28:04.602215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:04.637604 (+ 35389us) service_pool.cc:224] Handling call
0709 12:28:06.535673 (+1898069us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400219dd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:06.535775 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3289700224}
I20260709 12:28:06.543500  3929 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:06.546778  3755 catalog_manager.cc:5697] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 2, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:06.515098  6600 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.556412  3822 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:06.552088  3924 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:06.526859  6612 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.518309  6570 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:06.560739  3850 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:06.561535  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.566078  6600 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.566428  3923 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:06.566774  3969 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:06.564512  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:06.564231  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.520016  6571 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.581919  3822 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:06.516564  6473 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:06.563594  3970 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:06.573578  6633 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.574215  6568 consensus_queue.cc:1059] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:06.562086  6641 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.575531  6643 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:06.512253  6126 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:06.533527  6555 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:06.584576  6612 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:06.558108  6550 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:06.574645  3755 catalog_manager.cc:5697] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:06.585791  3821 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:06.591140  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:06.532191  6245 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:28:06.657298  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 71587.1us
I20260709 12:28:06.589043  6315 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:06.585217  6579 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:06.561823  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:06.684028  3925 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:06.614885  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:06.619274  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:06.685822  4000 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:06.622385  6548 raft_consensus.cc:3055] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:06.596319  6573 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:06.610018  6559 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:06.623878  6126 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:06.625500  6568 raft_consensus.cc:3055] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:06.627604  6454 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:06.723994  6454 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:06.596757  6586 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:06.634040  3998 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:28:06.634759  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.636039  6633 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.637343  6600 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:06.639506  6637 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.644095  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1673) took 1759 ms. Trace:
I20260709 12:28:06.621639  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:06.681785  6643 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:06.568264  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.726323  6568 raft_consensus.cc:740] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:06.741591  4567 raft_consensus.cc:2410] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:28:06.557485  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.729415  6586 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:06.753594  6586 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:06.612036  6641 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:06.671415  3853 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:06.591496  6605 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.570065  6508 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.688624  3755 catalog_manager.cc:5697] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 5, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 5 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:06.769285  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 359165us
I20260709 12:28:06.533730  6213 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:06.704878  6253 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:06.708436  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:06.773764  3998 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:28:06.591014  6428 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 12:28:06.776368  3755 catalog_manager.cc:5697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 3, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 3 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:06.586838  6571 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.687350  6548 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:06.732545  3857 rpcz_store.cc:276] 0709 12:28:04.885072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:04.885213 (+   141us) service_pool.cc:224] Handling call
0709 12:28:05.816128 (+930915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:05.876185 (+ 60057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:06.616321 (+740136us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b540027a450. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:06.644009 (+ 27688us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2084583168}
W20260709 12:28:06.779033  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:06.743316  6643 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.658294  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:06.690032  6573 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.780238  3755 catalog_manager.cc:5697] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: config changed from index 3 to 4, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New cstate: current_term: 1 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:06.766510  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:06.765789  3928 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:06.783015  4004 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:06.772589  3971 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:06.720518  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 429) took 1134 ms. Trace:
I20260709 12:28:06.782241  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.783780  4006 rpcz_store.cc:276] 0709 12:28:05.586607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:05.674785 (+ 88178us) service_pool.cc:224] Handling call
0709 12:28:05.675063 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:05.879536 (+204473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:06.720233 (+840697us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54000c4254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:06.720445 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349108480}
W20260709 12:28:06.771510  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 180439us
I20260709 12:28:06.785372  3970 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:06.786126  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:06.786379  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 128207us
W20260709 12:28:06.786545  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 209419us
I20260709 12:28:06.796581  4005 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:28:06.788277  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:06.797465  4006 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:06.796656  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.798408  4000 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:06.786969  3925 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:06.799907  3997 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:06.800781  4566 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:28:06.801543  4567 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:06.801638  6641 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:06.831898  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:06.802021  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.786636  6573 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:06.804996  6571 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.806836  6332 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:06.809728  6508 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.814687  6511 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.815363  6473 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:06.767629  6568 consensus_queue.cc:260] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:06.816200  3930 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:28:06.783519  6480 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:06.822959  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 50444.4us
I20260709 12:28:06.876556  3971 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:06.823931  4569 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:06.877760  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:06.828217  3924 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:06.878525  4002 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:06.828543  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:06.831679  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:06.830811  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.877807  3971 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:06.880905  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.881062  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.834851  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.881737  3853 raft_consensus.cc:2393] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 3: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:06.776378  6583 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.836781  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.832247  3755 catalog_manager.cc:5697] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 3, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 3 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:28:06.786374  6643 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:06.887301  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:06.887929  3971 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:06.837625  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:06.888767  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:06.889122  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 51593us
I20260709 12:28:06.842974  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.843354  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.783219  6620 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.847352  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.890182  3932 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:28:06.890390  4574 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:06.848371  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.850662  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.824646  6637 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:06.847517  6253 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:28:06.840303  6307 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 12:28:06.899993  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:06.863543  6511 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:06.832072  6245 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:06.865166  6342 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:06.866510  6609 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.851742  6567 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.873610  3969 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:06.881749  3927 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:06.879212  3929 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:06.885939  3928 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:06.887974  4001 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:06.893227  3971 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:06.894728  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:06.938552  4000 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:06.891100  6633 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:06.897405  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.825754  6613 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:28:06.903388  3822 connection.cc:256] RPC call timeout handler was delayed by -2.8054060959998424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
W20260709 12:28:06.941989  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 68455.7us
I20260709 12:28:06.942214  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:06.905531  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.900627  6508 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:06.931208  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.929821  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.932176  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.888365  6473 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:06.954936  4574 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:06.937714  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:06.956120  4005 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:06.958503  3895 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:06.959933  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:06.886318  6480 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.940610  4538 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:06.969249  4538 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:06.941284  4571 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:06.971190  4538 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:06.893824  6428 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:06.894114  6637 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:06.952236  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 59077.3us
I20260709 12:28:06.972674  3971 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:06.894585  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.974635  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:06.975363  3853 raft_consensus.cc:2393] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 4: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:06.983557  3895 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:06.961388  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.891402  6583 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:06.986459  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.943158  6492 raft_consensus.cc:3055] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:06.987452  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.988437  3971 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:06.994627  3971 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:06.997386  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.998556  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:06.999119  3928 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:07.000005  6549 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:07.000708  6629 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:06.988525  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:06.900575  6620 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:07.003428  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:07.004213  6620 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:06.987339  3822 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:07.004338  6360 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:07.005193  6126 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:07.006052  3821 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:07.006493  6559 consensus_queue.cc:1059] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:07.007125  6638 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:07.007444  6494 raft_consensus.cc:3055] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:07.007642  6638 raft_consensus.cc:697] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:07.007848  6494 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:06.992527  3927 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:07.008661  6638 consensus_queue.cc:237] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:07.011126  3971 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:07.013320  3821 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:07.016286  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 236447us
I20260709 12:28:06.950646  6508 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.961933  6555 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:07.027765  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.966039  6632 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:07.045619  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:06.973469  6342 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:06.975229  6637 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:06.976167  6428 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:06.986900  6253 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:07.017045  6550 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:07.017555  6600 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:07.020905  6213 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:07.030893  6508 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:06.993643  6492 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:07.058382  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:07.077244  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:06.965524  6272 consensus_queue.cc:1059] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 12:28:07.044488  6633 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:07.043743  6620 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:07.090354  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:07.100950  3853 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
W20260709 12:28:07.093766  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 133910us
I20260709 12:28:07.102077  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:07.103291  3852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.006s	sys 0.017s
W20260709 12:28:07.104792  3852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.006s	sys 0.017s
I20260709 12:28:07.061329  6253 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:07.057585  6555 raft_consensus.cc:697] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:07.054984  6427 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:07.064757  6428 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:07.084920  6600 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:07.112186  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:07.082846  6550 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:07.095335  6345 consensus_meta.cc:287] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.639s	user 0.012s	sys 0.002s
I20260709 12:28:07.084571  6213 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:07.130041  3853 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:07.103536  6633 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:07.104219  6348 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:28:07.146435  6664 log.cc:927] Time spent T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:28:07.115252  6253 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:07.129603  6600 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:07.140332  6213 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:07.135035  6550 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:07.167790  6661 log.cc:927] Time spent T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:28:07.109907  6660 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:28:07.148800  6633 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:07.183121  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:07.137146  6427 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:28:07.194685  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:07.195040  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:07.203161  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:07.289078  3849 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:07.213404  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:07.137393  6612 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:07.186758  3853 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:07.218576  6473 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:07.178256  6492 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:07.220664  3970 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:07.302533  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 81943.8us
I20260709 12:28:07.303791  3970 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:07.305178  3970 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:07.229442  6315 consensus_meta.cc:287] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.000s
I20260709 12:28:07.234536  6272 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:28:07.238399  6658 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
W20260709 12:28:07.238948  6649 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:28:07.319171  6571 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:07.319509  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:07.319754  6632 raft_consensus.cc:3055] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:07.319870  6571 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:07.239815  6662 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 12:28:07.241256  6663 log.cc:927] Time spent T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 12:28:07.320611  6571 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:07.320647  3851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d772c24bae14b138d4062798651f82f"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:28:07.241693  6620 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.322181  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:07.322182  6620 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:07.323715  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:07.325249  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:07.247301  6583 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:07.315097  6360 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:07.314880  6613 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:07.315403  6506 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 12:28:07.254201  6659 log.cc:927] Time spent T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:28:07.254693  6345 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:07.255371  6567 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:07.259713  6332 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:07.271111  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:07.272287  6494 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:07.273712  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:07.274191  6641 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.238412  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:07.279177  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:07.299039  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 85752.2us
W20260709 12:28:07.346406  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 67235.4us
W20260709 12:28:07.349342  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:07.350315  3822 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:07.298527  6559 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:07.309175  3970 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:07.310741  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:07.314580  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:07.320174  6632 raft_consensus.cc:740] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:07.321589  3851 raft_consensus.cc:606] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:07.355561  3851 raft_consensus.cc:614] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:07.239197  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 620) took 1367 ms. Trace:
I20260709 12:28:07.356034  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:07.325340  6620 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:07.247920  6555 consensus_queue.cc:237] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:07.356279  3930 rpcz_store.cc:276] 0709 12:28:05.872204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:05.894181 (+ 21977us) service_pool.cc:224] Handling call
0709 12:28:05.894455 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:06.872171 (+977716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:07.238959 (+366788us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54000d4b54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:07.239136 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118974208}
W20260709 12:28:07.362422  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 53341.3us
I20260709 12:28:07.363111  3969 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:07.307493  6660 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:07.330935  6613 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:07.330458  6360 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:07.386258  3854 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
W20260709 12:28:07.395218  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 340062us
W20260709 12:28:07.365912  3997 consensus_meta.cc:287] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.001s
I20260709 12:28:07.329833  6568 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:07.377148  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:07.378050  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:07.376225  6473 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:28:07.409865  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:07.410780  3997 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:07.361609  6315 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:07.472321  3848 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 12:28:07.473197  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:07.374758  6586 consensus_meta.cc:287] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.003s
I20260709 12:28:07.334651  6332 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:07.333570  6345 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:07.378008  6567 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:07.349539  6245 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:07.380970  6613 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:07.487526  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 695) took 1017 ms. Trace:
I20260709 12:28:07.412580  6360 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:07.488528  3851 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:07.488621  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:07.489359  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:07.424098  6494 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:07.510972  3850 rpcz_store.cc:276] 0709 12:28:06.470379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:06.567663 (+ 97284us) service_pool.cc:224] Handling call
0709 12:28:06.568833 (+  1170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:06.588063 (+ 19230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:06.588110 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:06.596055 (+  7945us) log.cc:844] Serialized 26 byte log entry
0709 12:28:06.786172 (+190117us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:06.786238 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:06.786302 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:07.487270 (+700968us) raft_consensus.cc:1685] finished
0709 12:28:07.487294 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:07.487457 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37623,"raft.queue_time_us":27570,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":16327,"thread_start_us":189727,"threads_started":1,"wal-append.queue_time_us":278529}
I20260709 12:28:07.489377  3853 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:07.352370  6641 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:07.426895  6583 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.478379  6315 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:07.389221  6660 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:07.555549  6315 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:07.519282  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 97033.1us
I20260709 12:28:07.415151  6620 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:07.525477  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:07.537812  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:07.586645  3997 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:07.590962  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:07.591960  3923 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:07.595731  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:07.508074  6567 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:07.521485  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2163) took 2367 ms. Trace:
I20260709 12:28:07.619059  3997 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:07.529049  3851 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
W20260709 12:28:07.610476  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:07.508360  6609 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:07.623520  3854 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:07.625128  4003 raft_consensus.cc:1275] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:28:07.531111  6497 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.616608  3999 rpcz_store.cc:276] 0709 12:28:05.154410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:05.231896 (+ 77486us) service_pool.cc:224] Handling call
0709 12:28:05.232291 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:06.005328 (+773037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:06.005357 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:06.720251 (+714894us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b2c000e1568. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:28:06.735315 (+ 15064us) log.cc:844] Serialized 52 byte log entry
0709 12:28:06.990633 (+255318us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:07.103588 (+112955us) log.cc:844] Serialized 14 byte log entry
0709 12:28:07.103858 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:07.520999 (+417141us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b540021a7d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:07.521076 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:07.521158 (+    82us) raft_consensus.cc:1685] finished
0709 12:28:07.521179 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:07.521408 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25255,"prepare.queue_time_us":172187,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":35307,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":13660,"spinlock_wait_cycles":1735838976,"thread_start_us":316940,"threads_started":2,"wal-append.queue_time_us":224194}
I20260709 12:28:07.557763  6660 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:07.629766  3929 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.057s	sys 0.088s
I20260709 12:28:07.533037  6480 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:07.633904  3929 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.058s	sys 0.088s
I20260709 12:28:07.631096  3997 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4. Ops: []
W20260709 12:28:07.643601  3857 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.019s	sys 0.028s
W20260709 12:28:07.622946  6573 consensus_meta.cc:287] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.775s	user 0.011s	sys 0.001s
I20260709 12:28:07.644735  3999 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:28:07.653956  4002 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.016s	sys 0.032s
W20260709 12:28:07.668668  3971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.049s	sys 0.098s
I20260709 12:28:07.534554  6548 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:07.754963  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 404727us
W20260709 12:28:07.738018  6570 consensus_meta.cc:287] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.158s	user 0.006s	sys 0.006s
I20260709 12:28:07.518352  6678 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.148s
W20260709 12:28:07.645946  3857 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.020s	sys 0.028s
I20260709 12:28:07.588195  6583 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:07.741124  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:07.654572  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 284305us
W20260709 12:28:07.742693  3971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.051s	sys 0.099s
W20260709 12:28:07.780682  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 769593us
I20260709 12:28:07.739627  6480 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.623207  6567 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:07.743333  4002 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.017s	sys 0.032s
I20260709 12:28:07.484050  6586 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:07.756115  3822 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:07.737061  3853 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:28:07.795449  3822 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:07.795738  3853 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:07.796645  3822 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:07.797308  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:07.797725  6579 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:07.797892  4573 raft_consensus.cc:1813] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:07.798429  4573 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 3: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:07.798898  3822 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:07.799284  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:07.800128  4574 raft_consensus.cc:2368] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4.
W20260709 12:28:07.758672  3821 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.044s	sys 0.114s
I20260709 12:28:07.761071  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:07.801813  3821 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.044s	sys 0.114s
W20260709 12:28:07.802286  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 775021us
I20260709 12:28:07.802372  6579 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:07.804330  3895 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:07.805266  6660 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:07.806258  3895 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:07.809317  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:28:07.809938  3999 raft_consensus.cc:606] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:07.810274  3999 raft_consensus.cc:614] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:28:07.810631  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:07.811658  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:07.813609  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:07.814857  6549 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.815055  6660 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:07.773907  4536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.003s	sys 0.016s
I20260709 12:28:07.559712  6632 consensus_queue.cc:260] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:07.648173  6620 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:07.782255  6139 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:07.817649  6126 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:07.820645  3999 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:28:07.826329  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:07.692333  6573 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:07.780900  6570 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9.
I20260709 12:28:07.656180  6497 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:07.815531  6549 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:07.795374  6612 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:07.817413  4536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.004s	sys 0.016s
W20260709 12:28:07.864701  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:07.874255  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 610942us
I20260709 12:28:07.816367  6559 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:07.829571  6548 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:07.831254  6255 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.012s	sys 0.012s
I20260709 12:28:07.870796  3853 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:28:07.878268  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:07.838451  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:07.896405  3999 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:28:07.824390  6511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.010s	sys 0.014s
W20260709 12:28:07.908270  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:07.873482  6662 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:28:07.837924  6632 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:07.937326  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 59140.8us
I20260709 12:28:07.946914  3822 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:07.816671  6480 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:07.872725  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:07.936141  6255 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.016s	sys 0.012s
I20260709 12:28:07.937774  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:07.961928  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 346197us
I20260709 12:28:07.962584  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:07.964699  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:07.911475  3897 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:07.939764  3971 leader_election.cc:400] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4.
I20260709 12:28:07.957166  4571 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:07.948498  3822 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:07.935889  6511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.013s	sys 0.015s
I20260709 12:28:07.967000  3971 leader_election.cc:403] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:07.970754  3822 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:07.972648  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 61235.5us
I20260709 12:28:07.945734  6332 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:07.985559  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:07.952252  6579 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:28:07.964880  6637 consensus_meta.cc:287] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.885s	user 0.010s	sys 0.000s
I20260709 12:28:07.952538  6674 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:28:07.989444  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:08.033676  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 47135.4us
W20260709 12:28:08.050109  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 238859us
W20260709 12:28:08.050786  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:08.051841  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:07.957584  6570 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:08.038846  3849 consensus_meta.cc:287] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.000s
W20260709 12:28:07.959307  6342 consensus_meta.cc:287] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.898s	user 0.010s	sys 0.002s
I20260709 12:28:08.050254  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:08.064424  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:08.048465  4006 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:08.053013  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:07.982201  6660 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:08.071094  3853 raft_consensus.cc:2410] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:28:07.977757  6126 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:08.058665  3849 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:08.084383  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2102) took 1251 ms. Trace:
I20260709 12:28:08.084728  3849 rpcz_store.cc:276] 0709 12:28:06.833416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.194357 (+360941us) service_pool.cc:224] Handling call
0709 12:28:08.084323 (+889966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:08.085973  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:08.050906  3895 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:07.969297  6345 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:07.977550  6559 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:08.089344  6559 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.091857  6559 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:08.073204  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1697) took 1559 ms. Trace:
I20260709 12:28:08.092458  3857 rpcz_store.cc:276] 0709 12:28:06.514208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:06.779378 (+265170us) service_pool.cc:224] Handling call
0709 12:28:06.800615 (+ 21237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:06.800983 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:28:06.801283 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 12:28:07.774174 (+972891us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:07.774645 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:28:07.774848 (+   203us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:07.774883 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:07.774954 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:08.072999 (+298045us) raft_consensus.cc:1685] finished
0709 12:28:08.073020 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:08.073150 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14476,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":35866,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":18460,"thread_start_us":972418,"threads_started":2,"wal-append.queue_time_us":225836}
I20260709 12:28:08.073328  3848 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: []
W20260709 12:28:08.055576  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 144822us
W20260709 12:28:08.079531  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:08.081269  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:07.979626  6272 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:08.097946  6272 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:08.061146  6508 consensus_meta.cc:287] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.954s	user 0.006s	sys 0.006s
I20260709 12:28:07.985662  6673 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:08.049335  6562 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:08.071806  6579 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:08.057309  6656 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:08.081055  6342 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:08.113178  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:08.122524  3853 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:08.101440  6605 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:08.140727  3999 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:08.149524  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:08.150213  3999 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:08.151518  3999 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
W20260709 12:28:08.150789  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 52902.3us
I20260709 12:28:08.059188  6637 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.071918  6570 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:08.191495  3999 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: []
W20260709 12:28:08.196897  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 97777.1us
I20260709 12:28:08.134853  6559 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:08.148108  6678 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:28:08.190573  6643 consensus_meta.cc:287] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.289s	user 0.013s	sys 0.000s
I20260709 12:28:08.113832  6508 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:08.208077  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 157240us
I20260709 12:28:08.155332  6126 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:08.184731  6609 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4.
I20260709 12:28:08.154700  6332 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.121s
W20260709 12:28:08.285972  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:08.205041  6673 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.178669  6656 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.184069  6579 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:08.311661  3895 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:08.114804  6683 consensus_queue.cc:1048] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 12:28:08.136185  6674 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:28:08.121948  6562 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.134969  6694 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.152s
I20260709 12:28:08.189500  6586 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:08.189174  6671 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:08.328128  4000 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:08.311813  6272 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:08.319942  6573 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:08.285394  6559 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:08.284547  6342 consensus_queue.cc:1059] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 12:28:08.332806  6213 consensus_meta.cc:287] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 1.127s	user 0.009s	sys 0.003s
I20260709 12:28:08.284272  6695 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
W20260709 12:28:08.346190  6669 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 12:28:08.327360  6692 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:08.198227  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:08.327607  6583 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:08.349291  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:08.321594  6511 consensus_queue.cc:1059] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:28:08.325590  6549 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:08.317427  6643 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:08.390345  6686 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:08.391042  6686 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.394889  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2104) took 1561 ms. Trace:
I20260709 12:28:08.322119  6126 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.395457  3854 rpcz_store.cc:276] 0709 12:28:06.834009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.387548 (+553539us) service_pool.cc:224] Handling call
0709 12:28:07.387951 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:07.624088 (+236137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:08.393528 (+769440us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54002ed954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:08.394809 (+  1281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541295488}
W20260709 12:28:08.401180  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:08.347599  6637 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:08.346652  6391 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:08.342826  6480 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:08.402740  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 460) took 1463 ms. Trace:
I20260709 12:28:08.410713  4000 rpcz_store.cc:276] 0709 12:28:06.939123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:06.939226 (+   103us) service_pool.cc:224] Handling call
0709 12:28:08.401830 (+1462604us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540032d054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:08.402651 (+   821us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3144734464}
I20260709 12:28:08.411424  3855 raft_consensus.cc:2393] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:08.403589  4003 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:28:08.361191  6620 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:08.408833  6332 raft_consensus.cc:3055] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:08.413297  6332 raft_consensus.cc:740] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:08.338500  6579 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.366614  6213 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.327430  6673 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:08.395529  6692 raft_consensus.cc:697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:08.400909  6685 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 12:28:08.414696  6332 consensus_queue.cc:260] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:08.425594  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:08.408007  6679 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:08.428999  6550 consensus_meta.cc:287] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.134s	user 0.005s	sys 0.003s
W20260709 12:28:08.431600  6676 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.834s	user 0.007s	sys 0.000s
W20260709 12:28:08.421706  6677 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.543s	user 0.000s	sys 0.007s
I20260709 12:28:08.397866  6342 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:08.289422  3853 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:08.343320  6671 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:08.450477  6497 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:08.453006  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 701) took 1107 ms. Trace:
W20260709 12:28:08.453241  6696 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.130s	user 0.003s	sys 0.000s
I20260709 12:28:08.453640  6656 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:08.454303  6692 consensus_queue.cc:237] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:08.455366  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:08.437424  6428 consensus_meta.cc:287] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.300s	user 0.004s	sys 0.007s
I20260709 12:28:08.455669  6213 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:08.458259  6126 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:08.431119  6643 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:08.428251  6579 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:08.431571  6253 consensus_meta.cc:287] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 1.258s	user 0.010s	sys 0.000s
I20260709 12:28:08.549425  6253 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.551505  6253 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:08.461061  6567 consensus_meta.cc:287] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.628s	user 0.004s	sys 0.004s
W20260709 12:28:08.461061  6600 consensus_meta.cc:287] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 1.281s	user 0.008s	sys 0.000s
I20260709 12:28:08.475714  6550 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:08.458261  6568 consensus_meta.cc:287] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.035s	user 0.009s	sys 0.001s
W20260709 12:28:08.478745  6494 consensus_meta.cc:287] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.941s	user 0.009s	sys 0.002s
W20260709 12:28:08.584806  6632 consensus_meta.cc:287] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.000s
W20260709 12:28:08.481418  6315 consensus_meta.cc:287] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.925s	user 0.009s	sys 0.002s
I20260709 12:28:08.482151  6570 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:08.482707  6686 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:08.422652  6391 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.427044  6562 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:08.487892  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 453) took 1606 ms. Trace:
W20260709 12:28:08.489775  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 291624us
I20260709 12:28:08.489176  3857 rpcz_store.cc:276] 0709 12:28:07.345714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.096456 (+750742us) service_pool.cc:224] Handling call
0709 12:28:08.096837 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:08.208643 (+111806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:08.208675 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:08.209202 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 12:28:08.328940 (+119738us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:08.328976 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:08.329530 (+   554us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:08.452750 (+123220us) raft_consensus.cc:1685] finished
0709 12:28:08.452776 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:08.452942 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19293,"raft.queue_time_us":81438,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4729,"thread_start_us":211067,"threads_started":2,"wal-append.queue_time_us":212495}
W20260709 12:28:08.492918  6360 consensus_meta.cc:287] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.962s	user 0.009s	sys 0.001s
W20260709 12:28:08.493041  6571 consensus_meta.cc:287] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.171s	user 0.004s	sys 0.008s
I20260709 12:28:08.494568  6559 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:08.494839  6633 consensus_meta.cc:287] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.182s	user 0.010s	sys 0.000s
I20260709 12:28:08.494607  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2183) took 1377 ms. Trace:
I20260709 12:28:08.496076  3853 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:08.497174  6492 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:08.599261  4003 rpcz_store.cc:276] 0709 12:28:07.117014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.626203 (+509189us) service_pool.cc:224] Handling call
0709 12:28:08.403263 (+777060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:08.412274 (+  9011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:08.494411 (+ 82137us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b540032d050. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:08.494547 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786133888}
I20260709 12:28:08.497347  6695 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:08.498708  6139 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:08.499418  6671 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:08.500408  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 455) took 1617 ms. Trace:
I20260709 12:28:08.578197  6567 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:08.592600  6570 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.496289  6342 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:08.598809  6360 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.640471  6641 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:08.635097  6695 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:08.641263  6695 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:08.500989  6613 consensus_meta.cc:287] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.918s	user 0.002s	sys 0.005s
I20260709 12:28:08.484575  6679 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.501873  6508 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:08.503561  6673 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:08.445813  6620 consensus_queue.cc:1059] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:28:08.506196  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 457) took 1614 ms. Trace:
W20260709 12:28:08.520296  3928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.009s	sys 0.003s
W20260709 12:28:08.521952  3923 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.004s	sys 0.008s
W20260709 12:28:08.529757  6487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.000s	sys 0.003s
I20260709 12:28:08.530974  6428 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.548316  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:08.553465  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:08.557062  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:08.566607  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:08.663929  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 106961us
I20260709 12:28:08.566731  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:08.567294  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2207) took 1572 ms. Trace:
I20260709 12:28:08.568097  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:08.556391  6656 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:08.570318  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:08.570986  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:08.571734  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:08.579311  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 691752us
W20260709 12:28:08.585901  3925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.010s	sys 0.001s
W20260709 12:28:08.557008  6548 consensus_meta.cc:287] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.002s
W20260709 12:28:08.587234  3931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.010s	sys 0.005s
I20260709 12:28:08.592900  3897 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:08.616683  6571 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:08.594523  6711 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.613256  6633 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.594419  6705 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.589284  6315 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.632704  3856 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
W20260709 12:28:08.594518  6675 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.750s	user 0.000s	sys 0.002s
I20260709 12:28:08.637483  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:08.592049  6213 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.638664  4004 rpcz_store.cc:276] 0709 12:28:06.882825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:06.910707 (+ 27882us) service_pool.cc:224] Handling call
0709 12:28:06.927763 (+ 17056us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:06.934260 (+  6497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:06.934298 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:06.945105 (+ 10807us) log.cc:844] Serialized 26 byte log entry
0709 12:28:07.312080 (+366975us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:07.312148 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:07.312251 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:08.430936 (+1118685us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:08.500121 (+ 69185us) raft_consensus.cc:1685] finished
0709 12:28:08.500141 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:08.500350 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":646,"raft.queue_time_us":6320,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":17982,"spinlock_wait_cycles":810391424,"thread_start_us":279999,"threads_started":1,"wal-append.queue_time_us":506363}
I20260709 12:28:08.642370  3997 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:28:08.648065  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:08.648315  4536 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:08.586043  6600 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.616950  6454 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:08.639125  6707 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.090s	user 0.001s	sys 0.001s
W20260709 12:28:08.661254  3923 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.005s	sys 0.009s
W20260709 12:28:08.661724  3928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.011s	sys 0.004s
I20260709 12:28:08.638383  6139 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:08.661552  4001 rpcz_store.cc:276] 0709 12:28:06.891929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:06.949280 (+ 57351us) service_pool.cc:224] Handling call
0709 12:28:06.986149 (+ 36869us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:07.055867 (+ 69718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:07.055901 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:07.085650 (+ 29749us) log.cc:844] Serialized 26 byte log entry
0709 12:28:07.365526 (+279876us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:07.365599 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:07.530280 (+164681us) spinlock_profiling.cc:243] Waited 69.4 ms on lock 0x7b54001329d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:07.530344 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:08.421079 (+890735us) spinlock_profiling.cc:243] Waited 59.7 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:08.505960 (+ 84881us) raft_consensus.cc:1685] finished
0709 12:28:08.505982 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:08.506136 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297100416,"thread_start_us":227982,"threads_started":1,"wal-append.queue_time_us":664507}
I20260709 12:28:08.665738  3929 rpcz_store.cc:276] 0709 12:28:06.995038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:06.995172 (+   134us) service_pool.cc:224] Handling call
0709 12:28:06.995697 (+   525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:07.635750 (+640053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:07.635795 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:07.636380 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 12:28:07.901510 (+265130us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:07.901545 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:07.901621 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:08.389829 (+488208us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:08.553042 (+163213us) raft_consensus.cc:1685] finished
0709 12:28:08.553067 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:08.567231 (+ 14164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27017,"raft.queue_time_us":58571,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":29805,"spinlock_wait_cycles":15144192,"thread_start_us":877321,"threads_started":2,"wal-append.queue_time_us":510816}
I20260709 12:28:08.641816  6342 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:08.642230  6360 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:08.629992  6307 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:08.680927  6641 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:28:08.646510  6555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.016s	sys 0.012s
I20260709 12:28:08.592312  4002 rpcz_store.cc:276] 0709 12:28:06.881434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:06.881546 (+   112us) service_pool.cc:224] Handling call
0709 12:28:06.881846 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:06.891856 (+ 10010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:06.891888 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:06.920549 (+ 28661us) log.cc:844] Serialized 26 byte log entry
0709 12:28:07.784631 (+864082us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:07.784686 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:07.784772 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:08.487642 (+702870us) raft_consensus.cc:1685] finished
0709 12:28:08.487673 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:08.487820 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13011,"raft.queue_time_us":10205,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":39935,"thread_start_us":798000,"threads_started":1,"wal-append.queue_time_us":911195}
I20260709 12:28:08.649076  6570 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:08.650723  6613 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.012459  3851 raft_consensus.cc:1240] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:09.260223  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:09.033607  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:08.992089  4006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2178) took 1963 ms (client timeout 1772 ms). Trace:
W20260709 12:28:08.815398  3930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.006s	sys 0.022s
I20260709 12:28:09.260555  3854 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
W20260709 12:28:09.023228  3855 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2112) took 2149 ms (client timeout 1725 ms). Trace:
I20260709 12:28:08.749650  3999 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: []
W20260709 12:28:09.039346  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:09.230393  6473 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.286908  6705 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:08.663224  6487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.000s	sys 0.003s
I20260709 12:28:09.230708  6567 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:09.037712  6666 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 1.548s	user 0.004s	sys 0.000s
I20260709 12:28:08.956753  6348 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:08.979031  6727 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
W20260709 12:28:09.035591  6698 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.850s	user 0.000s	sys 0.003s
I20260709 12:28:09.285507  6307 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:09.108510  6690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.000s	sys 0.011s
I20260709 12:28:09.223874  6245 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:09.204422  6629 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:08.806306  6706 log.cc:927] Time spent T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.421s	user 0.002s	sys 0.000s
W20260709 12:28:08.824791  6704 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.431s	user 0.004s	sys 0.000s
W20260709 12:28:09.303599  3931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.244s	user 0.017s	sys 0.022s
I20260709 12:28:09.376036  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 461) took 2171 ms. Trace:
I20260709 12:28:09.376542  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 639) took 1582 ms. Trace:
I20260709 12:28:09.376418  3997 rpcz_store.cc:276] 0709 12:28:07.212490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.637532 (+425042us) service_pool.cc:224] Handling call
0709 12:28:07.637918 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:09.284721 (+1646803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:09.372043 (+ 87322us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000c4254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:09.375959 (+  3916us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2309452032}
I20260709 12:28:09.377243  3931 rpcz_store.cc:276] 0709 12:28:07.793982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.794103 (+   121us) service_pool.cc:224] Handling call
0709 12:28:07.794370 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:07.794547 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:08.059889 (+265342us) log.cc:844] Serialized 14 byte log entry
0709 12:28:09.376084 (+1316195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:09.376162 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:09.376225 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:09.376318 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:09.376459 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":524588,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"thread_start_us":1544834,"threads_started":2,"wal-append.queue_time_us":1221261}
I20260709 12:28:09.038715  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2107) took 2187 ms. Trace:
I20260709 12:28:08.713551  6656 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:08.905046  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:08.945946  6638 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:09.386881  6638 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.389146  6638 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:09.305236  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 633) took 1677 ms. Trace:
I20260709 12:28:09.390049  3928 rpcz_store.cc:276] 0709 12:28:07.629096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.629235 (+   139us) service_pool.cc:224] Handling call
0709 12:28:07.629637 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:07.837994 (+208357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:07.838022 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:07.838496 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:28:09.304830 (+1466334us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:09.304883 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:09.304977 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:09.305050 (+    73us) raft_consensus.cc:1685] finished
0709 12:28:09.305069 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:09.305179 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126715,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":22717,"thread_start_us":1566222,"threads_started":2,"wal-append.queue_time_us":694382}
I20260709 12:28:09.391913  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:09.393208  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:09.285744  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:09.305436  6315 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:09.393775  3928 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
W20260709 12:28:08.822043  6506 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.008s	sys 0.047s
I20260709 12:28:09.305644  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 452) took 2424 ms. Trace:
W20260709 12:28:09.285476  3930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.013s	sys 0.030s
I20260709 12:28:09.394246  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:09.260528  3925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.302s	user 0.023s	sys 0.010s
I20260709 12:28:09.190165  6391 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:08.978281  6632 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.306399  6213 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:09.286402  3855 rpcz_store.cc:269] 0709 12:28:06.873536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:06.905279 (+ 31743us) service_pool.cc:224] Handling call
0709 12:28:09.012020 (+2106741us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540027a954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:09.023118 (+ 11098us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3368944896}
I20260709 12:28:08.980180  6573 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:09.287125  4006 rpcz_store.cc:269] 0709 12:28:07.029036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.270786 (+241750us) service_pool.cc:224] Handling call
0709 12:28:08.991831 (+1721045us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b540007f3d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:08.991994 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265586560}
I20260709 12:28:09.422562  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:09.423317  4565 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:09.423523  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:09.424296  4006 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:09.308279  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 630) took 1715 ms. Trace:
W20260709 12:28:09.308887  6555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.764s	user 0.016s	sys 0.027s
W20260709 12:28:09.412389  6506 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.208s	user 0.010s	sys 0.060s
W20260709 12:28:08.796988  6699 log.cc:927] Time spent T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.610s	user 0.001s	sys 0.001s
W20260709 12:28:09.189138  6722 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.489s	user 0.001s	sys 0.000s
I20260709 12:28:08.778301  6550 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:08.698081  6673 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.612s
W20260709 12:28:08.815212  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 452050us
I20260709 12:28:09.418385  6511 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:09.310976  6342 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:28:09.311136  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 718339us
I20260709 12:28:08.715509  3850 raft_consensus.cc:1240] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:09.303131  6454 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:08.699901  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:08.916985  6605 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.322122  4567 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:09.467263  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 631) took 1873 ms. Trace:
I20260709 12:28:09.371964  6348 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.326365  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:09.382378  6629 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.328295  6570 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:09.316299  6688 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.331534  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:09.335266  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:09.483582  4003 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:09.337229  6633 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:09.500537  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 628) took 1909 ms. Trace:
I20260709 12:28:09.500954  3924 rpcz_store.cc:276] 0709 12:28:07.590841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.591150 (+   309us) service_pool.cc:224] Handling call
0709 12:28:07.591547 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:07.591966 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:07.592008 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:07.616292 (+ 24284us) log.cc:844] Serialized 26 byte log entry
0709 12:28:07.974018 (+357726us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:07.974144 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:07.974298 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:08.796174 (+821876us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:09.500239 (+704065us) raft_consensus.cc:1685] finished
0709 12:28:09.500268 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:09.500475 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47160,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":13877632,"thread_start_us":220052,"threads_started":1,"wal-append.queue_time_us":480577}
I20260709 12:28:09.338464  6679 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:08.778484  6671 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.503328  6671 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:09.348069  3822 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.002s	sys 0.015s
W20260709 12:28:09.506129  3822 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.003s	sys 0.016s
W20260709 12:28:09.506558  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 795269us
I20260709 12:28:09.508760  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:09.509363  3924 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:09.356089  6613 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:09.316344  6549 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.356856  6615 raft_consensus.cc:3055] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:09.443145  6632 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:09.351408  6473 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:09.369354  3957 heartbeater.cc:646] Failed to heartbeat to 127.2.157.62:44099 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.2.157.62:44099 timed out after 15.000s (SENT)
I20260709 12:28:09.285403  6711 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:09.370779  3856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2111) took 2497 ms (client timeout 1949 ms). Trace:
I20260709 12:28:09.369436  6307 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:09.371738  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2188) took 1529 ms. Trace:
I20260709 12:28:09.374552  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:09.530889  4004 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:09.381338  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1701) took 2435 ms. Trace:
I20260709 12:28:09.379261  3848 rpcz_store.cc:276] 0709 12:28:06.850954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.491237 (+640283us) service_pool.cc:224] Handling call
0709 12:28:08.073159 (+581922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:08.097339 (+ 24180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:09.038437 (+941098us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b5400191c50. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:09.038642 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128722176}
I20260709 12:28:09.530526  3999 rpcz_store.cc:276] 0709 12:28:07.842651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.198750 (+356099us) service_pool.cc:224] Handling call
0709 12:28:08.199142 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:09.288260 (+1089118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:09.371061 (+ 82801us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54000230d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:09.371675 (+   614us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083519360}
W20260709 12:28:09.287313  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:09.413535  3931 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:09.535961  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:09.536763  3931 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:09.394817  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 1643) took 1286 ms. Trace:
I20260709 12:28:09.538130  3929 rpcz_store.cc:276] 0709 12:28:08.108067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.285465 (+1177398us) service_pool.cc:224] Handling call
0709 12:28:09.394744 (+109279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:09.538278  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:09.539212  3928 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:09.539569  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:09.416723  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:09.369961  6690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.005s	sys 0.014s
I20260709 12:28:09.404657  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:09.541105  4573 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:09.389663  6638 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:09.372769  6428 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:09.309218  6641 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:09.551425  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:09.426062  3926 rpcz_store.cc:276] 0709 12:28:07.593057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.593213 (+   156us) service_pool.cc:224] Handling call
0709 12:28:07.593511 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:07.949599 (+356088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:07.949655 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:07.956524 (+  6869us) log.cc:844] Serialized 26 byte log entry
0709 12:28:08.112392 (+155868us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:08.112456 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:08.112576 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:09.308039 (+1195463us) raft_consensus.cc:1685] finished
0709 12:28:09.308067 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:09.308213 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":188,"raft.queue_time_us":45672,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":15583,"thread_start_us":410459,"threads_started":2,"wal-append.queue_time_us":524820}
I20260709 12:28:09.447993  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:09.553175  4572 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:09.449083  4006 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:09.442555  3855 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
W20260709 12:28:09.420811  6492 consensus_meta.cc:287] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.787s	user 0.006s	sys 0.005s
I20260709 12:28:09.450297  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:09.414721  6720 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.418618  6345 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:09.454082  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 694) took 2985 ms. Trace:
I20260709 12:28:09.418097  6583 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:09.412767  3998 rpcz_store.cc:276] 0709 12:28:06.881138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:06.882511 (+  1373us) service_pool.cc:224] Handling call
0709 12:28:06.898309 (+ 15798us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:06.898708 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:06.898740 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:06.949491 (+ 50751us) log.cc:844] Serialized 26 byte log entry
0709 12:28:07.318712 (+369221us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b4800062358. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe056f00aa1 00007fe056ef7b37 00007fe056ef79ca 00007fe056fef26f 00007fe056feef37 00007fe05700355c 00007fe057003508 00007fe057003488 00007fe057003443 00007fe0570026ec 00007fe055f2ca96
0709 12:28:07.336573 (+ 17861us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:07.336647 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:07.336812 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:08.549724 (+1212912us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:09.305453 (+755729us) raft_consensus.cc:1685] finished
0709 12:28:09.305478 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:09.305592 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1828,"raft.run_cpu_time_us":4031,"raft.run_wall_time_us":414950,"spinlock_wait_cycles":292811776,"thread_start_us":259266,"threads_started":1,"wal-append.queue_time_us":663978}
I20260709 12:28:09.382213  6245 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.464246  3895 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:09.467651  3927 rpcz_store.cc:276] 0709 12:28:07.594035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.594246 (+   211us) service_pool.cc:224] Handling call
0709 12:28:07.594531 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:07.594743 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:07.594773 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:07.644212 (+ 49439us) log.cc:844] Serialized 26 byte log entry
0709 12:28:08.031146 (+386934us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:08.031200 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:08.031296 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:09.034889 (+1003593us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:09.466964 (+432075us) raft_consensus.cc:1685] finished
0709 12:28:09.466988 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:09.467208 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5584768,"thread_start_us":284085,"threads_started":1,"wal-append.queue_time_us":471468}
I20260709 12:28:09.608173  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:09.609391  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:09.322992  6332 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:09.588811  6637 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.610569  6637 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:09.606833  6428 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:09.484753  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:09.613340  6428 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:09.614948  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:09.616122  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:09.616261  6428 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:09.617125  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:09.617012  6428 consensus_queue.cc:1059] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:09.487776  6629 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:09.630939  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:09.488265  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:09.631290  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:09.488555  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:09.632315  4001 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:09.489053  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:09.489573  6688 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:09.470170  6511 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.492859  4569 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:28:09.517684  6549 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.463310  6342 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.499372  4000 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
W20260709 12:28:09.499715  4005 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2172) took 2547 ms (client timeout 1652 ms). Trace:
I20260709 12:28:09.510602  3822 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:09.641273  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 131398us
I20260709 12:28:09.642338  3822 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:09.361416  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 713149us
I20260709 12:28:09.469369  6672 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:28:09.515697  6705 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:09.516801  6656 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:09.516973  6571 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:09.447475  6573 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:09.520241  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 638) took 1737 ms. Trace:
I20260709 12:28:09.521410  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1703) took 2453 ms. Trace:
W20260709 12:28:09.524328  3856 rpcz_store.cc:269] 0709 12:28:06.873259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:06.941847 (+ 68588us) service_pool.cc:224] Handling call
0709 12:28:09.370606 (+2428759us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54000ee054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:09.370710 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3775763200}
I20260709 12:28:09.524406  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 766) took 1620 ms. Trace:
I20260709 12:28:09.525584  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:09.366783  6723 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:09.537760  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:09.533138  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:09.665979  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:09.666843  3999 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 8: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:09.667853  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:09.669274  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:09.465451  6315 consensus_queue.cc:1059] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:28:09.512645  6615 raft_consensus.cc:740] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:09.549904  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:09.531752  3851 rpcz_store.cc:276] 0709 12:28:06.945429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.621816 (+676387us) service_pool.cc:224] Handling call
0709 12:28:09.012190 (+1390374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:09.279633 (+267443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:09.373442 (+ 93809us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540027a950. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:09.381256 (+  7814us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3134970240}
I20260709 12:28:09.648451  6428 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:09.465613  6692 consensus_queue.cc:1059] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:28:09.519798  6731 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:09.673105  6660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.493s	user 0.031s	sys 0.062s
I20260709 12:28:09.588798  3852 rpcz_store.cc:276] 0709 12:28:06.463635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:06.562359 (+ 98724us) service_pool.cc:224] Handling call
0709 12:28:06.582356 (+ 19997us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:06.582563 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:06.582601 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:06.583159 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:28:07.106438 (+523279us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:07.106475 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:07.106544 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:09.037023 (+1930479us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:09.439645 (+402622us) raft_consensus.cc:1685] finished
0709 12:28:09.439678 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:09.449041 (+  9363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020177792,"thread_start_us":520849,"threads_started":1,"wal-append.queue_time_us":762576}
I20260709 12:28:09.769212  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:09.770226  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:09.770447  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:09.771286  3852 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:09.566345  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:09.772445  3926 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:09.483399  6605 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.482944  6562 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:28:09.524272  6600 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:09.618779  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 640) took 1790 ms. Trace:
I20260709 12:28:09.618945  4571 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:28:09.778442  3820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.011s	sys 0.069s
I20260709 12:28:09.634516  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:09.556325  6641 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:09.635120  4538 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:09.564152  6671 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:09.496925  6454 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:09.564033  6508 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:09.638569  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:09.618466  6492 raft_consensus.cc:3055] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:28:09.640664  4005 rpcz_store.cc:269] 0709 12:28:06.952056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.003180 (+ 51124us) service_pool.cc:224] Handling call
0709 12:28:09.499467 (+2496287us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b540007eed4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:09.499622 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5635818368}
I20260709 12:28:09.647323  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:09.643784  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:09.556473  6638 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.654733  3997 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:28:09.564385  6713 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:28:09.655436  4001 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:09.657644  3850 rpcz_store.cc:276] 0709 12:28:07.067600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.786006 (+718406us) service_pool.cc:224] Handling call
0709 12:28:07.786304 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:09.464574 (+1678270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:09.521125 (+ 56551us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b540001aed4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:09.521342 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2136400256}
I20260709 12:28:09.657467  3932 rpcz_store.cc:276] 0709 12:28:07.783014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.783231 (+   217us) service_pool.cc:224] Handling call
0709 12:28:07.822801 (+ 39570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:07.836285 (+ 13484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:07.836324 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:07.878383 (+ 42059us) log.cc:844] Serialized 26 byte log entry
0709 12:28:08.117185 (+238802us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:08.117325 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:08.117525 (+   200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:08.824117 (+706592us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:09.478930 (+654813us) raft_consensus.cc:1685] finished
0709 12:28:09.478961 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:09.520166 (+ 41205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13125,"raft.queue_time_us":39827,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":17922,"spinlock_wait_cycles":6943104,"thread_start_us":151085,"threads_started":1,"wal-append.queue_time_us":384042}
I20260709 12:28:09.661108  4567 rpcz_store.cc:276] 0709 12:28:07.905865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.952324 (+ 46459us) service_pool.cc:224] Handling call
0709 12:28:08.060462 (+108138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:09.467497 (+1407035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:09.524166 (+ 56669us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002404d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:09.524348 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2882877184}
W20260709 12:28:09.797971  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:09.663542  4003 raft_consensus.cc:2393] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 4: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:09.643851  6342 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:09.647001  4566 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:28:09.670303  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:09.670987  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:09.768739  6743 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:09.692458  3971 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:09.554689  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:09.724716  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 199877us
W20260709 12:28:09.818080  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 154168us
I20260709 12:28:09.782451  6548 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:09.762336  4004 raft_consensus.cc:2368] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4.
I20260709 12:28:09.589564  3849 raft_consensus.cc:2410] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:28:09.656625  6672 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:09.789978  6741 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.776937  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:09.789109  6506 consensus_queue.cc:1059] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:28:09.802944  6745 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:09.781373  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:09.778388  3924 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:09.722213  6673 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:09.778386  3925 rpcz_store.cc:276] 0709 12:28:07.828816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.829706 (+   890us) service_pool.cc:224] Handling call
0709 12:28:07.830016 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:07.836828 (+  6812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:07.836856 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:07.871733 (+ 34877us) log.cc:844] Serialized 26 byte log entry
0709 12:28:09.414194 (+1542461us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:09.414251 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:09.414348 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:09.618606 (+204258us) raft_consensus.cc:1685] finished
0709 12:28:09.618626 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:09.618729 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17544,"raft.queue_time_us":36642,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":15716,"thread_start_us":1455565,"threads_started":1,"wal-append.queue_time_us":735605}
I20260709 12:28:09.784935  3998 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:09.785236  3927 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
W20260709 12:28:09.775267  6660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.619s	user 0.032s	sys 0.062s
I20260709 12:28:09.765345  6705 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:09.794986  3923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.012s	sys 0.019s
I20260709 12:28:09.798949  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:09.780709  6615 consensus_queue.cc:260] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.961014  3850 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:09.774194  6571 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:09.722776  6255 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:28:09.971331  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:09.619218  6720 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:09.803095  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 168046us
W20260709 12:28:09.976297  3923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.017s	sys 0.024s
I20260709 12:28:09.775693  6629 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:09.804273  3857 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:28:09.806299  3856 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:09.806247  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 162529us
I20260709 12:28:09.776121  6213 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:09.819080  3971 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:09.761147  4002 raft_consensus.cc:2410] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:28:09.819655  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:09.821687  6713 raft_consensus.cc:3055] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:09.716594  6656 raft_consensus.cc:3055] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:09.822875  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:09.789423  6492 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:09.823966  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:09.768293  6428 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:09.830677  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 179594us
I20260709 12:28:09.802299  6680 raft_consensus.cc:3055] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:09.829797  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:09.800418  6695 consensus_meta.cc:287] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.159s	user 0.011s	sys 0.002s
I20260709 12:28:09.834769  4004 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:28:10.049117  3929 raft_consensus.cc:2368] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4.
I20260709 12:28:09.830148  6548 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:09.833971  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 369778us
I20260709 12:28:09.838119  3926 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:09.774657  6731 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:09.778957  3820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.011s	sys 0.069s
I20260709 12:28:09.817698  6671 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:09.879433  6348 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:09.942710  6245 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:09.943482  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:09.943835  6613 raft_consensus.cc:3055] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:09.985584  6615 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:10.003837  6506 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:28:09.948608  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:09.958025  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:10.115851  3925 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:09.824052  6600 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:09.797849  6508 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.822474  6753 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:09.961992  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:10.145213  3924 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 2.
I20260709 12:28:09.968374  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:09.961704  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:10.147363  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:09.970325  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 710) took 1407 ms. Trace:
I20260709 12:28:10.148648  3854 rpcz_store.cc:276] 0709 12:28:08.562979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.286841 (+723862us) service_pool.cc:224] Handling call
0709 12:28:09.287151 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:09.287345 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:28:09.656405 (+369060us) log.cc:844] Serialized 14 byte log entry
0709 12:28:09.969848 (+313443us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:09.969940 (+    92us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:09.970004 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:09.970098 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:09.970249 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64740,"prepare.queue_time_us":638469,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"thread_start_us":680019,"threads_started":2,"wal-append.queue_time_us":458141}
I20260709 12:28:09.807260  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:09.982626  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 163642us
I20260709 12:28:10.151921  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:09.985385  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 165792us
I20260709 12:28:09.846313  6743 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:09.915192  6660 raft_consensus.cc:697] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:09.987389  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:10.169152  6755 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.002851  3856 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:10.169436  6660 consensus_queue.cc:237] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.170430  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:10.170673  6740 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:10.171344  3856 raft_consensus.cc:2410] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:28:10.171265  6740 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.945735  6605 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.172835  6600 raft_consensus.cc:697] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:10.169682  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:10.173563  6740 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.066781  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2193) took 1529 ms. Trace:
I20260709 12:28:10.049768  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:09.831965  6672 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.099336  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:10.101022  3895 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:10.098677  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:09.943969  6454 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.978497  6692 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.107511  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:10.175146  4004 rpcz_store.cc:276] 0709 12:28:08.537169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.823313 (+1286144us) service_pool.cc:224] Handling call
0709 12:28:09.834560 (+ 11247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:10.066442 (+231882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.066716 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:10.187572  3928 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
W20260709 12:28:10.041209  6733 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.402s	user 0.000s	sys 0.001s
I20260709 12:28:09.947535  3970 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:10.178128  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 77190.4us
W20260709 12:28:10.188784  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 241302us
I20260709 12:28:10.186795  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:10.189695  3931 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
W20260709 12:28:10.071000  6139 consensus_meta.cc:287] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.001s
I20260709 12:28:10.194190  6139 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.196440  6139 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:10.197991  6348 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:09.994462  6656 raft_consensus.cc:740] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:10.073949  6737 log.cc:927] Time spent T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Append to log took a long time: real 0.435s	user 0.001s	sys 0.001s
I20260709 12:28:10.107251  6613 raft_consensus.cc:740] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:10.108487  6671 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.974637  6705 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.118773  6752 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:10.119338  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:10.120514  6620 raft_consensus.cc:3055] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:28:10.122222  6750 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:28:09.914044  6741 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.123472  6428 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.123420  6391 consensus_queue.cc:1059] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:10.006323  6629 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.994607  6673 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:09.973831  6571 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.986668  6713 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:10.043558  6213 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:10.043944  6680 raft_consensus.cc:740] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:10.221987  6752 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:09.929917  6745 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.068748  6723 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:10.154474  4537 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:10.164713  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:10.148131  3852 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:10.180009  6753 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.157366  6492 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.242452  6673 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.115592  6573 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:10.137113  6731 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:10.167924  6743 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:09.824723  6742 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:10.190603  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:10.175380  4567 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:28:10.176378  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:10.173928  4571 raft_consensus.cc:2410] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:28:10.170447  6746 consensus_queue.cc:1059] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:28:10.190073  6740 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:10.132649  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:10.200107  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:10.300129  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 100084us
I20260709 12:28:10.186993  3971 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:10.203853  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:10.302121  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:10.204322  3932 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:10.203898  3925 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:10.179949  6506 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:10.226293  6613 consensus_queue.cc:260] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.199342  6692 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.233870  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:10.290493  6762 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:10.297286  6673 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:10.263720  6761 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:10.265159  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 629) took 2672 ms. Trace:
I20260709 12:28:10.169678  6755 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.199105  6454 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.217902  6139 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:10.041630  6511 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:10.274621  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:10.231006  6620 raft_consensus.cc:740] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:10.274417  3821 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:10.273341  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 713) took 1695 ms. Trace:
W20260709 12:28:10.265514  6733 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:28:10.289966  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:10.315711  6740 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:10.291008  3852 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:10.173857  6600 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:10.293288  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 192839us
I20260709 12:28:10.353205  3926 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:10.353960  3969 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:10.354863  6774 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:10.355507  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:10.355422  6774 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.356257  6245 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:10.356606  3969 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:10.356685  6245 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:10.293529  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 139143us
I20260709 12:28:10.357343  6245 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:10.244194  6638 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.267642  6253 raft_consensus.cc:3055] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:10.333868  6613 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:10.273325  6213 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:10.304217  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:10.376935  3925 raft_consensus.cc:2410] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:28:10.305400  3970 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:10.306851  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:10.308954  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 155044us
I20260709 12:28:10.379135  3971 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:10.309830  3895 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:10.291117  6428 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.289572  6752 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:10.177104  6672 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.263473  6671 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.316541  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 641) took 2480 ms. Trace:
I20260709 12:28:10.406744  3927 rpcz_store.cc:276] 0709 12:28:07.835748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.313248 (+2477500us) service_pool.cc:224] Handling call
0709 12:28:10.315894 (+  2646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.316119 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.316154 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.316209 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:10.316258 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.316331 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.316457 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:10.317251  3928 raft_consensus.cc:2410] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:28:10.324836  3997 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:28:10.301971  6764 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:10.410494  6764 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.410950  6764 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:10.268028  6767 consensus_queue.cc:1059] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:28:10.302695  6731 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:10.333994  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:10.320106  6724 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.960s	user 0.000s	sys 0.003s
I20260709 12:28:10.334867  3929 raft_consensus.cc:2410] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:28:10.290756  6756 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:28:10.328276  3923 rpcz_store.cc:276] 0709 12:28:07.592742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.592900 (+   158us) service_pool.cc:224] Handling call
0709 12:28:07.593364 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:07.938952 (+345588us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:09.288210 (+1349258us) log.cc:844] Serialized 14 byte log entry
0709 12:28:09.977279 (+689069us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:09.977836 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:28:09.982126 (+  4290us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:09.982164 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:09.982639 (+   475us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:10.264880 (+282241us) raft_consensus.cc:1685] finished
0709 12:28:10.264904 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.265090 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":403511,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":5764,"raft.queue_time_us":237278,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":151,"thread_start_us":2343921,"threads_started":3,"wal-append.queue_time_us":442037}
I20260709 12:28:10.426846  3923 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:10.427621  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2209) took 2461 ms. Trace:
I20260709 12:28:10.428002  3923 rpcz_store.cc:276] 0709 12:28:07.965923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.426244 (+2460321us) service_pool.cc:224] Handling call
0709 12:28:10.426624 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.427326 (+   702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.427556 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:28:10.344836  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 70509.7us
I20260709 12:28:10.072885  6695 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:10.313705  6459 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.007s
W20260709 12:28:10.430166  6459 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.006s	sys 0.007s
I20260709 12:28:10.431692  6695 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.432457  6695 raft_consensus.cc:3055] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:10.432865  6695 raft_consensus.cc:740] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:10.334039  4566 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:10.351655  3924 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:10.435356  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 642) took 2564 ms. Trace:
I20260709 12:28:10.435765  3924 rpcz_store.cc:276] 0709 12:28:07.871332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.346011 (+2474679us) service_pool.cc:224] Handling call
0709 12:28:10.346362 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.435064 (+ 88702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.435298 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:10.329406  6746 raft_consensus.cc:3055] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:10.336427  3848 rpcz_store.cc:276] 0709 12:28:08.578334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.555511 (+977177us) service_pool.cc:224] Handling call
0709 12:28:09.555848 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:09.556048 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:09.775031 (+218983us) log.cc:844] Serialized 14 byte log entry
0709 12:28:10.273020 (+497989us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.273074 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:10.273114 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.273188 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.273290 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59732,"prepare.queue_time_us":517350,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":258146,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6164,"thread_start_us":623742,"threads_started":3,"wal-append.queue_time_us":422955}
I20260709 12:28:10.438050  6746 raft_consensus.cc:740] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:10.438545  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:10.438910  6746 consensus_queue.cc:260] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.439703  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:10.440117  6746 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:10.440716  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:10.441412  3848 raft_consensus.cc:2393] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 3: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:10.357550  6774 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.296161  3931 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:10.442978  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2210) took 2476 ms. Trace:
I20260709 12:28:10.443387  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2212) took 2476 ms. Trace:
I20260709 12:28:10.443341  3923 rpcz_store.cc:276] 0709 12:28:07.966304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.428877 (+2462573us) service_pool.cc:224] Handling call
0709 12:28:10.442545 (+ 13668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.442704 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.442728 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.442764 (+    36us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:10.442792 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.442839 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.442930 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:10.443794  3931 rpcz_store.cc:276] 0709 12:28:07.966969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.442693 (+2475724us) service_pool.cc:224] Handling call
0709 12:28:10.442946 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.443104 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.443129 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.443175 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:10.443202 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.443250 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.443337 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:10.444847  3923 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:10.445268  3931 raft_consensus.cc:1240] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:28:10.445398  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1638) took 2478 ms. Trace:
W20260709 12:28:10.368863  3853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.012s	sys 0.021s
I20260709 12:28:10.329653  6348 raft_consensus.cc:697] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:10.290436  6766 consensus_queue.cc:1059] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:28:10.446862  6766 raft_consensus.cc:3055] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:10.445873  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1639) took 2478 ms. Trace:
I20260709 12:28:10.446923  6348 consensus_queue.cc:237] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.447461  6766 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:10.447681  3931 rpcz_store.cc:276] 0709 12:28:07.967591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.444781 (+2477190us) service_pool.cc:224] Handling call
0709 12:28:10.445074 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:10.445647 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.445826 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:10.449112  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:10.448640  6766 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.450342  6766 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:10.429546  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:10.452651  3821 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:10.369050  3850 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 4: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:10.373360  4537 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:10.380816  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 71084us
I20260709 12:28:10.454041  6774 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:10.454738  6774 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:10.394599  3926 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:10.455073  6774 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:10.455458  6760 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:10.303217  6656 consensus_queue.cc:260] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:10.400394  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:10.455089  3895 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:10.456519  6656 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:10.446076  3853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.013s	sys 0.021s
I20260709 12:28:10.437619  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2211) took 2471 ms. Trace:
W20260709 12:28:10.460979  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 80632us
I20260709 12:28:10.399839  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:10.461308  6766 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:10.453804  3821 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:10.455524  6774 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:10.461403  3924 rpcz_store.cc:276] 0709 12:28:07.966595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.436656 (+2470061us) service_pool.cc:224] Handling call
0709 12:28:10.437010 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.437243 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.437279 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.437334 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:10.437378 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.437444 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.437559 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:10.462147  6766 raft_consensus.cc:697] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:10.466984  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1641) took 2498 ms. Trace:
I20260709 12:28:10.467604  6766 consensus_queue.cc:237] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.465808  4537 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:10.471928  4537 leader_election.cc:400] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4.
I20260709 12:28:10.368896  6253 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:10.472432  4537 leader_election.cc:403] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:10.333544  6770 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:28:10.467383  3924 rpcz_store.cc:276] 0709 12:28:07.968142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.465462 (+2497320us) service_pool.cc:224] Handling call
0709 12:28:10.466526 (+  1064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.466704 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.466728 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.466765 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:10.466791 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.466842 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.466933 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:10.375924  6548 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.383132  6742 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:10.383314  6213 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:10.493242  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1642) took 2518 ms. Trace:
I20260709 12:28:10.404448  6638 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:10.445710  3923 rpcz_store.cc:276] 0709 12:28:07.967325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.444444 (+2477119us) service_pool.cc:224] Handling call
0709 12:28:10.444692 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.445192 (+   500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.445351 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:10.493745  3929 rpcz_store.cc:276] 0709 12:28:07.974745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.475009 (+2500264us) service_pool.cc:224] Handling call
0709 12:28:10.492605 (+ 17596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.492837 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.492878 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.492929 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:10.492959 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.493013 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.493152 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:10.487112  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:10.326951  6762 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.406073  6508 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.371315  6506 consensus_queue.cc:1059] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
W20260709 12:28:10.497792  4002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2197) took 1959 ms (client timeout 2180 ms). Trace:
W20260709 12:28:10.521459  4002 rpcz_store.cc:269] 0709 12:28:08.538276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.331273 (+792997us) service_pool.cc:224] Handling call
0709 12:28:10.497578 (+1166305us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b540021a7d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:10.497727 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":638186368}
I20260709 12:28:10.522859  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:10.523423  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1648) took 1141 ms. Trace:
I20260709 12:28:10.523651  4002 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:10.523974  3929 rpcz_store.cc:276] 0709 12:28:09.382098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.500760 (+1118662us) service_pool.cc:224] Handling call
0709 12:28:10.522816 (+ 22056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.523085 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.523110 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.523150 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:10.523181 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.523235 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.523359 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:10.524935  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:10.363888  6139 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.433810  6695 consensus_queue.cc:260] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.500129  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1644) took 1131 ms. Trace:
I20260709 12:28:10.331907  6713 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.365545  6740 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.407011  6771 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:10.555836  3848 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:28:10.473291  6672 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:10.516224  4537 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:10.475135  6660 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:10.413872  6731 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.485520  6671 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:10.579021  6671 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.579505  6671 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:10.582218  6777 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:28:10.583038  6775 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:10.583343  6762 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.583628  6775 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.567188  6765 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:10.531910  6571 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.569856  6511 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:28:10.586886  6779 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:28:10.490767  6332 consensus_meta.cc:287] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.881s	user 0.010s	sys 0.000s
I20260709 12:28:10.484357  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:10.403379  6428 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:10.530723  3849 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40038 (request call id 705) took 2578 ms (client timeout 3318 ms). Trace:
I20260709 12:28:10.530346  3923 rpcz_store.cc:276] 0709 12:28:09.368608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.499328 (+1130720us) service_pool.cc:224] Handling call
0709 12:28:10.499653 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.499822 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.499844 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.499882 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:10.499910 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.499963 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.500075 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:28:10.597383  3849 rpcz_store.cc:269] 0709 12:28:07.951938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.085672 (+133734us) service_pool.cc:224] Handling call
0709 12:28:10.530532 (+2444860us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540027ae54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:10.530670 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3400755584}
I20260709 12:28:10.507050  6548 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:10.499028  6638 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:10.539352  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:10.378036  6680 consensus_queue.cc:260] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.550297  6753 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:10.549985  6253 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.551182  6743 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.587563  6695 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:10.552215  6656 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:10.490516  6620 consensus_queue.cc:260] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:10.495028  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:10.515995  6742 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:10.564636  6629 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:10.565769  6342 consensus_meta.cc:287] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.743s	user 0.007s	sys 0.003s
I20260709 12:28:10.528638  6754 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:10.529410  6741 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:10.522477  6705 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.353219  6723 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.586799  6511 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:10.332672  6761 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.588405  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:10.596597  4567 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
W20260709 12:28:10.598332  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:10.601629  4536 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:10.598035  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:10.567729  6713 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:10.567179  6454 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:10.765070  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:10.765727  4567 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:10.656493  6754 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.759027  6253 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:10.586310  6745 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:10.650637  6740 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.651193  6692 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:10.567698  6771 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.652477  6731 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:10.654996  6615 consensus_meta.cc:287] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 12:28:10.591744  6487 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:28:10.655192  6428 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:10.775563  6754 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:10.658689  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 211960us
W20260709 12:28:10.666249  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 287188us
I20260709 12:28:10.804740  3971 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:10.806385  3971 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:10.611425  6641 consensus_meta.cc:287] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.816s	user 0.007s	sys 0.003s
I20260709 12:28:10.611258  6638 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:10.760151  4565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 760) took 1266 ms (client timeout 1611 ms). Trace:
I20260709 12:28:10.610683  6767 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:10.809388  4565 rpcz_store.cc:269] 0709 12:28:09.493610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.557333 (+ 63723us) service_pool.cc:224] Handling call
0709 12:28:10.588207 (+1030874us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b58000d5c98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056f9d0a0 00007fe056f9c984 00007fe0505176d4 00007fe050517662
0709 12:28:10.760073 (+171866us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12768000}
W20260709 12:28:10.761021  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 159485us
I20260709 12:28:10.761485  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:10.810823  3923 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:10.762712  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2184) took 1245 ms. Trace:
I20260709 12:28:10.764070  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1720) took 1042 ms. Trace:
I20260709 12:28:10.644363  6680 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:10.812674  6794 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:10.812228  3852 rpcz_store.cc:276] 0709 12:28:09.721727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.349963 (+628236us) service_pool.cc:224] Handling call
0709 12:28:10.350277 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.365099 (+ 14822us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:28:10.403252 (+ 38153us) log.cc:844] Serialized 14 byte log entry
0709 12:28:10.655994 (+252742us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b1800392680. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:28:10.763628 (+107634us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.763698 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:10.763776 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.763863 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.764002 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2673,"prepare.queue_time_us":53014,"prepare.run_wall_time_us":5637,"raft.queue_time_us":60577,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":4873,"spinlock_wait_cycles":27231360,"thread_start_us":273187,"threads_started":1}
I20260709 12:28:10.615749  6548 raft_consensus.cc:697] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:10.775539  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2220) took 1408 ms. Trace:
I20260709 12:28:10.815330  6548 consensus_queue.cc:237] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.815845  3924 rpcz_store.cc:276] 0709 12:28:09.366610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.484123 (+1117513us) service_pool.cc:224] Handling call
0709 12:28:10.484702 (+   579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.770961 (+286259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.771006 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.771063 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:10.771117 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.771199 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.771328 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19632,"raft.queue_time_us":308013,"thread_start_us":252537,"threads_started":1}
I20260709 12:28:10.817561  3924 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:28:10.611279  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 305980us
I20260709 12:28:10.818266  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 649) took 1303 ms. Trace:
I20260709 12:28:10.818812  6741 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:10.819643  6741 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.756907  6656 raft_consensus.cc:697] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:10.759518  6511 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:10.821676  6656 consensus_queue.cc:237] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.761540  6497 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4.
I20260709 12:28:10.782347  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:10.827280  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:10.828630  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:10.829201  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 643) took 2955 ms. Trace:
I20260709 12:28:10.769289  6765 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:10.830451  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:10.831363  4573 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:10.832036  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 762) took 1337 ms. Trace:
I20260709 12:28:10.768874  6573 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:10.661194  6342 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.834800  3928 raft_consensus.cc:1240] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:10.769145  6755 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:10.835915  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2208) took 2870 ms. Trace:
I20260709 12:28:10.642807  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:10.836580  4002 raft_consensus.cc:2376] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9. Re-sending same reply.
W20260709 12:28:10.836712  4000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2192) took 2299 ms (client timeout 1681 ms). Trace:
W20260709 12:28:10.837203  4000 rpcz_store.cc:269] 0709 12:28:08.536874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.699611 (+162737us) service_pool.cc:224] Handling call
0709 12:28:10.836492 (+2136881us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b540007f8d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:10.836608 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76411264}
I20260709 12:28:10.837853  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:10.838393  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:10.838855  4002 raft_consensus.cc:2393] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:10.839564  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:10.839808  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:10.840348  4000 raft_consensus.cc:2393] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:10.799476  6771 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:10.806945  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:10.812139  4004 rpcz_store.cc:276] 0709 12:28:09.517114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.188292 (+671178us) service_pool.cc:224] Handling call
0709 12:28:10.192673 (+  4381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.192908 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:10.320343 (+127435us) log.cc:844] Serialized 14 byte log entry
0709 12:28:10.655284 (+334941us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b18003df660. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:28:10.668323 (+ 13039us) log.cc:844] Serialized 14 byte log entry
0709 12:28:10.762317 (+ 93994us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.762379 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:10.762441 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.762515 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.762654 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93023,"prepare.queue_time_us":304954,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":4746,"raft.queue_time_us":197140,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":12210,"spinlock_wait_cycles":51308672,"thread_start_us":469312,"threads_started":3,"wal-append.queue_time_us":212302}
I20260709 12:28:10.765501  6620 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:10.844395  6473 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.841310  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:10.836316  3928 rpcz_store.cc:276] 0709 12:28:07.965563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.409375 (+2443812us) service_pool.cc:224] Handling call
0709 12:28:10.483742 (+ 74367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.835155 (+351413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.835711 (+   556us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b5400236ed4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:10.835857 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806889856}
I20260709 12:28:10.845832  6775 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:10.835765  6632 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:10.832459  4573 rpcz_store.cc:276] 0709 12:28:09.494237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.560213 (+ 65976us) service_pool.cc:224] Handling call
0709 12:28:10.830242 (+1270029us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b58000d5c98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056f9d0a0 00007fe056f9c984 00007fe0505176d4 00007fe050517662
0709 12:28:10.831959 (+  1717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77463808}
I20260709 12:28:10.851866  3928 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:10.829790  3927 rpcz_store.cc:276] 0709 12:28:07.873845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.408204 (+2534359us) service_pool.cc:224] Handling call
0709 12:28:10.408558 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.602599 (+194041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.602631 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.602670 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:10.602702 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.828866 (+226164us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54002e2f54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:10.828952 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.829124 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445782912}
I20260709 12:28:10.858001  4536 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:10.851881  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:10.841233  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:10.862447  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:10.818714  3924 rpcz_store.cc:276] 0709 12:28:09.514828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.816992 (+1302164us) service_pool.cc:224] Handling call
0709 12:28:10.817246 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.818026 (+   780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.818206 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:10.780071  6766 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:10.850569  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:10.868867  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:10.870015  4000 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:28:10.872197  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:10.872288  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:10.791013  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:10.846697  6720 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:10.792831  6139 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.881971  4000 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:28:10.809048  6428 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:10.853938  6740 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.835915  6342 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:10.882176  4004 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:28:10.809906  6742 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:10.862119  6473 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.808486  6761 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:10.893173  4002 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 12:28:10.895001  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:10.904366  4567 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:10.872431  6688 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:10.871969  6766 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.909138  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:10.881559  6771 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.907291  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2186) took 1389 ms. Trace:
I20260709 12:28:10.883230  6679 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:28:10.914438  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 460663us
I20260709 12:28:10.915185  3821 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:10.860715  6641 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.910972  4002 rpcz_store.cc:276] 0709 12:28:09.517661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.881759 (+1364098us) service_pool.cc:224] Handling call
0709 12:28:10.890946 (+  9187us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:10.906920 (+ 15974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.907223 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:10.920547  4002 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:28:10.921319  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2187) took 1396 ms. Trace:
I20260709 12:28:10.921751  4002 rpcz_store.cc:276] 0709 12:28:09.525325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.916101 (+1390776us) service_pool.cc:224] Handling call
0709 12:28:10.920252 (+  4151us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:10.921050 (+   798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.921263 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:28:10.911541  6613 consensus_meta.cc:287] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.001s
I20260709 12:28:10.929821  3821 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:10.934021  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:10.935640  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:10.936700  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:10.958091  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 600583us
W20260709 12:28:10.918931  6773 log.cc:927] Time spent T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:28:10.960428  3852 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:10.963732  3969 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:10.961771  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1651) took 1457 ms. Trace:
I20260709 12:28:10.903083  6473 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.901232  6740 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:11.042203  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 49490.6us
I20260709 12:28:10.899858  6428 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.050383  6742 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:28:11.064409  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:10.929322  6688 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:10.960932  6761 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:10.862345  6767 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:10.918433  6771 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.912699  6213 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:10.967880  6741 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:11.100190  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:10.976054  6774 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:11.109157  4006 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:11.109629  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 766) took 1614 ms. Trace:
I20260709 12:28:11.068041  6778 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:11.111075  4570 rpcz_store.cc:276] 0709 12:28:09.495423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.644183 (+148760us) service_pool.cc:224] Handling call
0709 12:28:09.665473 (+ 21290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:09.790865 (+125392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:09.790910 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:09.843691 (+ 52781us) log.cc:844] Serialized 26 byte log entry
0709 12:28:10.341756 (+498065us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:10.341817 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.341931 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:11.109331 (+767400us) raft_consensus.cc:1685] finished
0709 12:28:11.109362 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.109550 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18771,"raft.queue_time_us":119716,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":8631,"thread_start_us":399233,"threads_started":2,"wal-append.queue_time_us":631363}
I20260709 12:28:11.086043  6742 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.055732  6613 consensus_queue.cc:1059] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 12:28:11.092339  6660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.057s	sys 0.110s
W20260709 12:28:11.115688  3932 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 1658) took 1609 ms (client timeout 2118 ms). Trace:
I20260709 12:28:11.129581  4565 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: []
W20260709 12:28:11.129241  3932 rpcz_store.cc:269] 0709 12:28:09.506605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.822635 (+316030us) service_pool.cc:224] Handling call
0709 12:28:11.115472 (+1292837us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540018cc54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:11.115609 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310969088}
I20260709 12:28:11.112231  4006 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:28:11.132234  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2188) took 1602 ms. Trace:
I20260709 12:28:11.132714  4006 rpcz_store.cc:276] 0709 12:28:09.546654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.111353 (+1564699us) service_pool.cc:224] Handling call
0709 12:28:11.111814 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:11.131849 (+ 20035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.132159 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:11.134052  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:11.134943  4006 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:11.135864  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.097378  6688 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:11.105597  6764 consensus_meta.cc:287] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.694s	user 0.007s	sys 0.008s
I20260709 12:28:11.138365  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 480) took 1588 ms. Trace:
I20260709 12:28:11.141111  3849 raft_consensus.cc:1240] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:11.144400  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:28:11.142567  6245 consensus_meta.cc:287] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.785s	user 0.009s	sys 0.007s
I20260709 12:28:11.141486  4006 rpcz_store.cc:276] 0709 12:28:09.560689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.136926 (+1576237us) service_pool.cc:224] Handling call
0709 12:28:11.137269 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.137478 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:11.137517 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.137577 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:11.137626 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.137695 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.137826 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:11.153541  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 478) took 1630 ms. Trace:
I20260709 12:28:11.154103  4006 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6. Ops: []
W20260709 12:28:11.155251  6790 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 12:28:11.151106  6245 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:11.128090  6728 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 1.624s	user 0.002s	sys 0.004s
I20260709 12:28:11.124789  6548 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.127092  6742 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:11.158526  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2190) took 1537 ms. Trace:
W20260709 12:28:11.152316  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 322541us
I20260709 12:28:11.155452  6766 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:11.140291  6688 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:11.172389  4006 rpcz_store.cc:276] 0709 12:28:09.620875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.153628 (+1532753us) service_pool.cc:224] Handling call
0709 12:28:11.153945 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.158297 (+  4352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.158475 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:11.128459  6660 raft_consensus.cc:697] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:11.177142  4006 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
W20260709 12:28:11.177820  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:11.181581  3897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.007s	sys 0.012s
W20260709 12:28:11.182003  3897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.007s	sys 0.012s
I20260709 12:28:11.182955  3971 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.181488  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.184746  4537 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:11.189285  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:11.190662  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.195587  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.126895  6778 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.201681  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.203218  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.207183  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:11.185043  6805 log.cc:927] Time spent T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 12:28:11.193195  6800 log.cc:927] Time spent T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.295s	user 0.001s	sys 0.001s
W20260709 12:28:11.186792  6784 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 12:28:11.218483  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.227552  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:11.228729  4572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 763) took 1734 ms (client timeout 1836 ms). Trace:
I20260709 12:28:11.229034  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.198563  6632 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:28:11.229333  4572 rpcz_store.cc:269] 0709 12:28:09.494522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.559025 (+ 64503us) service_pool.cc:224] Handling call
0709 12:28:11.227311 (+1668286us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b58000d5c98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056f9d0a0 00007fe056f9c984 00007fe0505176d4 00007fe050517662
0709 12:28:11.228643 (+  1332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78638976}
I20260709 12:28:11.185612  6637 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:11.232338  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.198802  6391 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:11.238404  6473 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:11.239389  3896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.008s	sys 0.003s
W20260709 12:28:11.239761  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:11.227041  6787 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 12:28:11.153645  6764 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.216154  6613 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:11.175761  6548 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:11.251557  3896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.008s	sys 0.003s
I20260709 12:28:11.252547  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 626) took 3662 ms. Trace:
I20260709 12:28:11.257154  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.228246  6641 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:11.260485  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:11.264156  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.257153  3930 rpcz_store.cc:276] 0709 12:28:07.590033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.590237 (+   204us) service_pool.cc:224] Handling call
0709 12:28:07.597733 (+  7496us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:07.972267 (+374534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:07.972325 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:08.071806 (+ 99481us) log.cc:844] Serialized 52 byte log entry
0709 12:28:09.412972 (+1341166us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:09.413019 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:09.413091 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:11.107404 (+1694313us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b240014b6b8. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ed709c4 00007fe04ed6eacb 00007fe04ef29dc9 00007fe04ef29a55 00007fe04ef2909d 00007fe051b5b10e 00007fe051b7288c 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221
0709 12:28:11.252186 (+144782us) raft_consensus.cc:1685] finished
0709 12:28:11.252217 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.252470 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2545,"raft.queue_time_us":48211,"raft.run_cpu_time_us":11343,"raft.run_wall_time_us":90870,"spinlock_wait_cycles":32492416,"thread_start_us":1666151,"threads_started":2,"wal-append.queue_time_us":1394508}
I20260709 12:28:11.259353  3852 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:11.269194  3970 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:11.269919  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.241809  6391 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.262095  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:11.240141  6673 consensus_meta.cc:287] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.908s	user 0.006s	sys 0.006s
I20260709 12:28:11.272121  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 479) took 1746 ms. Trace:
I20260709 12:28:11.273571  3970 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.226683  6760 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:28:11.280092  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:11.280679  6613 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:11.241425  6600 consensus_queue.cc:1059] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:28:11.280112  4002 rpcz_store.cc:276] 0709 12:28:09.525361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.922681 (+1397320us) service_pool.cc:224] Handling call
0709 12:28:10.942600 (+ 19919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.942890 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:11.168199 (+225309us) log.cc:844] Serialized 14 byte log entry
0709 12:28:11.271667 (+103468us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.271746 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:11.271805 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.271900 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.272049 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2118,"prepare.queue_time_us":161857,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":21580,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":4437,"thread_start_us":165249,"threads_started":3}
I20260709 12:28:11.289602  6778 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:11.285925  6813 log.cc:927] Time spent T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:28:11.293134  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 778) took 1053 ms. Trace:
I20260709 12:28:11.281674  6774 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:11.279615  6391 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:11.285436  6812 log.cc:927] Time spent T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:28:11.278434  6428 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:11.280957  6549 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:11.317140  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.333133  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.320632  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.321516  6740 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:11.291198  6819 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.139s	user 0.003s	sys 0.000s
I20260709 12:28:11.327984  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 708) took 3350 ms. Trace:
I20260709 12:28:11.341521  3857 rpcz_store.cc:276] 0709 12:28:07.977551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.007363 (+1029812us) service_pool.cc:224] Handling call
0709 12:28:09.007783 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:09.979026 (+971243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.327752 (+1348726us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54002ef254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:11.327924 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1830834560}
W20260709 12:28:11.307176  6671 consensus_meta.cc:287] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.716s	user 0.008s	sys 0.004s
I20260709 12:28:11.314052  4565 rpcz_store.cc:276] 0709 12:28:10.239438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.862441 (+623003us) service_pool.cc:224] Handling call
0709 12:28:10.862712 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.140353 (+277641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.292914 (+152561us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54004880d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:11.293077 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613240064}
I20260709 12:28:11.334004  3852 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:28:11.309746  6213 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:11.284657  6673 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:11.351516  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:11.315665  6771 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:11.363412  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:11.330948  6778 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.327245  6245 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:11.366468  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:11.342717  6680 consensus_meta.cc:287] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.002s
I20260709 12:28:11.368259  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:11.368850  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:11.371264  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.377671  3857 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
W20260709 12:28:11.350243  6752 consensus_meta.cc:287] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.877s	user 0.009s	sys 0.004s
W20260709 12:28:11.343837  6253 consensus_meta.cc:287] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.003s
I20260709 12:28:11.378432  3852 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:11.378484  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.383524  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.384332  4002 raft_consensus.cc:2393] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:11.385203  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:11.386276  6822 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:28:11.386498  3851 raft_consensus.cc:2368] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5.
I20260709 12:28:11.384800  6752 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.389918  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.286754  6660 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:11.382012  6818 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:28:11.395285  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.370805  6711 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:11.397022  3852 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:11.349594  6671 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:11.414783  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.416256  4002 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:11.398490  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:11.399654  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.419636  3928 raft_consensus.cc:1240] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4. Ops: []
W20260709 12:28:11.422132  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 67779us
I20260709 12:28:11.420980  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.375293  6778 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:11.424795  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.426538  4004 raft_consensus.cc:2393] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:28:11.421823  6620 consensus_meta.cc:287] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.003s
I20260709 12:28:11.418258  6740 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:11.429869  3924 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:11.430691  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:11.427347  6713 consensus_meta.cc:287] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.659s	user 0.012s	sys 0.000s
I20260709 12:28:11.428390  4002 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:11.431659  3852 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:11.437178  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.438747  6764 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:11.442520  6742 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:11.443240  4568 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
W20260709 12:28:11.443958  6754 consensus_meta.cc:287] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260709 12:28:11.444916  6754 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.445996  4573 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 2. Current term is 4. Ops: []
I20260709 12:28:11.445920  6673 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:11.446668  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.447321  4002 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
I20260709 12:28:11.445911  6742 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:11.448771  6754 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:11.450255  6765 consensus_meta.cc:287] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.003s
I20260709 12:28:11.451025  6765 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:11.450896  6688 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.453002  6688 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:11.450194  3852 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:11.454699  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:11.455343  6638 consensus_meta.cc:287] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.589s	user 0.006s	sys 0.002s
I20260709 12:28:11.431391  6548 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:11.455817  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:11.457103  6511 consensus_meta.cc:287] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.000s
I20260709 12:28:11.432397  6740 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:11.448639  6695 consensus_meta.cc:287] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.785s	user 0.007s	sys 0.003s
I20260709 12:28:11.458515  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:11.467339  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 122073us
I20260709 12:28:11.468226  3852 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 3.
W20260709 12:28:11.472445  3897 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.4:41095 timed out after 1.836s (SENT) [suppressed 14 similar messages]
I20260709 12:28:11.479528  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:11.479961  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 717) took 1145 ms. Trace:
I20260709 12:28:11.480485  3852 rpcz_store.cc:276] 0709 12:28:10.334595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.479121 (+1144526us) service_pool.cc:224] Handling call
0709 12:28:11.479442 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.479592 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:11.479623 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.479667 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:11.479701 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.479752 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.479891 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:11.488276  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 718) took 1153 ms. Trace:
I20260709 12:28:11.488703  3852 rpcz_store.cc:276] 0709 12:28:10.334908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.481959 (+1147051us) service_pool.cc:224] Handling call
0709 12:28:11.487741 (+  5782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.487928 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:11.487957 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.488001 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:11.488036 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.488104 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.488213 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:11.490422  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 719) took 1144 ms. Trace:
I20260709 12:28:11.490538  6752 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:11.490758  3852 rpcz_store.cc:276] 0709 12:28:10.346038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.489672 (+1143634us) service_pool.cc:224] Handling call
0709 12:28:11.489982 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.490149 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:11.490173 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.490210 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:11.490237 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.490286 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.490369 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:11.492355  6740 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:11.492471  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 721) took 1129 ms. Trace:
I20260709 12:28:11.492954  3852 rpcz_store.cc:276] 0709 12:28:10.363228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.491776 (+1128548us) service_pool.cc:224] Handling call
0709 12:28:11.492038 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.492197 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:11.492222 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.492259 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:11.492287 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.492333 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.492422 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:11.477756  6511 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.496384  6511 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:11.498456  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:11.498977  6391 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.499543  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:11.500561  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:11.501205  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 724) took 1094 ms. Trace:
I20260709 12:28:11.501502  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:11.468807  6638 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.504992  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:11.507222  3932 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:28:11.505437  3852 rpcz_store.cc:276] 0709 12:28:10.406698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.493869 (+1087171us) service_pool.cc:224] Handling call
0709 12:28:11.500725 (+  6856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.500901 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:11.500927 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.500968 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:11.500998 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.501052 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.501145 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:11.508625  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:11.509155  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 725) took 1024 ms. Trace:
I20260709 12:28:11.509550  3852 rpcz_store.cc:276] 0709 12:28:10.484372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.508445 (+1024073us) service_pool.cc:224] Handling call
0709 12:28:11.508712 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.508863 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:11.508887 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.508928 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:11.508957 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.509008 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.509104 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:11.513623  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:11.493829  6778 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:11.493093  6671 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:11.507051  6345 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:11.518415  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:11.518921  3932 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:28:11.517503  6345 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:11.522464  3850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1714) took 1802 ms (client timeout 2178 ms). Trace:
W20260709 12:28:11.522878  3850 rpcz_store.cc:269] 0709 12:28:09.719830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.971085 (+251255us) service_pool.cc:224] Handling call
0709 12:28:11.522281 (+1551196us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b5400063bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:11.522411 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898470144}
W20260709 12:28:11.525313  3851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1717) took 1804 ms (client timeout 2118 ms). Trace:
W20260709 12:28:11.525699  3851 rpcz_store.cc:269] 0709 12:28:09.720863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.879989 (+159126us) service_pool.cc:224] Handling call
0709 12:28:11.525139 (+1645150us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002ed954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:11.525259 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2836719360}
I20260709 12:28:11.526641  6638 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:11.526973  3851 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:28:11.530553  3969 leader_election.cc:400] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5.
I20260709 12:28:11.530857  3969 leader_election.cc:403] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:28:11.519447  6391 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:11.533460  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40038 (request call id 722) took 1161 ms. Trace:
I20260709 12:28:11.533752  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.533941  3848 rpcz_store.cc:276] 0709 12:28:10.371670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.448830 (+ 77160us) service_pool.cc:224] Handling call
0709 12:28:11.533292 (+1084462us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400018bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:11.533389 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244019072}
I20260709 12:28:11.534437  4571 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:28:11.534930  4571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 780) took 1256 ms. Trace:
I20260709 12:28:11.535211  3848 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:11.536345  6508 raft_consensus.cc:3055] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:11.536751  6508 raft_consensus.cc:740] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:11.537509  6508 consensus_queue.cc:260] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.535212  4571 rpcz_store.cc:276] 0709 12:28:10.278310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.462246 (+183936us) service_pool.cc:224] Handling call
0709 12:28:11.533593 (+1071347us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b58000d5c98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056f9d0a0 00007fe056f9c984 00007fe0505176d4 00007fe050517662
0709 12:28:11.534863 (+  1270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24324352}
I20260709 12:28:11.542786  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2191) took 3006 ms. Trace:
I20260709 12:28:11.543025  6508 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:11.543190  4005 rpcz_store.cc:276] 0709 12:28:08.536591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.805682 (+1269091us) service_pool.cc:224] Handling call
0709 12:28:09.827968 (+ 22286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:10.268435 (+440467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.268479 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:10.268956 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:28:10.788402 (+519446us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:28:10.788458 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.542414 (+753956us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54000f87d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:11.542461 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:11.542516 (+    55us) raft_consensus.cc:1685] finished
0709 12:28:11.542529 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.542729 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":718,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":16755,"spinlock_wait_cycles":1011970304,"thread_start_us":489452,"threads_started":1,"wal-append.queue_time_us":560851}
I20260709 12:28:11.545732  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 482) took 1352 ms. Trace:
I20260709 12:28:11.546254  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:11.547531  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 274020us
I20260709 12:28:11.546455  4003 rpcz_store.cc:276] 0709 12:28:10.192872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.205707 (+1012835us) service_pool.cc:224] Handling call
0709 12:28:11.205996 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.206230 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:11.227693 (+ 21463us) log.cc:844] Serialized 14 byte log entry
0709 12:28:11.545260 (+317567us) spinlock_profiling.cc:243] Waited 998 us on lock 0x7b18003d2400. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04ee64c0a 00007fe0585a4219 00007fe04eeeca40 00007fe04eee74e4 00007fe04eee7455 00007fe051fcf060 00007fe051fe1716 00007fe051ff2287 00007fe051ff2208
0709 12:28:11.545418 (+   158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.545469 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:11.545513 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.545572 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.545683 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2528,"prepare.queue_time_us":26691,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":274415,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":2295552,"thread_start_us":43571,"threads_started":1,"wal-append.queue_time_us":121269}
I20260709 12:28:11.549515  4568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 771) took 1098 ms. Trace:
I20260709 12:28:11.550107  6827 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:11.550577  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1722) took 1820 ms. Trace:
I20260709 12:28:11.550683  6345 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.551004  3849 rpcz_store.cc:276] 0709 12:28:09.730189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.613453 (+883264us) service_pool.cc:224] Handling call
0709 12:28:10.651216 (+ 37763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.143697 (+492481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.550376 (+406679us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400377dd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:11.550525 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126194048}
I20260709 12:28:11.549934  4568 rpcz_store.cc:276] 0709 12:28:10.451091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.771982 (+320891us) service_pool.cc:224] Handling call
0709 12:28:11.549361 (+777379us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b540052c454. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:11.549456 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268276608}
I20260709 12:28:11.545090  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.552508  4005 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:11.554220  6741 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:11.157804  4000 rpcz_store.cc:276] 0709 12:28:09.523342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.885733 (+1362391us) service_pool.cc:224] Handling call
0709 12:28:10.886148 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.886430 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:10.900592 (+ 14162us) log.cc:844] Serialized 14 byte log entry
0709 12:28:11.153045 (+252453us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.153130 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:11.153197 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.153294 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.153468 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135932,"prepare.queue_time_us":17181,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":1000,"spinlock_wait_cycles":5581184,"thread_start_us":251031,"threads_started":1,"wal-append.queue_time_us":251170}
I20260709 12:28:11.556548  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.553357  3849 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:11.557127  4000 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:11.559847  4574 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:28:11.559945  6797 consensus_queue.cc:1059] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:11.560320  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.556732  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.560895  6797 raft_consensus.cc:3055] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:11.561233  6797 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:11.561971  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:11.536338  3848 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:11.563144  3895 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.557802  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.567127  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.567549  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.563892  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:11.558840  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:11.568670  3895 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:11.569774  3849 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:11.558924  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.570585  4000 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:11.570188  3822 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.571502  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.572134  4000 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:11.572896  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:11.573375  4000 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:11.574198  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.575047  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:11.565613  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 485) took 1372 ms. Trace:
I20260709 12:28:11.548674  4003 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:11.576812  4002 rpcz_store.cc:276] 0709 12:28:10.193659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.447945 (+1254286us) service_pool.cc:224] Handling call
0709 12:28:11.448242 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.448441 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:11.449702 (+  1261us) log.cc:844] Serialized 14 byte log entry
0709 12:28:11.565375 (+115673us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.565424 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:11.565456 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.565498 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.565572 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55179,"prepare.queue_time_us":854,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":55311,"thread_start_us":60089,"threads_started":1,"wal-append.queue_time_us":70371}
I20260709 12:28:11.574872  6740 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:11.582356  6673 consensus_queue.cc:1059] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:11.575165  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.585636  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:11.570187  3895 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:11.587469  4569 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:28:11.588182  3895 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:11.588414  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 486) took 1394 ms. Trace:
I20260709 12:28:11.588819  4003 rpcz_store.cc:276] 0709 12:28:10.199484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.548232 (+1348748us) service_pool.cc:224] Handling call
0709 12:28:11.548499 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.588198 (+ 39699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.588362 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:11.589454  3895 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:11.589975  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.590802  4003 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:11.591933  3895 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.592113  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.593209  4003 raft_consensus.cc:2410] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:28:11.594175  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.595093  4003 raft_consensus.cc:2393] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 4: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:11.597277  3895 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:11.597831  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:11.598683  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:11.600660  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:11.600878  3895 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.601418  4003 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:28:11.601509  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 726) took 1104 ms. Trace:
I20260709 12:28:11.602123  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 487) took 1369 ms. Trace:
I20260709 12:28:11.602597  4003 rpcz_store.cc:276] 0709 12:28:10.232603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.600896 (+1368293us) service_pool.cc:224] Handling call
0709 12:28:11.601216 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:11.601895 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.602076 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:11.604302  3895 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.601931  3852 rpcz_store.cc:276] 0709 12:28:10.497330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.510509 (+1013179us) service_pool.cc:224] Handling call
0709 12:28:11.510767 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.510956 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:28:11.514647 (+  3691us) log.cc:844] Serialized 14 byte log entry
0709 12:28:11.601204 (+ 86557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.601253 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:11.601291 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.601350 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.601455 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9353,"prepare.queue_time_us":3754,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"thread_start_us":76811,"threads_started":1}
I20260709 12:28:11.606725  4003 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:11.584594  6660 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:11.608506  3821 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.609853  3895 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:11.609071  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 727) took 1092 ms. Trace:
I20260709 12:28:11.583168  6688 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:11.591302  6740 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:11.612762  3850 rpcz_store.cc:276] 0709 12:28:10.517099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.523677 (+1006578us) service_pool.cc:224] Handling call
0709 12:28:11.523959 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.524143 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:11.524403 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 12:28:11.608793 (+ 84390us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.608837 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:11.608876 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.608932 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.609022 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1769,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":1965,"thread_start_us":84097,"threads_started":1}
I20260709 12:28:11.614964  3821 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:11.584018  6345 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:11.596395  6752 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:11.626658  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.603077  6695 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:28:11.627450  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:11.605918  6620 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:11.600843  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.612197  6660 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:11.629066  6345 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:11.613487  6637 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:11.603268  6691 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:11.629824  6774 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:11.587399  6797 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:11.613408  6428 consensus_queue.cc:1059] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:28:11.645337  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:11.634606  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:11.641975  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.625471  6740 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:11.668051  6740 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:11.643885  6345 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.668829  6345 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:11.668902  6741 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5.
I20260709 12:28:11.627781  6752 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:11.670184  6752 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:11.671180  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:11.631384  6620 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:11.667572  6672 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:11.667935  6573 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:11.666319  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:11.665505  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:11.665398  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.630466  6695 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:11.678961  3897 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:11.680343  3932 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:11.680729  4000 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:11.610633  6808 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:11.613659  6807 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:11.682322  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.682739  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.683192  4003 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:11.685854  4565 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:11.683652  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:11.644358  6660 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:11.686902  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:11.688517  3932 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:11.686017  4000 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:11.675482  6620 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:11.696774  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 86990.7us
I20260709 12:28:11.683981  6695 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:11.698379  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:11.699668  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:11.700686  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:11.684796  6808 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.702356  6808 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:11.707568  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:11.709201  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:11.685045  6807 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:11.711541  6807 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:11.712437  6672 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:11.690378  6797 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:11.717303  6767 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:11.721972  6825 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:11.722707  6825 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.723232  6825 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:11.701654  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:11.731050  3822 leader_election.cc:336] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.652s (SENT)
I20260709 12:28:11.731711  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:11.732767  6345 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:11.734162  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.734879  4566 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
W20260709 12:28:11.735399  4566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 777) took 1499 ms (client timeout 1725 ms). Trace:
I20260709 12:28:11.731707  3822 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:11.738247  6492 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:11.739343  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:11.740290  3822 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.743125  6497 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:28:11.735829  4566 rpcz_store.cc:269] 0709 12:28:10.235866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.434561 (+198695us) service_pool.cc:224] Handling call
0709 12:28:11.733991 (+1299430us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b58000d5c98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056f9d0a0 00007fe056f9c984 00007fe0505176d4 00007fe050517662
0709 12:28:11.735335 (+  1344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91119360}
I20260709 12:28:11.746639  6656 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:11.747368  6656 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:11.747691  6656 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:11.748062  6656 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:11.750074  6637 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:11.752247  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2223) took 1481 ms. Trace:
I20260709 12:28:11.754485  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 714) took 3168 ms. Trace:
I20260709 12:28:11.754966  3855 rpcz_store.cc:276] 0709 12:28:08.585821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.557427 (+971606us) service_pool.cc:224] Handling call
0709 12:28:09.557709 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:09.825320 (+267611us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:10.275403 (+450083us) log.cc:844] Serialized 14 byte log entry
0709 12:28:10.434320 (+158917us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.434445 (+   125us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:10.434572 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.754199 (+1319627us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b5400019ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:11.754261 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.754413 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":289649,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":12780,"raft.queue_time_us":7929,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":614790400,"thread_start_us":588191,"threads_started":2,"wal-append.queue_time_us":629421}
I20260709 12:28:11.757247  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:11.758004  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.757730  6656 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.758909  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 663) took 1185 ms. Trace:
I20260709 12:28:11.759311  3928 rpcz_store.cc:276] 0709 12:28:10.573029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.894587 (+321558us) service_pool.cc:224] Handling call
0709 12:28:10.912050 (+ 17463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.420024 (+507974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.758640 (+338616us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b5400076f54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:11.758844 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163794816}
I20260709 12:28:11.760097  6656 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:11.761102  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1654) took 2255 ms. Trace:
I20260709 12:28:11.692788  4000 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:11.695729  3932 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
W20260709 12:28:11.761363  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 82450.3us
I20260709 12:28:11.672925  6774 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.675671  6573 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:11.678336  6428 consensus_queue.cc:1243] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:28:11.762337  3822 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.762369  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:11.761459  3923 rpcz_store.cc:276] 0709 12:28:09.505379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.811542 (+1306163us) service_pool.cc:224] Handling call
0709 12:28:10.811867 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.121814 (+309947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:11.121863 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.121960 (+    97us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:11.122020 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.760848 (+638828us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54003061d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:11.760919 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.761053 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15500,"raft.queue_time_us":532,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":15818,"spinlock_wait_cycles":711891712}
I20260709 12:28:11.763581  3897 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:11.768306  3923 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: [6.7-7.8]
I20260709 12:28:11.768697  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.769374  4567 raft_consensus.cc:2368] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7.
I20260709 12:28:11.752769  3925 rpcz_store.cc:276] 0709 12:28:10.270671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.839632 (+568961us) service_pool.cc:224] Handling call
0709 12:28:10.839924 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.929275 (+ 89351us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:28:11.052096 (+122821us) log.cc:844] Serialized 14 byte log entry
0709 12:28:11.175318 (+123222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:11.175365 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:11.175402 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.290615 (+115213us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:11.751918 (+461303us) spinlock_profiling.cc:243] Waited 89 ms on lock 0x7b54002364d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:11.751991 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.752171 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11945,"prepare.queue_time_us":111824,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":20144,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":24115,"spinlock_wait_cycles":210583552,"thread_start_us":104176,"threads_started":1,"wal-append.queue_time_us":98468}
I20260709 12:28:11.765908  6841 consensus_queue.cc:1059] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:11.772071  3822 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.773787  3821 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:11.778036  3822 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.776099  3932 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:11.776218  3999 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:11.781111  3999 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:28:11.781543  3999 pending_rounds.cc:85] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 4
I20260709 12:28:11.781824  3999 pending_rounds.cc:107] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:28:11.782148  3999 raft_consensus.cc:2889] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:11.784101  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 707) took 3822 ms. Trace:
I20260709 12:28:11.784415  3897 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:11.784477  3853 rpcz_store.cc:276] 0709 12:28:07.961620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.635312 (+673692us) service_pool.cc:224] Handling call
0709 12:28:08.649501 (+ 14189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:09.443852 (+794351us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:09.799518 (+355666us) log.cc:844] Serialized 14 byte log entry
0709 12:28:10.460714 (+661196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.460766 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:10.460813 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.783874 (+1323061us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b5400190fd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:11.783929 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.784047 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":610712,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":91244,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":1826145536,"thread_start_us":997720,"threads_started":2,"wal-append.queue_time_us":766425,"wal-append.run_cpu_time_us":1052,"wal-append.run_wall_time_us":1001268}
I20260709 12:28:11.787851  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 781) took 1508 ms. Trace:
I20260709 12:28:11.785638  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:11.788286  4573 rpcz_store.cc:276] 0709 12:28:10.279072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.880968 (+601896us) service_pool.cc:224] Handling call
0709 12:28:10.881384 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.446559 (+565175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.787649 (+341090us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54006f1dd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:11.787796 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298009984}
I20260709 12:28:11.767117  6774 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:11.790942  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:11.793301  3822 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.774771  6428 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:11.783456  6605 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:11.794981  6767 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:28:11.811800  6767 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:11.814549  6691 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:11.815258  6620 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.816254  6752 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:11.796943  6641 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:11.818334  6641 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.818723  6641 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:11.818909  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:10.974025  3929 rpcz_store.cc:276] 0709 12:28:09.504424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.531999 (+1027575us) service_pool.cc:224] Handling call
0709 12:28:10.556006 (+ 24007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.556194 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:10.670330 (+114136us) log.cc:844] Serialized 14 byte log entry
0709 12:28:10.961419 (+291089us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.961480 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:10.961524 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.961590 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.961709 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36629,"prepare.queue_time_us":233250,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":42554,"thread_start_us":336815,"threads_started":2}
I20260709 12:28:11.819621  3853 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:28:11.783078  6497 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:28:11.790441  6672 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:11.803490  6811 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.649s	user 0.003s	sys 0.000s
I20260709 12:28:11.807305  6746 raft_consensus.cc:3055] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:28:11.834770  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 43906.6us
I20260709 12:28:11.835723  3897 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:11.808064  6692 raft_consensus.cc:3055] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:11.809851  3857 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:11.787945  6637 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:28:11.794435  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.820837  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.866714  3925 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:11.821594  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.788591  6711 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:11.790230  6673 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:11.824215  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.832617  4002 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:11.838912  6620 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:11.838981  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.879283  3849 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:11.870059  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:11.822413  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.870795  3851 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:11.873135  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.876912  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.877781  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 474) took 2499 ms. Trace:
I20260709 12:28:11.881729  3997 rpcz_store.cc:276] 0709 12:28:09.378530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.005068 (+626538us) service_pool.cc:224] Handling call
0709 12:28:10.071901 (+ 66833us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:10.410094 (+338193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.877519 (+1467425us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400365bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:11.877717 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580944640}
I20260709 12:28:11.826246  6492 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:11.898275  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.898384  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.899874  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.900151  3852 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 4: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:11.834458  6332 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:11.834561  6746 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:11.897768  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:11.902624  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.913412  3850 raft_consensus.cc:2376] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6. Re-sending same reply.
I20260709 12:28:11.913765  3852 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:11.914480  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.903697  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:11.915560  3851 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:11.916550  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:11.867347  6692 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:11.920653  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 715) took 3331 ms. Trace:
W20260709 12:28:11.904392  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 117943us
W20260709 12:28:11.904561  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 111325us
I20260709 12:28:11.865907  6691 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:11.874665  6723 raft_consensus.cc:3055] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:11.911041  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:11.927423  3849 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:11.868335  6638 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.928825  3969 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.930364  3969 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.921212  3856 rpcz_store.cc:276] 0709 12:28:08.589664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.171971 (+1582307us) service_pool.cc:224] Handling call
0709 12:28:10.172259 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.321651 (+149392us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:10.331462 (+  9811us) log.cc:844] Serialized 14 byte log entry
0709 12:28:10.763029 (+431567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.763078 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:10.763130 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.920416 (+1157286us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54003778d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:11.920469 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.920592 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28733,"prepare.queue_time_us":11758,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":65378,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":343003520,"thread_start_us":431011,"threads_started":2,"wal-append.queue_time_us":482135,"wal-append.run_cpu_time_us":1053,"wal-append.run_wall_time_us":1007383}
I20260709 12:28:11.931834  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.923055  3822 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.934314  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:11.936367  3850 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:11.936926  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.938535  3969 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.939821  6671 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:11.941592  3969 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.940325  6797 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:28:11.947547  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 79187.6us
I20260709 12:28:11.924446  4568 raft_consensus.cc:2393] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:11.947742  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1712) took 2293 ms. Trace:
I20260709 12:28:11.907087  6673 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:11.950589  3854 rpcz_store.cc:276] 0709 12:28:09.654265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.200290 (+546025us) service_pool.cc:224] Handling call
0709 12:28:10.230834 (+ 30544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.312102 (+ 81268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.312149 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.312206 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:10.312250 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.947499 (+1635249us) spinlock_profiling.cc:243] Waited 81 ms on lock 0x7b5400064ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:11.947555 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.947668 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186313984}
I20260709 12:28:11.951241  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:11.950096  3969 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:11.957948  3969 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:11.927074  6723 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:11.916972  6332 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.977231  6801 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:11.977591  6332 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:11.978157  6332 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:11.962879  6613 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:11.981096  6844 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:28:11.985709  6771 raft_consensus.cc:3055] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:11.986285  6771 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:11.987433  6771 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.989079  6771 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:11.948734  6752 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:11.959829  4001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:46292
I20260709 12:28:11.994463  4001 raft_consensus.cc:606] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:11.995034  4001 raft_consensus.cc:614] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:11.962373  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:11.941510  6793 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:11.947741  6828 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:28:11.964771  3822 leader_election.cc:336] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.772s (SENT)
I20260709 12:28:11.965219  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:11.962442  6348 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:11.962561  6656 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.963580  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:11.974069  6846 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:11.974509  4566 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:11.974131  6711 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:11.975024  3856 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:11.975167  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:12.023387  3997 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 4: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:11.975167  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:11.959429  3969 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:28:12.023557  3926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2226) took 1750 ms (client timeout 2227 ms). Trace:
I20260709 12:28:11.973754  3851 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:12.024834  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:11.926525  6766 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:28:11.996335  4573 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:12.000272  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:11.952382  6671 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:28:12.011090  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 46353.2us
I20260709 12:28:11.943463  6638 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:11.990319  6845 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.037778  3851 raft_consensus.cc:2393] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:28:12.038272  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 89626.4us
I20260709 12:28:12.038491  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:12.038863  3970 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.022063  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:12.039187  4537 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:11.991518  3849 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:11.959918  6740 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.025470  3853 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:12.025511  3931 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:28:12.042060  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 82684.5us
I20260709 12:28:12.042856  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:12.009797  6793 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:12.032055  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:12.022178  6656 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.047734  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:12.019567  3999 raft_consensus.cc:2393] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 3: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:12.011922  6672 raft_consensus.cc:3055] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:11.947690  6797 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:12.024279  3926 rpcz_store.cc:269] 0709 12:28:10.273096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.301855 (+ 28759us) service_pool.cc:224] Handling call
0709 12:28:12.023325 (+1721470us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b5400196ed4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:12.023481 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116008192}
I20260709 12:28:12.040866  4567 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:28:12.029968  6731 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:12.052430  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2191) took 2405 ms. Trace:
I20260709 12:28:12.052956  3822 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:12.053193  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 469) took 2690 ms. Trace:
I20260709 12:28:12.053574  3998 rpcz_store.cc:276] 0709 12:28:09.362561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.946123 (+583562us) service_pool.cc:224] Handling call
0709 12:28:10.841844 (+895721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:10.842065 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.842097 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.842143 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:10.842178 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.842238 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:12.053045 (+1210807us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b540007f8d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:12.053143 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000452480}
I20260709 12:28:12.054245  3822 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.044255  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:12.034273  4005 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:11.977825  6801 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:11.963991  6807 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.052848  4006 rpcz_store.cc:276] 0709 12:28:09.647835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.174998 (+1527163us) service_pool.cc:224] Handling call
0709 12:28:11.175357 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.181556 (+  6199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:12.052211 (+870655us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b5400022bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:12.052372 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3694976}
I20260709 12:28:11.957407  6746 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.016399  6620 consensus_queue.cc:1059] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:28:12.036418  6637 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.049794  6562 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:12.071981  3929 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:12.050094  6793 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:12.076999  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:12.079807  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:12.080615  3997 raft_consensus.cc:2393] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 4: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:12.072919  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:12.081969  3857 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:12.055006  6797 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:12.073287  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:12.063057  6846 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:12.073904  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:12.078832  4002 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:28:12.064011  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:12.073792  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:12.085829  4002 pending_rounds.cc:85] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 7
I20260709 12:28:12.068230  6497 consensus_queue.cc:1059] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:28:12.084168  6684 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:12.055325  6754 consensus_queue.cc:1059] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:28:12.071756  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:12.077471  6549 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:12.071624  6849 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:12.067925  6605 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:12.068172  6786 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:12.058714  6348 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:11.994212  6692 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.086778  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:12.071197  6428 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:28:12.082297  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 43518.3us
I20260709 12:28:12.051162  6672 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:12.083206  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:12.046731  6845 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.100068  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:12.110545  3849 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:12.066093  3822 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:12.111712  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 45693.2us
I20260709 12:28:12.086192  4002 pending_rounds.cc:107] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.8
I20260709 12:28:12.107832  6428 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:12.112519  4002 raft_consensus.cc:2917] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Aborting config change with OpId 6.8: Aborted: Op aborted by new leader
I20260709 12:28:12.112880  6428 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:12.113135  4002 raft_consensus.cc:2889] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:12.113757  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36508 (request call id 85) took 5722 ms. Trace:
I20260709 12:28:12.114089  4002 rpcz_store.cc:276] 0709 12:28:06.391271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:06.391562 (+   291us) service_pool.cc:224] Handling call
0709 12:28:06.474492 (+ 82930us) log.cc:844] Serialized 487 byte log entry
0709 12:28:12.113691 (+5639199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32589,"raft.queue_time_us":42086,"raft.run_cpu_time_us":1414,"raft.run_wall_time_us":62866,"thread_start_us":139959,"threads_started":1,"wal-append.queue_time_us":392804,"wal-append.run_cpu_time_us":1750,"wal-append.run_wall_time_us":1005141}
I20260709 12:28:12.114686  6672 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.078087  6637 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.106246  6849 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.121284  6842 raft_consensus.cc:3055] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:12.077720  6492 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:28:12.115870  6672 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:12.084663  6562 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:12.107471  3923 raft_consensus.cc:2393] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 4: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:12.109321  3998 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:12.074215  6808 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.119297  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.121675  6842 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:12.100368  3897 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.062117  6673 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.100179  6549 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.102545  6852 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:12.132786  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:12.103993  6786 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:28:12.124166  6843 log.cc:927] Time spent T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:28:12.134755  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.130534  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.121831  6637 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.140978  6786 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.132948  6549 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:12.142242  6786 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:12.146184  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:12.133378  6691 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:12.147588  3923 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:12.148180  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:12.148547  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:12.149329  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:12.151152  6613 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:12.068548  6723 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.152055  3851 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:28:12.154110  6845 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.154770  3822 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:12.170775  6637 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:12.171195  6637 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.171239  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.171686  6637 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:12.172521  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:12.155073  3852 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:12.149700  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:12.174106  6213 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:12.174889  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:12.175720  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:12.176074  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:12.176411  3924 raft_consensus.cc:2393] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:12.176680  3923 raft_consensus.cc:1813] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:12.125916  6348 raft_consensus.cc:697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:12.177338  3923 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 4: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:12.122903  6848 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:28:12.158574  3928 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:28:12.159562  6808 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.160491  6801 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.160682  6562 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.160879  6695 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.124675  6605 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:12.138443  3849 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:12.161593  6656 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:12.177397  6745 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:12.190688  6745 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.162032  3821 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:12.165544  3970 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:12.191494  6745 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:12.191296  6641 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.193156  3970 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:12.169253  6841 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:12.193941  6613 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:12.194072  6740 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.133378  6778 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:12.190644  3822 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:12.180939  3998 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:12.184542  3923 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:12.127182  6573 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.181571  6774 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:12.122514  3741 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 95a53a95fd9f44e59c1b1615b9281948 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 12:28:12.189898  4536 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:12.190726  6656 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:12.122654  6688 raft_consensus.cc:3055] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:12.195139  3855 raft_consensus.cc:2368] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8.
I20260709 12:28:12.194805  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:12.164084  6852 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:12.195498  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.193620  6641 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.177872  6849 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:12.184396  6848 consensus_queue.cc:1243] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Peer f3cab225ecb7488386a1a19239498cfe log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:28:12.203378  3854 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:12.188862  6605 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.185070  6771 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:12.198290  6857 consensus_queue.cc:1059] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:28:12.227680  6857 raft_consensus.cc:3055] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:12.228082  6857 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:12.205798  3932 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:12.226569  6774 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:12.231115  6573 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.196955  6613 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:12.234938  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2213) took 1341 ms. Trace:
W20260709 12:28:12.235168  6825 consensus_meta.cc:287] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.003s
I20260709 12:28:12.235354  4004 rpcz_store.cc:276] 0709 12:28:10.893161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.893414 (+   253us) service_pool.cc:224] Handling call
0709 12:28:12.234732 (+1341318us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b540032ad54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:12.234879 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185502464}
I20260709 12:28:12.235728  6825 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.236311  3969 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:12.237062  3930 raft_consensus.cc:2393] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:12.238322  4001 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:12.209774  6656 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.239388  6656 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:12.240231  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 488) took 1419 ms. Trace:
I20260709 12:28:12.240500  6637 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.240618  4003 rpcz_store.cc:276] 0709 12:28:10.820735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.608282 (+787547us) service_pool.cc:224] Handling call
0709 12:28:11.683061 (+ 74779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.687058 (+  3997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:12.240048 (+552990us) spinlock_profiling.cc:243] Waited 74.5 ms on lock 0x7b540036e550. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:12.240177 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171393792}
I20260709 12:28:12.209599  6688 raft_consensus.cc:740] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:12.242080  6613 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:12.242667  6613 raft_consensus.cc:697] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:12.208940  6842 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.244036  6842 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:12.243655  6613 consensus_queue.cc:237] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.212435  6660 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.248703  6660 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.251037  6695 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.250947  6549 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.256083  6638 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:12.256816  6615 raft_consensus.cc:3055] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:12.257236  6615 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:12.237545  3969 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:12.218564  6473 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:12.258121  6615 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.259687  6615 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:12.213987  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:12.216495  3848 raft_consensus.cc:2393] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 4: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:28:12.260878  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 47045.8us
I20260709 12:28:12.261660  3970 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:12.180692  6428 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.263156  6741 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:12.262810  6852 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.205380  3857 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:12.226055  6641 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:12.186403  6348 consensus_queue.cc:237] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.209246  6391 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:12.226539  6605 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:12.269716  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:12.270306  4001 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:12.274799  3971 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.276052  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:12.228121  6807 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.259948  6786 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:12.217275  6860 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:28:12.208544  3741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 86233.2us
I20260709 12:28:12.267045  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:12.229137  6857 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.263999  6741 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:12.310719  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:12.304790  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:12.319448  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 50436.9us
W20260709 12:28:12.320063  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:12.322738  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 126137us
I20260709 12:28:12.323102  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:12.323541  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:12.324851  4006 raft_consensus.cc:2376] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6. Re-sending same reply.
I20260709 12:28:12.281718  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:12.329785  6391 raft_consensus.cc:697] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:28:12.330030  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:12.335649  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 201707us
I20260709 12:28:12.328998  4004 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:12.328718  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 138153us
I20260709 12:28:12.337193  3897 leader_election.cc:400] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7.
I20260709 12:28:12.337505  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.333235  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:12.338294  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 55380.8us
I20260709 12:28:12.338583  3850 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 8: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:12.337512  3897 leader_election.cc:403] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:12.332155  3848 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:12.339809  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.320380  6573 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:12.287129  4001 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:12.341287  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:12.351722  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:12.343144  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:12.339988  3897 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.354784  3850 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:12.325919  6786 raft_consensus.cc:697] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:12.356916  6825 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:12.356652  6786 consensus_queue.cc:237] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.343101  6638 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:28:12.358145  3848 raft_consensus.cc:2368] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4.
I20260709 12:28:12.343050  6684 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:12.361627  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:12.366278  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.367681  4001 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:28:12.369127  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:12.369700  4001 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:12.370882  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:12.372299  4001 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 8: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:12.372907  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:12.373788  4004 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:12.379184  4006 raft_consensus.cc:2393] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 5: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:12.330394  6860 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:12.343144  6672 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7.
W20260709 12:28:12.380316  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.343879  6428 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.343266  6673 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:12.362740  6660 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:12.399648  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1640) took 4431 ms. Trace:
I20260709 12:28:12.403239  3931 rpcz_store.cc:276] 0709 12:28:07.967868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.448450 (+2480582us) service_pool.cc:224] Handling call
0709 12:28:12.025217 (+1576767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:12.042339 (+ 17122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:12.395093 (+352754us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b5400196ed0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:12.399579 (+  4486us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3625446272}
W20260709 12:28:12.391769  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 52007.5us
I20260709 12:28:12.392812  6857 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:12.406024  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:12.426613  3822 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:12.436857  3850 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
W20260709 12:28:12.440797  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.393813  6862 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:12.444161  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 47411.2us
I20260709 12:28:12.448815  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.439774  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:12.445725  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:12.453236  3897 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:12.453137  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:12.398154  6793 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.446836  3822 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:12.412704  6673 raft_consensus.cc:697] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:12.455364  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:12.456478  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:12.448550  6641 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:12.439440  6854 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:12.402033  6745 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.473047  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:12.473443  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:12.475162  3897 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:12.446667  6672 consensus_queue.cc:1059] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:28:12.448019  6695 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:12.477481  6695 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.488307  6859 consensus_queue.cc:1059] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:28:12.470854  6671 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.489220  6859 raft_consensus.cc:3055] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:12.489324  6695 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.489742  6859 raft_consensus.cc:740] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:12.479461  6825 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:12.490352  6767 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:12.490664  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 659) took 1927 ms. Trace:
I20260709 12:28:12.490772  6767 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.490942  6583 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:12.491416  6767 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:12.491291  3927 rpcz_store.cc:276] 0709 12:28:10.563346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.854076 (+290730us) service_pool.cc:224] Handling call
0709 12:28:10.854501 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:10.855022 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.855067 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:10.866222 (+ 11155us) log.cc:844] Serialized 26 byte log entry
0709 12:28:11.146481 (+280259us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:12.394024 (+1247543us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b1800079c60. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe051b7f4bc 00007fe04eecd48b 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee7455 00007fe0559cf3c7 00007fe051fe19a7 00007fe051ff10bf
0709 12:28:12.394187 (+   163us) log.cc:844] Serialized 14 byte log entry
0709 12:28:12.490302 (+ 96115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:12.490385 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:12.490423 (+    38us) raft_consensus.cc:1685] finished
0709 12:28:12.490495 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:12.490610 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29013,"prepare.queue_time_us":74353,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":225,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":9050,"spinlock_wait_cycles":11026304,"thread_start_us":414011,"threads_started":3,"wal-append.queue_time_us":371389,"wal-append.run_cpu_time_us":1861,"wal-append.run_wall_time_us":1047002}
I20260709 12:28:12.461705  6852 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:28:12.486090  6849 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:12.495119  6849 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:12.495942  6849 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.497093  6849 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:12.490518  6825 raft_consensus.cc:697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:12.498713  6825 consensus_queue.cc:237] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.502136  6673 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:12.503151  6858 log.cc:927] Time spent T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:28:12.405241  6863 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:28:12.489481  6671 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.470690  6641 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:12.455004  6807 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:12.451908  6637 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:12.525969  4001 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:28:12.478008  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:12.471259  6428 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:12.545606  3851 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:12.505821  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:12.551605  6671 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.552423  6641 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.572371  6656 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.573767  6731 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:12.574276  6731 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:12.574620  6656 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:12.546144  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:12.578401  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 670) took 1295 ms. Trace:
I20260709 12:28:12.578655  3852 raft_consensus.cc:2393] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:12.578768  3928 rpcz_store.cc:276] 0709 12:28:11.283492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.771898 (+488406us) service_pool.cc:224] Handling call
0709 12:28:11.787777 (+ 15879us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:12.179795 (+392018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:12.578152 (+398357us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54002378d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:12.578342 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852112768}
I20260709 12:28:12.490654  6859 consensus_queue.cc:260] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.580166  6859 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:12.454722  6797 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.455053  6391 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.555128  6793 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.539644  6860 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.474936  6549 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:12.559803  6741 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:12.582875  6863 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:12.483541  6821 consensus_queue.cc:1059] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 12:28:12.506310  6854 raft_consensus.cc:697] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:12.569622  6745 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.585551  3850 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:12.587231  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:28:12.613335  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.587930  4568 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
W20260709 12:28:12.564832  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 86889.9us
I20260709 12:28:12.614749  6473 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:12.633445  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:12.634931  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:12.641134  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:12.644095  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.644946  4538 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:12.620862  6863 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:12.648032  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.649607  6880 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:12.650833  6583 raft_consensus.cc:3055] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:12.651248  6583 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:12.655478  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:12.652053  6583 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.673113  6854 consensus_queue.cc:237] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.656436  3928 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:28:12.655308  6863 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:12.645730  6673 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:12.652947  6821 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:12.678156  6872 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:12.695348  3857 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:12.693408  6583 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:12.708033  6473 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:12.708642  6473 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.707789  6740 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.711011  6473 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.711303  6740 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.713650  6740 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:12.714358  6876 log.cc:927] Time spent T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:28:12.696738  6673 raft_consensus.cc:697] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:12.714562  6660 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:12.715786  6673 consensus_queue.cc:237] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.718389  3857 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4. Ops: []
W20260709 12:28:12.718813  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.721344  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:12.723428  4001 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:12.696797  6821 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.735569  6797 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.737010  6345 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:12.737774  6874 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:28:12.740787  6731 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:12.750376  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 58512.1us
I20260709 12:28:12.753532  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:12.757711  4538 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:12.757205  6723 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:12.758805  4001 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:12.758586  6863 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.760902  6863 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.763751  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:12.763450  6797 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:12.773798  6767 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.776196  6767 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.777185  6307 raft_consensus.cc:3055] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:12.777608  6307 raft_consensus.cc:740] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:12.778419  6307 consensus_queue.cc:260] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.779609  6307 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:12.780259  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.784634  6605 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:12.630463  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:12.787031  6605 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:12.787495  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:12.789693  6821 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:12.789999  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:12.790688  4568 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:12.791149  6692 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:12.794394  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:12.794879  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:12.795195  4571 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:12.795468  3923 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:12.796108  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:12.796451  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:12.794610  3969 leader_election.cc:400] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8.
I20260709 12:28:12.797052  3969 leader_election.cc:403] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:28:12.797597  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:12.797906  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 678) took 1207 ms. Trace:
I20260709 12:28:12.798269  3932 rpcz_store.cc:276] 0709 12:28:11.590816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.779570 (+188754us) service_pool.cc:224] Handling call
0709 12:28:11.794773 (+ 15203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:12.229661 (+434888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:12.797674 (+568013us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54002e2f54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:12.797823 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944676736}
I20260709 12:28:12.798688  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:12.799223  3931 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:12.800537  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:12.796991  3925 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:12.803630  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:12.804608  3927 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:12.805708  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:12.806222  3925 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:12.806919  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:12.807379  3923 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:12.808714  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:12.809525  4566 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:12.811187  6511 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:12.811710  6511 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:12.811779  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:12.812570  6511 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.813196  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:12.814267  4566 raft_consensus.cc:2410] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:28:12.815816  4570 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:28:12.816797  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.817425  3895 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:12.818607  3895 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.802767  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:12.819532  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:12.820618  3821 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:12.821527  3821 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:12.822175  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:12.822767  4572 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:12.823525  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:12.825094  3971 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.826212  3895 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:12.828547  4568 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:12.832746  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:12.833233  4001 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:12.840387  3895 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:12.841749  4001 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:12.849946  3895 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.854424  3925 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:12.855008  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:12.855249  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:12.855700  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:12.863169  3821 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:12.827395  6705 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:12.869109  3931 raft_consensus.cc:2410] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:28:12.869943  3895 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:12.915635  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.869277  6473 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:12.827795  6391 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:12.924269  4574 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:12.924876  6583 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:12.925840  6583 raft_consensus.cc:3055] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:12.926225  6583 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:12.926335  6878 log.cc:927] Time spent T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
W20260709 12:28:12.931407  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 61556.3us
I20260709 12:28:12.934456  3895 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.936695  3923 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:12.838904  6492 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:12.938140  3821 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:12.869652  6332 raft_consensus.cc:2764] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:28:12.939581  6660 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:12.869424  6741 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:28:12.839135  6863 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:12.847222  6641 consensus_queue.cc:1059] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:28:12.869408  6767 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:12.827730  6605 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:12.909294  6745 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:12.940987  3895 leader_election.cc:400] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4.
I20260709 12:28:12.968001  3923 raft_consensus.cc:1240] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:28:12.970407  3895 leader_election.cc:403] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:12.856981  6821 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:12.851581  6849 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:12.846145  6859 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:12.973224  3895 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.940709  6492 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.870291  6848 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.941152  6766 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:12.856051  6615 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.982867  3895 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.989143  3895 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:12.950703  6771 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:12.974280  6740 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:28:12.961192  6863 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.969399  6605 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.773804  6797 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:12.991184  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.981328  6821 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:12.978533  6428 consensus_queue.cc:1059] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:28:12.992338  6848 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.945114  6583 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.987006  6492 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:12.995266  6660 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:12.986253  6745 raft_consensus.cc:697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:12.986769  6825 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:12.984804  6754 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.012146  6821 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:12.994338  6695 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:13.024493  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:13.025271  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:13.025924  6715 raft_consensus.cc:3055] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:13.026716  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:13.015666  6428 consensus_queue.cc:1243] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:28:13.030874  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:13.031010  3999 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:28:13.031973  4006 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:28:13.034132  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:13.037297  6848 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.038741  6656 raft_consensus.cc:3055] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:13.038672  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:12.994743  6863 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:13.187530  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 148946us
I20260709 12:28:13.156788  6307 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.125742  6825 raft_consensus.cc:697] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:13.010802  6771 raft_consensus.cc:697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:13.173995  3854 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:12.994539  6615 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.125617  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:13.162636  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 68700us
W20260709 12:28:13.159271  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 76720us
I20260709 12:28:13.125162  4004 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:13.047109  6705 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8.
I20260709 12:28:13.216012  6705 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.216755  6705 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.125264  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 679) took 1527 ms. Trace:
I20260709 12:28:13.218196  3929 rpcz_store.cc:276] 0709 12:28:11.597511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.819991 (+222480us) service_pool.cc:224] Handling call
0709 12:28:11.821714 (+  1723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:12.078376 (+256662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:13.124460 (+1046084us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54002e1b54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:13.125176 (+   716us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572260736}
I20260709 12:28:13.179896  6473 consensus_queue.cc:1059] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:28:13.060796  6754 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:12.996047  6605 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:13.046212  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:13.160775  6715 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:13.048218  6807 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.141s
I20260709 12:28:13.189625  6656 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:13.179739  6741 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.189013  3897 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:13.233587  6767 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:13.255211  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 66284.2us
I20260709 12:28:13.259666  6705 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.251487  6632 raft_consensus.cc:3055] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:13.265152  6688 consensus_queue.cc:260] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:13.261077  6660 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:13.274600  6656 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:13.276403  6615 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:13.277304  6740 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 3. Current term is 4.
I20260709 12:28:13.198627  6745 consensus_queue.cc:237] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:13.282882  6797 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.197441  6307 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.276970  6771 consensus_queue.cc:237] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:13.326121  3932 raft_consensus.cc:1240] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:13.327104  3925 raft_consensus.cc:1240] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:13.330431  3927 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:28:13.334792  3927 pending_rounds.cc:85] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 5
I20260709 12:28:13.335036  3927 pending_rounds.cc:107] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:28:13.335263  3927 raft_consensus.cc:2889] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:13.330451  3928 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:13.338513  3925 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:13.287559  6632 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:13.304584  6660 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.348619  6549 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.257179  6741 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.304662  6848 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:13.314007  6766 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:13.282155  6825 consensus_queue.cc:237] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.263082  6807 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:28:13.262095  6715 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.347285  6660 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:13.366360  6848 raft_consensus.cc:697] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:13.367282  6848 consensus_queue.cc:237] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.370688  6731 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:13.371119  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:13.371508  6741 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.371737  4570 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:28:13.373906  6492 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:13.374969  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2161) took 1015 ms. Trace:
I20260709 12:28:13.376602  6807 raft_consensus.cc:3055] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:13.377068  6807 raft_consensus.cc:740] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:13.378095  6807 consensus_queue.cc:260] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.379521  6807 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:13.382179  3852 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:28:13.375819  6492 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:13.375445  3853 rpcz_store.cc:276] 0709 12:28:12.359185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:12.413401 (+ 54216us) service_pool.cc:224] Handling call
0709 12:28:13.374723 (+961322us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54002ed954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:13.374889 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249007360}
I20260709 12:28:13.373651  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:13.386277  3971 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:13.387111  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:13.388123  4567 raft_consensus.cc:2410] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:28:13.348788  3925 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:13.332796  6767 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:13.341645  6656 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:13.342394  3929 raft_consensus.cc:1240] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:13.356580  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:13.344096  6688 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:13.359930  3927 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:13.391109  3923 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:13.350067  6859 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:13.352342  6797 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:13.403980  3850 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:13.408290  3895 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:13.408396  3741 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 95a53a95fd9f44e59c1b1615b9281948 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 34711da9380944d2969a2bc3e203db3d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:28:13.410241  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 207119us
I20260709 12:28:13.411372  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:13.411912  3970 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:13.396227  6794 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:13.357259  6549 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:13.417820  3970 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:13.409754  6766 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.412611  6847 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:13.399634  6767 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.415721  6794 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.403069  6860 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:28:13.406502  6859 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.402611  6348 consensus_queue.cc:1059] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:28:13.422864  6705 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:13.407716  6797 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.457219  6797 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.458489  6473 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:13.460901  6549 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:13.443023  6794 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:13.399020  6632 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.470952  6632 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:13.413143  6615 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:28:13.449158  6859 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.450821  6605 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.454627  6705 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:13.461582  6549 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.431991  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:13.438956  6766 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:13.502477  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 70583.4us
I20260709 12:28:13.510924  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:13.508345  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:13.487416  6754 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:13.517704  6767 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.518019  6660 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.520510  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:13.486263  6741 consensus_queue.cc:1175] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f3cab225ecb7488386a1a19239498cfe" responder_term: 6 status { last_received { term: 6 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 6 index: 9 } }
W20260709 12:28:13.522531  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:13.509382  6746 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:13.531805  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:13.532764  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 206642us
I20260709 12:28:13.534160  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:13.536034  4001 raft_consensus.cc:2393] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 4: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:13.534706  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 189870us
I20260709 12:28:13.536126  4536 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:13.537401  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:13.537693  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:13.538034  3999 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:13.538231  4003 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:13.539568  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:13.540091  3999 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:13.540927  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:13.541836  4002 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:13.511955  6894 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:13.546577  3928 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:13.550776  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:13.551564  3925 raft_consensus.cc:1813] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:13.552115  3925 raft_consensus.cc:2368] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4.
I20260709 12:28:13.554438  3932 raft_consensus.cc:1275] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:13.500768  6549 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.559229  6900 consensus_queue.cc:1059] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:13.527387  6307 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:13.560312  3927 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
W20260709 12:28:13.566732  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:13.561158  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:13.508729  6821 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:13.572469  4003 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:13.568255  3927 pending_rounds.cc:85] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 3
I20260709 12:28:13.573577  3927 pending_rounds.cc:107] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:28:13.573822  3927 raft_consensus.cc:2889] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:13.569674  4005 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:13.575582  4006 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:13.581998  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:13.596164  3999 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:13.599884  3999 raft_consensus.cc:1240] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:13.604492  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:13.605304  4006 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:13.615811  4003 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:13.615646  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:13.617496  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:13.618243  4006 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:13.622143  4005 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:13.625725  6549 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.627305  6511 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:13.629626  6391 raft_consensus.cc:3055] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:13.630946  6307 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:13.631042  6615 consensus_queue.cc:1059] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:13.638206  6605 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.562203  6315 consensus_queue.cc:1059] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:28:13.614725  6894 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.615023  6705 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.652410  6391 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:13.686101  6711 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.686686  6711 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.690960  6766 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.692706  6821 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:13.661871  6894 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.692109  6794 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.695785  6894 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.685603  6863 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:13.698276  6794 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.701320  6863 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:13.731711  3851 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
W20260709 12:28:13.733276  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:13.735072  3929 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:13.746770  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:13.748390  3849 raft_consensus.cc:2368] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:28:13.750512  3929 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:13.752781  3924 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:13.755966  3895 leader_election.cc:400] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:28:13.760820  4004 raft_consensus.cc:2368] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4.
W20260709 12:28:13.764380  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:13.792659  3895 leader_election.cc:403] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:28:13.775442  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 208750us
W20260709 12:28:13.777238  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 241050us
I20260709 12:28:13.777683  6307 raft_consensus.cc:697] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:28:13.778192  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 221041us
I20260709 12:28:13.779953  6315 raft_consensus.cc:3055] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:13.779865  6391 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.781396  6428 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:13.642446  6213 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:28:13.785302  6345 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:13.771801  3970 leader_election.cc:400] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4.
I20260709 12:28:13.801853  3970 leader_election.cc:403] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:13.798556  6428 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.803879  6688 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:13.805968  6688 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:13.806849  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 53235.9us
I20260709 12:28:13.807356  6848 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:28:13.661798  6705 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:13.809166  6688 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.810825  6821 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.811048  6705 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:13.811765  6786 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.811637  6821 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:13.812729  6786 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.816710  6786 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.817049  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:13.817953  3924 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:13.820225  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:13.821045  3928 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:28:13.821592  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2163) took 1377 ms. Trace:
W20260709 12:28:13.822187  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:13.822074  3852 rpcz_store.cc:276] 0709 12:28:12.443768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:12.609668 (+165900us) service_pool.cc:224] Handling call
0709 12:28:13.381962 (+772294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:13.382580 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:13.821107 (+438527us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b5400019fd0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:13.821354 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769263488}
I20260709 12:28:13.811781  6428 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.826066  6863 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:13.826509  6771 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:13.827332  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:13.831105  6893 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.831965  6893 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:13.835222  6766 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:13.835723  6849 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.836012  6766 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:13.836475  6849 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:13.840397  6794 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:13.842322  6894 consensus_queue.cc:1048] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:13.842820  6863 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:13.844030  6863 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.845225  6861 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:13.846298  6861 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.846885  6901 consensus_queue.cc:1059] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:13.848361  6901 consensus_queue.cc:1059] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:13.848752  6861 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.850210  6911 raft_consensus.cc:3055] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:13.850601  6911 raft_consensus.cc:740] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:13.851217  6688 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.851955  6911 consensus_queue.cc:260] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.852152  6688 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.853479  6911 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:13.831284  6915 log.cc:927] Time spent T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.127s	user 0.000s	sys 0.002s
I20260709 12:28:13.845243  4536 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:13.796252  6315 raft_consensus.cc:740] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:13.879992  6688 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.880777  6473 raft_consensus.cc:3055] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:13.881389  6473 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:13.882951  6315 consensus_queue.cc:260] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.885123  6315 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:13.893741  3925 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:13.898419  6754 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:13.899120  6754 raft_consensus.cc:697] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:13.900668  6754 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.902889  6391 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:13.903501  6910 consensus_queue.cc:1059] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:13.904088  4538 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:13.905004  6856 consensus_queue.cc:1059] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:13.906250  6345 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.911146  6307 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.916342  6673 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:13.917507  6673 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:13.922861  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 151504us
I20260709 12:28:13.909381  6345 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.936074  3924 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:13.937255  6910 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:28:13.942385  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:13.943843  6863 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.944077  6847 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.920573  6673 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:13.954849  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:13.805639  6807 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.140s
I20260709 12:28:13.937826  6910 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:13.962525  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 117530us
W20260709 12:28:13.963616  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 128503us
I20260709 12:28:13.969645  3822 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:13.971118  6492 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:13.938524  6794 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.972460  6794 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:13.973917  6900 raft_consensus.cc:3055] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:13.974380  6900 raft_consensus.cc:740] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:13.975013  6794 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:13.971591  6910 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:13.976964  6473 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:13.978044  6821 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:13.978636  6893 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:13.951201  6705 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:28:13.994400  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:13.995513  4005 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 4: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:13.996285  6872 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:13.996826  6872 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.997184  6872 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:13.944890  6847 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:13.981947  6902 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.423s	user 0.004s	sys 0.000s
W20260709 12:28:13.983438  6908 log.cc:927] Time spent T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.313s	user 0.002s	sys 0.005s
W20260709 12:28:13.985342  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:14.004036  6615 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:28:13.986171  6913 log.cc:927] Time spent T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.004s
W20260709 12:28:14.008035  6918 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 12:28:13.990671  6903 log.cc:927] Time spent T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.312s	user 0.007s	sys 0.000s
I20260709 12:28:14.013746  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.014930  3925 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:14.017109  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 62395.6us
I20260709 12:28:14.022089  6583 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:14.030448  6896 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:14.031224  6896 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.034353  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:14.035246  4005 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:14.036814  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 82796.1us
I20260709 12:28:14.037351  6711 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:13.975633  6900 consensus_queue.cc:260] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.043433  6473 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:14.043807  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.044548  3852 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:14.044853  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1749) took 1003 ms. Trace:
I20260709 12:28:14.047694  4006 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:28:14.048291  3999 raft_consensus.cc:1240] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:14.049309  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:14.049922  6711 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.045225  3851 rpcz_store.cc:276] 0709 12:28:13.041340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:13.041982 (+   642us) service_pool.cc:224] Handling call
0709 12:28:13.042253 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:13.733109 (+690856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:14.044584 (+311475us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54002a30d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:14.044783 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583976832}
I20260709 12:28:14.050021  4006 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:14.050421  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.050757  6711 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.030133  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.058357  6711 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:14.051853  3856 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:14.061231  3895 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.060706  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:14.065333  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 52897.9us
I20260709 12:28:14.068661  3854 raft_consensus.cc:2410] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:28:14.068172  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 87418.3us
W20260709 12:28:14.073277  3969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.028s	sys 0.038s
W20260709 12:28:14.073686  3969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.029s	sys 0.039s
I20260709 12:28:14.076776  3849 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:28:14.078006  6632 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:14.078771  6632 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.080229  4006 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:14.080994  6632 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:14.082639  6924 consensus_queue.cc:1059] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:28:14.083673  6930 consensus_queue.cc:1059] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:14.085484  6847 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:14.086045  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.086169  6901 raft_consensus.cc:3055] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:14.086714  6901 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:14.086755  3853 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
W20260709 12:28:14.088465  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:14.088063  6901 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:14.089342  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 117766us
I20260709 12:28:14.069826  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.090641  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.068727  6821 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:14.098481  3851 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:14.098661  6723 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.099855  6797 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:14.096912  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:14.100430  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:14.100641  6797 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.101224  4565 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:14.102625  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:14.104312  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.099447  6723 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.104950  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.105608  6797 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:14.105779  3929 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:14.106419  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.107182  3930 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:14.107467  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:14.107878  3927 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:14.108426  4569 raft_consensus.cc:2393] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:14.108836  6821 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.108973  6911 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.109361  6821 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:14.109647  6911 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.108248  6893 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:14.111189  6893 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.111955  6849 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:14.104971  3925 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:14.124936  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:14.125322  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:14.127243  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:14.130177  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:14.130472  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.131616  3848 raft_consensus.cc:2410] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:28:14.109689  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:14.131994  3822 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:14.132423  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.133176  3848 raft_consensus.cc:2393] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:14.132011  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.134093  3855 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:14.134490  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.135182  3851 raft_consensus.cc:1813] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:14.135640  3851 raft_consensus.cc:2368] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4.
I20260709 12:28:14.137501  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.099856  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:14.138266  3856 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:28:14.134526  6900 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:14.140101  3852 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:14.140241  6797 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:14.140938  6797 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.141258  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:14.139376  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.139312  3897 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:14.142572  6315 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:14.142855  6901 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:14.144374  3897 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:14.144870  6910 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.146006  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:14.132987  6863 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:14.146329  6849 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:14.146785  6723 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:14.147671  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.148051  3851 raft_consensus.cc:2410] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:28:14.148770  6893 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:14.146742  3848 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:14.154709  4005 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:14.159878  3928 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:14.165216  3931 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:28:14.164351  6847 raft_consensus.cc:2764] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:28:14.168031  4568 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:14.168884  6899 raft_consensus.cc:3055] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:14.169368  6899 raft_consensus.cc:740] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:14.169729  3822 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.170758  6863 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:14.171347  6863 raft_consensus.cc:697] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:14.172550  6863 consensus_queue.cc:237] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.174705  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.176786  6673 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:14.177382  6673 raft_consensus.cc:697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:14.178454  6673 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.179294  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.111997  6911 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:14.191215  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.165033  4565 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:14.196135  6910 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:14.198102  6766 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:14.195413  6899 consensus_queue.cc:260] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.199237  3851 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:14.200341  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.206745  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.204250  6893 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.211194  6766 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.211651  6893 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.213096  6797 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:14.214674  6899 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:14.215598  6492 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:14.215782  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.216253  6492 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.217069  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.211853  6766 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.218400  6492 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:14.219642  6766 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:14.224180  6705 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4.
W20260709 12:28:14.226033  6656 consensus_meta.cc:287] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.831s	user 0.004s	sys 0.014s
W20260709 12:28:14.226143  4568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 793) took 1389 ms (client timeout 1573 ms). Trace:
W20260709 12:28:14.226766  4568 rpcz_store.cc:269] 0709 12:28:12.836890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:14.099244 (+1262354us) service_pool.cc:224] Handling call
0709 12:28:14.225872 (+126628us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b5400512054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:14.226068 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58150656}
I20260709 12:28:14.213517  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.224282  3895 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.235343  4536 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:14.241480  3895 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.247754  3895 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.248725  3895 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.249611  3821 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.256672  3928 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:28:14.241396  6911 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:14.242551  6847 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:14.266301  6428 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:14.266825  6428 raft_consensus.cc:697] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:14.267627  6715 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:14.267860  6428 consensus_queue.cc:237] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.270123  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.270444  6332 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.270895  3926 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:14.271167  6332 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.274013  6928 consensus_queue.cc:1059] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:28:14.274904  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:14.275111  6928 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.275627  6928 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.276031  6925 raft_consensus.cc:3055] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:14.276430  6925 raft_consensus.cc:740] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:14.277658  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:14.277381  6925 consensus_queue.cc:260] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.279035  6925 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:14.279631  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:14.279868  4572 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:14.280833  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:14.281296  6711 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:14.281421  4570 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:28:14.282506  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:14.283114  4567 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:14.245257  6656 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:14.287879  6914 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.419s	user 0.004s	sys 0.000s
I20260709 12:28:14.290062  6786 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.290699  6786 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.291175  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:14.291977  6928 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:14.293013  6786 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:14.294942  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.295756  3849 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:14.296370  3999 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:28:14.259975  6583 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:28:14.297765  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 90005.2us
I20260709 12:28:14.298059  6583 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.258625  6849 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:28:14.298498  6583 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:14.298621  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.300693  3822 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.255496  6848 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:14.301473  6848 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:14.301867  6848 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:14.286688  6924 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.302517  6924 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.304284  3856 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:28:14.304903  4006 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:14.304987  6893 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:14.294994  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:14.286192  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 43957.5us
I20260709 12:28:14.286212  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:14.314244  3848 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:14.260360  6766 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:14.264406  6911 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.265975  6847 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:14.286509  6656 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:14.325403  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:14.313508  6688 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:14.262868  6807 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.304921  6924 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:14.333788  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:14.324642  6797 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.339465  6797 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.340312  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:14.341053  3998 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
W20260709 12:28:14.341953  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:14.342262  6741 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.342828  6741 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.343809  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.344923  6741 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:14.345045  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.329308  6771 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:28:14.345736  3849 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:14.346750  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.349756  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.349923  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.350922  3927 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 4: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:14.351442  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.351608  6746 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.352290  6746 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.352558  6688 raft_consensus.cc:697] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:14.352962  4565 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:14.353655  6688 consensus_queue.cc:237] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.354120  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.355410  6656 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:14.318434  6766 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.328433  6911 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:14.339866  6605 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:14.349117  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.345765  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.343900  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:14.343357  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:14.367156  3895 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.364537  3821 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.332249  6847 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:14.391819  3822 leader_election.cc:400] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4.
I20260709 12:28:14.393958  3822 leader_election.cc:403] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:28:14.341670  6797 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:14.392700  3821 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:14.410991  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 67732.8us
I20260709 12:28:14.413460  3999 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:28:14.413383  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:14.404215  6492 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:14.368078  6766 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:14.419365  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:14.420799  3926 raft_consensus.cc:1275] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:28:14.329557  6821 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.422470  3971 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:14.423437  4567 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:14.427711  3821 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.426848  4000 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:28:14.410611  6893 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:14.405049  6924 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:14.450382  6924 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.453254  6924 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:14.421761  6492 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.456139  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:14.456218  3971 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:14.419312  6605 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:14.464167  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:14.449429  3851 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:14.460548  6797 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:14.460634  3998 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:14.460927  6859 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:14.439389  6794 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:14.427552  6673 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4.
I20260709 12:28:14.454226  6741 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:14.467871  4568 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:28:14.405149  6872 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.461253  6861 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:14.461311  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:14.445962  6893 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.459672  6492 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:14.498816  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:14.499074  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:14.459703  4566 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:14.507581  4572 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:14.508467  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:14.444222  6807 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.501636  6797 raft_consensus.cc:697] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:14.542683  4000 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:14.499955  6771 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:14.544341  6771 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.545910  6332 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:14.548062  3998 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:14.554293  6660 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:14.492170  6741 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.514745  4003 raft_consensus.cc:1240] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:14.515214  4570 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:14.514640  6605 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.515550  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:14.564874  4569 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:28:14.516215  4574 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:14.518657  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:14.566588  4004 raft_consensus.cc:2368] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:28:14.499564  6861 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.520481  6848 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.521653  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.509770  6746 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:14.522866  6688 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:14.579452  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:14.524286  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:14.501899  6859 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.525810  6854 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:14.526283  6786 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.527698  6583 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.529922  3932 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
W20260709 12:28:14.552307  6936 log.cc:927] Time spent T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:28:14.506682  6893 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:14.573587  3925 raft_consensus.cc:2393] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:14.575155  6660 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.565305  4001 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
W20260709 12:28:14.576826  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 185135us
I20260709 12:28:14.565269  4569 pending_rounds.cc:85] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 7
I20260709 12:28:14.579450  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:14.573715  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 150086us
I20260709 12:28:14.581651  6771 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:14.513824  6899 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.586038  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:14.587251  6213 raft_consensus.cc:3055] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:14.573318  6741 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:14.596906  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:14.577860  6861 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:14.598089  4003 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:14.626778  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.598455  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:14.605135  4570 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:14.533109  6797 consensus_queue.cc:237] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.612332  3821 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.615011  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:14.637817  4000 raft_consensus.cc:2410] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:28:14.619196  4538 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:14.622588  4568 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:14.610724  4569 pending_rounds.cc:107] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:28:14.638823  4569 raft_consensus.cc:2889] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:14.590698  6854 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:14.641741  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:14.602886  6673 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:14.647311  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.649611  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.639815  4538 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:14.641196  3999 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:14.595511  6746 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:14.644469  4001 raft_consensus.cc:2410] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:28:14.651451  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:14.653702  4573 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:14.653859  6767 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.652236  4003 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:14.654671  6767 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.654057  6754 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:14.658716  6754 raft_consensus.cc:697] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:14.659888  6754 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.661127  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:14.661999  4003 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:14.662070  6771 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:14.662541  6771 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:14.662943  6771 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:14.647946  3927 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:14.651536  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:14.667867  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:14.621807  6213 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:14.672972  4002 raft_consensus.cc:2393] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:14.610167  6688 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.624086  6925 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:28:14.646644  6315 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:28:14.673936  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 280776us
I20260709 12:28:14.646492  6854 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:14.651350  6632 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.652035  6821 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:14.685542  6315 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.648659  6715 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 12:28:14.711469  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 65561.6us
I20260709 12:28:14.648350  6899 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:14.713241  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 98550.3us
I20260709 12:28:14.682394  6767 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:14.714663  3970 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:14.690845  6315 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:14.672686  6786 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.666128  6660 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.736176  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.680017  6746 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.699110  6863 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:14.740788  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.743253  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.693064  6632 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.744328  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.678736  6896 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:14.743765  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:14.695291  6332 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:14.748733  6942 log.cc:927] Time spent T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:28:14.748880  3857 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:28:14.781564  3857 pending_rounds.cc:85] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 7
I20260709 12:28:14.781906  3857 pending_rounds.cc:107] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:28:14.782142  3857 raft_consensus.cc:2889] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:14.752229  6939 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:28:14.754344  6848 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:14.756758  6660 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:14.758654  6938 log.cc:927] Time spent T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:28:14.758297  6911 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.759229  6950 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:14.761564  6899 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:14.725608  6872 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:14.774701  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 44517us
I20260709 12:28:14.724478  6656 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:14.777827  3856 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:14.767426  3969 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:14.782920  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 68331.2us
I20260709 12:28:14.694119  6428 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:28:14.687414  6673 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.789862  6332 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.790511  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:14.790958  3930 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:14.712181  6944 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:28:14.736413  6473 consensus_queue.cc:1059] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:28:14.800020  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:14.785272  6863 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:14.811414  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.808012  3970 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:14.815177  4567 raft_consensus.cc:2368] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
I20260709 12:28:14.817099  3851 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 3.
I20260709 12:28:14.804791  6896 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:14.822669  3927 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:14.808347  6583 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:14.868397  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:14.872814  3928 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:14.826081  6896 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.864516  6807 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:14.876375  6941 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:28:14.877987  6923 raft_consensus.cc:3055] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:14.864128  6660 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:14.878551  6923 raft_consensus.cc:740] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:14.879045  6660 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.879740  6923 consensus_queue.cc:260] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.881102  6923 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:14.815177  6847 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.898411  6847 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:14.903738  6766 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:14.797425  6213 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.906508  6863 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:14.907712  6896 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:14.910280  6746 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:14.911235  3926 raft_consensus.cc:2393] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:14.957371  6950 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:14.969656  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:14.968237  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 160308us
I20260709 12:28:14.986728  3851 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:14.981732  6920 log.cc:927] Time spent T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.945s	user 0.000s	sys 0.005s
I20260709 12:28:14.973418  6854 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.028244  6854 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:15.023856  6940 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.527s	user 0.002s	sys 0.000s
I20260709 12:28:14.974697  6794 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.958194  3927 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:28:14.928469  6951 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:15.030211  6794 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:15.059580  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:15.063108  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:15.063900  3925 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:15.065366  3932 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:28:15.069001  6922 log.cc:927] Time spent T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 1.131s	user 0.000s	sys 0.009s
I20260709 12:28:15.070971  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1691) took 1318 ms. Trace:
I20260709 12:28:15.071345  3923 rpcz_store.cc:276] 0709 12:28:13.752712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:13.823345 (+ 70633us) service_pool.cc:224] Handling call
0709 12:28:13.823932 (+   587us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:13.824537 (+   605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:13.824575 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:13.825253 (+   678us) log.cc:844] Serialized 52 byte log entry
0709 12:28:13.924626 (+ 99373us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:13.946940 (+ 22314us) log.cc:844] Serialized 14 byte log entry
0709 12:28:13.957992 (+ 11052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:13.958211 (+   219us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:15.068045 (+1109834us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:15.070558 (+  2513us) raft_consensus.cc:1685] finished
0709 12:28:15.070656 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:15.070795 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10681,"prepare.queue_time_us":15532,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":16842,"raft.run_cpu_time_us":458,"raft.run_wall_time_us":459,"spinlock_wait_cycles":5025152,"thread_start_us":69878,"threads_started":1,"wal-append.queue_time_us":111579}
I20260709 12:28:14.952792  6492 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.077221  6492 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:15.078377  3850 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:14.918937  6307 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:14.844667  6656 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.084102  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:15.065447  3925 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
W20260709 12:28:15.276409  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 545387us
I20260709 12:28:15.356518  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:15.357523  6793 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:28:15.302342  6945 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.009s	sys 0.004s
I20260709 12:28:15.300674  3996 tablet_service.cc:1558] Processing DeleteTablet for tablet eadf6ff4956f47ff8a85f77d02584a0d with delete_type TABLET_DATA_TOMBSTONED (TS 34711da9380944d2969a2bc3e203db3d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36508
I20260709 12:28:15.179720  3848 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:15.164418  3971 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:15.125483  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:15.358541  6945 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.009s	sys 0.004s
W20260709 12:28:15.358922  6473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.001s	sys 0.013s
I20260709 12:28:15.359201  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:15.359341  6332 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:15.360517  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:15.354940  3925 pending_rounds.cc:85] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 7
I20260709 12:28:15.381037  3925 pending_rounds.cc:107] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:28:15.381089  3849 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:15.381307  3925 raft_consensus.cc:2889] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:15.355559  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 271579us
I20260709 12:28:15.359567  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:15.382237  3927 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:15.382959  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:15.374117  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 396695us
I20260709 12:28:15.379639  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:15.215216  6741 consensus_meta.cc:287] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.001s
I20260709 12:28:15.294878  6213 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:15.189648  6911 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:15.385952  3852 raft_consensus.cc:2393] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:28:15.362980  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 198675us
W20260709 12:28:15.396872  3856 consensus_meta.cc:287] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.004s
I20260709 12:28:15.397213  3856 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
W20260709 12:28:15.380023  6711 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.007s	sys 0.008s
I20260709 12:28:15.355623  6786 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:15.256476  6673 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:15.385388  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 510) took 1060 ms. Trace:
I20260709 12:28:15.299255  3754 catalog_manager.cc:5697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 4 to 5, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 5 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.355952  6632 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:15.379570  6473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.002s	sys 0.013s
I20260709 12:28:15.391872  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:15.391784  6688 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:15.367175  6956 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:15.448014  6956 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.448422  6956 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:15.373522  6793 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:15.450104  6793 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:15.450680  6793 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:15.453130  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:15.404270  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 45173.3us
I20260709 12:28:15.453784  3925 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:15.454818  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:15.455878  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:15.078362  6771 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:15.456585  3928 raft_consensus.cc:2393] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:15.438499  4005 rpcz_store.cc:276] 0709 12:28:14.319493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:14.319638 (+   145us) service_pool.cc:224] Handling call
0709 12:28:14.350772 (+ 31134us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:14.351302 (+   530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:14.351330 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:14.351946 (+   616us) log.cc:844] Serialized 52 byte log entry
0709 12:28:14.388689 (+ 36743us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:14.388729 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:14.388789 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:14.983235 (+594446us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:15.366706 (+383471us) raft_consensus.cc:1685] finished
0709 12:28:15.366728 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:15.379357 (+ 12629us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":324609,"raft.queue_time_us":11762,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":38947,"spinlock_wait_cycles":5811456,"thread_start_us":36320,"threads_started":1,"wal-append.queue_time_us":86669}
I20260709 12:28:15.410802  3999 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:15.404322  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:15.459434  4000 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:14.964883  6315 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.404974  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:15.382709  6849 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:15.384752  6893 consensus_meta.cc:287] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.760s	user 0.007s	sys 0.004s
I20260709 12:28:15.404402  6954 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:15.383888  6715 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.404534  6950 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:15.435531  3741 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 95a53a95fd9f44e59c1b1615b9281948 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 34711da9380944d2969a2bc3e203db3d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:15.436192  6935 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.436630  6923 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.437444  6966 consensus_queue.cc:1059] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:15.381650  3851 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
W20260709 12:28:15.447595  6861 consensus_meta.cc:287] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.781s	user 0.014s	sys 0.003s
I20260709 12:28:15.462532  6807 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.410228  6656 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:15.411129  6847 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.410961  6583 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.414867  6766 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:15.440896  6605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.007s	sys 0.015s
W20260709 12:28:15.441056  6767 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.015s	sys 0.008s
I20260709 12:28:15.413674  6660 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:15.467012  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:15.511111  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:15.511278  3927 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
W20260709 12:28:15.468025  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 69669.9us
I20260709 12:28:15.414327  6951 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:15.474071  3848 raft_consensus.cc:2393] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:15.475733  3931 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:15.393818  6741 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.515960  6315 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:15.516909  6741 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:15.394263  6307 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.521436  6307 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:15.477330  3969 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:15.446756  3754 catalog_manager.cc:5697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 1 to 4, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 4 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:28:15.543398  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 66220.7us
I20260709 12:28:15.543143  3754 catalog_manager.cc:5697] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 6 to 7, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 7 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:15.544519  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:15.498858  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:15.545822  6911 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.546489  6911 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.501009  6849 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.507194  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:15.550043  3928 raft_consensus.cc:2393] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:15.550220  6911 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:15.511798  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:15.551082  6911 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:15.510644  6605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.008s	sys 0.016s
I20260709 12:28:15.551900  6911 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:15.510828  6767 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.015s	sys 0.008s
I20260709 12:28:15.476029  6715 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.515141  3931 raft_consensus.cc:1275] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:15.478142  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:15.522269  4567 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:15.477669  6950 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.554291  3926 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:15.555276  4006 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:15.555856  6950 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:15.470293  6893 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:15.558089  6315 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.558610  6315 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.559628  6893 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:15.529560  6307 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.560488  6307 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.561655  6315 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:15.562996  6307 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:15.530174  6771 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:15.530646  6966 raft_consensus.cc:3055] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:15.498922  6923 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.567842  6923 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:15.505766  6807 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:15.570377  6807 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:15.571264  6793 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.574230  4006 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
W20260709 12:28:15.578208  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 75928.3us
I20260709 12:28:15.532157  6705 raft_consensus.cc:3055] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:15.485850  6935 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:15.533485  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 148842us
I20260709 12:28:15.534981  6583 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.499326  6859 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:15.509199  6847 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:15.524255  6951 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:15.467110  6332 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.503432  6786 consensus_queue.cc:1059] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:28:15.545186  3754 catalog_manager.cc:5697] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 4 to 6, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 6 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:15.598310  6741 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:15.649053  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:15.656747  3932 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:15.657728  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:15.582998  3897 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:15.600946  3822 leader_election.cc:400] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
W20260709 12:28:15.637633  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 93297.3us
I20260709 12:28:15.660496  3822 leader_election.cc:403] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:28:15.660997  3969 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:15.638892  3895 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:15.662002  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:15.662633  3856 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:28:15.655471  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:15.663498  4000 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
W20260709 12:28:15.667335  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 84410.3us
I20260709 12:28:15.748935  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:15.750084  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:15.861325  3848 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:15.778412  3754 catalog_manager.cc:5697] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.810379  3927 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:15.863508  3851 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:15.590188  6705 raft_consensus.cc:740] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:15.573501  6911 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:15.603276  6793 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:15.669176  6821 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:15.875958  3754 catalog_manager.cc:5697] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 1 to 2, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 2 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:15.835508  6893 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:28:15.878623  3755 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51802 (request call id 333) took 21602 ms (client timeout 15000 ms). Trace:
I20260709 12:28:15.877945  3754 catalog_manager.cc:5697] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 1 to 2, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 2 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:15.881115  6863 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
W20260709 12:28:15.879070  3755 rpcz_store.cc:269] 0709 12:27:53.878047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:53.878289 (+   242us) service_pool.cc:224] Handling call
0709 12:27:55.471349 (+1593060us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400046ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f41090 00007fe051fdff3a 00007fe057d95e9c 00007fe057e9404e 00007fe0563552a4 00007fe056355232 00007fe056355161 00007fe0563550dc 00007fe056354392 00007fe05031248c 00007fe0503118c6
0709 12:28:15.473601 (+20002252us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:08.321530 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:08.392231 (+ 70701us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:08.392313 (+    82us) write_op.cc:435] Acquired schema lock
0709 12:28:08.392336 (+    23us) tablet.cc:662] Decoding operations
0709 12:28:08.418831 (+ 26495us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:08.418919 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:08.418953 (+    34us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:28:08.419984 (+  1031us) tablet.cc:701] Row locks acquired
0709 12:28:08.420052 (+    68us) write_op.cc:260] PREPARE: finished
0709 12:28:08.420254 (+   202us) write_op.cc:270] Start()
0709 12:28:08.420439 (+   185us) write_op.cc:276] Timestamp: P: 1783600088420184 usec, L: 0
0709 12:28:08.420467 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:28:08.421235 (+   768us) log.cc:844] Serialized 3939 byte log entry
0709 12:28:10.596839 (+2175604us) op_driver.cc:464] REPLICATION: finished
0709 12:28:11.185559 (+588720us) write_op.cc:301] APPLY: starting
0709 12:28:11.206519 (+ 20960us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:11.266819 (+ 60300us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:11.309527 (+ 42708us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:11.454327 (+144800us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:11.454642 (+   315us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:28:11.454695 (+    53us) write_op.cc:312] APPLY: finished
0709 12:28:11.455051 (+   356us) log.cc:844] Serialized 77 byte log entry
0709 12:28:11.558521 (+103470us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:11.576302 (+ 17781us) write_op.cc:454] Released schema lock
0709 12:28:11.597148 (+ 20846us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:11.628390 (+ 31242us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:11.628426 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1345558,"reported_tablets":23,"spinlock_wait_cycles":416360192,"child_traces":[["op",{"apply.queue_time_us":530516,"apply.run_cpu_time_us":22709,"apply.run_wall_time_us":448269,"num_ops":10,"prepare.queue_time_us":681289,"prepare.run_cpu_time_us":26037,"prepare.run_wall_time_us":1402054,"raft.queue_time_us":182202,"raft.run_cpu_time_us":26373,"raft.run_wall_time_us":402679,"replication_time_us":2115202,"thread_start_us":1897606,"threads_started":5,"wal-append.queue_time_us":1170384,"wal-append.run_cpu_time_us":11247,"wal-append.run_wall_time_us":2930799}]]}
I20260709 12:28:15.883607  6847 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:15.641049  6807 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.224s
I20260709 12:28:15.669245  6332 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.565732  6966 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:15.664121  6786 consensus_queue.cc:1243] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer 4eedd844c09d456ca0b3614490dd1dbb log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:28:15.867849  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:15.856889  3849 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:15.882141  3821 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:15.600507  6771 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.245s
I20260709 12:28:15.504026  6861 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:15.836194  6849 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:16.000784  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:15.972985  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:16.112691  3851 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
W20260709 12:28:15.924949  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 459475us
W20260709 12:28:15.944945  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 504827us
W20260709 12:28:15.980847  4004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.004s	sys 0.008s
I20260709 12:28:15.883741  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:15.962811  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:16.109512  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 448608us
I20260709 12:28:16.124817  3848 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:15.937628  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:16.111567  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 532143us
W20260709 12:28:16.123265  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 241160us
I20260709 12:28:16.113780  4536 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:15.995828  3970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.023s	sys 0.037s
W20260709 12:28:16.126601  3970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.024s	sys 0.041s
I20260709 12:28:16.114507  3856 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
W20260709 12:28:16.126986  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 691823us
W20260709 12:28:16.106021  6745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.002s	sys 0.017s
W20260709 12:28:16.127521  6745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.209s	user 0.002s	sys 0.022s
I20260709 12:28:16.127803  3970 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:16.011708  6766 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.129593  6766 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.130357  6861 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.131886  6766 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.133601  3969 leader_election.cc:400] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 3. Current term is 4.
I20260709 12:28:16.123806  3852 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:15.837541  6923 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:16.124058  4004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.009s	sys 0.009s
I20260709 12:28:15.860126  6632 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:28:16.141906  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:15.879762  3754 catalog_manager.cc:5697] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:15.858940  6954 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:15.868729  6492 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:16.160789  6975 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.166179  6492 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:16.166474  6975 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.167802  6910 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:16.168208  6492 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:16.168586  6975 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.160768  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:16.161134  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.163931  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.161842  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.169907  4567 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:16.171003  4566 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:16.162508  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.163230  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.163909  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.172905  4571 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:15.937318  6821 raft_consensus.cc:697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:16.164477  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:16.174170  3971 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:16.165625  3969 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:16.164732  6583 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.149982  6861 consensus_queue.cc:1048] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:28:16.104190  6715 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:16.104830  6767 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:28:16.169287  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.133179  6849 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.222771  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.047356  6741 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:16.173961  6632 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:16.175190  6315 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.979240  6893 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.179226  4567 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:15.978955  6859 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:16.221957  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.138671  6428 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:28:16.226647  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 75783.6us
I20260709 12:28:16.165658  6213 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:16.227608  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:16.237073  3927 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:16.228381  4569 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:16.222219  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:15.960546  6956 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:16.215880  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.247093  4573 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:16.172356  6705 consensus_queue.cc:260] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:16.268633  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:16.270206  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.270887  4567 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:16.271867  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:16.273015  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.233320  3971 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:16.223553  4572 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:16.226401  3754 catalog_manager.cc:5697] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 2 to 3, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 3 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:16.175097  6786 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.238152  4571 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
W20260709 12:28:16.222084  6660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.019s	sys 0.014s
I20260709 12:28:16.228062  6863 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:16.259552  6656 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:16.232931  6632 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:16.262032  6975 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:16.232224  6428 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.263523  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:16.264303  6956 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:16.264588  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.239521  6583 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:16.278473  4574 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
W20260709 12:28:16.287813  6794 consensus_meta.cc:287] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.227s	user 0.001s	sys 0.011s
I20260709 12:28:16.279814  3848 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
W20260709 12:28:16.286202  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 52937.5us
W20260709 12:28:16.286767  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 159013us
I20260709 12:28:16.286605  3932 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
W20260709 12:28:16.288247  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 122688us
I20260709 12:28:16.315287  3969 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:16.260244  6492 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:16.295074  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:16.287973  6660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.020s	sys 0.014s
I20260709 12:28:16.295779  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.234516  6849 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:16.298851  6973 log.cc:927] Time spent T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 12:28:16.284631  6315 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.241299  6213 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.299326  3754 catalog_manager.cc:5697] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:16.273679  4567 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
W20260709 12:28:16.362546  6896 consensus_meta.cc:287] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.454s	user 0.016s	sys 0.012s
I20260709 12:28:16.362815  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:16.363163  6896 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:16.364161  4567 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:16.365528  4567 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:28:16.285998  6966 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:16.316988  6794 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.366464  6966 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:16.368419  6794 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.371414  6315 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:16.353001  4566 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:16.373401  4566 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:28:16.309439  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.209578  6821 consensus_queue.cc:237] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:16.365739  6896 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:16.378188  3754 catalog_manager.cc:5697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:16.379783  3754 catalog_manager.cc:5697] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:16.215487  6923 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.382563  4570 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:16.239066  6893 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:16.386085  6893 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:16.256289  6741 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.388121  6741 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.306602  6473 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:16.299672  6975 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.388741  6473 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:16.388872  6975 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:16.389194  6473 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:16.391292  6849 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.346597  6863 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.392328  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.384033  6923 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:28:16.352165  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:16.394106  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:16.394721  6974 tablet_replica.cc:333] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:28:16.394932  4566 raft_consensus.cc:2393] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 4: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:16.395488  6951 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:16.396021  6951 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:16.353350  6492 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:16.381273  3754 catalog_manager.cc:5697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: config changed from index 4 to 5, VOTER 34711da9380944d2969a2bc3e203db3d (127.2.157.3) evicted. New cstate: current_term: 2 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:28:16.400480  6971 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.324s	user 0.002s	sys 0.001s
I20260709 12:28:16.400996  6492 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:16.309727  6428 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:16.276955  6859 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:16.402769  3931 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:16.403891  6859 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:16.293151  6786 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.405972  6786 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.406447  6786 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:16.406941  6786 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.408077  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 692) took 1687 ms. Trace:
I20260709 12:28:16.407316  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.409672  6332 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.408571  3924 rpcz_store.cc:276] 0709 12:28:14.721054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:14.786221 (+ 65167us) service_pool.cc:224] Handling call
0709 12:28:14.806468 (+ 20247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:15.207781 (+401313us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:15.207829 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:15.387245 (+179416us) log.cc:844] Serialized 26 byte log entry
0709 12:28:15.944024 (+556779us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:15.944071 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:15.944136 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:16.407802 (+463666us) raft_consensus.cc:1685] finished
0709 12:28:16.407830 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:16.408003 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":189205,"raft.queue_time_us":378977,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":16914,"thread_start_us":485731,"threads_started":1,"wal-append.queue_time_us":964435}
I20260709 12:28:16.410432  6956 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:16.313052  6935 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:16.410579  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.348275  6583 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:16.411682  3928 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:16.412655  6583 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:16.413412  6213 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:16.414652  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 693) took 1686 ms. Trace:
I20260709 12:28:16.415022  3930 rpcz_store.cc:276] 0709 12:28:14.728603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:14.825704 (+ 97101us) service_pool.cc:224] Handling call
0709 12:28:14.867596 (+ 41892us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:15.233335 (+365739us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:28:15.233391 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:15.237210 (+  3819us) log.cc:844] Serialized 26 byte log entry
0709 12:28:15.476908 (+239698us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:15.476943 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:15.477006 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:16.399681 (+922675us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:16.414305 (+ 14624us) raft_consensus.cc:1685] finished
0709 12:28:16.414337 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:16.414586 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":339377,"raft.queue_time_us":366486,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":157,"spinlock_wait_cycles":85599488,"thread_start_us":239239,"threads_started":1,"wal-append.queue_time_us":612085}
I20260709 12:28:16.416483  4567 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:16.419131  3754 catalog_manager.cc:5697] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:28:16.432024  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:16.434311  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:16.393733  6863 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.432900  4538 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:16.480265  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 47435.1us
I20260709 12:28:16.420972  3754 catalog_manager.cc:5697] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 3 to 4, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 4 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:16.484247  4006 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:16.486552  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:16.473227  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:16.410171  6981 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:16.481245  3971 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:16.497116  4003 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:28:16.459959  3926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.001s	sys 0.015s
W20260709 12:28:16.498178  3926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.002s	sys 0.015s
I20260709 12:28:16.497591  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:16.494792  3924 raft_consensus.cc:2393] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:16.498751  3932 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:16.500908  3754 catalog_manager.cc:5697] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 2 to 3, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 3 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:28:16.501590  4003 raft_consensus.cc:1275] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:28:16.425870  6786 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.501688  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:16.509289  6978 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:28:16.508993  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:16.509967  3924 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:16.502547  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:16.510977  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:16.511258  6988 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:28:16.511070  6473 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:16.511817  3924 raft_consensus.cc:2393] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:16.513150  6473 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:16.514490  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:16.515218  4005 raft_consensus.cc:2393] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:16.516459  6715 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.495870  6863 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:16.516883  4005 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:28:16.504066  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:16.504406  4006 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:16.517086  6715 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.518693  3931 raft_consensus.cc:2410] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 8 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:28:16.518577  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:16.519259  3924 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:16.519526  6715 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:16.519550  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:16.509063  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:16.520865  3923 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:16.517264  6863 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.523831  6863 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.524235  3932 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:16.524534  6863 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.524971  6863 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.527251  6863 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.527566  6975 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.496943  6848 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:16.530411  6848 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:16.457103  6984 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:16.532332  6984 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:16.502261  3927 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:16.534482  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:16.525318  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2281) took 1070 ms. Trace:
W20260709 12:28:16.536099  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 54948.8us
I20260709 12:28:16.536048  3929 rpcz_store.cc:276] 0709 12:28:15.454450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:15.455006 (+   556us) service_pool.cc:224] Handling call
0709 12:28:15.455307 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:15.809001 (+353694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:15.809039 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:15.809523 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:28:16.460664 (+651141us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:16.460896 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:16.473504 (+ 12608us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:16.525122 (+ 51618us) raft_consensus.cc:1685] finished
0709 12:28:16.525142 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:16.525265 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13511,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":14760,"thread_start_us":766945,"threads_started":2,"wal-append.queue_time_us":498467}
I20260709 12:28:16.539417  3923 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:16.540548  6956 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:16.421535  6951 consensus_queue.cc:1059] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:28:16.546211  3971 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:16.501008  6911 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:16.538095  6896 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.539568  6786 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:16.561779  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 419723us
I20260709 12:28:16.566248  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:16.569059  4003 raft_consensus.cc:2393] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 4: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:16.552636  6981 raft_consensus.cc:697] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:16.556278  6911 raft_consensus.cc:697] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:16.563773  6473 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.582288  4003 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:28:16.583571  4536 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:16.580660  3925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.000s	sys 0.020s
I20260709 12:28:16.533420  6984 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.578883  6794 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:28:16.587684  3925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.000s	sys 0.021s
W20260709 12:28:16.563771  6970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.010s	sys 0.024s
I20260709 12:28:16.564446  6896 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:16.588454  3895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.004s	sys 0.033s
W20260709 12:28:16.592430  3895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.004s	sys 0.033s
I20260709 12:28:16.565374  6786 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.593463  4003 raft_consensus.cc:1240] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
W20260709 12:28:16.594002  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 362788us
I20260709 12:28:16.597085  3929 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:16.602787  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:16.603601  3932 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
W20260709 12:28:16.604585  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 337187us
W20260709 12:28:16.591848  6970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.010s	sys 0.024s
I20260709 12:28:16.590371  6923 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:16.579842  6975 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.636492  3856 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
W20260709 12:28:16.605275  3897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.009s	sys 0.021s
I20260709 12:28:16.590734  6794 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.635669  3848 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
W20260709 12:28:16.638139  3897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.010s	sys 0.021s
I20260709 12:28:16.585726  6473 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.606559  3821 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:16.641402  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 828480us
I20260709 12:28:16.642338  3821 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:16.643265  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:16.638820  4537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.832s (SENT) [suppressed 13 similar messages]
I20260709 12:28:16.589337  6715 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:28:16.587960  6428 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.685173  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:16.647054  3850 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:16.668864  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:16.686179  4005 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:16.655619  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:16.689898  3924 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:16.686728  4000 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:28:16.679095  3895 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:16.655283  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:16.646049  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:16.690451  3848 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
W20260709 12:28:16.688428  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 49649.9us
W20260709 12:28:16.701942  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 45760.5us
I20260709 12:28:16.704245  4002 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:16.701949  3895 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:16.714282  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 72031.1us
W20260709 12:28:16.668682  6985 log.cc:927] Time spent T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:28:16.639673  6923 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:16.682287  6982 log.cc:927] Time spent T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:28:16.737308  6332 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:16.738327  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:16.738960  4006 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:16.648571  6605 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:16.644167  6794 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:16.766855  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.767793  4574 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:16.727442  3821 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:16.725706  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:16.730495  6583 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:16.683909  6911 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.683722  6981 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.705430  6767 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:16.704407  6793 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:16.678062  6848 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:16.721014  6632 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:16.736567  6923 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:16.723886  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:16.791383  4005 raft_consensus.cc:2393] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 4: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:16.739804  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 525) took 1343 ms. Trace:
I20260709 12:28:16.682263  6705 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:16.680104  6896 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.742353  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.744798  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:16.750520  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.752084  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:16.752853  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.807446  4570 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:16.753530  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.728035  3895 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:16.754236  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.754468  6473 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.742926  6863 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.676035  6786 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.720885  6656 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:16.755002  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.851147  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.864409  4570 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:16.755513  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:16.756177  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:16.726712  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:16.758122  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:16.758910  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2282) took 1304 ms. Trace:
I20260709 12:28:16.759439  4537 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:16.760005  6428 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:16.760763  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:16.766139  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:16.769932  3850 raft_consensus.cc:2393] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:16.774830  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:16.881155  3929 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:16.775102  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:16.779438  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:16.781144  3970 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:16.782963  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 55618.4us
I20260709 12:28:16.783663  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:16.737790  6332 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.789814  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:16.809324  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:16.805780  4567 raft_consensus.cc:2393] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:16.837116  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:16.837276  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.766759  6492 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:28:16.792367  4001 rpcz_store.cc:276] 0709 12:28:15.395973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:15.396086 (+   113us) service_pool.cc:224] Handling call
0709 12:28:15.404461 (+  8375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:15.810053 (+405592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:15.810094 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:16.163165 (+353071us) log.cc:844] Serialized 52 byte log entry
0709 12:28:16.566975 (+403810us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:16.567034 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:16.567102 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:16.739595 (+172493us) raft_consensus.cc:1685] finished
0709 12:28:16.739612 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:16.739746 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33238,"raft.queue_time_us":58980,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":9393,"thread_start_us":633681,"threads_started":2,"wal-append.queue_time_us":570391}
I20260709 12:28:16.889195  3821 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:16.889490  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 108517us
I20260709 12:28:16.845700  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:16.785454  6605 raft_consensus.cc:697] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:16.814658  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:16.848053  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2290) took 1267 ms. Trace:
W20260709 12:28:16.848057  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 120103us
I20260709 12:28:16.809065  4572 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:16.779340  6910 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 12:28:16.853802  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 270301us
W20260709 12:28:16.845073  3897 connection.cc:256] RPC call timeout handler was delayed by -1.5406964099997822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
I20260709 12:28:16.850848  6956 raft_consensus.cc:697] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:16.865686  4000 raft_consensus.cc:2410] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:28:16.874537  3997 raft_consensus.cc:2393] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 8: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:16.849509  6711 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:16.774560  6767 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.884513  3849 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:16.887454  4006 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:16.887194  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.884143  3931 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:16.890897  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:16.915591  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:16.850767  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 307775us
I20260709 12:28:16.858369  6859 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:16.951849  3822 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:16.962649  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.963045  4571 raft_consensus.cc:2410] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:28:16.960762  3897 connection.cc:256] RPC call timeout handler was delayed by -1.4243802000000869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 12:28:16.964124  3897 connection.cc:256] RPC call timeout handler was delayed by -1.4178073420002875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 12:28:16.964795  3897 connection.cc:256] RPC call timeout handler was delayed by -1.2509136710000348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
I20260709 12:28:16.840104  6863 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:16.866940  3925 rpcz_store.cc:276] 0709 12:28:15.454738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:15.466601 (+ 11863us) service_pool.cc:224] Handling call
0709 12:28:15.483229 (+ 16628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:15.577300 (+ 94071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:15.577346 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:15.600375 (+ 23029us) log.cc:844] Serialized 26 byte log entry
0709 12:28:16.592015 (+991640us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:16.592063 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:16.675667 (+ 83604us) spinlock_profiling.cc:243] Waited 93.6 ms on lock 0x7b5400305cd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:16.675721 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:16.758622 (+ 82901us) raft_consensus.cc:1685] finished
0709 12:28:16.758642 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:16.758849 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7666,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":60961,"spinlock_wait_cycles":215210752,"thread_start_us":732943,"threads_started":1,"wal-append.queue_time_us":1057882}
I20260709 12:28:16.960906  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:16.849336  6989 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:16.858685  6656 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:16.963883  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 74778.8us
I20260709 12:28:16.960350  3895 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:16.957226  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:16.965822  3897 connection.cc:256] RPC call timeout handler was delayed by -1.1723801999996795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260709 12:28:16.969300  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 78493us
I20260709 12:28:16.956396  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.970891  4002 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:16.961174  3926 rpcz_store.cc:276] 0709 12:28:15.580205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:15.580758 (+   553us) service_pool.cc:224] Handling call
0709 12:28:15.651082 (+ 70324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:15.651377 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:15.748494 (+ 97117us) log.cc:844] Serialized 14 byte log entry
0709 12:28:16.805213 (+1056719us) log.cc:844] Serialized 14 byte log entry
0709 12:28:16.847691 (+ 42478us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:16.847745 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:16.847794 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:16.847859 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:16.847995 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52088,"prepare.queue_time_us":183148,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":18544,"raft.queue_time_us":44409,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":13172,"thread_start_us":980854,"threads_started":2,"wal-append.queue_time_us":869547}
I20260709 12:28:16.981385  3822 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:17.001925  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:17.083400  4573 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
W20260709 12:28:16.971792  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 212434us
I20260709 12:28:17.064270  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:16.895052  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:17.072609  4574 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:28:17.072317  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:17.094383  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:17.094835  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:17.095256  3851 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:17.095715  3848 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:16.884302  6935 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:17.096235  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:17.120087  4570 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:28:17.094417  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:16.883416  6995 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:17.116297  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:17.134090  4571 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:16.917695  6786 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:16.892947  4566 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:17.142554  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.889110  6332 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:17.117396  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:17.143229  4571 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:17.096006  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:17.144189  3857 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:17.144456  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:17.118381  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:17.119076  3897 connection.cc:256] RPC call timeout handler was delayed by -1.0649803080000311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 12:28:17.145795  3897 connection.cc:256] RPC call timeout handler was delayed by -1.0076801999998679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
I20260709 12:28:17.068840  6896 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:17.068514  6984 consensus_queue.cc:1059] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:28:17.132648  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:17.138232  3970 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:16.962989  6767 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:17.145403  4000 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:16.978474  6428 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:17.150808  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:16.991734  6859 raft_consensus.cc:697] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:17.151132  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 68268.3us
I20260709 12:28:16.971659  6980 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:17.097772  6656 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:17.063584  6983 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:17.156145  3849 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
W20260709 12:28:17.132089  6213 consensus_meta.cc:287] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.718s	user 0.010s	sys 0.002s
I20260709 12:28:17.166769  4568 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:16.916684  6861 consensus_queue.cc:1059] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.234s
I20260709 12:28:17.225800  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:17.226202  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:17.186820  6583 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:17.187711  6428 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:17.203694  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 65546.9us
I20260709 12:28:17.086300  6715 consensus_queue.cc:1059] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:28:17.205791  6983 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:17.131239  6989 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:17.187896  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:17.207685  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:17.172345  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:17.210908  4573 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:17.249799  3856 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:17.211498  6964 raft_consensus.cc:3055] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:17.205986  6859 consensus_queue.cc:237] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:17.216444  6213 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:17.253997  3897 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:17.158057  6995 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:17.203907  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:17.275743  4000 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:17.223229  6980 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:17.231022  3970 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:17.175212  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:17.239066  4570 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
W20260709 12:28:17.246809  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 129847us
I20260709 12:28:17.150764  6896 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:17.161098  6745 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:17.225992  6793 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:28:17.289651  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 58697.2us
I20260709 12:28:17.292526  3857 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:28:17.240747  6428 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:17.292980  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:17.298834  3970 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:17.293329  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:17.296717  7006 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:17.302030  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:17.310642  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:17.303040  6863 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:17.253769  6964 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:17.303258  7005 consensus_queue.cc:1059] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:17.226691  6605 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:17.304037  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 77415.9us
I20260709 12:28:17.304246  6951 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:17.331476  6951 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:17.332136  6951 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:17.291237  6896 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:17.304566  7018 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:17.337445  7018 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:17.305464  6999 log.cc:927] Time spent T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 12:28:17.308511  6995 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:17.255373  6583 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:17.339545  6583 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:17.310595  6998 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 12:28:17.314570  4565 raft_consensus.cc:2393] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 8: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:17.315438  6213 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:17.316244  3849 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 3.
I20260709 12:28:17.291443  6745 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:17.343451  6745 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:17.323441  4536 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:17.346691  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 523) took 1951 ms. Trace:
I20260709 12:28:17.347201  4004 rpcz_store.cc:276] 0709 12:28:15.395424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:15.404634 (+  9210us) service_pool.cc:224] Handling call
0709 12:28:15.404935 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:15.552983 (+148048us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b4800062358. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe056f00aa1 00007fe056ef7b37 00007fe056ef79ca 00007fe056fef26f 00007fe056feef37 00007fe05700355c 00007fe057003508 00007fe057003488 00007fe057003443 00007fe0570026ec 00007fe055f2ca96
0709 12:28:16.210236 (+657253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:16.210270 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:16.236173 (+ 25903us) log.cc:844] Serialized 26 byte log entry
0709 12:28:16.702517 (+466344us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:16.702575 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:16.703242 (+   667us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:17.346281 (+643039us) raft_consensus.cc:1685] finished
0709 12:28:17.346312 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:17.346599 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54844,"raft.queue_time_us":61453,"raft.run_cpu_time_us":2440,"raft.run_wall_time_us":82081,"spinlock_wait_cycles":5984000,"thread_start_us":1108080,"threads_started":2,"wal-append.queue_time_us":561471}
I20260709 12:28:17.324350  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:17.352983  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:17.353540  4000 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:17.354447  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:17.355126  4000 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:17.327857  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:17.358283  4001 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:17.359108  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:17.280189  6786 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:17.359818  6786 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:17.349766  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:17.367728  4004 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:17.369076  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:17.371877  6951 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:17.229331  6975 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 12:28:17.383771  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 57752.5us
W20260709 12:28:17.388907  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 65545.2us
I20260709 12:28:17.388687  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:17.392267  4004 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:17.304096  6861 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:17.404896  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:17.294193  6473 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:17.418831  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:17.403901  6951 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:17.323339  6821 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:17.242484  6632 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:17.329370  7004 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:17.329246  6793 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:17.387670  6711 raft_consensus.cc:697] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:17.419525  4005 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:17.451519  4006 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:28:17.436825  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 190743us
I20260709 12:28:17.446738  4000 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:17.478655  4006 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:17.421871  7006 raft_consensus.cc:3055] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:28:17.489990  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 529689us
I20260709 12:28:17.501217  3895 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:17.506007  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 810) took 1334 ms. Trace:
I20260709 12:28:17.506395  4565 rpcz_store.cc:276] 0709 12:28:16.152880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:16.152984 (+   104us) service_pool.cc:224] Handling call
0709 12:28:17.487049 (+1334065us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540055d2d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:17.487232 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2627435264}
I20260709 12:28:17.508419  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:17.329010  6956 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:17.427599  6473 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:17.486523  6848 raft_consensus.cc:3055] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:28:17.535832  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 554505us
I20260709 12:28:17.536702  3822 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:17.531939  3897 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:17.538527  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:17.496404  7004 raft_consensus.cc:697] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:17.497196  6793 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:17.496752  7006 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:17.548287  3822 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:17.554625  3895 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:17.550524  3822 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:28:17.555804  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 257022us
W20260709 12:28:17.549003  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 134526us
I20260709 12:28:17.535923  6848 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:17.560185  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:17.559782  4536 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:17.572193  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:17.558339  3970 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:17.525678  6821 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:28:17.572835  3926 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:17.575855  3822 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:17.554100  6859 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:17.594856  3822 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:17.596107  6997 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:28:17.614392  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 55265.1us
I20260709 12:28:17.548767  7020 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:17.554533  6861 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:17.594856  3971 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:17.563089  6786 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:17.595767  6632 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:17.648600  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:17.648466  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:17.654721  4005 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:17.581995  7012 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:17.522912  6711 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:17.652423  7020 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:17.540863  6964 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:17.657984  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 98299.7us
I20260709 12:28:17.656832  6786 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:17.614105  6583 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:17.614909  7022 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:17.621362  6997 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:17.654021  7016 log.cc:927] Time spent T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
I20260709 12:28:17.557535  7027 consensus_queue.cc:1059] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 12:28:17.573462  7021 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:28:17.605408  6213 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:28:17.904148  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 540) took 1148 ms. Trace:
W20260709 12:28:17.734606  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 58161.4us
I20260709 12:28:17.953528  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:17.715174  3926 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
W20260709 12:28:17.967216  4537 connection.cc:256] RPC call timeout handler was delayed by -1.0356656089998069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
I20260709 12:28:17.949751  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:17.583979  7024 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:28:17.658231  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 63443.8us
W20260709 12:28:17.967651  4537 connection.cc:256] RPC call timeout handler was delayed by -1.020678923000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 12:28:17.680912  4536 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:17.992516  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:17.993453  3971 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:17.648264  6989 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:18.038884  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:18.039276  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:18.040429  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:17.916733  4002 consensus_meta.cc:287] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.781s	user 0.011s	sys 0.000s
I20260709 12:28:18.041052  3848 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:18.041262  4002 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:17.622757  6861 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:17.992115  7022 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:17.880429  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:18.077057  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:17.662043  7012 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:17.663028  7020 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:17.681139  6786 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.043776  4006 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:17.945931  3923 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:18.059005  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:18.061930  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:17.701144  6987 log.cc:927] Time spent T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:28:18.063330  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:18.063995  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:18.076546  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36516 (request call id 2252) took 1272 ms. Trace:
I20260709 12:28:17.658700  6632 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.060114  6951 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:18.078022  6861 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:17.606141  6859 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:17.994302  6910 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:28:18.005002  6656 consensus_meta.cc:287] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.797s	user 0.011s	sys 0.000s
W20260709 12:28:18.132694  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 594208us
I20260709 12:28:17.662871  6983 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:17.991941  6997 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:17.757462  6896 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:17.947147  6990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.036s	sys 0.024s
I20260709 12:28:18.152707  4002 rpcz_store.cc:276] 0709 12:28:16.769786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:16.960567 (+190781us) service_pool.cc:224] Handling call
0709 12:28:18.041920 (+1081353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:18.049208  6964 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:17.869683  6994 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:28:18.169741  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:18.077646  3929 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:18.106324  7022 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:18.179227  3969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.017s	sys 0.029s
W20260709 12:28:18.350519  3969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.018s	sys 0.029s
I20260709 12:28:18.134433  7031 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:18.159119  7014 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.629s	user 0.000s	sys 0.001s
I20260709 12:28:18.151235  6786 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:18.135109  7012 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:18.259395  7050 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:18.159111  6632 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:18.277828  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:18.178826  6715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.027s	sys 0.018s
W20260709 12:28:18.281867  3931 consensus_meta.cc:287] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.310s	user 0.008s	sys 0.002s
I20260709 12:28:18.469965  3931 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
W20260709 12:28:18.261526  3822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.032s	sys 0.088s
I20260709 12:28:18.337576  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:18.470845  3822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.033s	sys 0.089s
I20260709 12:28:18.259387  6859 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:18.259281  6910 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.395130  7033 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.350576  6994 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:18.396160  7031 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:17.734320  6793 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:18.267426  6951 raft_consensus.cc:697] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:17.714903  7004 consensus_queue.cc:237] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:18.442615  7050 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:18.489924  3931 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 1722) took 1705 ms (client timeout 1751 ms). Trace:
W20260709 12:28:18.500720  4538 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.049s	sys 0.045s
W20260709 12:28:18.596207  4538 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.049s	sys 0.045s
W20260709 12:28:18.596751  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 605199us
I20260709 12:28:17.850956  7006 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:18.469816  6715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.028s	sys 0.018s
I20260709 12:28:18.336154  6984 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.149s
I20260709 12:28:18.279531  6656 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:18.582494  3741 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 95a53a95fd9f44e59c1b1615b9281948 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 34711da9380944d2969a2bc3e203db3d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:18.519390  6821 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:28:18.590608  7037 log.cc:927] Time spent T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.640s	user 0.000s	sys 0.001s
I20260709 12:28:18.542454  6994 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:18.542210  7033 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:18.593722  7034 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.688s	user 0.001s	sys 0.000s
W20260709 12:28:18.595039  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 1.30166e+06us
W20260709 12:28:18.596108  3931 rpcz_store.cc:269] 0709 12:28:16.764903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:16.765045 (+   142us) service_pool.cc:224] Handling call
0709 12:28:18.470584 (+1705539us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:18.501343  7042 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.503804  6910 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:18.655081  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 56209.1us
W20260709 12:28:18.728973  4570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.007s	sys 0.002s
W20260709 12:28:18.729592  4570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.007s	sys 0.002s
W20260709 12:28:18.730202  3895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.000s	sys 0.009s
W20260709 12:28:18.730957  3895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.000s	sys 0.009s
I20260709 12:28:18.624004  7050 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:18.736438  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:18.742159  3856 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:28:18.667469  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 329971us
W20260709 12:28:18.628033  6583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.008s	sys 0.016s
W20260709 12:28:18.697196  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 1.10233e+06us
I20260709 12:28:18.541234  7060 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:18.752933  3969 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:18.618242  6473 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:18.748147  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:18.762781  4536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.007s	sys 0.003s
W20260709 12:28:18.787026  4536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.007s	sys 0.003s
W20260709 12:28:18.787616  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 1.1067e+06us
W20260709 12:28:18.751756  6583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.008s	sys 0.017s
I20260709 12:28:18.744037  7006 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:18.729940  6715 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.794453  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:18.710927  3741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 128509us
I20260709 12:28:18.732602  6983 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:18.770367  7017 log.cc:927] Time spent T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.885s	user 0.001s	sys 0.001s
I20260709 12:28:18.761346  7060 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.841771  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:17.965695  4000 rpcz_store.cc:276] 0709 12:28:16.755260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.475731 (+720471us) service_pool.cc:224] Handling call
0709 12:28:17.476079 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:17.476317 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:17.615744 (+139427us) log.cc:844] Serialized 14 byte log entry
0709 12:28:17.903476 (+287732us) log.cc:844] Serialized 14 byte log entry
0709 12:28:17.903693 (+   217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:17.903762 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:17.903828 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:17.903914 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:17.904071 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1308,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":43777,"thread_start_us":426035,"threads_started":2}
W20260709 12:28:18.853210  6428 consensus_meta.cc:287] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.524s	user 0.009s	sys 0.001s
W20260709 12:28:18.863968  7008 log.cc:927] Time spent T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 1.291s	user 0.013s	sys 0.006s
I20260709 12:28:18.853068  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:18.913192  7012 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:18.880503  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2268) took 1272 ms. Trace:
I20260709 12:28:18.927752  4004 rpcz_store.cc:276] 0709 12:28:17.608018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.823855 (+215837us) service_pool.cc:224] Handling call
0709 12:28:18.841433 (+1017578us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b58001b3f98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056f9d0a0 00007fe056f9c984 00007fe0505176d4 00007fe050517662
0709 12:28:18.880448 (+ 39015us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41200512}
I20260709 12:28:18.853726  6896 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:18.853818  6983 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:18.903967  7057 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:18.905313  6332 consensus_meta.cc:287] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.660s	user 0.010s	sys 0.000s
I20260709 12:28:18.906719  6656 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:18.858742  6848 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:18.847047  6923 consensus_meta.cc:287] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 2.034s	user 0.010s	sys 0.003s
I20260709 12:28:18.912252  6428 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:18.882516  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:18.913854  7024 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:28:18.843386  7036 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.499s	user 0.000s	sys 0.001s
W20260709 12:28:18.916468  7022 consensus_meta.cc:287] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.000s
I20260709 12:28:18.917142  7038 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:28:18.844642  6794 consensus_meta.cc:287] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 2.062s	user 0.007s	sys 0.004s
I20260709 12:28:18.917954  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1778) took 2159 ms. Trace:
I20260709 12:28:18.918140  7055 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:18.919483  7068 consensus_queue.cc:1059] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:18.920257  7033 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:18.920734  7029 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:18.923313  7021 consensus_queue.cc:1059] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:19.026845  7029 raft_consensus.cc:3055] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:19.027247  7029 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:28:18.923738  6705 consensus_meta.cc:287] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 2.117s	user 0.012s	sys 0.000s
I20260709 12:28:18.866528  6715 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.028275  4003 raft_consensus.cc:1275] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:19.028110  7029 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.029274  6715 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:19.029556  7039 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.989660  7057 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:19.031069  7066 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.031562  7066 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.032570  7057 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:18.927317  6786 consensus_meta.cc:287] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 12:28:19.033367  6786 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:19.034515  7051 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 12:28:19.035921  6786 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:18.988170  6821 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.038352  6821 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:19.040841  6767 consensus_meta.cc:287] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.814s	user 0.009s	sys 0.003s
I20260709 12:28:19.040944  6821 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:18.811821  6583 raft_consensus.cc:697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:19.041340  6767 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.042667  6583 consensus_queue.cc:237] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:19.043490  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 780) took 1911 ms. Trace:
I20260709 12:28:19.044695  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2304) took 1567 ms. Trace:
I20260709 12:28:19.043944  3854 rpcz_store.cc:276] 0709 12:28:17.131726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.275222 (+143496us) service_pool.cc:224] Handling call
0709 12:28:17.298532 (+ 23310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:17.314965 (+ 16433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:17.314998 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:17.315444 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:28:17.532620 (+217176us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:17.532684 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:17.532765 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:19.043225 (+1510460us) raft_consensus.cc:1685] finished
0709 12:28:19.043243 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:19.043409 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15999,"raft.queue_time_us":39574,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":216774,"threads_started":1,"wal-append.queue_time_us":1007642}
I20260709 12:28:19.045051  3928 rpcz_store.cc:276] 0709 12:28:17.477554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.477755 (+   201us) service_pool.cc:224] Handling call
0709 12:28:17.478180 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:17.478600 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:17.478643 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:17.479366 (+   723us) log.cc:844] Serialized 26 byte log entry
0709 12:28:17.557852 (+ 78486us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:17.557984 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:17.558121 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:19.044509 (+1486388us) raft_consensus.cc:1685] finished
0709 12:28:19.044529 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:19.044642 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24624,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":77636,"threads_started":1,"wal-append.queue_time_us":1417923}
I20260709 12:28:19.046260  7068 raft_consensus.cc:3055] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:19.046645  7068 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:18.984382  7027 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.001s	sys 0.006s
W20260709 12:28:19.047703  7027 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.001s	sys 0.007s
I20260709 12:28:19.047555  7068 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.048887  7068 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:19.049244  6632 consensus_meta.cc:287] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.001s
W20260709 12:28:18.844067  7049 log.cc:927] Time spent T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:28:18.893973  7060 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:19.050581  7031 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:18.949281  6492 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:19.054069  6492 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:19.054270  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 822) took 1937 ms. Trace:
I20260709 12:28:19.054489  6492 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:18.926111  6975 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:18.735482  7042 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:18.982165  6863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.222s	user 0.070s	sys 0.087s
I20260709 12:28:19.009636  3852 rpcz_store.cc:276] 0709 12:28:16.758054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:16.759276 (+  1222us) service_pool.cc:224] Handling call
0709 12:28:16.759612 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:16.780556 (+ 20944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:16.780609 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:16.842513 (+ 61904us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b2c00060638. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:28:16.864001 (+ 21488us) log.cc:844] Serialized 26 byte log entry
0709 12:28:17.161658 (+297657us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:17.161696 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:17.161855 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:18.917587 (+1755732us) raft_consensus.cc:1685] finished
0709 12:28:18.917609 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:18.917855 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58039,"raft.queue_time_us":10892,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6964,"spinlock_wait_cycles":3242368,"thread_start_us":193571,"threads_started":1,"wal-append.queue_time_us":725540}
W20260709 12:28:18.925252  6745 consensus_meta.cc:287] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.581s	user 0.012s	sys 0.004s
I20260709 12:28:19.030105  7039 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:18.965651  7032 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:28:18.952252  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 128076us
I20260709 12:28:19.009115  7038 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:18.942202  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 194163us
I20260709 12:28:19.054803  4574 rpcz_store.cc:276] 0709 12:28:17.116815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.153499 (+ 36684us) service_pool.cc:224] Handling call
0709 12:28:17.201706 (+ 48207us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:17.560391 (+358685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:17.560433 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:17.561336 (+   903us) log.cc:844] Serialized 52 byte log entry
0709 12:28:17.878073 (+316737us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:17.878114 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:17.878187 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:19.053964 (+1175777us) raft_consensus.cc:1685] finished
0709 12:28:19.053989 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:19.054172 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15478,"raft.queue_time_us":324740,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6047,"thread_start_us":604545,"threads_started":2,"wal-append.queue_time_us":861531}
W20260709 12:28:19.061843  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 273405us
W20260709 12:28:19.012445  3970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.012s	sys 0.014s
I20260709 12:28:18.877940  6951 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:19.067368  3970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.012s	sys 0.014s
I20260709 12:28:19.067574  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:19.081609  3822 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:28:19.090934  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 338084us
I20260709 12:28:19.091758  3969 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:19.095011  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:19.060511  6848 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:18.978483  6332 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:19.063616  6863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.329s	user 0.071s	sys 0.087s
I20260709 12:28:19.099771  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:19.104221  3897 leader_election.cc:400] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6.
I20260709 12:28:19.049678  6632 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.106618  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:18.990156  6923 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.108533  3897 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:19.110538  4571 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:19.112668  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:19.107424  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:19.072225  7038 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:19.122201  3931 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:19.015349  6656 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:28:19.099772  3969 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:19.178194  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 69753.9us
W20260709 12:28:19.184567  3822 connection.cc:256] RPC call timeout handler was delayed by -1.6201611980000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 12:28:19.019042  6794 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:19.187804  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 179251us
W20260709 12:28:19.180430  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 54926.8us
I20260709 12:28:19.182745  3928 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:19.098737  6821 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:28:19.187757  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 88033.8us
I20260709 12:28:19.192091  4569 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:28:19.112429  7057 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:19.190810  3930 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:19.184894  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:19.008762  7022 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.097231  6715 consensus_queue.cc:1059] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
W20260709 12:28:19.195037  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:19.182211  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:19.064670  7050 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:19.212445  3822 connection.cc:256] RPC call timeout handler was delayed by -1.1737611979997382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 12:28:19.212970  3822 connection.cc:256] RPC call timeout handler was delayed by -1.132361198000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
I20260709 12:28:19.213299  4001 raft_consensus.cc:2393] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:28:19.213442  3822 connection.cc:256] RPC call timeout handler was delayed by -1.0747611980000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
I20260709 12:28:19.200639  3969 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:19.213896  3822 connection.cc:256] RPC call timeout handler was delayed by -1.0270611979999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
I20260709 12:28:19.195111  3850 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:28:19.205200  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:19.119735  6975 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:19.119920  6793 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.200004  4569 pending_rounds.cc:85] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 5
I20260709 12:28:19.065498  6745 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:19.214275  3822 connection.cc:256] RPC call timeout handler was delayed by -1.0243611979999514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
W20260709 12:28:19.259696  3822 connection.cc:256] RPC call timeout handler was delayed by -1.0009611979999136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
I20260709 12:28:19.219493  7005 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:19.222306  3997 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:28:19.227777  7077 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:19.228200  7028 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.264590  3850 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:19.229092  7069 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.230242  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2300) took 2628 ms. Trace:
I20260709 12:28:19.230511  3924 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:28:19.218780  7063 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:19.200944  7033 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:19.218173  3970 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:19.204274  7057 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:19.204780  6821 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:19.278007  3851 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:19.229624  6980 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.208657  6711 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.249305  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:19.096783  7032 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:19.253319  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 68546.1us
I20260709 12:28:19.061589  7055 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.258445  4569 pending_rounds.cc:107] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:28:19.232465  7027 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.216707  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:28:19.194852  7007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.007s	sys 0.016s
W20260709 12:28:19.288873  7007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.007s	sys 0.017s
I20260709 12:28:19.288930  6332 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.179113  6994 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.289731  7055 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.289796  7032 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:19.290235  7023 raft_consensus.cc:3055] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:19.290665  7023 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:19.291132  6994 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.266785  3927 rpcz_store.cc:276] 0709 12:28:16.601507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:16.601675 (+   168us) service_pool.cc:224] Handling call
0709 12:28:16.639728 (+ 38053us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:16.649371 (+  9643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:16.649402 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:16.661864 (+ 12462us) log.cc:844] Serialized 52 byte log entry
0709 12:28:17.080624 (+418760us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:17.080671 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:17.080750 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:19.229968 (+2149218us) raft_consensus.cc:1685] finished
0709 12:28:19.229990 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:19.230156 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":12001,"thread_start_us":327259,"threads_started":1,"wal-append.queue_time_us":2456219}
W20260709 12:28:19.278249  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 60184.8us
I20260709 12:28:19.245905  6793 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:19.286966  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 70335.2us
I20260709 12:28:19.281622  7012 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.289590  7054 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.171s
I20260709 12:28:19.283587  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:19.328580  3970 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:19.328958  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 45483us
I20260709 12:28:19.283728  7005 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:28:19.331607  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 70538us
I20260709 12:28:19.332479  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:19.334429  6997 consensus_meta.cc:287] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.983s	user 0.010s	sys 0.000s
I20260709 12:28:19.333755  6632 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.334892  6997 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.337270  3925 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:19.294603  6656 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:28:19.287109  6863 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:19.281160  7033 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:19.339102  6863 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.340526  7033 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:19.340886  6997 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.285560  6983 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:19.268941  7028 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.351065  7022 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:19.352150  6794 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.352154  7028 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:19.300398  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 874) took 1347 ms. Trace:
I20260709 12:28:19.290689  6980 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:19.353078  6980 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:19.293926  7027 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:19.353356  6793 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:19.354202  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:19.354787  3855 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:19.354959  7027 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:19.302163  6767 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.303337  7029 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:19.357115  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2260) took 2716 ms. Trace:
I20260709 12:28:19.278075  7069 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:19.305439  6964 consensus_meta.cc:287] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.962s	user 0.004s	sys 0.004s
I20260709 12:28:19.305555  7067 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:28:19.318606  6859 consensus_meta.cc:287] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.787s	user 0.007s	sys 0.003s
I20260709 12:28:19.228603  7078 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.191s
I20260709 12:28:19.367041  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:19.286391  6711 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.285051  4569 raft_consensus.cc:2889] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:19.265260  7077 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:19.383078  7047 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.383847  7047 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.360597  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:19.352947  4570 rpcz_store.cc:276] 0709 12:28:17.953466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.954277 (+   811us) service_pool.cc:224] Handling call
0709 12:28:17.954661 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:18.774409 (+819748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:18.774447 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:18.789586 (+ 15139us) log.cc:844] Serialized 26 byte log entry
0709 12:28:19.118495 (+328909us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:19.118540 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:19.118629 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:19.300193 (+181564us) raft_consensus.cc:1685] finished
0709 12:28:19.300212 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:19.300340 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":548716,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":28631,"thread_start_us":998612,"threads_started":2,"wal-append.queue_time_us":508950}
I20260709 12:28:19.357484  4003 rpcz_store.cc:276] 0709 12:28:16.640328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:16.641979 (+  1651us) service_pool.cc:224] Handling call
0709 12:28:16.642291 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:19.028631 (+2386340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:19.356830 (+328199us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b54000230d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:19.357024 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5486461312}
I20260709 12:28:19.363874  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:19.365442  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:19.391839  3931 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:19.366108  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:19.361826  7067 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:19.393332  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:19.394140  4002 raft_consensus.cc:2410] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:28:19.366900  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:19.366856  7025 consensus_queue.cc:1059] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:19.367262  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:19.342151  7005 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:19.311383  6428 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.363534  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:19.280032  7057 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:19.367890  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:19.368680  3929 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:28:19.367816  6859 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:19.343077  6910 consensus_meta.cc:287] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.581s	user 0.006s	sys 0.003s
I20260709 12:28:19.368113  6975 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:19.372949  7069 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:19.373437  3849 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1787) took 2200 ms (client timeout 1944 ms). Trace:
I20260709 12:28:19.277511  7058 consensus_queue.cc:1059] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:28:19.375128  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:19.395869  3997 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:28:19.392074  4006 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 3.
I20260709 12:28:19.391119  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:19.403208  3931 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:19.399631  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:19.362147  6980 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:19.359802  6863 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.377002  6771 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:28:19.358472  7018 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:19.317270  6994 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:28:19.577922  4002 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
W20260709 12:28:19.582947  4537 leader_election.cc:336] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.616s (SENT)
I20260709 12:28:19.585717  4537 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:19.502033  3971 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:19.459530  3855 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:19.404210  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:19.460275  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:19.516680  3929 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:19.525478  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:19.562012  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:19.445362  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:19.454666  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 94159.5us
W20260709 12:28:19.587900  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 196854us
I20260709 12:28:19.590387  3923 raft_consensus.cc:2410] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:28:19.499505  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:19.362816  7054 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:19.588495  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:19.390586  7050 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:19.587710  3849 rpcz_store.cc:269] 0709 12:28:17.172842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.207393 (+ 34551us) service_pool.cc:224] Handling call
0709 12:28:19.373228 (+2165835us) spinlock_profiling.cc:243] Waited 66.4 ms on lock 0x7b54002a35d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:19.373343 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152632192}
I20260709 12:28:19.506394  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:19.594435  6997 raft_consensus.cc:2764] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:28:19.597471  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:19.599200  3822 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:19.596566  4574 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:19.400580  7020 consensus_meta.cc:287] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.225s	user 0.007s	sys 0.003s
I20260709 12:28:19.592039  3897 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:19.593207  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 91272.6us
I20260709 12:28:19.596837  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:19.395777  6705 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:19.400112  7006 consensus_meta.cc:287] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
I20260709 12:28:19.605521  3855 raft_consensus.cc:2410] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:28:19.395270  7077 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:19.397245  7005 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:19.606599  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:19.516750  6861 consensus_meta.cc:287] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.235s	user 0.012s	sys 0.001s
I20260709 12:28:19.395483  7067 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:19.604171  6994 consensus_queue.cc:1243] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:28:19.504233  6473 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:19.547863  7025 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:28:19.454830  7070 raft_consensus.cc:3055] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:19.607788  6863 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:28:19.659459  4574 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:19.626681  3928 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
W20260709 12:28:19.627866  7026 log.cc:927] Time spent T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:28:19.628331  7059 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:19.662096  3971 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:19.504879  7081 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.663167  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:19.663261  7081 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.663964  4570 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:19.666158  6492 consensus_meta.cc:287] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.003s
I20260709 12:28:19.666333  7006 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:19.666658  6492 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.667496  7006 raft_consensus.cc:697] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:19.639708  6861 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.672165  3853 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:19.654997  7069 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:19.674145  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 819) took 2778 ms. Trace:
I20260709 12:28:19.675985  7057 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.630923  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:19.677058  4004 raft_consensus.cc:2393] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 4: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:19.689990  6861 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.484512  6923 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:19.591524  7091 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:19.669730  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:19.699460  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:19.681542  6859 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:19.700115  4574 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
W20260709 12:28:19.635111  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 52233.5us
I20260709 12:28:19.609757  6896 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:19.701262  4537 leader_election.cc:336] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.657s (SENT)
I20260709 12:28:19.701185  6896 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:19.611300  6705 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:19.614181  7018 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:19.703946  7006 consensus_queue.cc:237] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.630327  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:19.706684  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 76578.2us
I20260709 12:28:19.707880  7059 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:19.707964  3822 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:19.708676  7059 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:19.399117  6848 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.231s
I20260709 12:28:19.710275  4003 raft_consensus.cc:2410] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:28:19.710088  7059 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:19.615449  7020 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.712563  7020 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.606144  6632 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:19.629750  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:19.633288  7060 consensus_meta.cc:287] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.005s
W20260709 12:28:19.715520  7038 consensus_meta.cc:287] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.003s
I20260709 12:28:19.715624  7060 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.716125  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:19.715991  7038 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.716734  3997 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:19.650964  6711 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.652387  7096 consensus_queue.cc:1059] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:28:19.720515  7096 raft_consensus.cc:3055] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:19.720860  7096 raft_consensus.cc:740] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:19.721477  7057 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.722323  7057 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:28:19.703483  7068 consensus_meta.cc:287] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.654s	user 0.006s	sys 0.006s
I20260709 12:28:19.723294  3854 raft_consensus.cc:2410] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:28:19.653101  4572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 865) took 2692 ms. Trace:
I20260709 12:28:19.632026  7078 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:19.723776  4568 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:28:19.632192  7058 consensus_queue.cc:1243] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer 4eedd844c09d456ca0b3614490dd1dbb log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:28:19.659611  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:19.717765  7060 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:28:19.725544  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:19.723943  4572 rpcz_store.cc:276] 0709 12:28:16.960278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:16.966447 (+  6169us) service_pool.cc:224] Handling call
0709 12:28:17.071857 (+105410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:18.839878 (+1768021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:18.839915 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:18.839961 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:18.840003 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:19.652820 (+812817us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b540055c8d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:19.652878 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:19.653011 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4065571584}
I20260709 12:28:19.608894  6583 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:19.659430  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:19.728322  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:19.717558  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:19.729414  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:19.594552  6910 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.504621  6951 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.656024  6473 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.668179  7081 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.674630  4567 rpcz_store.cc:276] 0709 12:28:16.895331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:16.956428 (+ 61097us) service_pool.cc:224] Handling call
0709 12:28:16.956830 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:16.967167 (+ 10337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:16.967211 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:16.967812 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:28:17.288375 (+320563us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:17.331011 (+ 42636us) log.cc:844] Serialized 14 byte log entry
0709 12:28:17.384258 (+ 53247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:17.384336 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:19.673862 (+2289526us) raft_consensus.cc:1685] finished
0709 12:28:19.673912 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:19.674068 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150226,"prepare.queue_time_us":39998,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":256381,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":34117,"thread_start_us":172282,"threads_started":1,"wal-append.queue_time_us":2297078}
I20260709 12:28:19.659658  7070 raft_consensus.cc:740] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:19.633104  6656 consensus_queue.cc:1059] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:28:19.700148  3852 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:19.721740  7096 consensus_queue.cc:260] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.652868  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:19.757350  6981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.186s	user 0.025s	sys 0.028s
I20260709 12:28:19.649075  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:19.762020  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 247784us
I20260709 12:28:19.765064  7096 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:19.765707  3855 raft_consensus.cc:1275] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:28:19.768484  3969 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:19.455435  6995 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:19.729868  3997 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:19.733119  4570 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:19.588994  6975 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:19.607911  3897 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:19.776854  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 169010us
I20260709 12:28:19.722747  7057 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:19.741394  6964 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:28:19.785567  4001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 537) took 3031 ms (client timeout 2917 ms). Trace:
W20260709 12:28:19.786031  4001 rpcz_store.cc:269] 0709 12:28:16.754338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.358880 (+604542us) service_pool.cc:224] Handling call
0709 12:28:19.785370 (+2426490us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b5400310954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:19.785492 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4262727552}
I20260709 12:28:19.742542  6910 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:19.743042  7062 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.742987  6980 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:19.744374  6473 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.744768  6951 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.669064  6492 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.747617  6745 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.750730  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1723) took 2985 ms. Trace:
I20260709 12:28:19.751976  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:19.800441  4005 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
W20260709 12:28:19.801050  4005 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2267) took 2193 ms (client timeout 2008 ms). Trace:
W20260709 12:28:19.801424  4005 rpcz_store.cc:269] 0709 12:28:17.607734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.734568 (+126834us) service_pool.cc:224] Handling call
0709 12:28:19.751743 (+2017175us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b58001b3f98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056f9d0a0 00007fe056f9c984 00007fe0505176d4 00007fe050517662
0709 12:28:19.800974 (+ 49231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103204224}
I20260709 12:28:19.739589  6583 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:19.803727  6583 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:19.754464  7085 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.467s	user 0.002s	sys 0.000s
I20260709 12:28:19.756143  3971 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:19.756081  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:19.807638  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 51622.6us
I20260709 12:28:19.649269  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:19.739749  7038 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:19.769626  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:19.779181  6975 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:19.772145  3969 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:19.777544  3897 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:19.771242  6981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.209s	user 0.026s	sys 0.028s
I20260709 12:28:19.773458  7070 consensus_queue.cc:260] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:19.784320  7066 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.827306  3999 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:19.789832  7047 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:19.757843  7059 consensus_queue.cc:1059] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:28:19.758273  7018 consensus_queue.cc:1048] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:28:19.831825  7070 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:19.800247  3924 rpcz_store.cc:276] 0709 12:28:16.765626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:16.765769 (+   143us) service_pool.cc:224] Handling call
0709 12:28:19.230264 (+2464495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:19.266952 (+ 36688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:19.750539 (+483587us) spinlock_profiling.cc:243] Waited 2.46 s on lock 0x7b54000ee7d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:19.750668 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5667039488}
I20260709 12:28:19.775795  7081 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:19.730841  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:19.810284  6656 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:19.788645  7057 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:19.790673  7062 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:19.813534  6995 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:19.814062  6848 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:19.814553  6605 raft_consensus.cc:3055] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:28:19.814668  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 58588.4us
I20260709 12:28:19.815176  6964 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:19.815459  7069 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:19.818521  4000 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:19.787096  6859 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:19.790063  7077 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:19.753005  3998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36516 (request call id 2246) took 3009 ms (client timeout 3065 ms). Trace:
I20260709 12:28:19.832253  7018 consensus_queue.cc:1243] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:28:20.052984  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:19.992305  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:19.889871  4537 leader_election.cc:336] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.832s (SENT)
W20260709 12:28:19.835984  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:20.055898  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 166082us
I20260709 12:28:20.053730  3849 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
W20260709 12:28:20.056667  4537 leader_election.cc:336] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.875s (SENT)
I20260709 12:28:19.935137  3850 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:19.890780  6632 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:20.057862  6632 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.058835  6656 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:20.059314  6656 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:19.955576  6981 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:20.060068  6981 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:20.059345  4006 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:20.054858  7081 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:28:20.061774  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 284295us
W20260709 12:28:19.935029  3856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2204) took 1896 ms (client timeout 1979 ms). Trace:
W20260709 12:28:20.052182  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 280112us
I20260709 12:28:20.064700  3969 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:20.063776  3897 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:20.067342  3897 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:20.066321  3969 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:19.876636  7005 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:20.075318  3851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40038 (request call id 772) took 3009 ms (client timeout 2168 ms). Trace:
W20260709 12:28:20.062767  3856 rpcz_store.cc:269] 0709 12:28:18.038480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:18.038627 (+   147us) service_pool.cc:224] Handling call
0709 12:28:19.934775 (+1896148us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b540001a9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:19.934929 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1589144960}
W20260709 12:28:20.087922  3851 rpcz_store.cc:269] 0709 12:28:17.065602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.158315 (+ 92713us) service_pool.cc:224] Handling call
0709 12:28:20.075113 (+2916798us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54002ef254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:20.075239 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4716922112}
I20260709 12:28:20.088531  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:20.089207  3856 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:20.090035  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2199) took 2140 ms. Trace:
W20260709 12:28:20.079469  4537 leader_election.cc:336] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.935s (SENT)
W20260709 12:28:20.089491  3857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40038 (request call id 781) took 2763 ms (client timeout 1813 ms). Trace:
W20260709 12:28:20.068325  3998 rpcz_store.cc:269] 0709 12:28:16.743678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:16.744496 (+   818us) service_pool.cc:224] Handling call
0709 12:28:19.752716 (+3008220us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54003a5cd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:19.752896 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5094339968}
I20260709 12:28:20.067947  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:20.092449  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:20.089471  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:20.094110  3851 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:20.094710  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:20.090454  3853 rpcz_store.cc:276] 0709 12:28:17.949359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.949490 (+   131us) service_pool.cc:224] Handling call
0709 12:28:20.089848 (+2140358us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54000177d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:20.089972 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3918856448}
W20260709 12:28:20.092474  3857 rpcz_store.cc:269] 0709 12:28:17.325853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.326038 (+   185us) service_pool.cc:224] Handling call
0709 12:28:20.089296 (+2763258us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b540001a4d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:20.089423 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4076715264}
I20260709 12:28:20.099637  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:20.099479  3897 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:20.097491  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:20.103283  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:20.103299  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:20.104185  3849 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:20.104301  4002 raft_consensus.cc:2393] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 4: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:28:20.104691  3930 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2305) took 2607 ms (client timeout 2107 ms). Trace:
W20260709 12:28:20.105062  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:20.105113  3930 rpcz_store.cc:269] 0709 12:28:17.480228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.480369 (+   141us) service_pool.cc:224] Handling call
0709 12:28:20.086918 (+2606549us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54000d5554. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:20.087079 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3867049216}
I20260709 12:28:20.107502  4571 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:28:20.107784  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:20.108732  4569 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:20.108853  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:20.109508  3853 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:20.106029  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:20.112550  3998 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:19.832929  6794 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:20.115170  4536 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:20.125665  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:20.117468  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:20.128108  3857 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:20.118446  3848 raft_consensus.cc:1240] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:28:20.120786  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.121153  3851 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:20.121773  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.129287  3931 raft_consensus.cc:2393] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:20.129166  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:20.129616  3924 raft_consensus.cc:2368] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8.
I20260709 12:28:20.129933  3853 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:20.130892  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.066156  6859 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:20.122565  3997 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:20.123378  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:19.944914  7039 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:20.122063  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.066308  6964 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:20.100422  7046 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:20.063510  6605 raft_consensus.cc:740] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:20.069447  6793 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:20.169853  7005 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:20.170207  6951 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:20.191813  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1735) took 1001 ms. Trace:
I20260709 12:28:20.192189  3928 rpcz_store.cc:276] 0709 12:28:19.190533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:19.191405 (+   872us) service_pool.cc:224] Handling call
0709 12:28:19.208077 (+ 16672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:19.660751 (+452674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:20.191556 (+530805us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540018c754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:20.191751 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922051328}
I20260709 12:28:20.193430  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.196152  6975 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.209419  6896 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:20.137703  3924 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:20.181452  3855 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:28:20.101013  7056 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:20.181603  4003 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:20.147017  4538 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:20.147930  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:20.148350  4536 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:20.252694  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 104431us
W20260709 12:28:20.252789  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 105854us
I20260709 12:28:20.254347  4538 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:20.152789  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.153439  6981 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:20.153700  3927 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:28:20.255704  3927 pending_rounds.cc:85] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 7
I20260709 12:28:20.255797  3926 raft_consensus.cc:2393] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:20.255982  3927 pending_rounds.cc:107] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:28:20.147375  6859 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:20.158291  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.159229  6632 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:20.160941  3849 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:20.136169  6848 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:20.162446  7060 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:28:20.162788  7010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.006s	sys 0.015s
I20260709 12:28:20.162962  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.166257  7081 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.167471  7077 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:20.168207  6980 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:20.119342  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:20.313158  4001 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:20.272907  4569 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:20.151677  6964 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:20.115824  6984 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:20.281682  7060 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:20.136389  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:20.214507  4006 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:20.216288  7042 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:20.217483  6605 consensus_queue.cc:260] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.218930  7019 raft_consensus.cc:3055] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:20.220326  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2250) took 3732 ms. Trace:
I20260709 12:28:20.220644  7062 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:20.222908  6705 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:20.226358  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:20.351155  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:20.198285  6975 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:20.354017  4571 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: [6.6-8.7]
I20260709 12:28:20.227727  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.355737  3925 raft_consensus.cc:2393] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 8: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:20.229771  3848 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:20.231205  6711 raft_consensus.cc:3055] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:20.232771  3857 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:20.234195  3856 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:20.243139  3855 pending_rounds.cc:85] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 6
I20260709 12:28:20.356696  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.360721  3855 pending_rounds.cc:107] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:28:20.360987  3855 raft_consensus.cc:2889] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:20.361183  3925 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 4: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:20.187018  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.361985  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.187865  4000 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:20.133494  3929 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:20.244628  3928 raft_consensus.cc:2368] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6.
I20260709 12:28:20.152709  3930 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:20.259411  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.363969  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:20.365041  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.366228  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:20.366344  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:20.274973  3851 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:28:20.367708  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:20.260021  4536 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:20.262988  4538 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:20.275985  3923 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:20.259083  7056 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:20.187136  7039 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:20.294808  3849 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:20.295970  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:20.300623  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 234355us
I20260709 12:28:20.260195  6951 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:20.150215  7046 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:20.381515  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:20.258443  3970 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:20.382539  4565 raft_consensus.cc:2368] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
W20260709 12:28:20.382755  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 124400us
I20260709 12:28:20.383685  3970 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:20.274693  7096 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:20.288127  6213 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:20.319231  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.211988  3850 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:28:20.172878  7067 consensus_meta.cc:287] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.522s	user 0.004s	sys 0.004s
I20260709 12:28:20.281355  6848 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:20.285462  6315 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:20.334304  3821 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:20.298275  7010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.257s	user 0.007s	sys 0.016s
I20260709 12:28:20.324041  3853 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:20.175448  6583 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:20.346830  3999 rpcz_store.cc:276] 0709 12:28:16.488433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:16.488567 (+   134us) service_pool.cc:224] Handling call
0709 12:28:16.488910 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:19.827781 (+3338871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:20.219977 (+392196us) spinlock_profiling.cc:243] Waited 3.34 s on lock 0x7b540036e554. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:20.220239 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7677147008}
I20260709 12:28:20.347690  7019 raft_consensus.cc:740] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:20.362051  3931 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:20.402191  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.402963  3931 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:20.256258  3927 raft_consensus.cc:2889] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:20.369355  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 106449us
I20260709 12:28:20.369588  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:20.370078  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 116775us
I20260709 12:28:20.343217  7060 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:20.367726  3925 raft_consensus.cc:2410] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:28:20.375370  3969 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:20.376931  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.377620  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:20.377486  7070 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:20.359695  6711 raft_consensus.cc:740] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:20.386705  3932 raft_consensus.cc:2393] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 8: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:20.388149  3970 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:20.377625  6910 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:20.393339  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:20.390729  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 56547.3us
I20260709 12:28:20.390865  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.423796  3929 raft_consensus.cc:2410] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:28:20.424010  3926 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:20.385826  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.425544  3930 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:20.375660  7056 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:20.448073  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 72793.4us
I20260709 12:28:20.417960  3928 raft_consensus.cc:2410] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:28:20.450594  3969 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:20.452126  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 64073.4us
I20260709 12:28:20.453272  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:20.413180  4001 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: [6.6-8.7]
I20260709 12:28:20.386992  7046 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:20.432039  7019 consensus_queue.cc:260] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.464143  7019 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:20.342947  7023 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:20.434500  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 134659us
I20260709 12:28:20.434689  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.425431  4536 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:20.471531  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 46179.2us
I20260709 12:28:20.472723  4536 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:20.443455  3925 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:20.474218  7096 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:20.474727  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.381628  7069 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:20.474761  7096 raft_consensus.cc:697] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:20.474890  6315 consensus_queue.cc:1059] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:20.475442  7069 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.476253  7042 raft_consensus.cc:3055] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:20.476073  7096 consensus_queue.cc:237] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.476665  7042 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:20.445932  4572 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:20.395113  6980 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:20.392416  6975 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:20.386209  6213 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:20.404647  6605 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:20.460816  4537 leader_election.cc:336] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.521s (SENT)
I20260709 12:28:20.401569  7062 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:20.409948  7067 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.477653  7069 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:20.477624  7042 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.497290  6213 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:20.500927  7069 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:20.501739  7069 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.502589  6711 consensus_queue.cc:260] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:20.504139  7069 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:20.504328  6711 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:20.502605  7042 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:20.480225  6983 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:20.506328  6983 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:20.506743  6983 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:20.506841  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 46087.5us
W20260709 12:28:20.508216  4537 leader_election.cc:336] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.551s (SENT)
I20260709 12:28:20.509102  7062 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:20.509472  7062 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:20.480126  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:20.479684  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:20.512131  3925 raft_consensus.cc:2393] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:20.512360  4567 raft_consensus.cc:2368] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:28:20.479194  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:20.462774  3932 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:28:20.515957  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:20.516829  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:20.430473  4565 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:28:20.473685  7038 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:20.394922  6848 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:20.510890  4536 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:20.523469  3930 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:28:20.523757  4536 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:20.526367  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 75896.9us
I20260709 12:28:20.526881  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.472345  7060 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.528280  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:20.531404  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 78198.4us
I20260709 12:28:20.532141  3925 raft_consensus.cc:2368] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8.
I20260709 12:28:20.422065  7070 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:20.530213  4536 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:20.530368  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:20.534917  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 64638.9us
I20260709 12:28:20.536185  4571 raft_consensus.cc:2368] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:28:20.536962  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.537817  3925 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:20.540117  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.386940  6951 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:20.552387  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.553198  3932 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
W20260709 12:28:20.559130  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:20.546983  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.529682  7025 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:20.567595  3929 raft_consensus.cc:1275] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:28:20.459139  6910 raft_consensus.cc:697] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:20.570086  4570 raft_consensus.cc:2368] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
I20260709 12:28:20.569916  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.550082  6975 raft_consensus.cc:697] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:20.602746  3928 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:28:20.530565  6705 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:20.603132  3928 pending_rounds.cc:85] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 6
I20260709 12:28:20.544356  6315 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:20.603458  3928 pending_rounds.cc:107] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:28:20.603869  3928 raft_consensus.cc:2889] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:20.535337  7070 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:20.608117  3932 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:28:20.541865  7063 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:20.544188  6984 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:20.616549  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.617328  3929 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:20.619218  3925 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:20.625422  3926 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:20.614096  6794 consensus_queue.cc:1059] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:28:20.543990  6980 raft_consensus.cc:697] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:20.633303  3930 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:20.597832  7042 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:20.637826  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.530314  7108 consensus_queue.cc:1048] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 12:28:20.641366  3925 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:20.550972  6793 consensus_queue.cc:1059] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:28:20.542672  7069 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:28:20.544885  7057 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:20.650269  3928 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: [8.6-9.7]
W20260709 12:28:20.633117  7006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.018s	sys 0.058s
I20260709 12:28:20.593588  7038 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:28:20.653750  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.566882  6656 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.662811  3930 raft_consensus.cc:2393] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:20.606931  7025 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.634235  6315 raft_consensus.cc:697] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:28:20.713125  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:20.693540  3822 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.013s	sys 0.049s
I20260709 12:28:20.724782  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.729560  3925 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:20.649375  6984 raft_consensus.cc:697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:20.608309  7031 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:28:20.644176  7042 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:20.730645  3822 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.016s	sys 0.052s
I20260709 12:28:20.729305  7021 raft_consensus.cc:3055] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:28:20.739601  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 674419us
I20260709 12:28:20.739962  7021 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:20.740870  3822 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:20.741765  7091 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:28:20.679514  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:20.742751  7018 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:20.739133  7042 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:20.743319  7021 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.750483  6656 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:20.661971  6583 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:20.653935  6473 consensus_queue.cc:1059] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:28:20.754084  7031 raft_consensus.cc:3055] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:20.754544  7031 raft_consensus.cc:740] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:20.755637  7031 consensus_queue.cc:260] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.757087  7091 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:20.652436  6974 raft_consensus.cc:2243] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.759131  6656 consensus_queue.cc:1059] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:20.760742  6974 raft_consensus.cc:2272] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.764681  7057 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:20.698768  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:20.765900  4537 leader_election.cc:336] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.764s (SENT)
I20260709 12:28:20.766153  7060 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:20.766552  7091 raft_consensus.cc:3055] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:20.766520  4537 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:20.767232  7091 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:20.770102  6984 consensus_queue.cc:237] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:20.660457  7006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.019s	sys 0.059s
I20260709 12:28:20.755651  3822 leader_election.cc:400] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
I20260709 12:28:20.749212  6859 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:20.784794  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.788709  3928 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:20.791816  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.787039  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.792514  3926 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:20.793056  3925 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:20.795523  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.782352  3822 leader_election.cc:403] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:28:20.796864  3930 raft_consensus.cc:2368] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:28:20.797513  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.780532  7060 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:20.798940  3932 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:20.800611  3822 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:20.803634  3822 leader_election.cc:400] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:28:20.807680  7057 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:20.808235  7057 raft_consensus.cc:697] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:20.808727  6964 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.810037  4004 raft_consensus.cc:2368] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8.
I20260709 12:28:20.811607  7023 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:20.814422  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.815574  3926 raft_consensus.cc:2393] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:20.805586  3822 leader_election.cc:403] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:28:20.821370  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:20.809262  7057 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.797513  6656 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
I20260709 12:28:20.740124  6213 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.734864  6910 consensus_queue.cc:237] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:20.853238  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:20.853869  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:20.840204  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.842420  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2277) took 1028 ms. Trace:
I20260709 12:28:20.855139  4000 rpcz_store.cc:276] 0709 12:28:19.814342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.105491 (+291149us) service_pool.cc:224] Handling call
0709 12:28:20.842162 (+736671us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b540032c154. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:20.842338 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125960448}
I20260709 12:28:20.856969  3926 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:20.831673  6705 raft_consensus.cc:3055] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:28:20.866190  4537 leader_election.cc:336] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.885s (SENT)
I20260709 12:28:20.874109  4537 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:20.873097  4000 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:28:20.772523  6975 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.877123  4004 pending_rounds.cc:85] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 1
I20260709 12:28:20.883821  4004 pending_rounds.cc:107] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 12:28:20.878453  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:20.881810  3928 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:20.884119  4004 raft_consensus.cc:2889] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:20.902647  4537 leader_election.cc:336] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.932s (SENT)
I20260709 12:28:20.903302  4537 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:20.906669  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.907435  3925 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:20.909022  4566 raft_consensus.cc:2368] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8.
I20260709 12:28:20.910272  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.910993  3928 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:20.914852  3932 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:28:20.794625  6980 consensus_queue.cc:237] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.873306  6705 raft_consensus.cc:740] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:20.900031  6583 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:20.974546  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:20.912768  7069 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:20.905361  6656 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:28:20.935233  7019 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:20.970964  3926 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:20.875998  6983 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:20.948417  6974 ts_tablet_manager.cc:1916] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:28:20.836014  7091 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.841800  6315 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:20.874351  7056 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:21.000051  3928 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:21.014973  3932 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:28:21.022512  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:21.022660  3930 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:21.021643  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:21.022876  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:21.023867  3928 raft_consensus.cc:2393] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:20.995407  6951 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:21.032225  3923 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:21.001839  7067 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:20.980881  6583 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:21.053403  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:21.054437  3928 raft_consensus.cc:2393] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 8: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:21.032518  7091 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:21.047453  6964 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:21.058115  4538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.010s	sys 0.013s
W20260709 12:28:21.061458  4538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.010s	sys 0.013s
W20260709 12:28:21.061931  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 529065us
W20260709 12:28:21.052986  7081 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.000s	sys 0.021s
I20260709 12:28:21.067543  3926 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:28:21.068756  7077 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.001s	sys 0.024s
W20260709 12:28:21.069146  7077 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.001s	sys 0.024s
W20260709 12:28:21.064381  3999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.021s	sys 0.050s
W20260709 12:28:21.060282  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 461070us
W20260709 12:28:21.065130  3821 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.019s	sys 0.013s
W20260709 12:28:21.070225  3821 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.019s	sys 0.013s
I20260709 12:28:21.050277  7025 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:21.069896  3999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.021s	sys 0.050s
I20260709 12:28:21.070694  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:21.080081  3932 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
W20260709 12:28:21.055299  7096 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.008s	sys 0.015s
W20260709 12:28:21.071225  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:21.070703  4536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.015s	sys 0.010s
W20260709 12:28:21.045945  7059 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.006s	sys 0.015s
I20260709 12:28:21.079058  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:21.060330  6859 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:21.133366  4000 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: []
W20260709 12:28:21.066172  7081 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.000s	sys 0.022s
I20260709 12:28:21.113550  3857 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:21.114368  3856 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:28:21.120390  7059 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.007s	sys 0.015s
I20260709 12:28:21.115577  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.116321  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:21.138859  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:21.139608  4570 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:21.139699  3856 raft_consensus.cc:2393] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:21.119030  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:21.119807  4536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.015s	sys 0.010s
W20260709 12:28:21.140456  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 610272us
I20260709 12:28:21.114116  6213 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:21.120097  4003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.024s	sys 0.032s
I20260709 12:28:21.121765  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:21.144430  4569 raft_consensus.cc:2393] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 5: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:21.122704  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:21.146306  3932 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:21.116359  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.125159  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:21.120205  6951 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:21.024466  6705 consensus_queue.cc:260] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:21.126530  4565 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:28:21.126894  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:21.148864  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:21.058391  7042 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:21.111642  7096 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.008s	sys 0.015s
I20260709 12:28:21.065681  7067 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.113256  7018 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.138327  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:21.171609  7018 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:21.116477  3854 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:21.174088  7018 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:21.174765  6583 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:21.175452  7021 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:21.182776  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:21.183845  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.184538  3855 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:21.185760  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2283) took 1080 ms. Trace:
I20260709 12:28:21.186487  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.187162  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.187685  3852 raft_consensus.cc:2410] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:28:21.188290  7121 log.cc:927] Time spent T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:28:21.188807  6896 raft_consensus.cc:3055] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:21.186164  4001 rpcz_store.cc:276] 0709 12:28:20.105503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.314734 (+209231us) service_pool.cc:224] Handling call
0709 12:28:20.409787 (+ 95053us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:20.454268 (+ 44481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:21.185554 (+731286us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b540032d050. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:21.185696 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217520000}
I20260709 12:28:21.189312  6896 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:28:21.144865  7115 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.269s	user 0.002s	sys 0.003s
I20260709 12:28:21.189981  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:21.190275  6896 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:21.190853  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 890) took 1093 ms. Trace:
W20260709 12:28:21.150900  4003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.024s	sys 0.033s
I20260709 12:28:21.152364  3856 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:21.190984  4001 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:21.203344  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.198875  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.199592  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.205533  3854 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
W20260709 12:28:21.153985  4006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.011s	sys 0.021s
I20260709 12:28:21.154481  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:21.207044  3857 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:21.208585  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:21.120270  7006 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:21.210695  6705 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:21.211094  7006 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:21.212383  7111 log.cc:927] Time spent T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.214s	user 0.001s	sys 0.003s
I20260709 12:28:21.213418  7006 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:21.213950  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:21.138931  6983 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:21.197940  6605 consensus_meta.cc:287] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.696s	user 0.008s	sys 0.003s
I20260709 12:28:21.166546  6951 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:21.232606  6951 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:21.191239  4573 rpcz_store.cc:276] 0709 12:28:20.097540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.097897 (+   357us) service_pool.cc:224] Handling call
0709 12:28:20.124595 (+ 26698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:20.127118 (+  2523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:20.127161 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:20.133585 (+  6424us) log.cc:844] Serialized 26 byte log entry
0709 12:28:20.385027 (+251442us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:20.385077 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:20.385160 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:21.190661 (+805501us) raft_consensus.cc:1685] finished
0709 12:28:21.190680 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:21.190798 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":13913,"thread_start_us":195674,"threads_started":1,"wal-append.queue_time_us":627375}
I20260709 12:28:21.237156  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:21.238458  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:21.239056  4573 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:21.242097  6213 consensus_queue.cc:1059] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:21.243206  6213 raft_consensus.cc:3055] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:28:21.243302  7116 log.cc:927] Time spent T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.225s	user 0.002s	sys 0.000s
I20260709 12:28:21.243584  6213 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:21.164072  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:21.244525  6213 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:21.245186  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 559) took 1531 ms. Trace:
I20260709 12:28:21.164410  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.246204  3850 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:21.247545  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:21.248987  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:21.089083  7108 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:28:21.168821  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:21.251339  7031 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:21.251562  3849 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 5: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:21.252727  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:21.169628  7110 log.cc:927] Time spent T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:28:21.169523  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:21.255854  4570 raft_consensus.cc:2410] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:28:21.169345  7067 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:21.258803  7067 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:21.169828  7056 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:21.249703  3850 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:21.261682  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 553) took 1679 ms. Trace:
W20260709 12:28:21.209448  4006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.012s	sys 0.021s
I20260709 12:28:21.268882  4002 rpcz_store.cc:276] 0709 12:28:19.582071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.111966 (+529895us) service_pool.cc:224] Handling call
0709 12:28:20.842926 (+730960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:20.843194 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:20.843236 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:20.843300 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:20.843351 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:20.843435 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:21.261522 (+418087us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b540032c150. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:21.261624 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1610537728}
I20260709 12:28:21.271027  4572 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:21.214756  3854 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:21.275278  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.141638  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:21.222950  7046 consensus_meta.cc:287] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.693s	user 0.011s	sys 0.000s
W20260709 12:28:21.223536  7062 consensus_meta.cc:287] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.714s	user 0.006s	sys 0.006s
I20260709 12:28:21.245615  3998 rpcz_store.cc:276] 0709 12:28:19.713784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.113752 (+399968us) service_pool.cc:224] Handling call
0709 12:28:20.114086 (+   334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:20.114524 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:20.114554 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:20.134365 (+ 19811us) log.cc:844] Serialized 52 byte log entry
0709 12:28:20.645529 (+511164us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:20.645585 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:20.645685 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:21.233290 (+587605us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:21.244864 (+ 11574us) raft_consensus.cc:1685] finished
0709 12:28:21.244885 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:21.245125 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62380,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":72406400,"thread_start_us":445875,"threads_started":1,"wal-append.queue_time_us":767321}
W20260709 12:28:21.280596  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:21.224532  7070 consensus_meta.cc:287] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.589s	user 0.007s	sys 0.002s
W20260709 12:28:21.197394  6848 consensus_meta.cc:287] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.000s
I20260709 12:28:21.300601  3998 raft_consensus.cc:1217] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Deduplicated request from leader. Original: 3.5->[5.6-6.7]   Dedup: 5.6->[6.7-6.7]
I20260709 12:28:21.203737  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:21.272691  3925 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:21.301244  3998 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: [5.6-6.7]
I20260709 12:28:21.264262  3929 raft_consensus.cc:1240] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:21.276405  3849 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:21.221530  3857 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
W20260709 12:28:21.302376  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:21.261128  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2310) took 1028 ms. Trace:
I20260709 12:28:21.304015  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:21.281299  4000 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 8: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:21.281749  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:21.304421  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:21.305473  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.306591  3851 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:21.282972  3852 raft_consensus.cc:2410] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:28:21.284835  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.307991  3855 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:21.303478  3924 rpcz_store.cc:276] 0709 12:28:20.233132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.380324 (+147192us) service_pool.cc:224] Handling call
0709 12:28:20.447417 (+ 67093us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:20.447789 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:20.447818 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:20.537085 (+ 89267us) log.cc:844] Serialized 26 byte log entry
0709 12:28:20.980691 (+443606us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:20.980735 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:20.980988 (+   253us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:21.259456 (+278468us) raft_consensus.cc:1685] finished
0709 12:28:21.259474 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:21.260897 (+  1423us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b54000ef6d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:21.261069 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7279,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":52675,"spinlock_wait_cycles":153406848,"thread_start_us":372827,"threads_started":1,"wal-append.queue_time_us":562627}
I20260709 12:28:21.310844  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:21.316283  3857 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:21.291610  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:21.246325  6711 consensus_meta.cc:287] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.741s	user 0.012s	sys 0.000s
I20260709 12:28:21.320467  7019 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:21.320981  7019 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:21.304746  7070 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:21.326378  7019 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:21.328183  7070 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:21.299713  7062 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:21.329296  7056 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:21.329828  3848 raft_consensus.cc:2368] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11.
I20260709 12:28:21.330968  7062 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:21.332233  7056 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:28:21.334880  3970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.008s	sys 0.035s
W20260709 12:28:21.335724  3970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.008s	sys 0.035s
I20260709 12:28:21.216722  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:21.245761  6213 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:21.204613  6859 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:21.337391  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 371648us
W20260709 12:28:21.284617  6632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.010s	sys 0.031s
I20260709 12:28:21.312440  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:21.345664  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 129020us
I20260709 12:28:21.315430  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.347136  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:21.285111  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 481632us
I20260709 12:28:21.348413  3969 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:21.287249  3897 connection.cc:256] RPC call timeout handler was delayed by -3.0211854939998375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 12:28:21.312700  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:21.344106  4001 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:28:21.349329  3822 leader_election.cc:400] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:28:21.349454  3857 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:21.354912  3822 leader_election.cc:403] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:28:21.354988  3897 connection.cc:256] RPC call timeout handler was delayed by -3.0175854939998317s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260709 12:28:21.356046  3897 connection.cc:256] RPC call timeout handler was delayed by -2.9725854939997589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 12:28:21.356351  4537 leader_election.cc:336] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 2.168s (SENT)
W20260709 12:28:21.356608  3897 connection.cc:256] RPC call timeout handler was delayed by -2.9644854939997458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260709 12:28:21.300740  7039 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:21.312163  6848 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:21.372205  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:21.372552  3822 leader_election.cc:400] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
I20260709 12:28:21.373034  3822 leader_election.cc:403] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:28:21.358985  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:21.377125  3970 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:21.378247  3970 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:21.363862  7067 consensus_queue.cc:1059] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:28:21.359318  3897 connection.cc:256] RPC call timeout handler was delayed by -2.6206854939996447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
I20260709 12:28:21.380406  3822 leader_election.cc:400] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8.
W20260709 12:28:21.380627  3897 connection.cc:256] RPC call timeout handler was delayed by -2.6098854939996272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
I20260709 12:28:21.380963  3822 leader_election.cc:403] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:28:21.381729  3897 connection.cc:256] RPC call timeout handler was delayed by -2.437985493999804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260709 12:28:21.382189  3897 connection.cc:256] RPC call timeout handler was delayed by -2.40468549399975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
W20260709 12:28:21.382505  3897 connection.cc:256] RPC call timeout handler was delayed by -2.3407854939996469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2275s for a response
W20260709 12:28:21.382810  3897 connection.cc:256] RPC call timeout handler was delayed by -2.1472854939997887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24900000000000003s for a response
W20260709 12:28:21.383123  3897 connection.cc:256] RPC call timeout handler was delayed by -1.6297854939998615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3065s for a response
W20260709 12:28:21.383415  3897 connection.cc:256] RPC call timeout handler was delayed by -1.6297854939998615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3065s for a response
W20260709 12:28:21.383790  3897 connection.cc:256] RPC call timeout handler was delayed by -1.5415854939997189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3163s for a response
I20260709 12:28:21.384212  3850 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
W20260709 12:28:21.384470  3897 connection.cc:256] RPC call timeout handler was delayed by -1.4434854939995603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3272s for a response
I20260709 12:28:21.387604  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:21.387883  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:21.385010  3854 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
W20260709 12:28:21.377394  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:21.391506  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:21.377353  3895 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:21.390133  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.390749  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:21.391288  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:21.392486  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 725) took 1033 ms. Trace:
I20260709 12:28:21.393301  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:21.393744  4566 raft_consensus.cc:2393] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:28:21.345538  6632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.010s	sys 0.031s
I20260709 12:28:21.394765  3850 raft_consensus.cc:2393] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:21.393536  3931 rpcz_store.cc:276] 0709 12:28:20.359121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.559223 (+200102us) service_pool.cc:224] Handling call
0709 12:28:20.559491 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:20.559685 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:20.978416 (+418731us) log.cc:844] Serialized 14 byte log entry
0709 12:28:21.384922 (+406506us) log.cc:844] Serialized 14 byte log entry
0709 12:28:21.392132 (+  7210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:21.392173 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:21.392218 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:21.392271 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:21.392432 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6964,"prepare.queue_time_us":632497,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"thread_start_us":781460,"threads_started":2}
W20260709 12:28:21.399951  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:21.286087  7046 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:21.401432  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:21.407109  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.408181  3854 raft_consensus.cc:2393] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:21.409168  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.377709  7019 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:21.421321  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:21.416049  3854 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
W20260709 12:28:21.417083  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 68756.6us
I20260709 12:28:21.423800  3969 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:21.424610  3927 raft_consensus.cc:1240] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:21.402200  7039 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:21.419723  3822 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:21.422271  3970 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:21.418779  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.430251  3850 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:21.376684  6711 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:28:21.376259  6859 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:21.436861  3897 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:21.404163  6605 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8.
I20260709 12:28:21.404528  7129 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.401628  7091 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
I20260709 12:28:21.429355  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:21.431666  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:21.424631  7108 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:21.400887  6964 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:21.377435  7062 consensus_queue.cc:1059] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:28:21.403853  6656 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:21.421965  6583 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:21.438434  4537 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:21.439040  3970 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:21.433475  7023 consensus_meta.cc:287] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.621s	user 0.006s	sys 0.006s
I20260709 12:28:21.424499  7124 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.445456  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:21.411589  6983 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:28:21.448123  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:21.427090  7025 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:28:21.497691  4568 raft_consensus.cc:2410] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:28:21.498052  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:21.432469  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 53043.9us
I20260709 12:28:21.452119  3822 leader_election.cc:400] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8.
I20260709 12:28:21.436189  6995 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:21.514479  6995 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:21.514923  6995 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:21.451287  7108 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:21.490726  7005 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:28:21.519268  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 73886us
I20260709 12:28:21.520327  3969 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:21.521282  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:21.496443  6656 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:21.443560  7081 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:28:21.498912  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 60548.8us
W20260709 12:28:21.499815  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 47827.6us
W20260709 12:28:21.500080  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:21.501035  7096 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:21.547009  6605 raft_consensus.cc:3055] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:28:21.547242  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:21.547508  6605 raft_consensus.cc:740] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:21.489121  6848 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:21.548678  6848 raft_consensus.cc:2764] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:28:21.549435  6848 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:28:21.506699  7118 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:28:21.508333  7109 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.514s	user 0.005s	sys 0.002s
I20260709 12:28:21.441944  7006 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:28:21.510927  7124 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:21.513959  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2285) took 1399 ms. Trace:
W20260709 12:28:21.518368  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 79395.5us
I20260709 12:28:21.524732  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2280) took 1709 ms. Trace:
W20260709 12:28:21.563745  4004 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.008s	sys 0.025s
W20260709 12:28:21.564111  4004 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.008s	sys 0.025s
I20260709 12:28:21.564673  4567 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:28:21.427130  7063 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:28:21.518172  7108 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:21.527143  3969 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:21.488402  4002 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:21.531301  4571 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
W20260709 12:28:21.569525  3997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.015s
I20260709 12:28:21.453711  6964 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:21.426921  7131 consensus_queue.cc:1048] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 12:28:21.536644  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.445499  7129 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:21.447187  7069 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:28:21.537439  7031 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:21.543195  7046 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:21.519259  7005 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:21.544410  3848 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:28:21.525955  7038 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.545503  7091 consensus_queue.cc:1059] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:21.442075  3854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:28:21.635632  3854 raft_consensus.cc:606] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:21.636147  3854 raft_consensus.cc:614] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:21.550189  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.546074  3850 raft_consensus.cc:1240] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:21.555738  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:21.489130  7057 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.005s	sys 0.016s
I20260709 12:28:21.561200  4537 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:21.535208  3821 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:21.572049  3997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.007s	sys 0.015s
W20260709 12:28:21.584201  3896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.012s	sys 0.013s
W20260709 12:28:21.646162  3896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.012s	sys 0.014s
I20260709 12:28:21.586814  6964 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:21.590996  7131 consensus_queue.cc:1243] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:28:21.562932  4003 rpcz_store.cc:276] 0709 12:28:19.815162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.286711 (+471549us) service_pool.cc:224] Handling call
0709 12:28:20.287153 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:20.288426 (+  1273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:20.288498 (+    72us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:20.299407 (+ 10909us) log.cc:844] Serialized 26 byte log entry
0709 12:28:21.209930 (+910523us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:21.299897 (+ 89967us) log.cc:844] Serialized 14 byte log entry
0709 12:28:21.300123 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:21.300196 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:21.524534 (+224338us) raft_consensus.cc:1685] finished
0709 12:28:21.524553 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:21.524676 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36392,"prepare.queue_time_us":94295,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":1782,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":21912,"thread_start_us":859842,"threads_started":1,"wal-append.queue_time_us":1089967}
I20260709 12:28:21.537428  6859 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:21.591444  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:21.556984  6951 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:21.556893  6983 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.682999  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:21.597239  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2313) took 1290 ms. Trace:
W20260709 12:28:21.587486  7077 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.009s	sys 0.030s
W20260709 12:28:21.584703  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 57682.8us
I20260709 12:28:21.652670  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:21.654021  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 118895us
I20260709 12:28:21.654054  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:21.592062  7113 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.015s	sys 0.021s
I20260709 12:28:21.562675  4006 rpcz_store.cc:276] 0709 12:28:20.114807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.407627 (+292820us) service_pool.cc:224] Handling call
0709 12:28:20.408122 (+   495us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:20.447311 (+ 39189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:20.447343 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:20.460016 (+ 12673us) log.cc:844] Serialized 52 byte log entry
0709 12:28:21.269864 (+809848us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:21.269952 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:21.270929 (+   977us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:21.513692 (+242763us) raft_consensus.cc:1685] finished
0709 12:28:21.513713 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:21.513873 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":174406,"raft.queue_time_us":43293,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":18218,"thread_start_us":661556,"threads_started":1,"wal-append.queue_time_us":926561}
I20260709 12:28:21.694844  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 552) took 2113 ms. Trace:
W20260709 12:28:21.658284  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 97173us
I20260709 12:28:21.679754  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:21.596431  6705 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:28:21.645246  7057 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.006s	sys 0.016s
I20260709 12:28:21.682255  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:21.689846  4003 raft_consensus.cc:2410] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:28:21.690347  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:21.569324  7025 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:28:21.682335  7056 raft_consensus.cc:3055] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:21.690047  3927 rpcz_store.cc:276] 0709 12:28:20.307079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.435635 (+128556us) service_pool.cc:224] Handling call
0709 12:28:20.435914 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:21.425146 (+989232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:21.596887 (+171741us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b54002e2054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:21.597156 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273289600}
I20260709 12:28:21.684062  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:21.687759  3850 pending_rounds.cc:85] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 8
I20260709 12:28:21.718719  3850 pending_rounds.cc:107] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:28:21.719113  3850 raft_consensus.cc:2889] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:21.691143  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:21.695408  3969 leader_election.cc:400] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11.
I20260709 12:28:21.720669  3969 leader_election.cc:403] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:28:21.720903  3929 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:21.695952  3925 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:21.698472  4572 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:21.721683  3969 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:21.697724  7113 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.015s	sys 0.022s
I20260709 12:28:21.686774  6951 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:21.698043  4005 rpcz_store.cc:276] 0709 12:28:19.581741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:19.802829 (+221088us) service_pool.cc:224] Handling call
0709 12:28:19.803288 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:19.813591 (+ 10303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:19.813619 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:20.052626 (+239007us) log.cc:844] Serialized 26 byte log entry
0709 12:28:20.510380 (+457754us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:20.510415 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:20.510482 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:21.507706 (+997224us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:21.687840 (+180134us) raft_consensus.cc:1685] finished
0709 12:28:21.687863 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:21.694780 (+  6917us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7152,"raft.queue_time_us":10277,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":114367232,"thread_start_us":370564,"threads_started":1,"wal-append.queue_time_us":827631}
I20260709 12:28:21.723095  3969 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:21.694084  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 257288us
W20260709 12:28:21.689747  3739 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4eedd844c09d456ca0b3614490dd1dbb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:21.653700  7091 consensus_queue.cc:1243] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:28:21.656150  7019 raft_consensus.cc:697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:28:21.687217  7118 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:28:21.681355  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:21.739768  4002 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:21.702176  6705 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:21.746165  3923 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: []
W20260709 12:28:21.712865  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 137039us
I20260709 12:28:21.680936  6656 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:21.697032  7077 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.009s	sys 0.030s
W20260709 12:28:21.726009  3739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 142664us
I20260709 12:28:21.732367  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:21.687685  7005 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:28:21.742425  3895 leader_election.cc:336] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 2.126s (SENT)
I20260709 12:28:21.678788  7023 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:21.666550  7038 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:21.749645  3822 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:21.752354  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:21.803220  4006 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:21.766392  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:21.729004  6951 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:21.803242  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 53678.4us
W20260709 12:28:21.767800  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:21.770709  3895 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 2.219s (SENT) [suppressed 44 similar messages]
I20260709 12:28:21.807490  6859 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.740828  6711 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:21.717552  7056 raft_consensus.cc:740] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:21.696353  6983 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:21.726451  7112 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.687s	user 0.012s	sys 0.000s
I20260709 12:28:21.747679  7091 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:21.743266  7134 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:28:21.876094  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 180675us
W20260709 12:28:21.911108  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:21.816522  3923 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:21.886768  4002 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:21.751873  6705 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:21.931944  3929 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:21.802518  7063 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:28:21.824263  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 138078us
I20260709 12:28:21.804859  7069 raft_consensus.cc:3055] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:28:21.938534  7120 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:28:21.809629  7139 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:28:21.956025  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 185333us
I20260709 12:28:21.808161  6859 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:21.880273  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2284) took 1769 ms. Trace:
I20260709 12:28:21.922283  6975 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11.
W20260709 12:28:21.888478  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 165444us
I20260709 12:28:21.727833  7059 consensus_queue.cc:1059] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:28:21.920778  3821 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:21.896294  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:21.803773  7057 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.155s
I20260709 12:28:21.939484  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:21.940707  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 208440us
I20260709 12:28:21.986238  4002 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:21.987849  3897 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:21.989207  3897 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:21.951037  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:21.923568  3804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 45576.8us
I20260709 12:28:21.990046  4005 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:21.949218  7069 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:21.814538  6980 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:28:21.957413  3895 leader_election.cc:336] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 2.065s (SENT)
I20260709 12:28:21.960389  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:21.748420  7070 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:21.903823  4006 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:22.049161  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:21.942077  6995 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:21.970849  3999 rpcz_store.cc:276] 0709 12:28:20.110525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.394616 (+284091us) service_pool.cc:224] Handling call
0709 12:28:20.395002 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:20.395381 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:20.395411 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:20.395900 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:28:21.080050 (+684150us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:21.129410 (+ 49360us) log.cc:844] Serialized 14 byte log entry
0709 12:28:21.129739 (+   329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:21.129838 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:21.241343 (+111505us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b18003fcee0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:28:21.814157 (+572814us) raft_consensus.cc:1685] finished
0709 12:28:21.880003 (+ 65846us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:21.880200 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33327,"prepare.queue_time_us":49107,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":39,"raft.queue_time_us":299,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":17721,"spinlock_wait_cycles":9458560,"thread_start_us":645821,"threads_started":1,"wal-append.queue_time_us":993688}
W20260709 12:28:21.984460  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:21.978579  4536 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:22.007102  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:22.007647  3897 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:22.009944  4002 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:21.881382  4569 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:28:22.058660  4569 pending_rounds.cc:85] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 7
I20260709 12:28:22.058548  3923 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:22.059087  4569 pending_rounds.cc:107] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:28:22.059441  4569 raft_consensus.cc:2889] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:22.011638  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 90972.2us
I20260709 12:28:21.923959  7091 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:22.047092  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 89697.7us
I20260709 12:28:21.886085  7077 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:28:22.065641  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 87180.3us
I20260709 12:28:22.066525  4536 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:22.049986  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:22.067751  4536 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:22.068661  4005 raft_consensus.cc:2393] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 8: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:22.060993  3999 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:22.067023  4002 raft_consensus.cc:1240] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:22.070461  3999 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:28:21.956182  7019 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:22.063666  7136 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.342s	user 0.000s	sys 0.000s
I20260709 12:28:22.059882  7070 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.005535  7067 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:22.062543  3895 leader_election.cc:336] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 2.275s (SENT)
I20260709 12:28:22.082257  4572 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:28:22.078861  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:22.096961  4006 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:22.064745  7137 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 12:28:22.049732  7151 raft_consensus.cc:2764] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:28:22.072979  7144 log.cc:927] Time spent T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:28:22.118285  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:22.118992  7138 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:28:22.120203  7070 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:22.110512  7145 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:28:22.123498  6995 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:22.123907  7134 consensus_queue.cc:1059] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:22.124524  7124 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:22.125108  7021 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:22.124941  7059 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:22.114701  7129 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:22.177484  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:22.178177  3848 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:22.131165  7060 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:22.185487  7060 raft_consensus.cc:697] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:22.080924  7154 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 12:28:22.186483  7060 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.187228  7154 raft_consensus.cc:3055] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:22.187674  7154 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:22.188611  7154 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:21.998610  7056 consensus_queue.cc:260] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:22.094568  6213 consensus_meta.cc:287] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.004s
W20260709 12:28:22.135814  6583 consensus_meta.cc:287] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.000s
I20260709 12:28:22.066027  7077 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:22.190285  7056 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:22.190514  7077 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:22.194171  7042 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:22.194542  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:22.139618  7165 consensus_queue.cc:1059] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:28:22.141341  7160 consensus_queue.cc:1059] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:28:22.195007  6951 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:22.131321  4574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 848) took 1654 ms (client timeout 1755 ms). Trace:
W20260709 12:28:22.196466  4574 rpcz_store.cc:269] 0709 12:28:20.477331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.515657 (+ 38326us) service_pool.cc:224] Handling call
0709 12:28:22.131145 (+1615488us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54004bbed4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:22.131265 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3710388992}
I20260709 12:28:22.061228  6980 raft_consensus.cc:697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:22.148763  3851 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:22.136924  4000 pending_rounds.cc:85] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 3
I20260709 12:28:22.197997  4000 pending_rounds.cc:107] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 6.4
W20260709 12:28:22.109820  7133 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 12:28:22.170997  3854 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:28:22.145444  7091 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:22.155205  4006 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:22.210023  4006 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:22.021304  7005 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.129825  6910 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:22.198366  4000 raft_consensus.cc:2889] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:22.217468  3999 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:28:22.130942  6983 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:22.120467  7156 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:28:22.199472  3820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.012s	sys 0.015s
I20260709 12:28:22.200487  3969 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:22.240489  3820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.013s	sys 0.015s
I20260709 12:28:22.176927  7021 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:22.170390  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:22.242419  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:22.242892  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:22.243180  3851 raft_consensus.cc:2393] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 5: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:22.243929  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:22.244441  3851 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:22.147119  6859 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:22.245095  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:22.179500  7136 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:28:22.172290  7063 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:22.132340  7057 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:28:22.190392  6583 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:22.131873  6974 ts_tablet_manager.cc:1929] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:28:22.248013  4002 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:22.204607  7154 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:22.143288  6705 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:22.242674  7161 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:22.241521  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:22.174157  6964 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.263617  4536 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:22.221949  7134 raft_consensus.cc:3055] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:22.242332  7160 raft_consensus.cc:3055] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:28:22.230597  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:22.264428  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 141089us
I20260709 12:28:22.267830  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:22.273871  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:22.274041  3855 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:22.270658  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 805) took 1117 ms. Trace:
I20260709 12:28:22.250074  7021 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:22.254591  6983 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:22.250325  6910 raft_consensus.cc:697] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:22.278856  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.279681  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.285202  3930 raft_consensus.cc:2368] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9.
I20260709 12:28:22.285281  3929 raft_consensus.cc:2368] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:28:22.280301  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.280922  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:22.281584  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:22.286561  3932 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:22.287220  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.287456  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:22.288322  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.288398  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.288897  3928 raft_consensus.cc:2376] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6. Re-sending same reply.
I20260709 12:28:22.282292  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:22.289770  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.290433  3928 raft_consensus.cc:2368] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:28:22.274832  3853 rpcz_store.cc:276] 0709 12:28:21.152875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:21.153048 (+   173us) service_pool.cc:224] Handling call
0709 12:28:21.160381 (+  7333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:21.160796 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:21.160838 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:21.168117 (+  7279us) log.cc:844] Serialized 26 byte log entry
0709 12:28:21.726871 (+558754us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:21.726930 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:21.727036 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:22.270455 (+543419us) raft_consensus.cc:1685] finished
0709 12:28:22.270472 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:22.270602 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47163,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":480543,"threads_started":1,"wal-append.queue_time_us":526761}
I20260709 12:28:22.291282  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.291455  3924 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:22.291842  3923 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:22.267632  6974 log.cc:1199] T eadf6ff4956f47ff8a85f77d02584a0d P 34711da9380944d2969a2bc3e203db3d: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/wals/eadf6ff4956f47ff8a85f77d02584a0d
I20260709 12:28:22.293406  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.248600  7156 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:22.299145  3926 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:28:22.176563  7069 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.314622  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.316716  3927 raft_consensus.cc:2368] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
I20260709 12:28:22.317015  3932 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:22.273696  7006 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:22.275768  6983 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:22.321341  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:22.274574  7134 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:22.273470  7160 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:22.322865  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:22.282994  7042 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:22.327632  3929 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:22.274096  6473 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:28:22.264510  7063 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.341051  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:22.346233  6974 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36508 (request call id 92) took 7046 ms. Trace:
I20260709 12:28:22.352797  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1821) took 1005 ms. Trace:
I20260709 12:28:22.265190  6980 consensus_queue.cc:237] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:22.358590  6951 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:22.360363  3853 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:22.329996  6983 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:22.330806  7042 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:22.359629  6964 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:22.367251  3857 rpcz_store.cc:276] 0709 12:28:21.347547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:21.588737 (+241190us) service_pool.cc:224] Handling call
0709 12:28:21.589154 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:21.942387 (+353233us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:22.100107 (+157720us) log.cc:844] Serialized 14 byte log entry
0709 12:28:22.227194 (+127087us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:22.227774 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:28:22.227945 (+   171us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:22.227991 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:22.228072 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:22.352485 (+124413us) raft_consensus.cc:1685] finished
0709 12:28:22.352518 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:22.352709 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9725,"prepare.queue_time_us":69224,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":186992,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":29165,"thread_start_us":539823,"threads_started":3,"wal-append.queue_time_us":162268}
W20260709 12:28:22.372223  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:22.376403  3923 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:22.320992  7006 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:22.314049  7059 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:22.385859  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:22.338575  7073 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:22.378876  7138 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:28:22.367803  7069 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:22.394706  3821 leader_election.cc:400] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9.
I20260709 12:28:22.395593  3821 leader_election.cc:403] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:28:22.325218  7077 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.397119  3821 leader_election.cc:400] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
I20260709 12:28:22.353384  6910 consensus_queue.cc:237] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.384986  7042 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:22.405165  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:22.387475  7006 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:22.407708  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:22.408236  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:22.417101  7156 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:22.387774  6951 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:22.393038  7059 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.418196  6951 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.419523  4570 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:22.419699  7059 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:22.424353  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:22.425307  7184 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:28:22.426397  7139 raft_consensus.cc:2764] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:28:22.429265  7108 consensus_meta.cc:287] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.838s	user 0.012s	sys 0.000s
I20260709 12:28:22.429790  7108 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.431875  3998 raft_consensus.cc:2393] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:22.433418  3850 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:22.435731  3927 pending_rounds.cc:85] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 1
I20260709 12:28:22.436084  3927 pending_rounds.cc:107] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:28:22.436328  3927 raft_consensus.cc:2889] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:22.437345  3857 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:28:22.437531  7057 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9.
W20260709 12:28:22.438179  6981 consensus_queue.cc:1175] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "073f84fcc295417f9bcc1eea29d2bb58" responder_term: 6 status { last_received { term: 6 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 6 index: 5 } }
I20260709 12:28:22.438418  6711 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:22.438925  6711 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:22.439772  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:22.395996  7073 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.443245  7073 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:22.429203  3895 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:22.502383  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:22.505373  4538 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:22.445277  3930 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
W20260709 12:28:22.507539  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 499976us
I20260709 12:28:22.511479  3897 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:22.512336  6859 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:22.512792  6859 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:22.513168  6859 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:22.514016  7023 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:22.515202  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:22.507647  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:22.506150  4568 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
W20260709 12:28:22.501847  7180 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:28:22.499164  7021 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.528469  7021 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:22.497069  7188 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:28:22.532320  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:22.520233  3897 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:22.507351  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 78208.8us
I20260709 12:28:22.532970  3928 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
W20260709 12:28:22.504690  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 64995.6us
I20260709 12:28:22.463311  7134 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:22.534471  7134 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:22.443918  7006 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:22.521754  7060 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:28:22.508082  7158 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:22.517033  7023 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:22.523541  7142 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.571s	user 0.004s	sys 0.000s
I20260709 12:28:22.525427  7161 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:22.503382  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 101863us
I20260709 12:28:22.561564  7161 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:22.462662  7057 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:22.561951  3821 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:22.480587  3853 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:22.429813  7067 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:22.521925  7108 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:22.534564  3822 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:22.570230  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:22.571310  3822 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:22.538625  4538 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:22.571661  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 51529.1us
I20260709 12:28:22.572340  3897 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:22.543918  3928 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:22.405864  7160 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:22.367093  6974 rpcz_store.cc:276] 0709 12:28:15.300115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:15.300364 (+   249us) service_pool.cc:224] Handling call
0709 12:28:16.394319 (+1093955us) ts_tablet_manager.cc:1151] Deleting tablet eadf6ff4956f47ff8a85f77d02584a0d
0709 12:28:16.394418 (+    99us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:28:21.363789 (+4969371us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:22.131679 (+767890us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:22.346116 (+214437us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3859867,"tablet-delete.queue_time_us":1009355,"thread_start_us":361814,"threads_started":1}
I20260709 12:28:22.504488  6705 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:22.514803  6951 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:22.553685  7196 consensus_queue.cc:1059] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:22.548709  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:22.557071  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:22.560242  7023 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:22.531992  7056 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:22.567329  3855 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 12:28:22.568641  3821 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:22.573747  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:22.593546  3928 raft_consensus.cc:2393] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:22.575701  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 131500us
I20260709 12:28:22.595220  3821 leader_election.cc:400] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6.
W20260709 12:28:22.595893  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 47282.2us
I20260709 12:28:22.596567  3821 leader_election.cc:400] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 4 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5.
I20260709 12:28:22.589869  3850 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:22.590656  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2287) took 2447 ms. Trace:
I20260709 12:28:22.596571  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:22.600026  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:22.567837  6315 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:22.597121  4004 rpcz_store.cc:276] 0709 12:28:20.143013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.876609 (+733596us) service_pool.cc:224] Handling call
0709 12:28:20.876924 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:20.946551 (+ 69627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:20.946597 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:20.947290 (+   693us) log.cc:844] Serialized 52 byte log entry
0709 12:28:21.564484 (+617194us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:21.642400 (+ 77916us) log.cc:844] Serialized 14 byte log entry
0709 12:28:22.561519 (+919119us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b18003d3960. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04ee64c0a 00007fe0585a4219 00007fe04eeeca40 00007fe04eee74e4 00007fe04eee7455 00007fe0559cf3c7 00007fe051fe19a7 00007fe051ff10bf 00007fe051ff1038
0709 12:28:22.561729 (+   210us) log.cc:844] Serialized 14 byte log entry
0709 12:28:22.574835 (+ 13106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:22.574961 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:22.590381 (+ 15420us) raft_consensus.cc:1685] finished
0709 12:28:22.590411 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:22.590590 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":920932,"prepare.queue_time_us":984051,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":101127,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":17449,"spinlock_wait_cycles":10341760,"thread_start_us":556379,"threads_started":1,"wal-append.queue_time_us":733665}
I20260709 12:28:22.601229  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:22.603636  3853 raft_consensus.cc:2376] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6. Re-sending same reply.
I20260709 12:28:22.587352  7021 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:22.586685  7062 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:22.574333  7174 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:22.589762  7158 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:22.594620  7160 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:22.609678  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:22.586794  7131 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:22.610344  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2267) took 1337 ms. Trace:
I20260709 12:28:22.600448  7059 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:22.612215  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:22.603402  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.574479  7189 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:22.601729  7056 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:22.617062  4001 rpcz_store.cc:276] 0709 12:28:21.273435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:21.501263 (+227828us) service_pool.cc:224] Handling call
0709 12:28:21.501624 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:21.952429 (+450805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:21.952501 (+    72us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:21.953172 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 12:28:22.149819 (+196647us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:22.600253 (+450434us) log.cc:844] Serialized 14 byte log entry
0709 12:28:22.610038 (+  9785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:22.610127 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:22.610166 (+    39us) raft_consensus.cc:1685] finished
0709 12:28:22.610180 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:22.610291 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":467147,"raft.queue_time_us":47835,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":581369,"threads_started":2,"wal-append.queue_time_us":179917}
I20260709 12:28:22.608096  3970 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:22.603415  7108 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:22.626398  3928 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:22.574709  7067 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.624119  3895 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:22.635206  4004 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:22.609236  7130 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:22.637046  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:22.641714  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:22.642364  4000 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:22.644986  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.645603  3923 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:22.645926  4570 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:28:22.646417  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:22.611896  6632 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:22.611882  7174 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:22.675055  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:22.683540  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:22.620085  7021 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:22.684278  4006 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:22.638972  7056 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:22.608394  6315 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.645190  7189 raft_consensus.cc:697] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:22.645484  7198 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:22.656560  7174 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:22.723470  3928 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
W20260709 12:28:22.705828  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:22.645435  7057 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:22.629634  7196 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:28:22.690938  7199 raft_consensus.cc:3055] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:22.691879  7197 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:22.730968  4572 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:28:22.632359  7131 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:22.688975  7060 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:28:22.724627  7198 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:22.687883  7158 consensus_queue.cc:1059] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:28:22.703514  3923 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:22.833801  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:22.834432  3923 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:22.835289  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.738308  7006 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:22.800654  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.801604  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:22.824705  4006 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:22.839234  3925 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:22.814757  3850 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:22.779443  7194 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:22.841423  3923 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:28:22.846841  3923 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:22.752017  6983 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:22.800949  7199 raft_consensus.cc:740] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:22.832914  7057 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:22.833214  7197 raft_consensus.cc:697] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:22.833498  7198 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:22.882781  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 311502us
W20260709 12:28:22.883687  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 311396us
I20260709 12:28:22.888586  3822 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:22.790242  7021 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.890408  3897 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:22.892817  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:22.893595  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:22.891110  3925 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:22.866330  7194 raft_consensus.cc:697] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:22.898110  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 564) took 1558 ms. Trace:
I20260709 12:28:22.899087  3897 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:22.900184  6705 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:22.903926  3970 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:22.904789  7108 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:22.909556  7199 consensus_queue.cc:260] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:22.910836  7199 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:22.898655  4005 rpcz_store.cc:276] 0709 12:28:21.339318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:22.076702 (+737384us) service_pool.cc:224] Handling call
0709 12:28:22.151847 (+ 75145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:22.152092 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:22.777677 (+625585us) log.cc:844] Serialized 14 byte log entry
0709 12:28:22.897638 (+119961us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:22.897705 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:22.897770 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:22.897868 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:22.898040 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":450326,"prepare.queue_time_us":533052,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":4609,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":57,"thread_start_us":274132,"threads_started":2}
I20260709 12:28:22.913125  7108 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:22.837838  7042 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.915284  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:22.913774  7108 raft_consensus.cc:697] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:22.916555  6315 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:22.916486  7214 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:22.828339  7189 consensus_queue.cc:237] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:22.921916  3822 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:22.891662  7062 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:22.895226  7158 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:22.922346  3970 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:22.937325  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:22.915273  7196 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:22.950366  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:22.887454  7057 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:22.921693  7039 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:22.920476  7067 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:22.893821  7161 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:22.923262  7129 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:28:22.927711  7202 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:22.962514  7039 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:22.955685  7193 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:22.991303  7219 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:22.994100  7108 consensus_queue.cc:237] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:22.999617  7146 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:23.000092  7194 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:23.003829  6711 consensus_meta.cc:287] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.003s
W20260709 12:28:23.009130  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 58880.8us
I20260709 12:28:22.966607  7196 raft_consensus.cc:697] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:22.944465  7214 consensus_queue.cc:1059] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:28:23.025744  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:23.031560  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:23.009409  7209 log.cc:927] Time spent T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:28:23.031533  3897 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:22.987979  7134 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:23.006156  7039 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:23.045469  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:23.023367  7193 raft_consensus.cc:697] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:23.053915  7067 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:23.056871  7067 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:23.070333  7196 consensus_queue.cc:237] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.071149  7130 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:28:23.073077  6859 consensus_meta.cc:287] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.559s	user 0.005s	sys 0.005s
I20260709 12:28:23.067586  3897 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:23.042663  7214 consensus_queue.cc:1243] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:28:23.076697  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:23.076867  3897 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:23.044590  7202 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:23.084743  3821 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:23.035485  6711 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:23.088339  7212 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:28:22.973556  7197 consensus_queue.cc:237] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:23.092300  3849 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:28:23.093142  7205 log.cc:927] Time spent T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:28:23.089860  7023 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.094293  6896 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:23.094904  7056 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.095708  7057 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:23.095786  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:23.096635  3849 raft_consensus.cc:2393] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 5: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:23.096911  7056 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:23.096988  7057 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:23.097340  3928 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:28:23.081028  6983 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:23.102346  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 180535us
I20260709 12:28:23.102998  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:23.103884  3822 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:23.088403  6711 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:23.052779  7134 raft_consensus.cc:697] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:23.101017  7213 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:23.101154  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:23.078817  7067 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:23.100689  3821 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:23.085579  7214 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:23.121461  3927 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:28:23.129025  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:23.125598  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:23.136698  7091 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:23.138211  7091 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:23.113619  4537 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:23.120152  3925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:28:23.033252  7062 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.073570  6859 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.110136  7158 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:23.142776  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:23.142961  3925 raft_consensus.cc:606] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:23.150586  3925 raft_consensus.cc:614] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:23.150637  3932 raft_consensus.cc:2376] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5. Re-sending same reply.
I20260709 12:28:23.110929  7154 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:23.114634  6315 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:23.114765  7146 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:23.159453  7146 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:23.160447  7146 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:23.160995  3855 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:28:23.152714  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 105458us
I20260709 12:28:23.146234  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:23.154378  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:23.114828  6984 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:23.097522  7057 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.113301  7227 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:23.112659  7220 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 12:28:23.165474  7069 consensus_meta.cc:287] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.002s
I20260709 12:28:23.279596  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:23.280344  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:23.158532  7042 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:23.289888  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:23.290051  3897 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:23.164065  7225 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:23.278919  7160 consensus_meta.cc:287] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.000s
I20260709 12:28:23.298231  7229 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:23.263077  7227 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:23.302083  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:23.234735  7193 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.305320  7091 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:23.292454  7023 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:23.167335  6315 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.318475  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:23.319885  6315 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:23.320174  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:23.321600  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:23.322296  7160 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:23.322861  4570 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:23.164502  7154 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.262696  6984 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.324028  3855 raft_consensus.cc:2410] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:28:23.307405  7225 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.328403  6984 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:23.328689  7225 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:23.291975  7134 consensus_queue.cc:237] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:23.330997  7154 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:23.332921  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:23.333748  3855 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:23.157778  7158 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.288654  7161 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:23.307103  3927 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:23.338586  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:23.340860  4565 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:28:23.350485  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 236986us
I20260709 12:28:23.352959  3855 raft_consensus.cc:2393] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 5: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:28:23.359947  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 239150us
I20260709 12:28:23.363431  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:23.363982  3928 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:23.353425  3851 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:23.361358  4537 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:23.378324  3821 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:23.333829  7227 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:23.384176  7174 consensus_meta.cc:287] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.003s
I20260709 12:28:23.384785  7174 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:23.358258  7228 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:28:23.388015  3928 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:23.388774  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:23.322914  7160 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.437801  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:23.519392  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:23.487953  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:23.462828  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 850) took 1906 ms. Trace:
I20260709 12:28:23.521248  3927 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
W20260709 12:28:23.514696  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 133825us
I20260709 12:28:23.439625  3851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:28:23.519501  4565 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:23.360812  7161 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:23.523852  3851 raft_consensus.cc:606] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:23.524938  3851 raft_consensus.cc:614] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:23.520790  4569 rpcz_store.cc:276] 0709 12:28:21.557616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:21.558336 (+   720us) service_pool.cc:224] Handling call
0709 12:28:21.684149 (+125813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:22.059916 (+375767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:23.461650 (+1401734us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54004880d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:23.462620 (+   970us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54004880d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:23.462771 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741070976}
W20260709 12:28:23.448586  7185 log.cc:927] Time spent T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 1.101s	user 0.000s	sys 0.011s
I20260709 12:28:23.527247  4565 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: []
W20260709 12:28:23.527555  7233 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:28:23.541917  4537 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:23.547948  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:23.548821  3927 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:23.358667  7213 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:23.565465  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:28:23.553494  7069 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:23.553812  3851 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:28:23.570477  3851 pending_rounds.cc:85] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 5
I20260709 12:28:23.570741  3851 pending_rounds.cc:107] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:28:23.570976  3851 raft_consensus.cc:2889] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:23.571357  3851 pending_rounds.cc:107] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:28:23.571658  3851 raft_consensus.cc:2889] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:23.562716  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2271) took 2243 ms. Trace:
I20260709 12:28:23.572228  4002 rpcz_store.cc:276] 0709 12:28:21.319661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:22.069632 (+749971us) service_pool.cc:224] Handling call
0709 12:28:22.112741 (+ 43109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:22.263909 (+151168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:23.562397 (+1298488us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54000c5154. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:23.562634 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310503808}
I20260709 12:28:23.566743  3850 raft_consensus.cc:3055] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:23.573621  3850 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:23.564651  4571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 893) took 2486 ms (client timeout 1901 ms). Trace:
W20260709 12:28:23.575759  4571 rpcz_store.cc:269] 0709 12:28:21.078608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:21.078750 (+   142us) service_pool.cc:224] Handling call
0709 12:28:23.564355 (+2485605us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b540048c954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:23.564509 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707707136}
I20260709 12:28:23.555393  3923 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:28:23.390010  7125 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:28:23.429749  7232 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:28:23.446746  7181 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:23.441481  7158 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:23.392532  7057 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:23.437162  7226 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:23.533739  7235 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:23.586340  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:23.596248  7235 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.597613  3855 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:28:23.582486  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:23.597729  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:23.598462  3928 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:23.598630  3923 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:23.545913  4569 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:28:23.386878  7154 consensus_queue.cc:1059] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.193s
I20260709 12:28:23.574671  3850 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.627471  3850 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:23.628551  3928 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:28:23.630039  3928 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:23.643390  3850 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:28:23.644009  3850 pending_rounds.cc:85] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 5
I20260709 12:28:23.644352  3850 pending_rounds.cc:107] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:28:23.644749  3850 raft_consensus.cc:2889] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:23.435256  7146 consensus_queue.cc:1059] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.146s
I20260709 12:28:23.387694  7198 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.580909  7125 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:23.583918  7187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.026s	sys 0.080s
I20260709 12:28:23.568498  7096 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:28:23.646777  7226 raft_consensus.cc:697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:23.729987  7187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.026s	sys 0.081s
I20260709 12:28:23.723218  7237 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:23.752194  3928 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:23.584352  7161 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.730436  7125 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:23.711007  7239 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:23.728055  7198 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:23.755237  7220 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:23.755672  7227 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.737619  7235 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:23.774385  3849 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:28:23.722630  3923 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:23.754069  6995 raft_consensus.cc:3055] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:23.776373  3923 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:23.599802  7181 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:23.772009  7239 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:23.777734  6995 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:23.804417  4536 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:23.753898  7213 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:23.773183  7220 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.759923  7237 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:23.799016  7021 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:23.812846  7042 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:23.808804  7160 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:23.910351  7174 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:23.976882  7042 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:23.999743  7134 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:24.023072  6984 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:23.814149  7226 consensus_queue.cc:237] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.229240  7239 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:24.233023  7227 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:24.234759  7252 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:28:24.238301  7161 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:24.239838  7220 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:24.112563  7154 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:24.220423  7241 log.cc:927] Time spent T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:28:24.149111  7042 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:23.918107  6995 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:24.202867  7134 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:24.272692  6984 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.370201  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2346) took 2089 ms. Trace:
I20260709 12:28:24.373829  3926 rpcz_store.cc:276] 0709 12:28:22.280753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:22.290553 (+  9800us) service_pool.cc:224] Handling call
0709 12:28:22.292636 (+  2083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:22.299600 (+  6964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:24.369991 (+2070391us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b54002378d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:24.370143 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4141824}
W20260709 12:28:24.385070  3931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.016s	sys 0.088s
W20260709 12:28:24.385594  3931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.016s	sys 0.088s
I20260709 12:28:24.364557  6995 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:24.339084  7154 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.394955  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2288) took 2830 ms. Trace:
I20260709 12:28:24.395609  3999 rpcz_store.cc:276] 0709 12:28:21.564415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:22.098719 (+534304us) service_pool.cc:224] Handling call
0709 12:28:22.209033 (+110314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:22.218123 (+  9090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:24.394643 (+2176520us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540032ffd0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:24.394859 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252716928}
W20260709 12:28:24.389294  7039 consensus_meta.cc:287] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.340s	user 0.014s	sys 0.000s
I20260709 12:28:24.399530  6605 consensus_queue.cc:260] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.391299  7181 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:24.406313  7237 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:24.402110  7019 raft_consensus.cc:3055] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:28:24.414292  7146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.104s	sys 0.182s
W20260709 12:28:24.421308  7249 log.cc:927] Time spent T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 12:28:24.423918  7146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.105s	sys 0.182s
I20260709 12:28:24.428187  7235 raft_consensus.cc:3055] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:24.428712  7235 raft_consensus.cc:740] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:24.424077  7183 log.cc:927] Time spent T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Append to log took a long time: real 2.076s	user 0.003s	sys 0.014s
W20260709 12:28:24.434005  7250 log.cc:927] Time spent T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.235s	user 0.000s	sys 0.009s
W20260709 12:28:24.465330  3848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.007s	sys 0.025s
W20260709 12:28:24.466368  3848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.007s	sys 0.026s
W20260709 12:28:24.469424  3927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.074s	sys 0.092s
W20260709 12:28:24.469944  3927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.074s	sys 0.093s
W20260709 12:28:24.473212  4536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.017s	sys 0.046s
W20260709 12:28:24.473656  4536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.017s	sys 0.046s
W20260709 12:28:24.474126  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 657878us
W20260709 12:28:24.475610  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:24.475673  4536 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:24.476347  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:24.478176  4538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.002s	sys 0.009s
W20260709 12:28:24.478628  4538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.002s	sys 0.009s
I20260709 12:28:24.490585  6605 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:24.494868  6315 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:24.499383  6315 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.417893  7019 raft_consensus.cc:740] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:24.504158  6984 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:24.505229  6984 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:24.506014  6984 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:24.506425  7019 consensus_queue.cc:260] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.507781  6984 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.509212  7019 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:24.502535  6980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.005s	sys 0.009s
W20260709 12:28:24.510310  6980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.005s	sys 0.009s
I20260709 12:28:24.404954  7039 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.514828  7039 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:24.519730  7139 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:24.522847  7139 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:24.520522  7160 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:24.527343  7154 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:24.527153  7160 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:24.497856  4536 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:24.530474  7160 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:24.530732  7161 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:24.531162  7160 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:24.531596  7161 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.520860  7091 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:24.533314  7091 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.531920  7160 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:24.556414  7161 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:24.517861  7042 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.559989  7042 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:24.569720  7261 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:24.570425  7257 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:24.572871  7261 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:24.573407  7261 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:24.545418  6315 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:24.583822  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 53690.7us
I20260709 12:28:24.579967  7261 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:24.573005  7257 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:28:24.606389  7134 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:24.611532  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2279) took 4796 ms. Trace:
I20260709 12:28:24.612857  7091 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:24.619235  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2362) took 1171 ms. Trace:
I20260709 12:28:24.619701  3928 rpcz_store.cc:276] 0709 12:28:23.447863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:23.703795 (+255932us) service_pool.cc:224] Handling call
0709 12:28:23.724056 (+ 20261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:23.777020 (+ 52964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:24.618644 (+841624us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b54000d5a54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:24.618981 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64120576}
I20260709 12:28:24.620414  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 751) took 1495 ms. Trace:
I20260709 12:28:24.436977  7235 consensus_queue.cc:260] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:24.622385  7235 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:24.620880  3927 rpcz_store.cc:276] 0709 12:28:23.124536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:23.569373 (+444837us) service_pool.cc:224] Handling call
0709 12:28:23.585272 (+ 15899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:23.585779 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:23.635439 (+ 49660us) log.cc:844] Serialized 14 byte log entry
0709 12:28:24.470940 (+835501us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:24.472150 (+  1210us) log.cc:844] Serialized 26 byte log entry
0709 12:28:24.472418 (+   268us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:24.486242 (+ 13824us) log.cc:844] Serialized 14 byte log entry
0709 12:28:24.486467 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:24.486599 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:24.620070 (+133471us) raft_consensus.cc:1685] finished
0709 12:28:24.620091 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:24.620328 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13324,"prepare.queue_time_us":49825,"raft.queue_time_us":81304,"raft.run_cpu_time_us":548,"raft.run_wall_time_us":32079,"spinlock_wait_cycles":147708288,"thread_start_us":744210,"threads_started":1,"wal-append.queue_time_us":848040}
I20260709 12:28:24.592597  7139 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:24.627198  7039 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:24.628451  7160 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:24.628945  6980 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:24.611295  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:24.625662  3998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 568) took 3285 ms (client timeout 1983 ms). Trace:
I20260709 12:28:24.628021  7039 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.627812  6605 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:28:24.633164  6711 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:24.634151  4572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 913) took 2021 ms. Trace:
I20260709 12:28:24.634585  6980 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.637230  6980 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:24.637929  3930 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2345) took 2341 ms (client timeout 2063 ms). Trace:
W20260709 12:28:24.638350  3930 rpcz_store.cc:269] 0709 12:28:22.280004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:22.293191 (+ 13187us) service_pool.cc:224] Handling call
0709 12:28:24.621503 (+2328312us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54002e1b54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:24.621681 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312088960}
W20260709 12:28:24.638760  4570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 861) took 1512 ms (client timeout 1893 ms). Trace:
W20260709 12:28:24.639245  4570 rpcz_store.cc:269] 0709 12:28:23.126311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:23.144715 (+ 18404us) service_pool.cc:224] Handling call
0709 12:28:24.638371 (+1493656us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400490f54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:24.638558 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360040192}
I20260709 12:28:24.633814  6711 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:24.630041  3998 rpcz_store.cc:269] 0709 12:28:21.340537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:21.421114 (+ 80577us) service_pool.cc:224] Handling call
0709 12:28:24.625176 (+3204062us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400375854. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:24.625412 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2322355456}
I20260709 12:28:24.617658  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:24.643834  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:24.644922  3850 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:24.646708  6910 raft_consensus.cc:3055] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:24.647071  3851 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:28:24.647202  6910 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:24.634550  4572 rpcz_store.cc:276] 0709 12:28:22.612515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:22.612793 (+   278us) service_pool.cc:224] Handling call
0709 12:28:22.613042 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:22.806931 (+193889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:24.633587 (+1826656us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540053d254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:24.633923 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266358528}
I20260709 12:28:24.648594  6910 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.652469  7139 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:24.656344  6859 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:24.652982  7139 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:24.658221  7139 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:24.643857  6705 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:24.660310  3856 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
W20260709 12:28:24.668962  7264 log.cc:927] Time spent T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.096s	user 0.002s	sys 0.000s
I20260709 12:28:24.612015  3997 rpcz_store.cc:276] 0709 12:28:19.814926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.279333 (+464407us) service_pool.cc:224] Handling call
0709 12:28:20.279767 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:21.014142 (+734375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:21.014172 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:21.024393 (+ 10221us) log.cc:844] Serialized 26 byte log entry
0709 12:28:21.645826 (+621433us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:21.957432 (+311606us) log.cc:844] Serialized 14 byte log entry
0709 12:28:21.957785 (+   353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:24.610604 (+2652819us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b5400128254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:24.610692 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:24.610775 (+    83us) raft_consensus.cc:1685] finished
0709 12:28:24.610914 (+   139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:24.611236 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132546,"prepare.queue_time_us":916664,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":62939,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":34795,"spinlock_wait_cycles":759208192,"thread_start_us":1224769,"threads_started":3,"wal-append.queue_time_us":771609,"wal-append.run_cpu_time_us":4527,"wal-append.run_wall_time_us":1525133}
I20260709 12:28:24.637773  6980 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:24.672654  6980 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:24.675122  6980 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:24.685845  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:24.686167  7067 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:24.687032  3853 raft_consensus.cc:2410] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:28:24.687114  7067 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.687974  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:24.688395  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:24.688949  3851 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:24.693765  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:24.694439  7067 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:24.687988  7039 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:24.695902  7216 log.cc:927] Time spent T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 1.709s	user 0.004s	sys 0.005s
W20260709 12:28:24.696921  7125 consensus_meta.cc:287] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.923s	user 0.012s	sys 0.008s
I20260709 12:28:24.698539  7039 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:24.699527  7039 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } attrs { replace: true } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.698484  7203 raft_consensus.cc:3055] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:24.702759  7203 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:24.704252  7203 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:24.698516  7215 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 1.712s	user 0.011s	sys 0.007s
I20260709 12:28:24.706847  3854 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:24.707998  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2353) took 2422 ms. Trace:
I20260709 12:28:24.708120  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:24.702802  7039 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:24.640311  6605 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:28:24.697459  7125 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.956758  6896 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:24.886111  3850 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:24.709434  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:24.806998  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:24.733676  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 136199us
I20260709 12:28:24.965637  7257 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:24.966542  7023 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:24.967090  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 61389.4us
I20260709 12:28:24.967363  7023 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.841183  6910 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:24.966425  7257 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:24.947085  3821 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.004s	sys 0.016s
I20260709 12:28:24.808203  7060 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:24.973943  7063 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:24.974377  7060 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.974763  7063 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:24.975554  7063 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:24.976724  3821 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.220s	user 0.007s	sys 0.020s
I20260709 12:28:24.803166  6980 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:24.708387  3924 rpcz_store.cc:276] 0709 12:28:22.285556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:22.292066 (+  6510us) service_pool.cc:224] Handling call
0709 12:28:22.292346 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:22.474944 (+182598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:22.474991 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:22.515816 (+ 40825us) log.cc:844] Serialized 26 byte log entry
0709 12:28:22.884604 (+368788us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:22.884660 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:22.884754 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:24.697460 (+1812706us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:24.707515 (+ 10055us) raft_consensus.cc:1685] finished
0709 12:28:24.707534 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:24.707802 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":182146,"raft.queue_time_us":184065,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":164,"spinlock_wait_cycles":28723584,"thread_start_us":317544,"threads_started":1,"wal-append.queue_time_us":378502}
I20260709 12:28:24.970227  7023 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:24.876724  3851 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:24.980453  7257 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:24.981580  3851 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:24.981925  7060 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:24.810930  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:24.979375  7063 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:24.790680  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:24.963464  7203 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:24.978066  6980 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.737049  7131 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:24.957585  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:24.985085  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:24.985324  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:24.985788  7139 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:24.986555  7039 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:24.986832  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:24.715751  6705 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:24.989157  7189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.971s	user 0.019s	sys 0.056s
I20260709 12:28:24.989049  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:24.990149  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:24.990245  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:24.991094  6859 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:24.991734  7220 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:24.991669  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:24.992477  7198 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:24.990163  7067 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:28:24.993474  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:24.994807  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:24.995200  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:24.996395  3930 raft_consensus.cc:1240] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:24.997174  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:24.997392  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:25.000993  7152 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:25.003224  6605 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:24.957134  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:24.787537  7273 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:24.956665  7196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.875s	user 0.010s	sys 0.028s
I20260709 12:28:24.959384  7038 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:25.021785  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:25.026283  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:25.027215  7194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.548s	user 0.002s	sys 0.010s
I20260709 12:28:25.024165  3856 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:25.035737  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:24.956713  7021 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.230s
I20260709 12:28:25.033797  4566 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:25.033720  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:25.036849  7060 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:25.036914  7198 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:25.041898  7125 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:25.032789  7189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.037s	user 0.019s	sys 0.056s
I20260709 12:28:25.057188  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:25.058470  7060 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:25.059065  6656 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:28:25.061147  7060 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:25.046893  4565 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:25.063628  4567 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:25.064462  7077 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:25.051373  6605 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:25.051926  7139 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:25.052597  7198 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:25.052274  7220 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:25.078770  7220 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:25.053593  6632 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:25.055369  3924 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:25.081758  6632 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:25.083014  7147 log.cc:927] Time spent T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 2.924s	user 0.000s	sys 0.028s
I20260709 12:28:25.084249  6632 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:25.085091  3927 raft_consensus.cc:2393] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:28:25.040472  7196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.965s	user 0.010s	sys 0.029s
I20260709 12:28:25.086210  4573 raft_consensus.cc:2376] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8. Re-sending same reply.
I20260709 12:28:25.087018  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:25.087489  7039 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:25.088465  7274 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:25.089393  7274 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:25.090502  3925 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:25.091702  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 829) took 1532 ms. Trace:
I20260709 12:28:25.091768  7283 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:25.092196  3849 rpcz_store.cc:276] 0709 12:28:23.559571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:23.559734 (+   163us) service_pool.cc:224] Handling call
0709 12:28:23.560026 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:23.774869 (+214843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:25.091288 (+1316419us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54002ee854. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:25.091519 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491899264}
I20260709 12:28:25.092747  7283 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:25.070641  3854 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:25.085721  7152 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:25.098680  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 828) took 1541 ms. Trace:
I20260709 12:28:25.099390  4572 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:25.047159  7237 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.001s	sys 0.010s
I20260709 12:28:25.066327  3923 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:25.051959  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1819) took 3705 ms. Trace:
W20260709 12:28:25.043423  7194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.602s	user 0.002s	sys 0.010s
I20260709 12:28:25.074076  3856 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
W20260709 12:28:25.073189  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 84308.8us
I20260709 12:28:25.072669  7131 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:28:25.108171  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.099179  3855 rpcz_store.cc:276] 0709 12:28:23.557468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:23.557632 (+   164us) service_pool.cc:224] Handling call
0709 12:28:23.557910 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:23.597998 (+ 40088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:25.098182 (+1500184us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b540030cfd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:25.098468 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90610048}
I20260709 12:28:25.042083  6896 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:25.105831  3852 rpcz_store.cc:276] 0709 12:28:21.346845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:21.551302 (+204457us) service_pool.cc:224] Handling call
0709 12:28:21.551604 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:24.628951 (+3077347us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:28:24.629002 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:24.629061 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:24.629109 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:25.051552 (+422443us) spinlock_profiling.cc:243] Waited 3.08 s on lock 0x7b5400054bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:25.051592 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:25.051782 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":338,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":171,"spinlock_wait_cycles":7075974912}
W20260709 12:28:25.111613  7237 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.001s	sys 0.011s
I20260709 12:28:25.100932  7152 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:25.118228  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 67749.4us
I20260709 12:28:25.070928  7067 consensus_queue.cc:1243] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:28:25.122965  3924 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:25.054162  7273 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:25.091765  7274 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:25.125927  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:25.050042  6859 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:25.117516  6632 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:25.130795  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:25.131027  7131 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:25.131551  7096 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:25.132236  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:25.143694  3928 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
W20260709 12:28:25.133272  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.134065  6975 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:25.134366  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:25.126996  4570 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:25.138684  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:25.146885  4569 raft_consensus.cc:1813] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:25.139698  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:25.143879  3998 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:25.146489  4571 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:28:25.151259  4569 raft_consensus.cc:2368] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6.
I20260709 12:28:25.136519  7019 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:25.136122  7039 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:25.153855  4003 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 4.
I20260709 12:28:25.137110  7213 raft_consensus.cc:3055] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:25.153811  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:25.158270  4006 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:25.155567  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:25.159404  6975 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:25.153749  6632 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:25.160712  7151 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:25.161369  7151 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:25.161991  6632 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:25.167455  7019 raft_consensus.cc:697] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:25.168520  7019 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:25.170490  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:25.170989  7196 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:25.171634  7196 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:25.171936  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:25.172914  4572 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:25.173316  4568 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:25.173524  7220 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:25.174235  7220 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:25.174655  6859 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:25.175069  4006 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:25.159772  4001 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:28:25.181980  4573 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:25.183802  7196 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:25.186205  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 139725us
I20260709 12:28:25.258527  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:26.035238  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.472761  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:26.036046  3998 consensus_meta.cc:287] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.883s	user 0.024s	sys 0.040s
W20260709 12:28:25.984159  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 530117us
I20260709 12:28:26.036478  3930 raft_consensus.cc:1813] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:25.156826  7261 consensus_meta.cc:287] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 12:28:25.438814  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:25.230350  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:25.474290  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:26.036573  3998 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:25.464505  4565 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:25.470937  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:25.225711  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:26.045078  7237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.003s	sys 0.003s
I20260709 12:28:26.055449  3930 raft_consensus.cc:2368] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6.
I20260709 12:28:25.335821  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:25.992609  4538 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.018s	sys 0.005s
I20260709 12:28:25.571302  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:26.113441  4538 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.018s	sys 0.007s
I20260709 12:28:25.471510  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:26.113989  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 885007us
I20260709 12:28:26.114027  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 870) took 1126 ms. Trace:
I20260709 12:28:26.114650  4565 rpcz_store.cc:276] 0709 12:28:24.987570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:24.989640 (+  2070us) service_pool.cc:224] Handling call
0709 12:28:26.113968 (+1124328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:26.116097  3923 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:28:25.518275  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.016698  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:25.472272  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:26.037021  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:25.167840  6711 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:25.562566  7231 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 2.260s	user 0.000s	sys 0.026s
W20260709 12:28:26.057257  4567 consensus_meta.cc:287] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.993s	user 0.011s	sys 0.000s
W20260709 12:28:26.127240  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.127663  4569 raft_consensus.cc:2410] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:28:26.129701  3897 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.005s	sys 0.027s
W20260709 12:28:25.566200  7272 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.460s	user 0.000s	sys 0.001s
W20260709 12:28:26.122697  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.553301  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:25.175290  7131 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:25.473356  7198 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:25.554080  7275 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
W20260709 12:28:26.135842  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:26.136008  3897 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.005s	sys 0.027s
I20260709 12:28:26.136323  4567 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
W20260709 12:28:25.554783  7278 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.396s	user 0.000s	sys 0.000s
I20260709 12:28:25.158116  7213 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:25.266047  7067 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:26.126368  7237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.006s	sys 0.006s
I20260709 12:28:26.011657  6951 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:25.439693  6980 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:25.576386  7273 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:25.571110  7220 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:25.545908  7151 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:25.261065  7226 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:25.469666  6859 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.144160  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:26.144745  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 910729us
I20260709 12:28:25.531276  7281 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:25.509500  7005 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:25.579195  7283 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:25.179606  7063 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:26.149367  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.175288  7096 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.153735  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.172114  3998 raft_consensus.cc:2410] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:28:26.151656  4001 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:26.159196  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.128031  7261 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.161829  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.161899  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:26.174469  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:26.174441  3924 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:26.166051  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:26.158411  7280 log.cc:927] Time spent T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.928s	user 0.001s	sys 0.001s
W20260709 12:28:26.163060  7196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.011s	sys 0.011s
I20260709 12:28:26.175491  4002 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:26.158818  6605 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:26.159929  7226 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.185195  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:26.176183  7196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.011s	sys 0.011s
I20260709 12:28:26.192577  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:26.190044  6711 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:26.196725  4570 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:26.160203  7198 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:26.199002  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.199942  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.181874  7226 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:26.199107  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.184715  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:26.165356  7063 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.157764  7067 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.200119  4002 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:26.200920  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.175326  7283 consensus_queue.cc:1059] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 12:28:26.195603  3821 connection.cc:256] RPC call timeout handler was delayed by -1.1074996770003054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 12:28:26.205827  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 66449.5us
I20260709 12:28:26.208451  3926 raft_consensus.cc:2393] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:26.199517  7203 consensus_meta.cc:287] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.170s	user 0.009s	sys 0.003s
I20260709 12:28:26.209587  3925 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
W20260709 12:28:26.210320  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 49828.9us
I20260709 12:28:26.197494  6605 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:26.162987  7213 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.214895  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.214890  3998 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:26.218954  3929 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 5: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:26.219825  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.217538  4000 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:26.195698  7005 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.194845  6951 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:26.224941  3821 leader_election.cc:336] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 2.063s (SENT)
I20260709 12:28:26.234042  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:26.237404  3924 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:26.198652  6711 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.241479  3971 leader_election.cc:400] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6.
I20260709 12:28:26.245604  3971 leader_election.cc:403] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:26.241863  7131 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:26.242545  4570 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 4.
I20260709 12:28:26.250011  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:26.250284  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.250877  3925 raft_consensus.cc:2410] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:28:26.250950  4570 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:26.252324  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.252933  4570 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:26.209587  6859 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.245042  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:26.195983  7281 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.232963  3821 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:26.257052  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:26.259091  4004 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:26.262866  6632 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:28:26.266357  4537 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:26.264155  4006 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:26.267642  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.263394  7273 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:28:26.266018  7203 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:26.270902  7203 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.273360  7203 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:26.259187  6605 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.278570  6605 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:26.279068  6951 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:26.280441  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2305) took 1104 ms. Trace:
I20260709 12:28:26.280839  4006 rpcz_store.cc:276] 0709 12:28:25.176395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:25.223549 (+ 47154us) service_pool.cc:224] Handling call
0709 12:28:26.280241 (+1056692us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540032d054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:26.280359 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306584832}
I20260709 12:28:26.282047  3926 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:26.282991  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:26.283298  3926 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:26.283751  4006 raft_consensus.cc:2393] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:26.284463  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.284735  3926 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:26.285058  4006 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:26.285928  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.287206  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.287303  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:26.287644  7067 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:26.288657  3932 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:26.288793  7096 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:26.289031  3932 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:26.289541  4003 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:26.290759  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.291854  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.292814  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.289928  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:26.294571  3971 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:26.295692  6711 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:26.296834  6705 consensus_meta.cc:287] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.230s	user 0.005s	sys 0.005s
I20260709 12:28:26.297255  6705 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.297811  7274 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:26.300153  4006 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:28:26.301309  4570 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:28:26.302404  7261 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:26.247413  7213 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:26.303174  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.304708  6951 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:26.273659  3923 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
W20260709 12:28:26.306352  3895 connection.cc:256] RPC call timeout handler was delayed by -2.86448215099972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
I20260709 12:28:26.301352  4001 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:26.306442  7198 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:26.305567  3932 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:26.312669  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54068 (request call id 766) took 1315 ms. Trace:
I20260709 12:28:26.315618  3924 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:26.316197  3999 raft_consensus.cc:2393] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:26.319614  3927 rpcz_store.cc:276] 0709 12:28:24.996950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:24.997103 (+   153us) service_pool.cc:224] Handling call
0709 12:28:26.312469 (+1315366us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b540031c9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:26.312587 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112405888}
I20260709 12:28:26.320089  7038 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:26.320755  4573 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:26.324703  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36516 (request call id 2278) took 1093 ms. Trace:
I20260709 12:28:26.327121  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.325042  4001 rpcz_store.cc:276] 0709 12:28:25.231848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:25.249018 (+ 17170us) service_pool.cc:224] Handling call
0709 12:28:26.324646 (+1075628us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:26.328465  4001 raft_consensus.cc:1240] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:26.331908  4000 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:26.334568  7198 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.335291  7198 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.339134  7198 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:26.341027  6632 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6.
W20260709 12:28:26.341831  7253 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 1.903s	user 0.017s	sys 0.019s
I20260709 12:28:26.342592  4001 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:28:26.343472  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2241) took 2963 ms. Trace:
I20260709 12:28:26.344096  4001 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:28:26.243115  7283 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:28:26.346830  3923 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:28:26.348326  3998 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
W20260709 12:28:26.323671  6910 consensus_meta.cc:287] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 1.350s	user 0.004s	sys 0.009s
I20260709 12:28:26.318971  6951 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.341898  6632 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:26.326310  6711 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:26.343909  3848 rpcz_store.cc:276] 0709 12:28:23.380205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:23.380385 (+   180us) service_pool.cc:224] Handling call
0709 12:28:23.380719 (+   334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:23.598696 (+217977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:23.598724 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:23.670041 (+ 71317us) log.cc:844] Serialized 52 byte log entry
0709 12:28:24.467517 (+797476us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:24.467700 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:24.467873 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:26.341190 (+1873317us) spinlock_profiling.cc:243] Waited 90 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:26.343109 (+  1919us) raft_consensus.cc:1685] finished
0709 12:28:26.343127 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:26.343382 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1470,"raft.queue_time_us":65408,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"spinlock_wait_cycles":206918016,"thread_start_us":1012394,"threads_started":2,"wal-append.queue_time_us":765830}
I20260709 12:28:26.350633  3998 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:26.354779  7219 raft_consensus.cc:3055] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:28:26.356835  7256 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 1.918s	user 0.018s	sys 0.026s
I20260709 12:28:26.357578  6896 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:26.368741  7067 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:26.344801  7274 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:26.369694  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1760) took 4674 ms. Trace:
I20260709 12:28:26.371606  7274 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:26.358419  6951 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:26.362191  6975 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:26.364617  7219 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:26.373189  7219 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:26.367817  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.374678  7219 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:26.375061  3998 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:28:26.376576  3998 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:26.367915  3895 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:26.370334  3931 rpcz_store.cc:276] 0709 12:28:21.695124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:21.701152 (+  6028us) service_pool.cc:224] Handling call
0709 12:28:21.701646 (+   494us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:21.712124 (+ 10478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:21.712172 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:23.787209 (+2075037us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b2c0005c0c8. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:28:23.789522 (+  2313us) log.cc:844] Serialized 52 byte log entry
0709 12:28:24.390016 (+600494us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:24.711361 (+321345us) log.cc:844] Serialized 14 byte log entry
0709 12:28:24.738786 (+ 27425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:24.738901 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:26.344194 (+1605293us) spinlock_profiling.cc:243] Waited 87.5 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:26.369293 (+ 25099us) raft_consensus.cc:1685] finished
0709 12:28:26.369320 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:26.369496 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9982,"prepare.queue_time_us":230408,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":65,"raft.queue_time_us":21489,"raft.run_cpu_time_us":511,"raft.run_wall_time_us":74824,"spinlock_wait_cycles":261304960,"thread_start_us":712828,"threads_started":2,"wal-append.queue_time_us":648759}
I20260709 12:28:26.362968  6632 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.379833  6632 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:26.380371  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 118505us
I20260709 12:28:26.381227  4537 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:26.381332  3998 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:26.382036  7152 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:26.382624  7152 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.383024  7152 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:26.382869  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:26.386790  7261 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:26.388933  4537 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:26.390203  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:26.390908  3931 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:26.391224  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:26.391871  3927 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:26.392518  3926 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:28:26.394804  7226 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.395797  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:26.396571  3929 raft_consensus.cc:2393] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 8: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:26.397229  7226 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:26.397737  7287 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:28:26.398837  4001 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:28:26.367049  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:26.399986  3923 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:26.404142  3932 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:26.382066  7198 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:28:26.405599  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.406561  7261 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:28:26.416518  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.403936  6632 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.409864  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:24.626641  3741 catalog_manager.cc:5028] TS 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): tablet eadf6ff4956f47ff8a85f77d02584a0d (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
W20260709 12:28:26.412642  4538 leader_election.cc:336] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.983s (SENT)
I20260709 12:28:26.413959  7067 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.414131  7281 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:26.414994  4572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 916) took 1466 ms. Trace:
I20260709 12:28:26.415041  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.419867  7203 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.420385  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.420799  7198 raft_consensus.cc:697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:26.421789  7063 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:26.419883  7261 raft_consensus.cc:697] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:26.425621  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.431164  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:26.426891  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 207747us
I20260709 12:28:26.422943  4000 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:28:26.426647  4572 rpcz_store.cc:276] 0709 12:28:24.949073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:24.957295 (+  8222us) service_pool.cc:224] Handling call
0709 12:28:26.414832 (+1457537us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b54005aee54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:26.414936 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178945792}
I20260709 12:28:26.429303  7289 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:26.429241  3741 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 1.80265e+06us
I20260709 12:28:26.432896  7203 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.435936  3932 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:28:26.436348  4571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 843) took 1440 ms. Trace:
I20260709 12:28:26.438000  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.438699  4006 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 4.
I20260709 12:28:26.441330  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.441633  4001 raft_consensus.cc:2368] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9.
I20260709 12:28:26.437263  4571 rpcz_store.cc:276] 0709 12:28:24.996124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:24.996798 (+   674us) service_pool.cc:224] Handling call
0709 12:28:26.434541 (+1437743us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54007c2754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:26.436280 (+  1739us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250236160}
I20260709 12:28:26.437222  3932 pending_rounds.cc:85] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 4
W20260709 12:28:26.442657  7245 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 2.154s	user 0.025s	sys 0.021s
W20260709 12:28:26.452812  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.443441  3932 pending_rounds.cc:107] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:28:26.453542  3932 raft_consensus.cc:2889] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:26.454409  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 318289us
I20260709 12:28:26.455138  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.462354  3848 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:26.457043  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:26.464744  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.465830  4006 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 8: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:26.431823  6910 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:28:26.469139  4001 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:26.434657  7067 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:26.467918  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:26.433403  7261 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.471573  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.473299  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 839) took 1484 ms. Trace:
I20260709 12:28:26.474851  4571 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:26.475251  4567 rpcz_store.cc:276] 0709 12:28:24.988529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:24.989722 (+  1193us) service_pool.cc:224] Handling call
0709 12:28:26.473126 (+1483404us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b5400243bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:26.473239 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60273280}
I20260709 12:28:26.462390  7096 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.483479  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:26.480263  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.483762  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.432889  7289 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.478840  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:26.485836  3853 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:26.426148  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:26.489457  7219 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:26.436735  3741 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 95a53a95fd9f44e59c1b1615b9281948 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 34711da9380944d2969a2bc3e203db3d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:26.491221  7219 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:26.496049  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:26.491744  3741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 55099.2us
I20260709 12:28:26.513196  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.487914  7005 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:26.514446  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:26.517247  3821 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:26.519831  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.500792  7284 raft_consensus.cc:3055] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:28:26.520421  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.518277  4006 raft_consensus.cc:2376] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9. Re-sending same reply.
I20260709 12:28:26.527204  4537 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:26.529803  3897 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:26.542315  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 247802us
I20260709 12:28:26.492136  7096 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.546041  4537 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:26.547923  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.554978  4567 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:26.511423  6705 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:26.558051  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:26.572945  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:26.581388  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 81858.2us
I20260709 12:28:26.516601  6859 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:26.582768  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.579326  7273 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:26.587857  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.530120  7284 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:26.592140  4572 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:26.588591  4574 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:26.594117  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:26.498883  7198 consensus_queue.cc:237] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:26.594395  3971 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:26.596500  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:26.603973  4001 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 12:28:26.520109  6951 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.582013  6632 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:26.620308  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:26.584201  7237 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:26.587857  7038 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:26.588554  7273 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.584328  7005 consensus_queue.cc:1059] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:28:26.590111  7063 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
W20260709 12:28:26.788690  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 168474us
I20260709 12:28:26.788110  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:26.641925  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:26.643816  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.790623  3971 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:26.774279  4006 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:28:26.791536  3897 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:26.712283  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:26.588485  7151 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:28:26.603411  7302 log.cc:927] Time spent T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:28:26.756384  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2301) took 1368 ms. Trace:
W20260709 12:28:26.788223  4538 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 2.207s (SENT) [suppressed 21 similar messages]
I20260709 12:28:26.798590  3854 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:26.792302  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:26.787212  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:26.802682  4570 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:26.802852  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.698628  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:26.806218  4569 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:28:26.803983  3849 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:26.639848  7237 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:26.644047  7273 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:26.796341  6632 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:26.796191  7220 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:26.823143  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:26.747514  7291 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:26.798300  7151 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:26.827059  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.803660  7067 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:26.801384  4005 rpcz_store.cc:276] 0709 12:28:25.139288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:25.153970 (+ 14682us) service_pool.cc:224] Handling call
0709 12:28:25.155533 (+  1563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:25.432014 (+276481us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:28:26.163822 (+731808us) log.cc:844] Serialized 14 byte log entry
0709 12:28:26.494781 (+330959us) log.cc:844] Serialized 14 byte log entry
0709 12:28:26.494978 (+   197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:26.495038 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:26.507025 (+ 11987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:26.507108 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:26.507367 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":686500,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":8947,"raft.queue_time_us":11427,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":21619,"spinlock_wait_cycles":44309376,"thread_start_us":719916,"threads_started":2,"wal-append.queue_time_us":433685}
I20260709 12:28:26.842340  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:26.814343  7005 consensus_queue.cc:1243] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer f3cab225ecb7488386a1a19239498cfe log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:28:26.811439  7203 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:26.843151  4001 raft_consensus.cc:2376] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6. Re-sending same reply.
I20260709 12:28:26.817759  7289 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:26.846311  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:26.829071  7237 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:26.847055  4002 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:26.823659  6632 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.851909  3971 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:26.846906  7157 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:26.858357  4572 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:26.804625  6975 consensus_queue.cc:1059] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:28:26.836776  7151 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:26.842458  7295 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:28:26.862867  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.793116  7284 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.854108  3854 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:26.877058  3969 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:26.878347  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:26.878865  7296 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:28:26.879209  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:26.879782  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.881094  4001 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:26.841342  7291 raft_consensus.cc:697] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:26.896557  3853 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:26.910804  3852 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:28:26.911475  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:26.903537  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 113965us
W20260709 12:28:26.905030  7294 log.cc:927] Time spent T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 12:28:26.905475  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.906126  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:26.923985  3998 raft_consensus.cc:2376] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5. Re-sending same reply.
I20260709 12:28:26.906818  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.907704  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2303) took 1767 ms. Trace:
W20260709 12:28:26.907939  7305 log.cc:927] Time spent T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:28:26.918537  7291 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.871464  7203 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:26.919763  7096 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:26.873826  6632 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:26.961912  7203 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.964948  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:26.867056  7067 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:26.925822  3997 rpcz_store.cc:276] 0709 12:28:25.139999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:25.146846 (+  6847us) service_pool.cc:224] Handling call
0709 12:28:26.252742 (+1105896us) spinlock_profiling.cc:243] Waited 986 us on lock 0x7b58001b3f98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056fb0fc0 00007fe056f9b929 00007fe056f9b3d2 00007fe050512bd4
0709 12:28:26.252920 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:26.253201 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:28:26.708900 (+455699us) log.cc:844] Serialized 14 byte log entry
0709 12:28:26.828660 (+119760us) log.cc:844] Serialized 14 byte log entry
0709 12:28:26.906980 (+ 78320us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b1800410ec0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04ee64c0a 00007fe0585a4219 00007fe04eeeca40 00007fe04eee74e4 00007fe04eee7455 00007fe051fcf060 00007fe051fe1716 00007fe051ff2287 00007fe051ff2208
0709 12:28:26.907184 (+   204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:26.907252 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:26.907333 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:26.907445 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:26.907632 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9523,"prepare.queue_time_us":18688,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":98471,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":31762176,"thread_start_us":439403,"threads_started":2}
W20260709 12:28:27.058110  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:26.976940  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:27.029457  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 177598us
I20260709 12:28:27.139218  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1777) took 1669 ms. Trace:
W20260709 12:28:27.139523  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:26.985044  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 492677us
W20260709 12:28:27.104140  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.923413  4006 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:26.924927  4005 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
W20260709 12:28:26.986088  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 491246us
I20260709 12:28:27.011085  4570 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
W20260709 12:28:26.970129  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:27.142326  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 228165us
I20260709 12:28:27.069108  3999 raft_consensus.cc:3055] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:27.151752  7219 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:27.074571  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 197835us
W20260709 12:28:26.979498  7310 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.133s	user 0.001s	sys 0.001s
I20260709 12:28:27.139672  3928 rpcz_store.cc:276] 0709 12:28:25.470065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:25.473633 (+  3568us) service_pool.cc:224] Handling call
0709 12:28:25.577785 (+104152us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:26.034664 (+456879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:26.034699 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:26.142884 (+108185us) log.cc:844] Serialized 26 byte log entry
0709 12:28:26.472057 (+329173us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:26.472112 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:26.472183 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:27.139022 (+666839us) raft_consensus.cc:1685] finished
0709 12:28:27.139039 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:27.139148 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59095,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":60417,"thread_start_us":311193,"threads_started":1,"wal-append.queue_time_us":357208}
W20260709 12:28:26.989142  7311 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:28:27.153196  7152 consensus_meta.cc:287] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.770s	user 0.008s	sys 0.004s
I20260709 12:28:27.103747  7274 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:27.041635  7157 raft_consensus.cc:697] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:26.986706  7226 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:27.160041  3999 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:27.174220  3971 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:27.172222  3969 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:27.114463  6975 raft_consensus.cc:3055] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:27.041828  7303 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:27.149294  6951 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:27.187881  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:27.192566  3856 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:27.115382  7309 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.237s	user 0.003s	sys 0.000s
I20260709 12:28:27.152460  7067 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:27.020539  7151 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:27.152979  7203 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:27.218545  4569 raft_consensus.cc:1217] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Deduplicated request from leader. Original: 6.8->[7.9-7.9]   Dedup: 7.9->[]
W20260709 12:28:27.238336  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 66188.6us
I20260709 12:28:27.244692  4569 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 12:28:27.210819  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 47607.7us
I20260709 12:28:27.177412  7063 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:27.202099  3897 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:27.236562  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 44735.4us
I20260709 12:28:27.198871  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:27.260560  4568 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:27.173735  7226 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:27.161422  7220 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:26.986277  7273 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:26.970888  6632 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:27.177731  6975 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:27.187148  7303 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:27.195128  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 831) took 2081 ms. Trace:
W20260709 12:28:27.209263  7325 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:28:27.210981  3999 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:27.173852  7152 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:27.266772  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 75024.8us
I20260709 12:28:27.244094  7067 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:27.295786  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:27.290815  3855 rpcz_store.cc:276] 0709 12:28:25.119456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:26.443952 (+1324496us) service_pool.cc:224] Handling call
0709 12:28:26.467887 (+ 23935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:26.468143 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:26.468173 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:26.484860 (+ 16687us) log.cc:844] Serialized 26 byte log entry
0709 12:28:26.619921 (+135061us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:26.662498 (+ 42577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:26.662620 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:26.978765 (+316145us) spinlock_profiling.cc:243] Waited 63.4 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:27.162976 (+184211us) raft_consensus.cc:1685] finished
0709 12:28:27.162995 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:27.195040 (+ 32045us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145938688,"thread_start_us":103272,"threads_started":1,"wal-append.queue_time_us":316597}
I20260709 12:28:27.166015  7281 consensus_queue.cc:1059] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 12:28:27.195459  7005 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:27.272472  7226 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:27.304216  4570 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:28:27.305814  4000 raft_consensus.cc:2368] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7.
I20260709 12:28:27.265925  7274 raft_consensus.cc:697] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:27.286975  7203 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:27.293735  7303 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:27.310357  4571 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:28:27.210714  7157 consensus_queue.cc:237] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:27.323272  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:27.300976  6896 consensus_queue.cc:1059] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 12:28:27.330881  7313 log.cc:927] Time spent T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.453s	user 0.001s	sys 0.001s
W20260709 12:28:27.325055  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 80040.1us
I20260709 12:28:27.324156  3854 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
W20260709 12:28:27.372731  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 189897us
I20260709 12:28:27.316457  7203 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:27.384724  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:27.389257  3856 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:27.390350  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 877) took 1271 ms. Trace:
I20260709 12:28:27.390730  4565 rpcz_store.cc:276] 0709 12:28:26.118514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:26.119663 (+  1149us) service_pool.cc:224] Handling call
0709 12:28:26.133336 (+ 13673us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:26.464420 (+331084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:26.464470 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:26.467942 (+  3472us) log.cc:844] Serialized 26 byte log entry
0709 12:28:26.709579 (+241637us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:26.709638 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:26.711900 (+  2262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:27.114708 (+402808us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:27.324403 (+209695us) raft_consensus.cc:1685] finished
0709 12:28:27.324425 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:27.390290 (+ 65865us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21518,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":20522,"spinlock_wait_cycles":100764928,"thread_start_us":529970,"threads_started":2,"wal-append.queue_time_us":338702}
W20260709 12:28:27.392019  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 98546.9us
I20260709 12:28:27.392982  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:27.409524  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:27.410203  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:27.409446  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:27.411572  4566 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:27.413441  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:27.414225  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:27.415742  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:27.417527  7328 consensus_queue.cc:1059] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:28:27.385504  7321 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:27.425613  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 115155us
I20260709 12:28:27.407953  7063 raft_consensus.cc:697] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:28:27.426286  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:27.431651  3969 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:27.433241  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:27.434120  3932 raft_consensus.cc:2410] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:28:27.439024  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:27.439765  3924 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:27.441061  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:27.430990  7261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.007s	sys 0.019s
I20260709 12:28:27.427763  7297 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:27.421463  7327 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:27.455494  7327 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:27.458710  7300 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.554s	user 0.001s	sys 0.001s
I20260709 12:28:27.462160  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:27.426276  7326 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:28:27.454285  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:27.452302  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:27.471056  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:27.473682  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 99402.2us
I20260709 12:28:27.476409  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:27.477017  3932 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:27.478088  7327 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:27.478660  3924 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:27.409096  6975 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:27.426122  7321 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:27.485985  7321 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:27.471908  7326 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:27.488483  7320 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:28:27.489253  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:27.490131  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:27.490206  7063 consensus_queue.cc:237] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:27.490882  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:27.491384  4001 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:27.492503  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:27.493957  7314 log.cc:927] Time spent T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.342s	user 0.001s	sys 0.001s
I20260709 12:28:27.494022  7326 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:27.495419  3925 raft_consensus.cc:2410] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:28:27.442313  6632 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:27.499980  7330 consensus_queue.cc:1059] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:28:27.501385  7203 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:27.504961  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:27.466504  7005 raft_consensus.cc:3055] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:27.505132  7273 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:27.399739  7220 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:27.506474  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:27.507717  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:27.505708  7005 raft_consensus.cc:740] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:28:27.450327  7261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.007s	sys 0.019s
I20260709 12:28:27.447935  7331 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 12:28:27.518026  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:27.526711  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:27.526744  3924 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
W20260709 12:28:27.521054  7307 log.cc:927] Time spent T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.675s	user 0.003s	sys 0.000s
I20260709 12:28:27.521086  6980 consensus_queue.cc:1059] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:28:27.463618  7281 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:27.464241  7151 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:27.452841  7333 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:27.533346  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:27.530900  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:27.532553  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:27.537388  4569 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:27.540584  4570 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:27.432610  7274 consensus_queue.cc:237] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:27.570525  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:27.572739  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:27.573770  4001 raft_consensus.cc:2393] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:28:27.564757  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:27.575124  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:27.566675  3930 raft_consensus.cc:2393] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:27.580945  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:27.581624  3924 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:27.592120  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:27.593518  7326 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:27.594255  7326 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:27.596896  7326 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:27.607499  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:27.607695  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:27.609966  3928 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:28:27.613427  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:27.603621  7237 consensus_meta.cc:287] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.003s
I20260709 12:28:27.568200  7281 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:27.628167  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 203727us
I20260709 12:28:27.634812  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:27.637297  3999 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:27.638567  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 107011us
I20260709 12:28:27.609263  7332 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:27.640494  3821 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:27.655053  3924 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
W20260709 12:28:27.655758  7316 log.cc:927] Time spent T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.734s	user 0.002s	sys 0.002s
I20260709 12:28:27.656226  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:27.658082  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:27.658219  3930 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:27.659201  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:27.659659  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:27.660403  3931 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:27.661393  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:27.657364  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:27.621151  7237 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:27.614818  7005 consensus_queue.cc:260] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:27.844636  4568 consensus_meta.cc:287] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.000s
I20260709 12:28:27.879263  4568 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:27.873917  3856 raft_consensus.cc:3055] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:27.879979  3924 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:27.880257  3856 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:27.662185  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:27.880880  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 366687us
I20260709 12:28:27.663132  4571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 933) took 1116 ms. Trace:
I20260709 12:28:27.789783  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:27.789369  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:27.675524  3999 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:28:27.657388  3928 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:28:27.663478  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:27.885842  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:27.882884  4571 rpcz_store.cc:276] 0709 12:28:26.546712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:26.548551 (+  1839us) service_pool.cc:224] Handling call
0709 12:28:26.589447 (+ 40896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:27.315477 (+726030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:27.662789 (+347312us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b540053d254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:27.663051 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655651712}
I20260709 12:28:27.703197  4569 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:27.635989  7328 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:27.790109  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:27.884285  3855 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
W20260709 12:28:27.894670  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:27.883206  3856 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:27.994177  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:27.898180  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 255039us
I20260709 12:28:27.940778  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:27.945436  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:27.934422  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 597) took 1412 ms. Trace:
W20260709 12:28:27.850911  7337 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:28:27.976481  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:28.037775  3929 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:28.040058  7321 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.040639  7321 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:27.871694  6632 raft_consensus.cc:3055] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:27.822000  7338 raft_consensus.cc:3055] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:28.026381  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:27.700228  7203 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.029131  7348 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:28.029762  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:27.951750  7226 consensus_meta.cc:287] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.642s	user 0.005s	sys 0.005s
I20260709 12:28:28.032910  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:27.922034  7328 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:27.914458  7273 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 12:28:27.904785  7151 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.034521  4569 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:28.034709  4573 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:28.035810  7237 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:27.904628  7330 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:27.942601  7284 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:27.642217  7332 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:27.910794  7261 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.126s
I20260709 12:28:27.747625  7152 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:27.912247  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 600) took 1110 ms. Trace:
W20260709 12:28:28.042307  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:28.023299  3848 raft_consensus.cc:2376] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6. Re-sending same reply.
I20260709 12:28:28.025681  3999 rpcz_store.cc:276] 0709 12:28:26.521542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:26.521668 (+   126us) service_pool.cc:224] Handling call
0709 12:28:26.544228 (+ 22560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:27.636784 (+1092556us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b5800782fd0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f330aa 00007fe051fb5447 00007fe051fcdfe7 00007fe051fcf7de 00007fe051fd9b49 00007fe051fda416 00007fe051fd6d8f 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4
0709 12:28:27.885004 (+248220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:27.934078 (+ 49074us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b540007f8d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:27.934331 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212890240}
I20260709 12:28:27.697418  6975 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:28.046159  7338 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:28.048822  7321 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:28.050191  3928 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:28.030398  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:27.916759  7341 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.171s
W20260709 12:28:27.902236  7285 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 12:28:27.905081  7342 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:28:27.925119  7067 consensus_meta.cc:287] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.002s
I20260709 12:28:28.050899  3923 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:28.054416  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:28.054674  3930 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:28:27.910677  6896 raft_consensus.cc:3055] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:28.056010  4571 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:28.058056  3856 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:27.911672  7281 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:27.656226  7303 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:27.901706  7326 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:28.085256  3971 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:28.100394  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:28.060946  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:28.090240  4570 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:28:27.890789  7220 consensus_queue.cc:1059] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.170s
I20260709 12:28:28.116508  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:28.088598  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 207059us
W20260709 12:28:28.089725  3970 connection.cc:256] RPC call timeout handler was delayed by -1.366253470999709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
W20260709 12:28:28.182008  3970 connection.cc:256] RPC call timeout handler was delayed by -1.3311534709996522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
I20260709 12:28:28.041989  6632 raft_consensus.cc:740] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:28.060537  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:27.900668  7198 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.085249  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:28.170926  4003 rpcz_store.cc:276] 0709 12:28:26.802445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:26.802603 (+   158us) service_pool.cc:224] Handling call
0709 12:28:27.912048 (+1109445us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540036e054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:27.912179 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2546885504}
I20260709 12:28:28.178719  4567 raft_consensus.cc:2393] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:28:28.179103  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 93937.6us
I20260709 12:28:28.190397  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.181545  3925 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:28.099998  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:28.185839  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.192322  3929 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:28.193099  4006 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:28.194165  4565 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 10: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:28.181416  4574 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:28.089782  6980 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.090176  7063 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:28.196916  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:28.197453  3997 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:28.174976  7332 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:28.205955  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:28.183030  7281 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:28.199262  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.208454  4006 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:28:28.200696  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:28.203099  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.203384  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:28.169736  7348 raft_consensus.cc:697] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:28.169268  6896 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:28.205147  3970 leader_election.cc:400] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6.
W20260709 12:28:28.205076  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 302639us
I20260709 12:28:28.211910  3970 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:28.192667  7326 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.216822  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.190397  7152 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:28.059262  7226 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.087944  7203 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.218940  3999 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:28.089915  6705 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 12:28:28.195252  7237 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:28.171257  7067 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.201332  7220 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:28.219200  7334 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:28:28.175190  7151 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.229064  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 931) took 1683 ms. Trace:
I20260709 12:28:28.202329  6980 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:28.262692  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 50867.2us
I20260709 12:28:28.245550  7237 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.264945  7365 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:28.265578  7365 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.266031  7365 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:28.266935  7237 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:28.262473  4573 rpcz_store.cc:276] 0709 12:28:26.546032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:26.579450 (+ 33418us) service_pool.cc:224] Handling call
0709 12:28:26.584453 (+  5003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:28.168510 (+1584057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:28.228673 (+ 60163us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400484754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:28.228992 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3334705408}
I20260709 12:28:28.195246  7198 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.195098  7330 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.259346  7358 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:28.232089  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 595772us
I20260709 12:28:28.301752  3924 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:28.216800  6896 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.304419  3821 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:28.304265  7339 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.024s	sys 0.034s
I20260709 12:28:28.222025  7152 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.268900  7321 raft_consensus.cc:3055] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:28.330205  4537 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:28.331176  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 298749us
I20260709 12:28:28.302332  3970 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:28.338948  3924 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
W20260709 12:28:28.322727  7339 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.024s	sys 0.035s
W20260709 12:28:28.350559  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 86639.7us
I20260709 12:28:28.301396  7157 consensus_queue.cc:1059] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:28:28.325266  7341 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:28:28.336925  7349 log.cc:927] Time spent T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.269s	user 0.001s	sys 0.001s
W20260709 12:28:28.363358  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 146520us
W20260709 12:28:28.364171  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 155818us
W20260709 12:28:28.369275  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 171415us
I20260709 12:28:28.375653  4001 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:28.336095  6896 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:28.222584  7338 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.333367  7321 raft_consensus.cc:740] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:28.339426  7273 consensus_queue.cc:1059] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:28:28.333833  7220 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.391640  3970 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:28.414268  7360 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:28.414866  7360 raft_consensus.cc:697] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:28.415795  7360 consensus_queue.cc:237] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.416991  7261 consensus_queue.cc:1059] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:28.417968  7366 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.440337  7366 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.441965  7274 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:28.443185  7366 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:28.443871  7366 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:28.418109  7005 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:28.446561  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:28.426004  7237 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:28.451409  7067 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:28.452263  7067 consensus_queue.cc:1059] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:28.453435  7067 raft_consensus.cc:3055] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:28.427443  6980 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:28.428138  7369 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:28:28.430573  3754 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51798 (request call id 319) took 28404 ms (client timeout 15000 ms). Trace:
I20260709 12:28:28.433661  3996 tablet_service.cc:1558] Processing DeleteTablet for tablet d5c03e098f9a45cd94c52ada1bc9fa11 with delete_type TABLET_DATA_TOMBSTONED (TS 34711da9380944d2969a2bc3e203db3d not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36508
I20260709 12:28:28.474211  3821 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:28.438467  7203 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:28.436554  7330 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:28.436811  3753 catalog_manager.cc:5697] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 10, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 10 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:28.437646  7198 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:28.320395  7358 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.437985  7303 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:28.437973  3969 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:28.438540  7151 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:28.438992  7226 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:28.334905  6632 consensus_queue.cc:260] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.485240  6632 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:28.476131  7261 raft_consensus.cc:3055] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:28.461371  7274 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:28:28.390619  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 199150us
W20260709 12:28:28.461833  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 70266.7us
I20260709 12:28:28.490557  3970 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:28.462756  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 130812us
I20260709 12:28:28.486753  7261 raft_consensus.cc:740] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:28.493155  7347 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.493500  7261 consensus_queue.cc:260] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.360908  7353 consensus_queue.cc:1059] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.137s
I20260709 12:28:28.385562  7352 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 12:28:28.494904  7261 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:28.495051  7226 raft_consensus.cc:3055] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:28.495541  7226 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:28.486831  7330 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:28.496351  7226 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.496902  7330 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:28.497394  7330 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:28.487516  7285 consensus_queue.cc:1175] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "073f84fcc295417f9bcc1eea29d2bb58" responder_term: 7 status { last_received { term: 6 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:28:28.479357  7345 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:28:28.499126  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:28.499848  4566 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:28.500703  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:28.501251  4572 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:28.501133  7332 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.501858  3998 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:28.365958  7341 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:28.502696  7341 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:28.358529  7348 consensus_queue.cc:237] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.407771  7326 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:28.406375  6705 raft_consensus.cc:3055] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:28.506295  6705 raft_consensus.cc:740] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:28.507114  4005 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:28.383582  7328 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:28.482934  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 45077.8us
I20260709 12:28:28.435698  7321 consensus_queue.cc:260] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.457320  7067 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:28.458293  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 128033us
I20260709 12:28:28.493745  7347 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:28.492261  3822 connection.cc:256] RPC call timeout handler was delayed by -2.0414680670000962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2489s for a response
W20260709 12:28:28.520004  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:28.507571  6705 consensus_queue.cc:260] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.405478  7157 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:28.465479  7369 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:28.488867  7362 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:28.485289  3753 catalog_manager.cc:5697] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 5 to 9, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 9 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:28.497584  7226 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:28.510838  3970 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:28.515949  4572 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:28.507745  7358 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:28.520560  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:28.464838  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:28.494292  3897 leader_election.cc:336] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.788s (SENT)
W20260709 12:28:28.534400  3822 connection.cc:256] RPC call timeout handler was delayed by -1.534798783000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 12:28:28.518052  7338 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:28.510725  7359 raft_consensus.cc:3055] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:28.544124  4537 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:28.554344  3822 connection.cc:256] RPC call timeout handler was delayed by -1.4501987829999052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 12:28:28.558405  3897 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:28.559170  3822 connection.cc:256] RPC call timeout handler was delayed by -1.4267987829998674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 12:28:28.559412  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:28.559571  3822 connection.cc:256] RPC call timeout handler was delayed by -1.2863987830000951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
I20260709 12:28:28.517287  7303 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:28:28.561143  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:28.561614  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:28.556864  7359 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:28.521448  7281 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:28.511210  7364 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:28:28.567857  3998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 603) took 1665 ms (client timeout 1748 ms). Trace:
W20260709 12:28:28.571924  3998 rpcz_store.cc:269] 0709 12:28:26.903211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:27.489867 (+586656us) service_pool.cc:224] Handling call
0709 12:28:28.567658 (+1077791us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540036e554. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:28.567777 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2324893056}
I20260709 12:28:28.568418  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 604) took 1079 ms. Trace:
I20260709 12:28:28.575786  4005 rpcz_store.cc:276] 0709 12:28:27.488749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:27.488891 (+   142us) service_pool.cc:224] Handling call
0709 12:28:28.568262 (+1079371us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003a5cd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:28.568365 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2339054848}
W20260709 12:28:28.570179  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 151372us
I20260709 12:28:28.553058  7353 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.537685  7328 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.555527  7274 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:28.558944  7157 raft_consensus.cc:697] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:28.570727  7358 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.604359  7157 consensus_queue.cc:237] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.605219  7358 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.606151  7371 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:28.607573  7358 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:28.542309  7362 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.586494  3855 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:28.610307  7362 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:28.611833  7151 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:28.563602  7063 raft_consensus.cc:697] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:28.567551  7352 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:28.614116  7352 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.614509  7352 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:28.615814  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 121541us
I20260709 12:28:28.616118  7220 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:28.617264  3897 leader_election.cc:336] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.886s (SENT)
I20260709 12:28:28.588699  7328 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.618535  7281 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.620848  7328 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:28.456041  3754 rpcz_store.cc:269] 0709 12:28:00.025613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:00.034042 (+  8429us) service_pool.cc:224] Handling call
0709 12:28:00.632906 (+598864us) spinlock_profiling.cc:243] Waited 78.1 ms on lock 0x7b5400046ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f41090 00007fe051fdff3a 00007fe057d95e9c 00007fe057e9404e 00007fe0563552a4 00007fe056355232 00007fe056355161 00007fe0563550dc 00007fe056354392 00007fe05031248c 00007fe0503118c6
0709 12:28:28.430298 (+27797392us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:18.863164 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:18.863889 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:18.863949 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:28:18.863968 (+    19us) tablet.cc:662] Decoding operations
0709 12:28:19.038127 (+174159us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:19.038206 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:19.038235 (+    29us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:28:19.039516 (+  1281us) tablet.cc:701] Row locks acquired
0709 12:28:19.039549 (+    33us) write_op.cc:260] PREPARE: finished
0709 12:28:19.039717 (+   168us) write_op.cc:270] Start()
0709 12:28:19.039858 (+   141us) write_op.cc:276] Timestamp: P: 1783600099039651 usec, L: 0
0709 12:28:19.039880 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:28:19.040717 (+   837us) log.cc:844] Serialized 6268 byte log entry
0709 12:28:19.711911 (+671194us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe04eecd0ac 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b
0709 12:28:20.995148 (+1283237us) op_driver.cc:464] REPLICATION: finished
0709 12:28:22.011671 (+1016523us) write_op.cc:301] APPLY: starting
0709 12:28:22.060219 (+ 48548us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:22.109760 (+ 49541us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:22.109812 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:22.183221 (+ 73409us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:22.183587 (+   366us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:28:22.183656 (+    69us) write_op.cc:312] APPLY: finished
0709 12:28:22.184139 (+   483us) log.cc:844] Serialized 113 byte log entry
0709 12:28:22.303263 (+119124us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:22.324303 (+ 21040us) write_op.cc:454] Released schema lock
0709 12:28:22.344258 (+ 19955us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:22.397322 (+ 53064us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:22.402588 (+  5266us) write_op.cc:454] Released schema lock
0709 12:28:24.390105 (+1987517us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
Metrics: {"mutex_wait_us":1006237,"reported_tablets":29,"spinlock_wait_cycles":179547904,"child_traces":[["op",{"apply.queue_time_us":939456,"apply.run_cpu_time_us":30911,"apply.run_wall_time_us":405480,"num_ops":16,"prepare.queue_time_us":2108104,"prepare.run_cpu_time_us":28921,"prepare.run_wall_time_us":1561540,"raft.queue_time_us":763633,"raft.run_cpu_time_us":39260,"raft.run_wall_time_us":776935,"replication_time_us":1937356,"spinlock_wait_cycles":65375232,"thread_start_us":2819730,"threads_started":5,"wal-append.queue_time_us":1213954,"wal-append.run_cpu_time_us":67664,"wal-append.run_wall_time_us":4690670}]]}
I20260709 12:28:28.591764  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.586915  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.623565  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.625602  3851 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:28.625604  3848 raft_consensus.cc:1813] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Handling vote request from an unknown peer 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:28.598421  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.624917  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.566094  7334 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.629065  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.629410  7334 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.629935  3852 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:28.613428  7063 consensus_queue.cc:237] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.631937  7334 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:28.634505  7321 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:28.634840  3855 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:28.582523  7152 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:28.638825  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:28.640421  3822 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:28.571405  7067 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.641450  7067 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:28.641611  7366 raft_consensus.cc:3055] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:28.603083  7332 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:28.642063  7366 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:28.603082  7347 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:28.642947  7366 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.643838  7347 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:28.644568  7347 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:28.644117  7330 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.644946  7347 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.645325  7347 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:28.606072  7369 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.646847  7369 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:28.627035  3856 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:28.570931  6705 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:28.624238  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.651657  3853 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:28.562043  7370 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:28:28.617799  3897 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:28.645776  7359 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.566154  3753 catalog_manager.cc:5697] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 7, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 7 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:28:28.656034  3897 leader_election.cc:336] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.936s (SENT)
I20260709 12:28:28.588893  7353 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.657183  3970 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:28.659794  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:28.654690  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:28.656569  3897 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:28.626750  3848 raft_consensus.cc:2368] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6.
I20260709 12:28:28.661473  3970 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:28.654284  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.586190  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.662679  3753 catalog_manager.cc:5697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:28.663967  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 189855us
I20260709 12:28:28.665119  7368 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:28.664785  3821 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:28.643997  7366 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:28.680028  3929 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:28:28.681413  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:28.682364  3925 raft_consensus.cc:2393] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:28.682896  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:28.683224  3850 raft_consensus.cc:2393] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:28.679893  3821 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:28.702986  3932 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:28.680418  3929 pending_rounds.cc:85] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 4
I20260709 12:28:28.704257  3929 pending_rounds.cc:107] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:28:28.704557  3929 raft_consensus.cc:2889] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:28.706507  3821 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:28.658126  7326 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:28.707938  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 46538.3us
I20260709 12:28:28.708454  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.708750  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:28.714347  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:28.710366  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 48387.8us
W20260709 12:28:28.716315  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 60343.3us
W20260709 12:28:28.716934  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:28.718468  3897 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:28.720870  3753 catalog_manager.cc:5697] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:28:28.707866  7359 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:28.722360  3753 catalog_manager.cc:5697] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:28.723804  3753 catalog_manager.cc:5697] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 5, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 5 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:28.725050  3753 catalog_manager.cc:5697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:28.721724  7376 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:28.673738  7368 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:28:28.731232  3897 leader_election.cc:336] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 2.024s (SENT)
I20260709 12:28:28.621670  7341 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.691322  7328 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:28.740531  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.698946  7151 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:28.747138  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:28.745646  3753 catalog_manager.cc:5697] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 7, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 7 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
W20260709 12:28:28.755064  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 177767us
I20260709 12:28:28.765102  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.770308  3850 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:28.713390  7338 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:28:28.754705  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 192391us
I20260709 12:28:28.673897  7285 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:28:28.679523  7284 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 12:28:28.774600  3897 leader_election.cc:336] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 2.139s (SENT)
I20260709 12:28:28.707870  7375 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:28.783483  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.784703  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.776326  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.726245  7334 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:28.788650  4536 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:28.777130  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.774888  4538 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:28.777966  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.779213  3999 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:28.794152  4536 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:28.787241  3753 catalog_manager.cc:5697] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 5, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 5 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:28.787716  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:28.658783  7365 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:28.735299  7220 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:28.782320  7338 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.786515  4002 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:28.806519  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.786798  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:28.750978  7368 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:28.796404  4536 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:28.811532  4536 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:28.811910  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 248123us
W20260709 12:28:28.799397  3897 leader_election.cc:336] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 2.187s (SENT)
I20260709 12:28:28.790017  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.814123  3753 catalog_manager.cc:5697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 5 to 6, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 6 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:28:28.794202  4006 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:28.807638  3998 raft_consensus.cc:2410] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:28:28.806519  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.816709  4004 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:28.767169  7328 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:28.780073  6975 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.699483  7358 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:28:28.790048  7375 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:28.790861  7334 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:28.780350  6980 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:28.809930  7360 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:28.812865  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.813205  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.813450  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:28.818689  3924 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:28.806591  7220 raft_consensus.cc:697] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:28.807034  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:28.789799  7284 consensus_queue.cc:1243] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:28:28.824108  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:28.842064  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:28.842449  3929 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:28.825336  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.812178  7382 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:28.811695  7338 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:28.781159  7303 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:28:28.780565  7345 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:28:28.830011  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.837364  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:28.829612  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.829772  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:28.839910  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:28.855481  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:28.820358  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 74277us
I20260709 12:28:28.856559  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:28.835577  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.858718  3856 raft_consensus.cc:2410] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:28:28.833103  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:28.841163  4536 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:28.824419  7328 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:28.845351  3850 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:28.836287  7334 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:28.789656  7377 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:28:28.847350  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.848006  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.848731  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:28.849634  3753 catalog_manager.cc:5697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:28:28.846330  3928 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:28:28.958063  3928 pending_rounds.cc:85] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 6
I20260709 12:28:28.958415  3928 pending_rounds.cc:107] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:28:28.958696  3928 raft_consensus.cc:2889] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:28.854662  3925 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:28.853902  3848 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 4.
I20260709 12:28:28.826556  7378 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:28.874809  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:28.906550  7389 log.cc:927] Time spent T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:28:28.836946  7330 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:28.835760  6980 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.914752  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:28.896078  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 99094us
I20260709 12:28:28.901392  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.893697  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:28.974594  3923 raft_consensus.cc:2410] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 8 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:28:28.909664  3969 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:28.941642  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.976259  4000 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 8: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:28.977403  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.941684  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.911530  3857 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:28.921788  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:28.913026  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:28.829470  7375 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:28.947747  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 148380us
W20260709 12:28:28.983994  3897 leader_election.cc:336] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 2.211s (SENT)
I20260709 12:28:28.984545  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:28.948088  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:28.986029  3853 raft_consensus.cc:2410] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:28:28.948750  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:28.986711  3927 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:28.913873  7385 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:28.912434  3852 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:28.910609  3850 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:28.951951  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.952365  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:29.005254  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 148828us
I20260709 12:28:29.005475  3856 raft_consensus.cc:2393] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 5: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:28.830717  6975 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:28.960310  4004 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:29.006182  3822 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:28.894526  7362 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:28.957037  4006 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:28.851465  7303 consensus_queue.cc:1243] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:28:29.004556  4003 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:29.010811  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:28.978691  3753 catalog_manager.cc:5697] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:28.980454  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 70881us
I20260709 12:28:29.012630  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:28.954351  7382 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:28.962232  7378 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:29.008100  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:28.978569  3998 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 8: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:28.949543  7383 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:29.015941  3969 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:29.027357  4003 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:29.034823  7063 raft_consensus.cc:2764] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:28:29.037001  4006 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:29.036916  3822 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:29.038498  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:29.039508  3925 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:29.028766  4538 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:28.980727  6980 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:29.030511  3851 pending_rounds.cc:85] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 5
W20260709 12:28:29.032634  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 48664.6us
I20260709 12:28:29.055645  3851 pending_rounds.cc:107] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 12:28:29.056017  3897 leader_election.cc:336] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 2.217s (SENT)
I20260709 12:28:28.981824  7370 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:29.061094  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 246963us
I20260709 12:28:29.054746  3969 leader_election.cc:400] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6.
I20260709 12:28:29.061362  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:29.048909  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:29.056062  3851 raft_consensus.cc:2889] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:29.048067  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:29.062249  3927 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:29.062572  4004 raft_consensus.cc:2410] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:28:29.011858  7151 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:29.002081  7385 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:28.986984  7281 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:29.062275  3969 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:29.030469  7157 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:29.073079  3969 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:29.069553  3753 catalog_manager.cc:5697] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:29.074311  3969 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:29.071785  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:29.031255  7378 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:29.058936  7330 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:29.079650  3753 catalog_manager.cc:5697] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 4, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 4 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:29.057229  7358 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:29.089658  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 60975us
I20260709 12:28:29.087031  4537 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:29.090780  3969 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:29.091842  4538 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:29.040678  7285 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:28:29.058799  7383 raft_consensus.cc:697] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:29.095544  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:29.082026  7063 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:29.073434  7157 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:29.072494  7353 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:28.734170  7363 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:28:29.069576  7385 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:29.100152  7379 tablet_replica.cc:333] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:28:29.098935  7377 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:28:29.100313  3753 catalog_manager.cc:5697] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 4, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 4 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:29.109043  4005 raft_consensus.cc:2410] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:28:29.110633  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.095631  7332 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:29.085341  7005 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:29.111490  7261 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:29.113117  7396 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:29.088949  7226 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:29.081188  7393 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:29.139196  4538 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:29.094870  7341 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:29.116505  7388 log.cc:927] Time spent T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:28:29.103251  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:29.103247  7365 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:29.064246  7220 consensus_queue.cc:237] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:29.153501  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 56979.8us
W20260709 12:28:29.118000  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 62022.5us
W20260709 12:28:29.139043  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 43581.2us
W20260709 12:28:29.115918  7381 log.cc:927] Time spent T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
W20260709 12:28:29.117076  7390 log.cc:927] Time spent T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:28:29.111346  6632 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:29.109282  7370 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:29.111569  7157 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:29.190363  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 51253.6us
I20260709 12:28:29.158917  7396 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:29.179402  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:29.186905  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 345797us
I20260709 12:28:29.098763  7376 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:28:29.138185  7332 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:29.100274  7384 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.318s
I20260709 12:28:29.190424  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:29.113416  7358 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:29.117561  7380 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:28:29.194430  3753 catalog_manager.cc:5697] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 3 to 6, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 6 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:29.185233  7352 consensus_meta.cc:287] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.006s
W20260709 12:28:29.203819  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:29.133497  7353 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:28:29.183832  7402 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:29.213348  3753 catalog_manager.cc:5697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 5, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 5 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:29.197796  7332 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:29.247856  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 54264.4us
I20260709 12:28:29.218755  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:29.194787  7374 consensus_queue.cc:1059] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 12:28:29.220129  7392 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:28:29.220800  3753 catalog_manager.cc:5697] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 3 to 5, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 5 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
W20260709 12:28:29.222394  7399 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:28:29.214278  7370 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
W20260709 12:28:29.227005  7394 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 12:28:29.267149  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 48517.4us
I20260709 12:28:29.268359  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:29.228395  7274 consensus_meta.cc:287] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.000s
W20260709 12:28:29.231335  7391 log.cc:927] Time spent T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:28:29.302762  7274 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:29.217012  7261 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:29.304311  7261 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.214439  7383 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.234408  3848 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:29.208532  7352 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.307955  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.308779  3848 raft_consensus.cc:2368] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9.
I20260709 12:28:29.235430  3857 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:28:29.309705  4001 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
W20260709 12:28:29.310632  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 60311us
I20260709 12:28:29.310829  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:29.240233  7359 consensus_meta.cc:287] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.000s
I20260709 12:28:29.242026  7338 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:29.246584  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.195248  7396 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:29.257009  3856 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:29.252483  3897 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:29.325058  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 72645.1us
I20260709 12:28:29.325456  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.326135  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:29.326740  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.327853  7338 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:29.328228  3897 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:29.260972  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 68397.1us
I20260709 12:28:29.328833  3854 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:29.329648  4538 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:29.214255  7400 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:29.331818  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:29.290514  7379 raft_consensus.cc:2243] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:29.292550  7366 consensus_meta.cc:287] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.601s	user 0.006s	sys 0.003s
I20260709 12:28:29.208822  7363 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:28:29.266175  7284 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:28:29.296855  7328 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:29.300362  7369 consensus_meta.cc:287] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.000s
I20260709 12:28:29.302055  7358 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:29.309566  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.314776  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:28:29.305671  7347 consensus_meta.cc:287] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.004s
I20260709 12:28:29.374146  7347 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:29.374910  6975 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:29.376473  3999 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:28:29.322252  3852 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:28:29.327864  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:29.282368  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:29.326156  3856 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:29.260932  7285 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:29.344271  7353 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:29.342888  3753 catalog_manager.cc:5697] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:28:29.269769  7402 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:29.349776  7352 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:29.354035  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.400195  3854 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:28:29.342816  7362 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:29.359769  7379 raft_consensus.cc:2272] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:29.398264  3930 pending_rounds.cc:85] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 4
I20260709 12:28:29.404342  3930 pending_rounds.cc:107] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:28:29.404708  3930 raft_consensus.cc:2889] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:29.361649  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 93360.8us
I20260709 12:28:29.345700  7321 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:29.349377  7220 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:29.369048  7374 raft_consensus.cc:3055] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:29.353241  6980 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:29.369251  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.413980  3848 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:29.414916  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:29.379331  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 59058.2us
W20260709 12:28:29.379629  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 50069.5us
I20260709 12:28:29.379689  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:29.380813  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:29.416636  3929 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:29.338783  7360 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:29.386273  7285 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:29.340087  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.390184  3850 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:29.422974  3855 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:29.390362  3853 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:29.393646  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:29.396586  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 81898.8us
I20260709 12:28:29.397568  3923 pending_rounds.cc:85] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 3
I20260709 12:28:29.424328  3923 pending_rounds.cc:107] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:28:29.424610  3923 raft_consensus.cc:2889] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:29.321843  7378 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.407960  7362 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:29.427492  7362 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:29.428756  7378 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:29.430207  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:29.401562  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.431177  3857 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:29.431620  3851 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:29.432085  3857 raft_consensus.cc:1240] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
W20260709 12:28:29.386638  7067 consensus_meta.cc:287] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.003s
I20260709 12:28:29.405174  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.342284  7151 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:29.433976  3856 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:29.434710  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:29.434926  3931 raft_consensus.cc:2410] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:28:29.352083  7398 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:28:29.410917  3753 catalog_manager.cc:5697] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 3 to 6, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 6 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:28:29.436926  3753 catalog_manager.cc:5697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:29.438476  7369 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:29.439136  3855 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:28:29.439476  3855 pending_rounds.cc:85] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 5
I20260709 12:28:29.439725  3855 pending_rounds.cc:107] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:28:29.438988  3753 catalog_manager.cc:5697] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 5 to 7, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 7 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:28:29.410341  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.440562  3854 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:29.416723  3924 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:29.415933  4536 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:29.391027  7353 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:29.442015  7353 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:29.442517  4536 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:29.442937  7379 ts_tablet_manager.cc:1916] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:28:29.443200  7393 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:29.443528  4536 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:29.444868  7400 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:29.445245  7400 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:29.445557  7400 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:29.386495  3849 raft_consensus.cc:2393] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:29.446072  7384 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:29.404066  7005 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:29.430056  6975 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:29.448228  3852 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:29.423173  4538 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:29.449293  3969 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:29.420800  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 89049.5us
I20260709 12:28:29.451483  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.468283  3854 raft_consensus.cc:2393] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:29.462430  3970 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:29.452108  3855 raft_consensus.cc:2889] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:29.409266  7321 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:29.468215  3897 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:29.463994  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 50964.7us
I20260709 12:28:29.473227  3856 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:28:29.413476  7374 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:29.475744  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 52653.4us
I20260709 12:28:29.418028  7413 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:29.426095  7285 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:29.492051  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:29.480947  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.493462  3854 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:29.482460  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:29.494294  4002 raft_consensus.cc:2376] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6. Re-sending same reply.
I20260709 12:28:29.483121  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:29.486230  3928 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:28:29.486479  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:29.495074  3928 pending_rounds.cc:85] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 7
W20260709 12:28:29.461639  7334 consensus_meta.cc:287] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.521s	user 0.003s	sys 0.006s
I20260709 12:28:29.488956  3850 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:28:29.495165  4003 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:29.509210  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.509807  3856 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:29.512823  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:29.515128  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:29.515291  6705 consensus_queue.cc:1059] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:28:29.516443  6705 raft_consensus.cc:3055] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:29.516796  6705 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:29.423810  7330 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:28:29.473572  7321 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:29.529170  7419 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:29.530349  7402 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.532013  3929 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:29.489096  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:29.489832  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:29.490392  4567 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:29.425477  7347 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:29.495425  3928 pending_rounds.cc:107] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:28:29.535877  3928 raft_consensus.cc:2889] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:29.496455  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:29.497092  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:29.497644  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:29.498198  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:29.498715  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:29.499967  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:29.500636  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:29.538661  4006 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:29.501094  6980 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:29.486331  7376 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:29.461421  7063 consensus_queue.cc:1059] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:28:29.501248  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:29.541761  7063 raft_consensus.cc:3055] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:29.542192  7063 raft_consensus.cc:740] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:29.473805  7005 raft_consensus.cc:697] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:29.542436  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:29.543012  7063 consensus_queue.cc:260] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:29.543284  7005 consensus_queue.cc:237] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:29.543911  4567 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
W20260709 12:28:29.544315  7410 log.cc:927] Time spent T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:28:29.502130  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:29.503858  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:29.549484  4565 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:28:29.552678  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 63646.2us
I20260709 12:28:29.504845  7384 consensus_queue.cc:1059] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:29.546490  4567 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:28:29.478380  7360 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:29.491698  7413 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:29.563632  7413 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:29.490199  7303 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:29.566075  7303 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:29.566483  7303 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:29.551394  4571 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:29.552002  7328 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:29.491448  7358 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:29.559182  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.573006  3855 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:29.562464  3822 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:29.542275  4568 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
W20260709 12:28:29.574378  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 94044.3us
I20260709 12:28:29.446096  7409 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
I20260709 12:28:29.575881  4565 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:28:29.575553  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:29.569777  3971 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:29.527290  7411 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:28:29.580336  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:29.575101  3897 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:29.583943  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:29.517601  6705 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.618350  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.571830  7378 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:29.646919  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.647581  3855 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:29.558053  7359 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:28:29.620254  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:29.620739  3856 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:29.570720  7063 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:29.589391  3822 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:29.523576  7157 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.640697  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:29.580336  7398 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:29.518771  7334 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.589748  7326 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:29.558704  7339 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:28:29.643110  7328 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:29.618940  7274 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:29.571416  7385 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.572940  6980 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:28:29.658661  4004 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:29.640744  7369 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:28:29.653273  3897 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:29.663772  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.665035  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:29.620496  6632 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:28:29.651134  7281 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:29.698524  7281 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.700786  7281 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:29.653594  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 66465.5us
I20260709 12:28:29.586244  7358 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.703933  7358 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:29.551436  7374 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:29.687678  4005 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:29.664019  7363 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:29.624688  7419 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:29.691524  3848 raft_consensus.cc:2393] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:29.660729  7402 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:29.705175  7374 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:29.706905  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:29.662192  7398 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:29.708130  3850 pending_rounds.cc:85] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 6
I20260709 12:28:29.711084  3850 pending_rounds.cc:107] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:28:29.711396  3850 raft_consensus.cc:2889] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:29.711403  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 58209.2us
I20260709 12:28:29.712432  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:29.697813  4002 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:29.644801  7365 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:28:29.690078  7396 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.721985  7396 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:29.722333  3857 raft_consensus.cc:1240] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:28:29.724284  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:29.724947  3857 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:29.725901  7420 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:29.726402  7420 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:29.726732  7420 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:29.726907  7384 consensus_queue.cc:1059] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:29.728240  7384 raft_consensus.cc:3055] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:29.728682  7384 raft_consensus.cc:740] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:29.690495  7220 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:29.730290  7220 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.715561  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.731165  4573 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:29.731890  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.732290  7385 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:29.732535  3855 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:29.683378  6705 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:29.717684  7418 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:28:29.718418  4004 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:28:29.733819  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.666836  7326 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:28:29.716756  7415 log.cc:927] Time spent T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.248s	user 0.000s	sys 0.002s
I20260709 12:28:29.735478  7398 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:29.732589  7220 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:29.779011  7419 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:28:29.811642  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:29.739272  7368 consensus_meta.cc:287] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.912s	user 0.001s	sys 0.009s
I20260709 12:28:29.721694  7157 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:29.738586  7281 raft_consensus.cc:3055] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:28:29.799896  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 87552.4us
I20260709 12:28:29.867839  7359 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:29.739626  7363 raft_consensus.cc:2764] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:28:29.874656  3857 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:29.882648  3897 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:29.812141  7383 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.002s	sys 0.017s
I20260709 12:28:29.784518  7393 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:29.783835  7261 raft_consensus.cc:3055] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:29.888509  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:29.834052  7067 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:29.780169  7284 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:29.902326  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:29.912497  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:29.903311  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.906178  3857 raft_consensus.cc:2376] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9. Re-sending same reply.
I20260709 12:28:29.913664  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:29.780718  6975 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:29.868476  7396 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:29.921241  3856 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:29.833478  6980 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:29.911155  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:29.898885  7383 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.014s	sys 0.021s
I20260709 12:28:29.916699  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:30.000445  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:30.011159  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 159273us
W20260709 12:28:30.016074  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:29.916683  7419 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:29.781141  7005 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 12:28:29.926520  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.927477  7334 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:29.929899  7376 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:29.729755  7384 consensus_queue.cc:260] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:29.910892  7375 consensus_meta.cc:287] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.877s	user 0.005s	sys 0.005s
W20260709 12:28:29.926537  7421 log.cc:927] Time spent T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.458s	user 0.000s	sys 0.012s
I20260709 12:28:29.886296  7368 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:29.937192  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.941699  7303 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.943928  7413 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:29.907586  7332 consensus_meta.cc:287] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
I20260709 12:28:29.781935  7362 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:30.066061  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 174493us
I20260709 12:28:30.045632  7347 raft_consensus.cc:3055] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:28:29.976338  7427 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:28:29.978086  7374 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:29.890695  7281 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:29.997269  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:30.101744  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:30.102609  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:30.021843  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:30.023422  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:30.103740  3856 raft_consensus.cc:2376] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6. Re-sending same reply.
I20260709 12:28:29.905993  7261 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:29.914427  7067 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:29.874291  7326 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:30.041852  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:29.899927  7359 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.899031  6632 consensus_queue.cc:1059] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:28:30.027099  3895 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:30.124771  3855 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
W20260709 12:28:30.126233  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 99232.4us
I20260709 12:28:30.126329  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:30.127238  3923 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:30.127288  3895 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:29.963179  6975 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.026435  7419 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:29.922520  7284 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:29.963323  4569 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:30.075011  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:30.078926  4538 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:30.078233  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:30.087762  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:29.969660  7321 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:30.088406  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:30.012343  6980 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.105006  3853 raft_consensus.cc:2376] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11. Re-sending same reply.
I20260709 12:28:30.105367  4000 raft_consensus.cc:2368] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12.
I20260709 12:28:30.105181  3848 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:30.053572  7365 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:28:30.025739  7396 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.115913  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:30.161834  3927 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:30.117058  3970 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:30.118291  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:30.123333  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:30.163383  3856 raft_consensus.cc:2393] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:30.129415  3895 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:30.085251  7347 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:30.168793  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:30.064991  7375 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:30.146078  3931 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:28:30.114430  7384 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:30.149971  3857 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:30.120850  7067 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:30.073340  7332 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:30.155094  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 76274.2us
I20260709 12:28:30.184209  4538 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:30.159797  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:30.093137  7220 consensus_queue.cc:1059] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:28:30.165719  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:30.167665  7400 consensus_meta.cc:287] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.698s	user 0.007s	sys 0.004s
I20260709 12:28:30.169397  3929 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:30.173744  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:30.150784  7419 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:30.172708  7328 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:30.169302  7377 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:30.239890  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:30.228467  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:30.161528  6975 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:30.261097  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:30.261972  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:30.241217  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:30.244623  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 166479us
I20260709 12:28:30.257565  3997 raft_consensus.cc:2393] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:30.264118  3999 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:30.284053  3822 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:30.284971  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:30.225351  7383 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:30.294057  3853 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:30.300948  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:30.294065  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 219107us
I20260709 12:28:30.302471  3929 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:30.291535  3822 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:30.302855  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:30.307418  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:30.263051  7377 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:30.240216  7440 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:30.318106  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:30.323479  3857 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:30.314929  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:30.324296  3931 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:30.227078  7420 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:30.330479  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:30.338562  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:30.339460  7440 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:30.340667  7440 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:30.330264  7360 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:30.341770  7360 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.342489  3855 raft_consensus.cc:1240] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:30.343906  3855 raft_consensus.cc:1240] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
W20260709 12:28:30.340909  7353 consensus_meta.cc:287] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.898s	user 0.008s	sys 0.003s
I20260709 12:28:30.344719  7353 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.345623  7334 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:30.345793  3854 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:30.346125  7334 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:30.346292  7436 log.cc:927] Time spent T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:28:30.346532  7334 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:30.347270  7433 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:28:30.347525  7353 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:30.343930  7360 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:30.345063  3855 raft_consensus.cc:1240] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:30.351042  7353 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:30.351181  7362 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:30.351747  7353 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:30.352371  7353 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:30.353143  7362 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:28:30.354581  7435 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:28:30.355376  7321 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:30.355487  7413 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:30.354612  3857 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:30.308638  7383 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:30.181260  7281 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.377470  7413 consensus_queue.cc:1059] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:30.378213  4003 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:28:30.378422  7413 raft_consensus.cc:3055] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:30.378827  7413 raft_consensus.cc:740] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:30.379680  7413 consensus_queue.cc:260] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.380280  4003 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:30.380816  7413 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:30.381620  7368 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:30.377300  7360 consensus_queue.cc:1059] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:28:30.382954  7332 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:30.257696  7261 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:30.384070  7430 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 12:28:30.385779  6980 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:30.383325  7360 raft_consensus.cc:3055] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:30.386478  7360 raft_consensus.cc:740] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:30.386811  7359 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:30.387368  7360 consensus_queue.cc:260] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.388543  7360 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:30.393976  7383 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:30.394958  6705 consensus_meta.cc:287] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
W20260709 12:28:30.396238  3997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36516 (request call id 2321) took 1653 ms (client timeout 2061 ms). Trace:
W20260709 12:28:30.396643  3997 rpcz_store.cc:269] 0709 12:28:28.743049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:28.901103 (+158054us) service_pool.cc:224] Handling call
0709 12:28:30.396046 (+1494943us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540021a7d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:30.396179 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2923283328}
W20260709 12:28:30.398728  7285 consensus_meta.cc:287] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.880s	user 0.009s	sys 0.002s
I20260709 12:28:30.345496  7446 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:30.401293  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:30.307590  7441 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:30.190346  7398 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:30.374742  7437 log.cc:927] Time spent T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:28:30.245577  7400 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.324677  7377 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:30.376330  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36516 (request call id 2317) took 1634 ms. Trace:
I20260709 12:28:30.318609  3853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:28:30.399118  7285 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:30.377292  7420 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:30.377223  7352 consensus_queue.cc:1059] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:30.383298  7303 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:30.370810  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:30.442842  3931 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:30.407284  3927 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:30.353638  7362 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:30.326822  6975 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:28:30.369803  7063 consensus_meta.cc:287] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.704s	user 0.007s	sys 0.003s
I20260709 12:28:30.376842  3926 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:30.432030  3853 raft_consensus.cc:606] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:30.431459  4000 rpcz_store.cc:276] 0709 12:28:28.741801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:28.981513 (+239712us) service_pool.cc:224] Handling call
0709 12:28:30.376111 (+1394598us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540007f3d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:30.376265 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2484926336}
I20260709 12:28:30.437769  3848 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:28:30.383034  7375 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:30.420887  7376 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:30.382972  7396 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:30.422062  7441 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:30.437000  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:30.447346  4001 raft_consensus.cc:2393] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 5: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:28:30.452426  3850 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.001s	sys 0.001s
W20260709 12:28:30.480870  3850 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.001s	sys 0.001s
I20260709 12:28:30.472827  3998 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
W20260709 12:28:30.421089  7412 consensus_queue.cc:1175] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34711da9380944d2969a2bc3e203db3d" responder_term: 9 status { last_received { term: 6 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: [8.7-8.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:28:30.476261  3929 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:30.432029  7284 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:30.497299  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 205864us
W20260709 12:28:30.464215  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 334868us
I20260709 12:28:30.498553  3822 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:30.498842  3895 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:30.450502  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 333491us
I20260709 12:28:30.494508  3821 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:30.447928  7362 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:28:30.507207  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:30.508903  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:30.515288  3895 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:30.428757  7446 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.450807  7328 raft_consensus.cc:697] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:30.462828  7438 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:30.394982  7347 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.551316  4568 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:28:30.489271  6975 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:30.543418  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 948) took 1052 ms. Trace:
W20260709 12:28:30.567571  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 69080.4us
I20260709 12:28:30.488945  7441 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:30.559568  3853 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
W20260709 12:28:30.573253  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 68868.4us
I20260709 12:28:30.574044  3851 pending_rounds.cc:85] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 7
I20260709 12:28:30.574014  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:30.574573  3851 pending_rounds.cc:107] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 6.8
W20260709 12:28:30.563321  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 48123.1us
I20260709 12:28:30.574949  3851 raft_consensus.cc:2889] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:30.575505  3895 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:30.578681  3969 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:30.579138  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:30.564872  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:30.562232  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 259478us
I20260709 12:28:30.580901  3853 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:28:30.550320  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 55921.9us
I20260709 12:28:30.567795  4569 rpcz_store.cc:276] 0709 12:28:29.490774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:29.514881 (+ 24107us) service_pool.cc:224] Handling call
0709 12:28:30.543207 (+1028326us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b540052a154. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:30.543349 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005023616}
I20260709 12:28:30.530841  7338 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:30.586606  3821 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:30.587662  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 864) took 1133 ms. Trace:
I20260709 12:28:30.520601  7420 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:30.564990  7303 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:30.506059  7396 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:28:30.544495  7402 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:30.593377  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:30.588277  3852 rpcz_store.cc:276] 0709 12:28:29.454076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:29.487120 (+ 33044us) service_pool.cc:224] Handling call
0709 12:28:29.524383 (+ 37263us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:29.551332 (+ 26949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:29.551362 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:29.551939 (+   577us) log.cc:844] Serialized 52 byte log entry
0709 12:28:29.852817 (+300878us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:29.852876 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:29.852975 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:30.587443 (+734468us) raft_consensus.cc:1685] finished
0709 12:28:30.587462 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:30.587592 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14210,"raft.queue_time_us":32517,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5543,"thread_start_us":300408,"threads_started":1,"wal-append.queue_time_us":597096}
I20260709 12:28:30.595997  4569 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:30.584216  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:30.597278  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:30.667012  3927 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:30.506403  7379 ts_tablet_manager.cc:1929] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:28:30.489869  7376 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.600239  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:30.587478  7449 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:30.634174  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:30.591696  7347 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:30.635039  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:30.639878  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:30.584053  7273 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:30.665767  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 81963.3us
I20260709 12:28:30.632898  7465 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:30.605293  7338 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:30.671885  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:30.658442  7402 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:30.565426  7438 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:30.673139  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 94558.2us
I20260709 12:28:30.717258  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:30.718263  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:30.677006  7379 log.cc:1199] T d5c03e098f9a45cd94c52ada1bc9fa11 P 34711da9380944d2969a2bc3e203db3d: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/wals/d5c03e098f9a45cd94c52ada1bc9fa11
W20260709 12:28:30.723182  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 123205us
W20260709 12:28:30.702767  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:30.725271  3971 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:30.603782  7303 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:30.675625  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:30.726642  3821 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:30.731607  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:30.735956  4003 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:30.700927  7063 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:30.731932  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:30.732579  3971 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:30.733184  4000 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:28:30.734001  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:30.749698  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:30.753922  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 48501.8us
I20260709 12:28:30.710204  7338 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:30.757210  4574 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:28:30.755244  3970 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:30.720116  7449 raft_consensus.cc:697] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:30.763002  3897 leader_election.cc:400] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12.
W20260709 12:28:30.753404  7067 consensus_meta.cc:287] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.002s
W20260709 12:28:30.774130  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 48302.5us
I20260709 12:28:30.773145  3897 leader_election.cc:403] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:28:30.778259  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 51710.9us
W20260709 12:28:30.790577  3895 leader_election.cc:336] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 1.853s (SENT)
I20260709 12:28:30.811177  3895 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:30.812013  3821 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:30.812690  3895 leader_election.cc:336] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 1.875s (SENT)
W20260709 12:28:30.813781  3895 leader_election.cc:336] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 1.929s (SENT)
W20260709 12:28:30.814744  3895 leader_election.cc:336] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 2.018s (SENT)
I20260709 12:28:30.815205  3895 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:30.805963  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:30.769474  6632 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:28:30.819165  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 86680us
I20260709 12:28:30.709636  7273 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.763388  7338 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:30.855463  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 100331us
I20260709 12:28:30.857101  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 871) took 1375 ms. Trace:
I20260709 12:28:30.862632  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:30.864115  4003 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:30.709676  7328 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.770198  7454 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:30.862519  3855 rpcz_store.cc:276] 0709 12:28:29.481512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.350051 (+868539us) service_pool.cc:224] Handling call
0709 12:28:30.350306 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:30.350487 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:30.602721 (+252234us) log.cc:844] Serialized 14 byte log entry
0709 12:28:30.856769 (+254048us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:30.856818 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:30.856864 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:30.856925 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:30.857041 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1971,"prepare.queue_time_us":378654,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"thread_start_us":503564,"threads_started":2}
I20260709 12:28:30.720561  6975 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:30.854481  7447 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
W20260709 12:28:30.871868  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 108985us
I20260709 12:28:30.862555  7456 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:30.725483  7465 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:30.874241  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:30.877517  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:30.881464  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 142684us
W20260709 12:28:30.885985  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:30.880300  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:30.889031  3895 leader_election.cc:336] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 2.052s (SENT)
I20260709 12:28:30.843034  7220 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:30.807737  7284 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 12:28:30.895624  4004 raft_consensus.cc:1240] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:28:30.864183  7332 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:30.843374  7452 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:28:30.904038  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:30.905692  3855 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:28:30.858744  7462 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:30.869623  7396 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:30.875039  7063 raft_consensus.cc:697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:30.917578  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:30.874389  7398 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:30.820866  7067 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:30.910094  7445 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
I20260709 12:28:30.927034  7303 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:30.927574  7472 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:28:30.927763  7273 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:30.928049  7466 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:28:30.928555  7400 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:30.904973  6705 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:28:30.942051  7461 log.cc:927] Time spent T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
W20260709 12:28:30.942575  7453 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 12:28:30.943156  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:30.943548  7465 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:30.917944  7332 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:31.002800  7485 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:31.003320  7332 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:31.003571  7485 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:31.004168  7485 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:30.923306  7396 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:31.006286  7396 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:31.006968  7446 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:30.945416  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:31.010221  4572 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:30.971074  7449 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.014757  7438 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:31.015417  7489 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.061s	user 0.000s	sys 0.002s
W20260709 12:28:30.946215  7475 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:28:31.019249  4571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 959) took 1003 ms. Trace:
W20260709 12:28:31.019559  7360 consensus_meta.cc:287] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.000s
W20260709 12:28:30.989226  7471 log.cc:927] Time spent T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.254s	user 0.000s	sys 0.004s
I20260709 12:28:31.019677  4571 rpcz_store.cc:276] 0709 12:28:30.015595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.015738 (+   143us) service_pool.cc:224] Handling call
0709 12:28:30.044693 (+ 28955us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:30.048823 (+  4130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:30.048871 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:30.049743 (+   872us) log.cc:844] Serialized 26 byte log entry
0709 12:28:30.165000 (+115257us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:30.165050 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:30.165121 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:31.019046 (+853925us) raft_consensus.cc:1685] finished
0709 12:28:31.019067 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:31.019189 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3625,"raft.queue_time_us":3773,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"thread_start_us":114823,"threads_started":1,"wal-append.queue_time_us":395393}
W20260709 12:28:30.949441  7326 consensus_meta.cc:287] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.810s	user 0.002s	sys 0.007s
I20260709 12:28:31.022279  7067 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:31.022547  7334 consensus_meta.cc:287] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.000s
I20260709 12:28:31.022665  7326 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.022967  4568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 901) took 1026 ms. Trace:
I20260709 12:28:31.023046  7334 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.023523  4568 rpcz_store.cc:276] 0709 12:28:29.996445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:29.996705 (+   260us) service_pool.cc:224] Handling call
0709 12:28:30.551052 (+554347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:30.556701 (+  5649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.022795 (+466094us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b540052a150. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:31.022917 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267005696}
I20260709 12:28:31.024240  7362 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.024804  7326 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:31.026093  3999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2329) took 1553 ms (client timeout 1831 ms). Trace:
W20260709 12:28:31.026468  3999 rpcz_store.cc:269] 0709 12:28:29.472647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:29.474923 (+  2276us) service_pool.cc:224] Handling call
0709 12:28:31.025932 (+1551009us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b540007e9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:31.026029 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1672000256}
I20260709 12:28:31.027081  6705 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:31.027560  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:31.002815  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:30.950383  7470 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:28:30.894078  7454 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:30.952059  7376 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:30.953912  7492 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:30.950423  7483 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:30.953147  7063 consensus_queue.cc:237] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:30.961985  7384 consensus_meta.cc:287] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.778s	user 0.000s	sys 0.013s
I20260709 12:28:30.962939  7462 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:30.963719  7413 consensus_meta.cc:287] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.001s
W20260709 12:28:30.961651  3931 consensus_meta.cc:287] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.001s
I20260709 12:28:31.025787  7334 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:30.968007  4002 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:31.052385  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:31.053649  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:31.054539  4002 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:30.994160  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:31.055313  4003 raft_consensus.cc:2393] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:28:30.966676  7353 consensus_meta.cc:287] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.614s	user 0.005s	sys 0.005s
I20260709 12:28:30.867626  7402 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.030223  3924 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:31.028810  4574 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:30.967603  7452 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:31.040655  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:30.974107  7379 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36508 (request call id 96) took 2513 ms. Trace:
W20260709 12:28:31.034386  7419 consensus_meta.cc:287] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.766s	user 0.010s	sys 0.000s
I20260709 12:28:31.049010  3931 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:30.981841  4004 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:31.058331  4565 raft_consensus.cc:2410] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:28:31.035810  7303 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:31.077001  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:31.077793  3931 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:31.028025  6705 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.074693  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2284) took 1373 ms. Trace:
I20260709 12:28:31.095048  3931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:28:31.095732  3931 raft_consensus.cc:606] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:31.096058  3931 raft_consensus.cc:614] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:31.096385  7261 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:31.099516  7460 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:31.104089  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1876) took 1272 ms. Trace:
I20260709 12:28:31.104327  7285 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:31.104478  3857 rpcz_store.cc:276] 0709 12:28:29.831334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.585948 (+754614us) service_pool.cc:224] Handling call
0709 12:28:30.605547 (+ 19599us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:30.674043 (+ 68496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:30.674085 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:30.681872 (+  7787us) log.cc:844] Serialized 52 byte log entry
0709 12:28:31.035304 (+353432us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:31.039800 (+  4496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.040071 (+   271us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:31.103861 (+ 63790us) raft_consensus.cc:1685] finished
0709 12:28:31.103881 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:31.104031 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22184,"raft.queue_time_us":134902,"raft.run_cpu_time_us":670,"raft.run_wall_time_us":40063,"thread_start_us":281739,"threads_started":1,"wal-append.queue_time_us":370009}
W20260709 12:28:31.106968  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 284415us
I20260709 12:28:31.107719  3821 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:31.110707  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:31.111343  4003 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:31.046550  7273 consensus_queue.cc:1059] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:28:31.046303  7360 consensus_queue.cc:1059] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:28:31.117316  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:31.117383  3821 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:31.081248  7362 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:31.119218  3821 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:31.071579  7450 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:31.119771  3923 raft_consensus.cc:2393] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:31.116838  7446 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:31.125681  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:31.136989  7463 consensus_queue.cc:1059] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:28:31.140004  3821 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:31.142376  3895 leader_election.cc:336] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 1.789s (SENT)
I20260709 12:28:31.064425  7379 rpcz_store.cc:276] 0709 12:28:28.429833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:28.433366 (+  3533us) service_pool.cc:224] Handling call
0709 12:28:28.821944 (+388578us) ts_tablet_manager.cc:1151] Deleting tablet d5c03e098f9a45cd94c52ada1bc9fa11
0709 12:28:28.839578 (+ 17634us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:28:29.938788 (+1099210us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:30.481635 (+542847us) tablet_metadata.cc:665] Metadata flushed
0709 12:28:30.943192 (+461557us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127567,"tablet-delete.queue_time_us":312088,"thread_start_us":190605,"threads_started":1}
I20260709 12:28:31.142985  3895 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:31.137229  7452 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.064764  7353 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:31.181792  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 282165us
I20260709 12:28:31.175855  3821 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:31.200572  7285 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:31.110354  7326 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:31.137987  7486 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:31.049690  7483 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.219296  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:31.221771  3927 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:31.121610  7334 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:31.060796  7462 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.086949  7303 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.116921  7067 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:31.210750  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:31.071486  7419 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.246658  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:31.247433  3923 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:31.229234  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 53476.2us
W20260709 12:28:31.220633  7377 consensus_meta.cc:287] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.780s	user 0.011s	sys 0.000s
W20260709 12:28:31.223542  7442 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:28:31.240115  7498 raft_consensus.cc:3055] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:31.242657  7454 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:31.227233  7486 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:31.251052  7067 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.251682  7463 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.252393  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:31.323100  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 70786.8us
I20260709 12:28:31.252554  7419 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:31.120088  7451 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.118s
I20260709 12:28:31.253334  7465 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:31.254168  7456 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12.
I20260709 12:28:31.254299  7409 raft_consensus.cc:3055] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:31.257817  7303 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:31.336937  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 624) took 1624 ms. Trace:
I20260709 12:28:31.258716  3932 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:28:31.227031  7446 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:31.210590  7362 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:31.251133  7494 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:31.259033  7383 consensus_meta.cc:287] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.864s	user 0.008s	sys 0.008s
I20260709 12:28:31.227855  7285 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:31.282692  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:31.314399  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:31.274611  7474 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.136s	user 0.001s	sys 0.001s
I20260709 12:28:31.238852  7334 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:31.361776  7493 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.068s	user 0.001s	sys 0.001s
I20260709 12:28:31.362048  7334 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:31.363162  7332 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.364089  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:31.365020  3926 raft_consensus.cc:2368] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7.
W20260709 12:28:31.327622  7496 log.cc:927] Time spent T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.005s
I20260709 12:28:31.327522  3857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:28:31.366935  3857 raft_consensus.cc:606] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:31.367249  3857 raft_consensus.cc:614] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:31.367508  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:31.368080  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:31.369311  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:31.279271  7491 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.064s	user 0.002s	sys 0.000s
I20260709 12:28:31.273634  7498 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:31.384524  7498 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.232548  7326 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.274616  3741 catalog_manager.cc:5028] TS 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): tablet d5c03e098f9a45cd94c52ada1bc9fa11 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
W20260709 12:28:31.390232  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 61399.8us
I20260709 12:28:31.337438  4005 rpcz_store.cc:276] 0709 12:28:29.712225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:29.712364 (+   139us) service_pool.cc:224] Handling call
0709 12:28:29.712770 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:29.881131 (+168361us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:28:29.901944 (+ 20813us) log.cc:844] Serialized 14 byte log entry
0709 12:28:30.458680 (+556736us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:31.024883 (+566203us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b2c000e1568. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:28:31.025303 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 12:28:31.025457 (+   154us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:31.025689 (+   232us) log.cc:844] Serialized 14 byte log entry
0709 12:28:31.025862 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.025952 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:31.336651 (+310699us) raft_consensus.cc:1685] finished
0709 12:28:31.336687 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:31.336862 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68164,"prepare.queue_time_us":26861,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":5105,"raft.queue_time_us":231286,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":43381,"spinlock_wait_cycles":11739008,"thread_start_us":633527,"threads_started":3,"wal-append.queue_time_us":408732}
I20260709 12:28:31.320418  7486 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:31.282824  7464 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.275947  7328 consensus_queue.cc:1059] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:28:31.328334  7460 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:31.356830  3923 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
W20260709 12:28:31.358168  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 43922.1us
W20260709 12:28:31.402231  3895 leader_election.cc:336] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 2.061s (SENT)
I20260709 12:28:31.388157  7498 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:31.366545  3970 leader_election.cc:400] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7.
W20260709 12:28:31.411728  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 45319us
I20260709 12:28:31.376933  4000 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:31.371960  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 873) took 1749 ms. Trace:
I20260709 12:28:31.413009  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:31.381942  4003 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:31.352490  7347 consensus_meta.cc:287] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.006s
W20260709 12:28:31.383651  7488 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:28:31.386734  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:31.414152  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:31.343396  6975 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:31.336282  7409 raft_consensus.cc:740] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:31.415742  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:31.416328  3923 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:31.415973  7409 consensus_queue.cc:260] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.416630  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:31.278306  7377 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.417706  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:31.418781  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:31.419160  7377 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:31.419344  3926 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:31.392750  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1825) took 1276 ms. Trace:
I20260709 12:28:31.420583  4567 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:31.419868  3930 rpcz_store.cc:276] 0709 12:28:30.116453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.125218 (+  8765us) service_pool.cc:224] Handling call
0709 12:28:30.141579 (+ 16361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:30.459259 (+317680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:30.460101 (+   842us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:30.488186 (+ 28085us) log.cc:844] Serialized 26 byte log entry
0709 12:28:30.766195 (+278009us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:30.766248 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:30.766337 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:31.392486 (+626149us) raft_consensus.cc:1685] finished
0709 12:28:31.392517 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:31.392680 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":190976,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":134,"thread_start_us":586429,"threads_started":2,"wal-append.queue_time_us":590960}
I20260709 12:28:31.421742  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:31.422959  7303 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:31.423624  3970 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:31.423488  7303 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.424216  3857 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:31.424480  3970 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:31.425602  7376 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:31.426406  3848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2288) took 1706 ms (client timeout 2268 ms). Trace:
I20260709 12:28:31.426218  7376 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:31.426775  3848 rpcz_store.cc:269] 0709 12:28:29.720802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.239614 (+518812us) service_pool.cc:224] Handling call
0709 12:28:31.426170 (+1186556us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b540027b354. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:31.426324 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417549568}
I20260709 12:28:31.427910  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:31.428241  7376 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.428750  7376 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:31.428893  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:31.394320  3741 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 122346us
I20260709 12:28:31.359426  7467 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:31.429723  7005 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:31.422794  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:31.425633  7303 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.380501  7332 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.402856  3895 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:31.359340  7419 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:31.412086  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:31.412922  3851 rpcz_store.cc:276] 0709 12:28:29.622868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.365957 (+743089us) service_pool.cc:224] Handling call
0709 12:28:30.431525 (+ 65568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:30.575649 (+144124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:30.575694 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:30.576218 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:28:30.715232 (+139014us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:30.715286 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.371590 (+656304us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54003778d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:31.371636 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:31.371674 (+    38us) raft_consensus.cc:1685] finished
0709 12:28:31.371687 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:31.371900 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327122688,"thread_start_us":138653,"threads_started":1,"wal-append.queue_time_us":248329}
W20260709 12:28:31.439159  3998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 619) took 1879 ms (client timeout 2046 ms). Trace:
I20260709 12:28:31.439261  4005 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:31.439760  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:31.371598  7358 consensus_queue.cc:1059] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:28:31.396705  7465 raft_consensus.cc:697] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:31.415482  6975 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.446322  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:31.423255  7464 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.429237  7376 raft_consensus.cc:697] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:28:31.460115  7338 consensus_meta.cc:287] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.000s
I20260709 12:28:31.460678  7376 consensus_queue.cc:237] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.462105  7483 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:31.463415  7462 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.386462  7494 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.464624  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:31.466434  7494 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.466641  4005 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:28:31.469620  4005 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:28:31.420267  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:31.394188  7458 log.cc:927] Time spent T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.513s	user 0.001s	sys 0.001s
I20260709 12:28:31.432425  3895 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:31.328972  7463 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.355468  7362 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:31.439667  3998 rpcz_store.cc:269] 0709 12:28:29.559884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:29.560004 (+   120us) service_pool.cc:224] Handling call
0709 12:28:31.439013 (+1879009us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54000c4754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:31.439106 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885035392}
W20260709 12:28:31.502313  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 69961us
I20260709 12:28:31.369869  7396 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.372411  7383 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.402586  7353 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:31.432075  7285 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.392714  3822 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:31.470378  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:31.518630  3851 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:31.473399  7464 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.432015  3970 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:31.474280  3930 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:31.478665  7281 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:31.479956  6975 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.480752  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 867) took 2023 ms. Trace:
W20260709 12:28:31.535079  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 103222us
I20260709 12:28:31.535832  4005 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:28:31.460741  7338 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.486984  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2397) took 1346 ms. Trace:
W20260709 12:28:31.487118  7441 consensus_meta.cc:287] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.885s	user 0.007s	sys 0.003s
I20260709 12:28:31.488256  7067 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:31.490087  3926 raft_consensus.cc:2410] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:28:31.535118  3850 rpcz_store.cc:276] 0709 12:28:29.457356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:29.516854 (+ 59498us) service_pool.cc:224] Handling call
0709 12:28:29.517211 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:29.801376 (+284165us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:28:29.801422 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:29.802008 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:28:30.481305 (+679297us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:30.481347 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.480331 (+998984us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002ef254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:31.480388 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:31.480442 (+    54us) raft_consensus.cc:1685] finished
0709 12:28:31.480455 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:31.480687 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438532864,"thread_start_us":572959,"threads_started":1,"wal-append.queue_time_us":706347}
I20260709 12:28:31.448849  7485 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.571256  4005 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:31.556588  3849 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:28:31.570256  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:31.566845  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:31.503227  3895 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:31.504691  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:31.576673  3931 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:31.532421  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 139768us
I20260709 12:28:31.550150  3924 rpcz_store.cc:276] 0709 12:28:30.141120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.152447 (+ 11327us) service_pool.cc:224] Handling call
0709 12:28:30.152746 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:31.056343 (+903597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.486750 (+430407us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b54000ee7d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:31.486917 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2017590016}
I20260709 12:28:31.575470  4000 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:31.577435  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:31.544305  7285 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.449034  7334 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.597538  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:31.611507  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 44759.5us
I20260709 12:28:31.592672  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:31.584525  4003 raft_consensus.cc:2410] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:28:31.591641  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:31.613529  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 110418us
I20260709 12:28:31.614249  3895 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:31.543190  7339 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:31.578452  7446 raft_consensus.cc:697] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:31.578655  3848 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:31.579519  3924 raft_consensus.cc:1240] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:31.592267  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:31.622385  4002 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:31.560631  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 627) took 1645 ms. Trace:
I20260709 12:28:31.505722  7462 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:31.618950  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:31.627195  3822 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:31.623198  4006 rpcz_store.cc:276] 0709 12:28:29.915394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:29.953646 (+ 38252us) service_pool.cc:224] Handling call
0709 12:28:29.954081 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:30.169607 (+215526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:30.169641 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:30.170153 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:28:30.422046 (+251893us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:30.422141 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:30.844219 (+422078us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540007f8d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:30.844284 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:31.385266 (+540982us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:31.560436 (+175170us) raft_consensus.cc:1685] finished
0709 12:28:31.560459 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:31.560577 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151148,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":6741,"spinlock_wait_cycles":531457280,"thread_start_us":251327,"threads_started":1,"wal-append.queue_time_us":588886}
I20260709 12:28:31.628713  3855 raft_consensus.cc:1240] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:31.552986  7364 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:31.621381  7494 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:31.631803  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:31.625829  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:31.633430  3822 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:31.600651  7359 raft_consensus.cc:3055] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:31.563478  7440 raft_consensus.cc:3055] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:31.636969  3850 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:31.623679  7449 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.610141  7378 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:31.632267  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:31.628592  7383 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:31.555097  7441 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.627943  7067 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:31.651618  3924 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:31.634305  7364 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:31.637274  7358 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:31.644016  6705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.008s	sys 0.015s
I20260709 12:28:31.638278  7359 raft_consensus.cc:740] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:31.565045  7486 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.647842  3851 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
W20260709 12:28:31.658200  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:31.684662  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:31.685310  4005 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:31.659657  3998 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:28:31.677320  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:31.685941  3851 raft_consensus.cc:1240] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:31.663008  7374 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:31.686636  3850 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:31.610498  7353 consensus_queue.cc:1059] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:28:31.630208  7339 raft_consensus.cc:697] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:31.616500  7469 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 12:28:31.695793  7477 log.cc:927] Time spent T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:28:31.697589  3851 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:28:31.699035  3851 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:28:31.700773  7476 raft_consensus.cc:3055] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:31.701251  7476 raft_consensus.cc:740] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:31.700971  7359 consensus_queue.cc:260] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.702725  7359 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:31.714598  7384 raft_consensus.cc:3055] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:31.714155  7476 consensus_queue.cc:260] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.715021  7384 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:31.715591  7476 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:31.716172  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54068 (request call id 790) took 1123 ms. Trace:
I20260709 12:28:31.715837  7384 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.716601  3929 rpcz_store.cc:276] 0709 12:28:30.592967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.593083 (+   116us) service_pool.cc:224] Handling call
0709 12:28:31.715982 (+1122899us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54000d5a54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:31.716115 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1315066112}
I20260709 12:28:31.717110  7384 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:31.717928  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:31.718520  7478 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.790s	user 0.001s	sys 0.003s
W20260709 12:28:31.705724  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:31.720080  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 899) took 1830 ms. Trace:
I20260709 12:28:31.720511  4565 rpcz_store.cc:276] 0709 12:28:29.889943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:29.890049 (+   106us) service_pool.cc:224] Handling call
0709 12:28:31.719903 (+1829854us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54005b5c54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:31.720024 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2631774592}
I20260709 12:28:31.497530  3923 raft_consensus.cc:2410] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:28:31.642385  7328 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:31.721756  7328 raft_consensus.cc:697] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:31.722509  4006 raft_consensus.cc:1240] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:28:31.722746  7328 consensus_queue.cc:237] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.617990  7285 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.718525  3929 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:31.652168  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:31.641903  7440 raft_consensus.cc:740] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:31.650125  7494 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:31.633453  7419 consensus_queue.cc:1059] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:28:31.688475  3926 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
W20260709 12:28:31.690225  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:31.664705  6705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.009s	sys 0.016s
I20260709 12:28:31.566092  7465 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.728941  3931 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:31.729025  3970 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:31.661512  7402 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:28:31.736953  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:31.728340  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:31.732080  3924 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:31.715796  4005 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:31.738405  3929 raft_consensus.cc:2393] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:31.733816  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 119632us
I20260709 12:28:31.684273  7375 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.663918  7364 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:31.654868  7449 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.728459  7456 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:31.742957  3970 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:31.664832  7446 consensus_queue.cc:237] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.664547  7508 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:28:31.741238  3923 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 5. Current term is 6. Ops: []
W20260709 12:28:31.735500  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 78626.3us
I20260709 12:28:31.777132  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 801) took 1067 ms. Trace:
I20260709 12:28:31.780186  3923 rpcz_store.cc:276] 0709 12:28:30.709370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:31.733348 (+1023978us) service_pool.cc:224] Handling call
0709 12:28:31.741027 (+  7679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:31.776879 (+ 35852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.777078 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:31.781502  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1880) took 1840 ms. Trace:
I20260709 12:28:31.781749  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:31.767700  7383 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.773182  3931 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:31.742223  6705 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:31.739751  7365 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:31.790838  3923 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:31.791388  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 803) took 1041 ms. Trace:
I20260709 12:28:31.791646  3923 rpcz_store.cc:276] 0709 12:28:30.750512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:31.781026 (+1030514us) service_pool.cc:224] Handling call
0709 12:28:31.790683 (+  9657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:31.791228 (+   545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.791348 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:31.776155  7396 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.769922  7338 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:31.771648  7332 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:31.786574  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 802) took 1059 ms. Trace:
I20260709 12:28:31.796655  3931 rpcz_store.cc:276] 0709 12:28:30.726971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:31.742136 (+1015165us) service_pool.cc:224] Handling call
0709 12:28:31.772953 (+ 30817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:31.786337 (+ 13384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.786521 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:31.788607  7464 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:31.773840  7362 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.786677  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 798) took 1109 ms. Trace:
I20260709 12:28:31.739459  3895 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:31.807580  7362 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:31.806861  3928 rpcz_store.cc:276] 0709 12:28:30.677585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:31.467290 (+789705us) service_pool.cc:224] Handling call
0709 12:28:31.467590 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:31.467750 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:28:31.468031 (+   281us) log.cc:844] Serialized 14 byte log entry
0709 12:28:31.785545 (+317514us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:31.785590 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:31.785634 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.786516 (+   882us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:31.786617 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":943,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":24979,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":10902,"thread_start_us":317140,"threads_started":2,"wal-append.queue_time_us":313520}
W20260709 12:28:31.808763  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 69386.1us
I20260709 12:28:31.810087  7362 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:31.810458  7441 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.812242  7285 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.762800  7375 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.825603  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:31.800587  3923 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:31.782151  3856 rpcz_store.cc:276] 0709 12:28:29.940646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.701764 (+761118us) service_pool.cc:224] Handling call
0709 12:28:30.724360 (+ 22596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:30.724559 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:30.860823 (+136264us) log.cc:844] Serialized 14 byte log entry
0709 12:28:30.905589 (+ 44766us) log.cc:844] Serialized 14 byte log entry
0709 12:28:31.711091 (+805502us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b1800399760. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee7455 00007fe051fcf060 00007fe051fe1716 00007fe051ff2287 00007fe051ff2208
0709 12:28:31.781037 (+ 69946us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:31.781108 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:31.781176 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.781280 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:31.781427 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26850,"prepare.queue_time_us":95425,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":2782,"raft.queue_time_us":177327,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":11043,"spinlock_wait_cycles":11036544,"thread_start_us":220934,"threads_started":3}
I20260709 12:28:31.788080  6705 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:31.786791  7358 consensus_queue.cc:1059] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:28:31.804100  7398 raft_consensus.cc:3055] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:31.804591  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2395) took 1683 ms. Trace:
I20260709 12:28:31.804916  4566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 956) took 1792 ms. Trace:
I20260709 12:28:31.806329  7460 raft_consensus.cc:3055] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:31.812081  3895 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:31.795320  4006 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:28:31.835419  3932 rpcz_store.cc:276] 0709 12:28:30.120854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.121045 (+   191us) service_pool.cc:224] Handling call
0709 12:28:30.121451 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:31.340560 (+1219109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.804370 (+463810us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000e88d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:31.804540 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2614911744}
I20260709 12:28:31.844962  3895 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:31.845345  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:31.816890  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:31.824250  3925 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:28:31.832686  3850 raft_consensus.cc:2393] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:31.798255  7332 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:31.847723  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2398) took 1693 ms. Trace:
I20260709 12:28:31.850011  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:31.847800  4537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.837s (SENT) [suppressed 47 similar messages]
I20260709 12:28:31.792690  7383 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.849076  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:31.852149  3923 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:31.852306  3895 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:31.853008  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:31.849841  3925 rpcz_store.cc:276] 0709 12:28:30.154733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.154940 (+   207us) service_pool.cc:224] Handling call
0709 12:28:31.823821 (+1668881us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b5400306028. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe056f00aa1 00007fe056f7bebc 00007fe056fb108c 00007fe056f9b93b 00007fe056f9b3d2 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c
0709 12:28:31.823931 (+   110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:31.847476 (+ 23545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.847669 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9441536}
I20260709 12:28:31.855576  7362 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:28:31.834720  6705 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:31.858454  7513 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:28:31.859127  7514 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:28:31.846686  7460 raft_consensus.cc:740] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:31.834952  7398 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:31.862445  7362 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.863031  7362 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.863224  7398 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.864344  7398 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:31.865186  7362 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:31.834762  7334 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:31.783681  7339 consensus_queue.cc:237] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.867071  7375 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:31.836408  4566 rpcz_store.cc:276] 0709 12:28:30.012590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.040748 (+ 28158us) service_pool.cc:224] Handling call
0709 12:28:30.051855 (+ 11107us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:30.168883 (+117028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:30.168913 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:30.190207 (+ 21294us) log.cc:844] Serialized 26 byte log entry
0709 12:28:30.451164 (+260957us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:30.451231 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.804542 (+1353311us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54006a3954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:31.804601 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:31.804645 (+    44us) raft_consensus.cc:1685] finished
0709 12:28:31.804658 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:31.804860 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10409,"raft.queue_time_us":19064,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":6024,"spinlock_wait_cycles":234106752,"thread_start_us":142732,"threads_started":1,"wal-append.queue_time_us":467433}
I20260709 12:28:31.871521  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:31.872264  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:31.872828  3932 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:31.831279  7505 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:31.875349  3856 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:28:31.860090  7518 log.cc:927] Time spent T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:28:31.853942  7332 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:31.885181  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:31.885751  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:31.886408  3925 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:31.886065  3923 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:31.889993  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:31.874034  7362 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.891955  7362 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:31.894119  7362 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:31.884706  7505 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.897294  7364 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:31.898157  7505 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.898947  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 799) took 1217 ms. Trace:
I20260709 12:28:31.899307  3926 rpcz_store.cc:276] 0709 12:28:30.681127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:31.579033 (+897906us) service_pool.cc:224] Handling call
0709 12:28:31.624619 (+ 45586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:31.733761 (+109142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.898715 (+164954us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b54000d5554. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:31.898881 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146399104}
I20260709 12:28:31.899806  7364 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.901674  7383 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:31.903565  4001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2330) took 2430 ms (client timeout 1779 ms). Trace:
W20260709 12:28:31.903975  4001 rpcz_store.cc:269] 0709 12:28:29.472922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:29.473318 (+   396us) service_pool.cc:224] Handling call
0709 12:28:31.903374 (+2430056us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54003a61d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:31.903499 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2090201472}
I20260709 12:28:31.904940  3997 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:31.873553  7525 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.891067  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:31.873345  7520 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:31.912643  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:31.914131  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:31.916330  3923 raft_consensus.cc:1240] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:31.900110  7490 raft_consensus.cc:3055] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:31.881556  7449 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.916203  3856 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
W20260709 12:28:31.920513  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:31.921761  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:31.925575  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 77815.5us
I20260709 12:28:31.925801  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:31.926219  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:31.926911  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:31.930935  4537 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:31.950798  3923 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:31.955662  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:31.957742  3856 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:31.918150  7490 raft_consensus.cc:740] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:31.960158  7454 raft_consensus.cc:3055] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:31.972879  7509 raft_consensus.cc:3055] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:31.972999  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:31.983210  3850 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:31.984187  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:31.985383  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:31.974056  7503 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:28:31.960106  7326 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:31.977807  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:31.989078  4004 raft_consensus.cc:2393] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:31.979110  4000 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:28:31.990410  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:31.980446  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 49605.4us
W20260709 12:28:31.980911  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:31.978327  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:31.991945  3998 raft_consensus.cc:2393] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:31.974081  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:31.991717  4537 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:31.992895  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:31.993481  3998 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:31.986523  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:31.985961  4001 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:31.998217  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:31.999785  3969 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:31.981465  7454 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:32.003387  4006 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:28:32.004083  3856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:28:31.914974  7525 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:32.010540  4537 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:32.013473  4537 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:31.982501  7476 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:31.982748  7509 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:32.020494  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:32.021502  3850 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:32.023842  3897 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:32.024104  3850 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:32.025441  3850 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:28:32.003590  7261 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:32.008589  7377 consensus_queue.cc:1059] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:28:32.025336  7525 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:32.017146  7364 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:32.029696  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:32.027060  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:32.016925  7483 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:28:32.042542  4001 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:32.043877  3850 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:28:32.070914  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 43931.2us
I20260709 12:28:32.007863  7441 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:32.014550  7237 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:32.014394  7273 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:28:32.014394  7326 consensus_queue.cc:1059] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:28:32.025424  7419 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:28:32.075825  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 62464.6us
I20260709 12:28:32.021924  7063 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:32.077853  4537 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:32.029847  7519 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:32.041038  7476 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:32.041476  7261 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:32.070199  7374 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:32.074847  7365 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:32.091702  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1878) took 2259 ms. Trace:
I20260709 12:28:32.042415  7460 consensus_queue.cc:260] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:32.120626  7460 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:32.080878  7509 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:32.123899  7365 raft_consensus.cc:697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:32.124963  7365 consensus_queue.cc:237] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:32.129280  7539 raft_consensus.cc:3055] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:32.129709  7539 raft_consensus.cc:740] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:28:32.129892  7281 consensus_meta.cc:287] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.003s
W20260709 12:28:32.130519  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:32.078361  7419 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:32.092271  3852 rpcz_store.cc:276] 0709 12:28:29.831933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.604900 (+772967us) service_pool.cc:224] Handling call
0709 12:28:30.636335 (+ 31435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:31.048847 (+412512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:31.048894 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:31.061346 (+ 12452us) log.cc:844] Serialized 52 byte log entry
0709 12:28:31.270681 (+209335us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:31.329658 (+ 58977us) log.cc:844] Serialized 14 byte log entry
0709 12:28:31.408497 (+ 78839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.561158 (+152661us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540001aed4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:31.561223 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:31.875693 (+314470us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b18002b3ae0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:28:32.091405 (+215712us) raft_consensus.cc:1685] finished
0709 12:28:32.091437 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:32.091626 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17709,"prepare.queue_time_us":58831,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":142530,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":43497,"spinlock_wait_cycles":663926784,"thread_start_us":361546,"threads_started":3,"wal-append.queue_time_us":267497}
I20260709 12:28:32.086118  7063 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:32.172200  4000 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:32.086781  7519 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:32.091590  7261 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:32.172446  7455 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:32.175050  7285 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:32.191016  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 875) took 2206 ms. Trace:
I20260709 12:28:32.206365  3849 rpcz_store.cc:276] 0709 12:28:29.984407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.858762 (+874355us) service_pool.cc:224] Handling call
0709 12:28:30.874624 (+ 15862us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:31.581064 (+706440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:32.190696 (+609632us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400018bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:32.190947 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1567673600}
I20260709 12:28:32.193796  7486 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:32.196255  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:32.198066  7358 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:32.200688  7533 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.109s	user 0.001s	sys 0.001s
I20260709 12:28:32.232175  3822 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:32.029441  7490 consensus_queue.cc:260] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:32.184397  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:32.133273  7419 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:32.207967  3849 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:28:32.130990  7374 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:32.217978  7542 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:28:32.220897  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:32.222450  7449 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:32.224887  7440 consensus_queue.cc:260] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:32.229218  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 151449us
I20260709 12:28:32.331799  4537 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:32.230896  3895 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:32.333395  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 102622us
I20260709 12:28:32.334335  3895 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:32.174712  7483 raft_consensus.cc:3055] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:32.232124  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:32.335764  3924 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:32.176187  7063 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:31.080263  3853 rpcz_store.cc:276] 0709 12:28:29.701752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.581907 (+880155us) service_pool.cc:224] Handling call
0709 12:28:30.582176 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:30.591144 (+  8968us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:28:30.731618 (+140474us) log.cc:844] Serialized 14 byte log entry
0709 12:28:31.039825 (+308207us) log.cc:844] Serialized 14 byte log entry
0709 12:28:31.074252 (+ 34427us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:31.074320 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:31.074391 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:31.074471 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:31.074623 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37050,"prepare.queue_time_us":172243,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":11083,"raft.queue_time_us":38105,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":8975,"spinlock_wait_cycles":950016,"thread_start_us":368890,"threads_started":2}
I20260709 12:28:32.338958  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:32.339442  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:32.332082  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:32.340104  3853 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:32.341085  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:32.240494  3821 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:32.076370  7454 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:32.338605  7483 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:32.347468  7483 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:32.348728  7483 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:32.348918  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:32.349740  3850 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:28:32.213845  7455 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:32.349861  7339 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:32.351622  7455 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:32.352252  7531 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 12:28:32.362246  7440 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:32.362289  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:32.366688  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:32.341923  7362 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:32.372377  7374 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:32.374008  3851 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:32.375317  3851 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:28:32.375592  3851 pending_rounds.cc:85] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 6
I20260709 12:28:32.375813  3851 pending_rounds.cc:107] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:28:32.376060  3851 raft_consensus.cc:2889] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:32.376221  7261 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:32.377228  7540 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:32.377236  7542 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:32.377269  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:32.377789  7540 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:32.378273  7540 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:32.335316  7467 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:32.381966  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:32.382761  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1888) took 1983 ms. Trace:
I20260709 12:28:32.383262  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:32.383994  4567 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:32.385126  4570 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:28:32.243275  7358 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:32.386312  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:32.386646  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:32.387337  4566 raft_consensus.cc:2368] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10.
I20260709 12:28:32.387837  7358 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:32.387948  4574 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:28:32.388218  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:32.274142  7539 consensus_queue.cc:260] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:32.389127  4565 raft_consensus.cc:2410] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:28:32.389676  4571 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:32.391065  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:32.386341  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2301) took 1106 ms. Trace:
I20260709 12:28:32.392599  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:32.393282  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:32.393993  3924 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:28:32.275105  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:32.206979  7519 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:32.338785  7535 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.136s	user 0.000s	sys 0.005s
I20260709 12:28:32.262341  7353 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:32.246824  3852 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:28:32.394165  3851 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:32.406864  3852 pending_rounds.cc:85] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 5
I20260709 12:28:32.407119  3852 pending_rounds.cc:107] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:28:32.241248  7285 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:32.407370  3852 raft_consensus.cc:2889] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:32.392465  3848 rpcz_store.cc:276] 0709 12:28:31.279940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:31.428692 (+148752us) service_pool.cc:224] Handling call
0709 12:28:32.386165 (+957473us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400063bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:32.386283 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342519168}
I20260709 12:28:32.391755  3897 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:32.268078  7529 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
W20260709 12:28:32.404928  7538 log.cc:927] Time spent T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.172s	user 0.003s	sys 0.004s
I20260709 12:28:32.399621  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2348) took 1415 ms. Trace:
I20260709 12:28:32.417204  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:32.274576  7383 consensus_queue.cc:1059] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.131s
I20260709 12:28:32.424623  4003 rpcz_store.cc:276] 0709 12:28:30.984655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:31.139371 (+154716us) service_pool.cc:224] Handling call
0709 12:28:32.399405 (+1260034us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400375854. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:32.399551 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310580992}
I20260709 12:28:32.338337  3895 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:32.345192  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 104822us
I20260709 12:28:32.227751  7364 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:32.266528  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:32.338120  7537 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.135s	user 0.006s	sys 0.000s
W20260709 12:28:32.376524  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 44832.8us
I20260709 12:28:32.416899  3924 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:32.383123  3855 rpcz_store.cc:276] 0709 12:28:30.399192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.947583 (+548391us) service_pool.cc:224] Handling call
0709 12:28:30.947874 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:31.631644 (+683770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:32.382537 (+750893us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b540027a954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:32.382708 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1565354880}
I20260709 12:28:32.344271  7485 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:32.420897  3928 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:28:32.372411  7237 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:32.404388  7542 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:32.423615  7332 consensus_meta.cc:287] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.513s	user 0.014s	sys 0.000s
I20260709 12:28:32.399660  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:32.409198  7398 consensus_meta.cc:287] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.001s
I20260709 12:28:32.407752  7543 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:32.479543  7237 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:32.479888  7543 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:32.480695  4573 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:32.481935  3856 raft_consensus.cc:606] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:32.482326  3856 raft_consensus.cc:614] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:32.333786  7486 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 12:28:32.468339  3822 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:32.484494  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2407) took 1159 ms. Trace:
I20260709 12:28:32.485423  4568 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:32.484870  3925 rpcz_store.cc:276] 0709 12:28:31.324713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:31.887876 (+563163us) service_pool.cc:224] Handling call
0709 12:28:31.888212 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:31.888679 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:31.888705 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:31.889206 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:28:32.030025 (+140819us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:32.075651 (+ 45626us) log.cc:844] Serialized 14 byte log entry
0709 12:28:32.075887 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:32.082023 (+  6136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:32.484278 (+402255us) raft_consensus.cc:1685] finished
0709 12:28:32.484303 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:32.484437 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45425,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":1653,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":25374,"spinlock_wait_cycles":11519744,"thread_start_us":102298,"threads_started":1,"wal-append.queue_time_us":162876}
I20260709 12:28:32.487545  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:32.488516  7543 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:32.469115  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:32.490374  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:32.490667  7536 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:28:32.490896  3924 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:32.492086  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1838) took 1286 ms. Trace:
W20260709 12:28:32.470350  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 132088us
I20260709 12:28:32.404259  7490 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:32.493292  3895 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:32.492535  3932 rpcz_store.cc:276] 0709 12:28:31.205918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:31.873977 (+668059us) service_pool.cc:224] Handling call
0709 12:28:31.874315 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:31.874626 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:31.874667 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:31.875098 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 12:28:32.071626 (+196528us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:32.071664 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:32.071726 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:32.491823 (+420097us) raft_consensus.cc:1685] finished
0709 12:28:32.491854 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:32.492006 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1242,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":11965,"thread_start_us":196239,"threads_started":1,"wal-append.queue_time_us":333265}
I20260709 12:28:32.494446  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:32.494642  3895 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:32.497184  7450 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:32.425513  7467 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:32.498107  7467 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:32.498482  7467 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:32.476781  3853 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:32.502206  7449 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:32.477967  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:32.502928  7449 raft_consensus.cc:697] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:32.503417  3928 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:32.504557  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:32.504161  7449 consensus_queue.cc:237] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:32.505335  3928 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:32.494979  3932 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:32.506358  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:32.416503  7464 consensus_meta.cc:287] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.601s	user 0.007s	sys 0.003s
I20260709 12:28:32.420843  7353 raft_consensus.cc:697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:32.516062  3924 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:32.464480  7374 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:32.468649  7456 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:32.505745  7326 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:28:32.514703  7464 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:32.476890  7362 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:32.517851  3924 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:28:32.527410  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:32.548444  3924 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:32.532773  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 794) took 1928 ms. Trace:
I20260709 12:28:32.533690  7261 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:32.538045  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:32.551399  3924 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:28:32.527011  7520 consensus_queue.cc:1059] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:28:32.539057  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2406) took 1214 ms. Trace:
I20260709 12:28:32.545778  3970 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:32.567749  3930 rpcz_store.cc:276] 0709 12:28:31.324349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:31.422598 (+ 98249us) service_pool.cc:224] Handling call
0709 12:28:32.538851 (+1116253us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b54002387d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:32.538989 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100481408}
I20260709 12:28:32.568928  3970 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:32.537279  7374 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:32.528563  7456 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:32.553905  3928 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:32.549504  3927 rpcz_store.cc:276] 0709 12:28:30.604146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.727870 (+123724us) service_pool.cc:224] Handling call
0709 12:28:31.069037 (+341167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:31.230569 (+161532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:32.377500 (+1146931us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54002e2f54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:32.532553 (+155053us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54002e2f50. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:32.532709 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134467200}
I20260709 12:28:32.531774  7509 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:32.554482  7353 consensus_queue.cc:237] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:32.473831  7364 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:32.598388  7364 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:32.598940  7364 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:32.599383  7364 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:32.600154  7364 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:32.544911  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 226299us
I20260709 12:28:32.550161  3932 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
W20260709 12:28:32.568059  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 186763us
W20260709 12:28:32.592818  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 124434us
I20260709 12:28:32.593245  7553 raft_consensus.cc:3055] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:32.602906  7553 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:32.511089  7332 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:32.607873  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 100390us
W20260709 12:28:32.609392  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:32.608579  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:32.607780  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:32.612916  3930 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:32.603946  7553 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:32.624821  7409 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:32.614152  3930 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:32.618239  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:32.618346  7520 consensus_queue.cc:1059] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:32.619046  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:32.626389  4567 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:32.627197  7332 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:32.620993  7419 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:32.628491  4002 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:32.631039  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:32.605748  7365 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:32.605932  7456 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:32.636091  3895 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:32.678360  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 43618.2us
I20260709 12:28:32.679396  3895 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:32.637094  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 241503us
I20260709 12:28:32.639350  3927 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:32.639350  4537 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:32.640748  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:32.639717  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:32.684669  3930 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
W20260709 12:28:32.687171  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 117498us
W20260709 12:28:32.692128  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:32.694988  3926 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:32.690745  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:32.698797  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:32.610359  7261 consensus_queue.cc:1059] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
W20260709 12:28:32.708113  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 68828.8us
I20260709 12:28:32.715161  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:32.718729  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 115761us
I20260709 12:28:32.719278  3852 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:32.693320  7450 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:32.702996  6705 consensus_meta.cc:287] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.845s	user 0.008s	sys 0.009s
I20260709 12:28:32.747136  7559 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:32.750995  7374 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:32.754930  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 75663.1us
I20260709 12:28:32.811136  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:32.757635  4538 connection.cc:256] RPC call timeout handler was delayed by -1.5510671449997062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
W20260709 12:28:32.812561  4538 connection.cc:256] RPC call timeout handler was delayed by -1.3676062499998807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
W20260709 12:28:32.758915  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 58776.9us
I20260709 12:28:32.815327  4536 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:32.635087  7520 consensus_queue.cc:1059] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 12:28:32.634452  7540 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:32.711069  7326 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:32.816887  7326 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:32.817342  4570 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:32.817304  7326 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:32.818557  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:32.823628  7540 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:32.707619  7383 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:32.751284  7375 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:32.836737  3895 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:32.778553  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 60302us
W20260709 12:28:32.853154  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:32.992873  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:32.993542  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:32.812389  7559 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:33.060535  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 340677us
W20260709 12:28:33.089424  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 398729us
I20260709 12:28:32.934087  7540 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:33.142083  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 78661.6us
I20260709 12:28:32.852095  7273 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:32.856671  7374 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:32.742749  6980 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.305s
W20260709 12:28:33.166209  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 329569us
I20260709 12:28:32.933996  7543 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:32.932745  7375 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:32.853833  7560 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:32.845573  7237 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.256s
I20260709 12:28:33.048209  7552 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:33.091039  7359 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:33.076993  7559 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:32.850354  6705 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:32.933321  7383 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:33.286852  3898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.121s	sys 0.157s
W20260709 12:28:33.319650  3898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.122s	sys 0.158s
I20260709 12:28:33.207595  7375 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:33.227239  7455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.025s	sys 0.060s
W20260709 12:28:33.354336  4538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.005s	sys 0.004s
W20260709 12:28:33.354954  4538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.005s	sys 0.005s
W20260709 12:28:33.367362  3896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.000s	sys 0.019s
W20260709 12:28:33.367865  3896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.000s	sys 0.019s
W20260709 12:28:33.369092  3970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.007s	sys 0.003s
W20260709 12:28:33.369491  3970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.007s	sys 0.003s
W20260709 12:28:33.369863  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 634105us
W20260709 12:28:33.370939  4567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.006s	sys 0.011s
W20260709 12:28:33.371434  4567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.006s	sys 0.011s
W20260709 12:28:33.372282  3924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.000s	sys 0.014s
W20260709 12:28:33.372835  3924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.000s	sys 0.015s
W20260709 12:28:33.373916  3972 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.003s	sys 0.011s
W20260709 12:28:33.374477  3972 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.003s	sys 0.011s
I20260709 12:28:33.167474  7561 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.229s
I20260709 12:28:33.219208  7542 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:33.366973  7455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.026s	sys 0.060s
I20260709 12:28:33.389667  4538 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:33.298305  7359 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.440442  7359 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:33.441185  7359 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:33.296690  7552 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.207224  7273 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.216379  7540 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:32.832626  7326 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.403752  7237 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:33.401341  7363 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:33.285436  7543 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.495730  7368 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:33.497156  7552 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:33.498483  7568 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:33.498930  7578 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:33.499759  7578 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.501331  7383 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:33.503239  7578 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:33.504226  7554 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 12:28:33.506155  7569 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:33.506193  7540 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:33.507545  7571 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:33.448683  7542 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:33.507762  7273 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:33.402447  7570 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.173s
W20260709 12:28:33.637408  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 544500us
W20260709 12:28:33.509262  7550 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.570s	user 0.001s	sys 0.001s
I20260709 12:28:33.489398  7450 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:33.518601  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2364) took 1703 ms. Trace:
W20260709 12:28:33.481683  7544 log.cc:927] Time spent T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.791s	user 0.000s	sys 0.001s
W20260709 12:28:33.600328  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:33.497732  7552 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:33.626503  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 882) took 1009 ms. Trace:
W20260709 12:28:33.684572  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:33.629935  7578 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:33.571593  7063 consensus_meta.cc:287] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.218s	user 0.009s	sys 0.001s
I20260709 12:28:33.488740  7520 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:33.675951  4002 rpcz_store.cc:276] 0709 12:28:31.814888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:31.816631 (+  1743us) service_pool.cc:224] Handling call
0709 12:28:31.843383 (+ 26752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:32.628917 (+785534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:33.518245 (+889328us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b540021a2d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:33.518513 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1805139840}
I20260709 12:28:33.684514  4567 rpcz_store.cc:276] 0709 12:28:32.616811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.627013 (+ 10202us) service_pool.cc:224] Handling call
0709 12:28:32.627331 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:32.627670 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:32.627701 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:32.628188 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:28:33.371927 (+743739us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:33.371992 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:33.372098 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:33.626133 (+254035us) raft_consensus.cc:1685] finished
0709 12:28:33.626166 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:33.626410 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10675,"raft.queue_time_us":6056,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":11601,"thread_start_us":743308,"threads_started":1,"wal-append.queue_time_us":988916}
I20260709 12:28:33.491657  7237 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:33.689093  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:33.474824  7359 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.455811  7419 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:33.686786  7554 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:28:33.527856  6980 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.162s
I20260709 12:28:33.499030  7568 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.714138  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:33.719019  3969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.023s	sys 0.050s
W20260709 12:28:33.727311  3969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.023s	sys 0.050s
W20260709 12:28:33.727497  4536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.009s	sys 0.007s
W20260709 12:28:33.727886  4536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.009s	sys 0.007s
I20260709 12:28:33.693143  7438 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:33.667738  7542 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.728261  4565 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 10: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:28:33.727952  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 550018us
W20260709 12:28:33.728438  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 913176us
I20260709 12:28:33.743405  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 876) took 1148 ms. Trace:
I20260709 12:28:33.631335  7569 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:33.743893  4565 rpcz_store.cc:276] 0709 12:28:32.594913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:33.713769 (+1118856us) service_pool.cc:224] Handling call
0709 12:28:33.743332 (+ 29563us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:33.701489  7455 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:33.706238  7237 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:33.728415  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58174 (request call id 23) took 1944 ms. Trace:
I20260709 12:28:33.759776  3856 rpcz_store.cc:276] 0709 12:28:31.779550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.003925 (+224375us) service_pool.cc:224] Handling call
0709 12:28:33.723428 (+1719503us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54000640d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd1853 00007fe056f9f60a 00007fe0505257d4 00007fe050525762 00007fe050525691 00007fe05052560c 00007fe0505248c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:33.723557 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097174912}
W20260709 12:28:33.755671  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:33.756464  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:33.686535  7450 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:33.639192  7571 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:33.766604  4002 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:28:33.698688  7063 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.761633  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:33.736385  7552 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:33.694850  7578 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:33.773042  3897 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.000s	sys 0.022s
W20260709 12:28:33.773953  3897 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.000s	sys 0.022s
W20260709 12:28:33.766363  7563 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.394s	user 0.001s	sys 0.000s
W20260709 12:28:33.775632  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 893214us
I20260709 12:28:33.755041  6705 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:33.779091  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 814) took 1170 ms. Trace:
I20260709 12:28:33.779951  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:33.782573  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:33.771327  7570 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:33.786456  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:33.759097  7438 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.783170  4567 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
W20260709 12:28:33.789827  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 419032us
I20260709 12:28:33.784438  3924 rpcz_store.cc:276] 0709 12:28:32.609008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.609164 (+   156us) service_pool.cc:224] Handling call
0709 12:28:32.609430 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:32.609683 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:32.632207 (+ 22524us) log.cc:844] Serialized 14 byte log entry
0709 12:28:33.778745 (+1146538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:33.778799 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:33.778852 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:33.778918 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:33.779031 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25042,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":124783,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":1146053,"threads_started":2,"wal-append.queue_time_us":770792}
I20260709 12:28:33.696799  7520 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:33.763046  7455 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.785727  7363 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:28:33.794909  7577 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
W20260709 12:28:33.795809  7572 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
W20260709 12:28:33.804435  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 369690us
I20260709 12:28:33.788440  7462 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:33.819007  7409 consensus_meta.cc:287] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.194s	user 0.007s	sys 0.003s
I20260709 12:28:33.819489  7438 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:33.820967  7455 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:33.821686  7543 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:33.823038  7450 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:33.823155  7067 raft_consensus.cc:3055] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:33.823670  7067 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:33.824730  7456 consensus_meta.cc:287] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.123s	user 0.010s	sys 0.000s
I20260709 12:28:33.824556  7067 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:33.825178  7456 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.797971  7326 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:33.826299  7326 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:33.826795  7326 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.827497  7456 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:33.828104  7456 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:33.828540  7456 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:33.829062  7326 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:33.830266  7551 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:33.830806  7551 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.832059  7462 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.832590  7456 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:33.833823  7467 consensus_meta.cc:287] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.335s	user 0.010s	sys 0.002s
I20260709 12:28:33.834088  7483 raft_consensus.cc:3055] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:33.834473  7462 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:33.776181  7552 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.836766  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 1846) took 1605 ms. Trace:
I20260709 12:28:33.837437  7552 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:33.791339  7580 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:33.838176  7580 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:33.840484  7580 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:33.841095  7539 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:33.814580  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:33.795347  6705 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:33.837162  3926 rpcz_store.cc:276] 0709 12:28:32.231424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.231777 (+   353us) service_pool.cc:224] Handling call
0709 12:28:33.836553 (+1604776us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54000eecd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:33.836702 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683385728}
I20260709 12:28:33.842501  6705 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:33.829625  7326 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:33.815099  7063 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:33.792377  7540 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:33.816128  7332 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:33.815615  7363 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:33.834560  7483 raft_consensus.cc:740] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:33.784399  6980 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 12:28:33.817459  7509 consensus_meta.cc:287] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.209s	user 0.006s	sys 0.005s
I20260709 12:28:33.825608  7067 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:33.817008  3970 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:33.858982  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:33.800689  7582 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:28:33.862325  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 47831.8us
I20260709 12:28:33.842646  7454 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:33.870003  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 53079.9us
I20260709 12:28:33.834335  7467 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:33.850356  7565 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:28:33.867206  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:33.794732  7364 consensus_queue.cc:1059] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:28:33.791708  7570 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:33.873462  7384 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:28:33.869123  7374 consensus_meta.cc:287] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.674s	user 0.000s	sys 0.011s
I20260709 12:28:33.873941  4538 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:33.865964  7273 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:33.869653  7455 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:33.886088  4567 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:33.887363  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:33.888069  4565 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:33.888876  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:33.890648  3998 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:28:33.893071  3970 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:33.873999  7384 raft_consensus.cc:697] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:33.895916  3923 raft_consensus.cc:2393] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:33.889465  4565 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:33.851577  7326 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:33.897188  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:33.899132  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 56997.7us
I20260709 12:28:33.874569  7409 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:33.860656  7540 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.906425  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:33.903613  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:33.914582  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:33.934410  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:33.884580  7586 raft_consensus.cc:3055] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:33.940237  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:33.886401  7273 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:33.887409  7374 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:33.926154  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:33.947836  3930 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:33.949972  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 156208us
I20260709 12:28:33.895886  7543 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:33.950199  3999 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:33.877817  7582 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:33.957517  7570 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:33.938421  7542 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:33.962576  7519 consensus_meta.cc:287] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.549s	user 0.012s	sys 0.000s
I20260709 12:28:33.900754  7581 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:33.904322  7568 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:33.970171  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:33.949371  7273 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:33.970837  3932 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:33.969524  3897 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:33.963160  7519 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:33.982244  7384 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.983771  7519 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:33.984691  3925 raft_consensus.cc:2368] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10.
I20260709 12:28:33.946497  7586 raft_consensus.cc:740] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:33.904685  7455 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:33.987795  7455 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:33.946575  7409 raft_consensus.cc:697] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:33.989228  7571 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:33.989029  7409 consensus_queue.cc:237] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.990411  7467 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:33.991513  7363 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:33.952283  6705 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:33.993171  7463 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:33.971848  3926 raft_consensus.cc:1240] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:28:33.977654  3927 raft_consensus.cc:3055] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:33.994088  3927 raft_consensus.cc:740] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:33.978188  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:33.995473  3928 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
W20260709 12:28:33.979053  7589 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:28:33.996562  3930 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:33.952183  7543 raft_consensus.cc:697] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:33.966439  7581 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:33.992993  7586 consensus_queue.cc:260] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:34.009413  7586 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:34.011785  7543 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:33.966300  7578 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:34.022642  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.023312  3930 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:34.024266  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.025091  3930 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:34.025367  3999 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:34.000339  3927 consensus_queue.cc:260] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:34.026556  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:34.027666  3930 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:33.971601  7569 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:34.029110  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.030071  3926 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:34.031790  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.032517  3928 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:34.034053  3927 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:34.035589  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:34.021816  7559 consensus_meta.cc:287] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.000s
I20260709 12:28:33.896662  7483 consensus_queue.cc:260] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.023439  7581 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:33.951395  7593 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 12:28:34.045450  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 1.57709e+06us
I20260709 12:28:34.044698  7486 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:34.044711  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:34.238421  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:34.096069  7383 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:34.239120  3923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 1847) took 1995 ms (client timeout 1974 ms). Trace:
W20260709 12:28:34.239563  3923 rpcz_store.cc:269] 0709 12:28:32.243735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.243858 (+   123us) service_pool.cc:224] Handling call
0709 12:28:34.238894 (+1995036us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54003061d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:34.239035 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3259178368}
I20260709 12:28:34.086422  7559 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.075404  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.244004  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.244890  3856 raft_consensus.cc:2393] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:34.245062  7559 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:34.245899  3854 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:34.246239  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.247685  3851 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:28:34.066972  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.095170  3930 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:34.050951  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 885) took 2218 ms. Trace:
I20260709 12:28:34.225771  7362 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.075662  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.245899  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.253734  4004 raft_consensus.cc:2410] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:28:34.065222  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.254402  3999 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:34.095294  3926 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:28:34.045770  7490 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:28:34.257699  3822 connection.cc:256] RPC call timeout handler was delayed by -1.3978425089999291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
I20260709 12:28:34.258414  3822 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:34.044188  7507 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:34.051689  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:34.040545  7285 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:34.034178  7365 consensus_meta.cc:287] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.343s	user 0.011s	sys 0.001s
I20260709 12:28:34.044229  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1902) took 2240 ms. Trace:
W20260709 12:28:34.034363  7375 consensus_meta.cc:287] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.631s	user 0.008s	sys 0.002s
I20260709 12:28:34.045251  7485 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:34.050328  3932 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:34.052457  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 891) took 1232 ms. Trace:
I20260709 12:28:34.096850  7552 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.097066  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:34.099361  7476 raft_consensus.cc:3055] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:34.100028  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.280435  4001 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:28:34.106963  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.107914  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.108669  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.111023  7464 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:34.090253  7579 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.086491  7542 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.056077  7063 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.304692  7063 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:34.304638  7542 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.128396  7587 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:34.175176  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 70849.1us
I20260709 12:28:34.223979  3927 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:34.225625  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2338) took 3504 ms. Trace:
I20260709 12:28:34.022174  7519 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:34.307976  7587 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.316164  7569 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:34.227228  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:34.317234  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:34.270732  7463 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:34.250252  7383 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.251662  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.252323  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.254339  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.327780  3856 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:34.328790  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:34.056679  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:34.330425  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:34.228847  7574 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.228664  7454 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.229350  7564 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.296443  7482 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.250604  7483 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:34.267274  3857 rpcz_store.cc:276] 0709 12:28:31.804243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.220632 (+416389us) service_pool.cc:224] Handling call
0709 12:28:32.220893 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:32.221071 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:28:32.221357 (+   286us) log.cc:844] Serialized 14 byte log entry
0709 12:28:32.427725 (+206368us) log.cc:844] Serialized 14 byte log entry
0709 12:28:33.522868 (+1095143us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b18003bc020. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:28:34.043685 (+520817us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b18003bc020. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04ee64c0a 00007fe0585a4219 00007fe04eeeca40 00007fe04eee74e4 00007fe04eee7455 00007fe051fcf060 00007fe051fe1716 00007fe051ff2287 00007fe051ff2208
0709 12:28:34.043874 (+   189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:34.043926 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:34.043975 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:34.044048 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:34.044171 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":573120,"prepare.queue_time_us":2434,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":1651995,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":186,"spinlock_wait_cycles":20437504,"thread_start_us":205494,"threads_started":1,"wal-append.queue_time_us":326811,"wal-append.run_cpu_time_us":1546,"wal-append.run_wall_time_us":1053951}
I20260709 12:28:34.273756  3924 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:28:34.324915  7440 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:28:34.274917  3853 rpcz_store.cc:276] 0709 12:28:32.820023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.820168 (+   145us) service_pool.cc:224] Handling call
0709 12:28:32.820477 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:32.820682 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:28:32.820994 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 12:28:34.052132 (+1231138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:34.052182 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:28:34.052231 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:34.052296 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:34.052403 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1230887,"prepare.queue_time_us":383,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":1231158,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":62}
I20260709 12:28:34.290503  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.291662  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1834) took 3175 ms. Trace:
W20260709 12:28:34.366285  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:34.294368  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:34.303882  7560 raft_consensus.cc:3055] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:34.277261  7375 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.294368  4002 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:34.315299  7519 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:34.045497  7540 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:34.274725  7365 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:34.249037  3850 rpcz_store.cc:276] 0709 12:28:31.832986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.350256 (+517270us) service_pool.cc:224] Handling call
0709 12:28:32.350514 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:32.350721 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:32.351001 (+   280us) log.cc:844] Serialized 14 byte log entry
0709 12:28:34.050439 (+1699438us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:34.050512 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:34.050586 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:34.050680 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:34.050835 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1491778,"prepare.queue_time_us":862,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":1492821,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":207224,"threads_started":1,"wal-append.queue_time_us":390391}
I20260709 12:28:34.253013  7486 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.054345  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:34.271152  7507 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.279536  7525 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.271570  7492 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:34.332918  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:34.334764  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.329514  3856 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:28:34.364032  7490 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:34.267365  3822 leader_election.cc:400] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10.
I20260709 12:28:34.383605  3822 leader_election.cc:403] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:28:34.384115  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 116987us
I20260709 12:28:34.317608  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:34.338248  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.326171  7353 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.262586  7362 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.246070  7326 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:34.340535  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.389221  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:34.339082  7398 consensus_queue.cc:1059] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:28:34.378129  7519 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:34.332083  7446 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.348893  7587 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:34.284629  7485 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.393705  7556 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.321024  7579 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.298238  7552 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.316757  7569 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:34.309201  7464 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.274809  7347 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 12:28:34.393301  7067 consensus_meta.cc:287] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.527s	user 0.005s	sys 0.005s
W20260709 12:28:34.371358  4572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 875) took 1823 ms (client timeout 2215 ms). Trace:
I20260709 12:28:34.386627  7542 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:34.410018  4572 rpcz_store.cc:269] 0709 12:28:32.548425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.290216 (+1741791us) service_pool.cc:224] Handling call
0709 12:28:34.371298 (+ 81082us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:34.366412  3931 rpcz_store.cc:276] 0709 12:28:31.115981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:31.798549 (+682568us) service_pool.cc:224] Handling call
0709 12:28:31.831831 (+ 33282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:32.220501 (+388670us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:32.220800 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 12:28:32.717572 (+496772us) log.cc:844] Serialized 14 byte log entry
0709 12:28:32.934273 (+216701us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:32.934328 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:32.934382 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:34.291433 (+1357051us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54000d5f54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:34.291484 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:34.291604 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":89288,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":597857,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":68534,"spinlock_wait_cycles":893316480,"thread_start_us":711329,"threads_started":4,"wal-append.queue_time_us":391784,"wal-append.run_cpu_time_us":1676,"wal-append.run_wall_time_us":1107434}
I20260709 12:28:34.371857  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.412533  3853 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:34.413544  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.328370  7449 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:34.373099  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 112098us
I20260709 12:28:34.276728  7237 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.377610  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.416781  3850 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:34.417675  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.418267  3850 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:34.419097  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.325379  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2314) took 2085 ms. Trace:
I20260709 12:28:34.341639  7574 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.419699  3849 rpcz_store.cc:276] 0709 12:28:32.239532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.393683 (+154151us) service_pool.cc:224] Handling call
0709 12:28:32.393971 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:32.405018 (+ 11047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:32.405048 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:32.413045 (+  7997us) log.cc:844] Serialized 26 byte log entry
0709 12:28:34.038841 (+1625796us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b1800415840. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:28:34.250870 (+212029us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:34.250913 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:34.250985 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:34.300931 (+ 49946us) raft_consensus.cc:1685] finished
0709 12:28:34.300963 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:34.325312 (+ 24349us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12506,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":3199,"spinlock_wait_cycles":8724864,"thread_start_us":211850,"threads_started":1,"wal-append.queue_time_us":1864640}
I20260709 12:28:34.421504  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:34.340842  7463 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.383250  7492 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:34.422135  7463 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.424284  7463 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:34.424392  7492 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:34.391927  7353 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:34.426354  7464 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:34.426862  7353 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:34.380170  4566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 872) took 1967 ms (client timeout 1855 ms). Trace:
W20260709 12:28:34.427676  4566 rpcz_store.cc:269] 0709 12:28:32.412758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.053983 (+1641225us) service_pool.cc:224] Handling call
0709 12:28:34.380081 (+326098us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:34.428366  7552 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:34.428755  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:34.429535  4566 raft_consensus.cc:2393] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:34.381603  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.398303  7446 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:34.430255  7569 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:34.430684  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.431438  3856 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:34.431684  7446 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:34.431936  7485 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:34.432652  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:34.280004  7476 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:34.438330  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.439034  3853 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:34.369518  7560 raft_consensus.cc:740] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:34.388279  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:34.301401  7462 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.341267  7454 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.359193  7564 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:34.400913  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:34.400754  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:34.401352  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:34.403512  3970 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:34.465062  4574 raft_consensus.cc:2393] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:34.308868  3997 rpcz_store.cc:276] 0709 12:28:30.713783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:30.713947 (+   164us) service_pool.cc:224] Handling call
0709 12:28:31.904767 (+1190820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:31.905299 (+   532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:34.217919 (+2312620us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003a61d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:34.218159 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2737761152}
I20260709 12:28:34.370678  7273 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:34.466894  4574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 877) took 1851 ms (client timeout 1896 ms). Trace:
I20260709 12:28:34.389505  7465 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:34.389127  7441 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:34.478793  7507 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:34.479099  7441 raft_consensus.cc:697] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:34.479393  3925 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2421) took 2118 ms (client timeout 1876 ms). Trace:
W20260709 12:28:34.467347  4574 rpcz_store.cc:269] 0709 12:28:32.615244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.260431 (+1645187us) service_pool.cc:224] Handling call
0709 12:28:34.466832 (+206401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:34.480116  7441 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.481016  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:34.418906  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:34.385329  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 67811.5us
I20260709 12:28:34.483381  7362 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:34.485085  4573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 912) took 2104 ms (client timeout 1906 ms). Trace:
I20260709 12:28:34.437783  7449 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:34.485540  4573 rpcz_store.cc:269] 0709 12:28:32.380602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.386005 (+  5403us) service_pool.cc:224] Handling call
0709 12:28:34.484863 (+2098858us) spinlock_profiling.cc:243] Waited 93.6 ms on lock 0x7b540055d2d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:34.484986 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215215872}
I20260709 12:28:34.486768  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.435595  3849 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:34.488723  4537 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:34.489010  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:34.489622  4537 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:34.490444  4568 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:34.490765  4537 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:34.491271  7540 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:34.491753  7540 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:34.492175  7540 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:34.492596  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2417) took 2132 ms. Trace:
I20260709 12:28:34.492957  3929 rpcz_store.cc:276] 0709 12:28:32.360344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.537976 (+177632us) service_pool.cc:224] Handling call
0709 12:28:32.538277 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:32.630933 (+ 92656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:32.630962 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:32.631005 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:32.631045 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:34.492368 (+1861323us) spinlock_profiling.cc:243] Waited 92.5 ms on lock 0x7b54002bd254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:34.492412 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:34.492536 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212653952}
I20260709 12:28:34.445461  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.491598  4537 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:34.497997  3853 raft_consensus.cc:2410] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:28:34.386343  7525 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.499207  7559 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:34.499668  7559 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:34.500043  7559 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:34.500842  7525 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:34.501688  7377 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:34.502120  7377 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:34.502485  7377 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:34.486814  7520 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:34.479879  3925 rpcz_store.cc:269] 0709 12:28:32.361342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.487315 (+125973us) service_pool.cc:224] Handling call
0709 12:28:34.479181 (+1991866us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54002e3454. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:34.479318 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3441436032}
I20260709 12:28:34.446103  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.508049  3850 raft_consensus.cc:2410] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:28:34.508224  7486 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:34.508988  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.390148  7490 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:34.510365  7383 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:28:34.510531  4568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 874) took 1998 ms. Trace:
I20260709 12:28:34.510923  4568 rpcz_store.cc:276] 0709 12:28:32.512330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.512873 (+   543us) service_pool.cc:224] Handling call
0709 12:28:34.490115 (+1977242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:34.490839 (+   724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:34.510336 (+ 19497us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b540055d2d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:34.510469 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4513492864}
W20260709 12:28:34.512041  4570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 879) took 1896 ms (client timeout 1528 ms). Trace:
I20260709 12:28:34.511713  7476 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.512238  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:34.512445  4570 rpcz_store.cc:269] 0709 12:28:32.615884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.617970 (+  2086us) service_pool.cc:224] Handling call
0709 12:28:34.511847 (+1893877us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b5400512054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:34.511975 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439342848}
I20260709 12:28:34.512857  7476 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:34.513077  4568 raft_consensus.cc:2393] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 8: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:34.397662  7556 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.359894  7482 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:34.394322  7509 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 12:28:34.465482  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 62078.1us
I20260709 12:28:34.524123  3925 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:34.524865  3970 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:34.465987  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:34.526058  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:34.466758  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:34.526587  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.527343  3853 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:28:34.527271  3925 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:34.468650  7365 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:34.448596  7607 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:34.471199  7564 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:34.472886  7446 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:34.549108  4569 raft_consensus.cc:2410] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:28:34.474244  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:34.551463  3997 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:34.481060  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.552518  3855 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:34.436349  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.487385  7449 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:34.489674  3999 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:34.506749  7551 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:34.509040  7582 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:34.450580  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.515812  4574 raft_consensus.cc:2410] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:28:34.571171  3848 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:34.516152  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.513566  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.517542  3850 raft_consensus.cc:2410] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:28:34.515004  3857 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:34.530012  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:34.462361  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 47126.6us
I20260709 12:28:34.530819  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.577736  3930 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:34.578136  3927 raft_consensus.cc:2410] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:28:34.531155  3849 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:34.534129  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.579409  3932 raft_consensus.cc:2393] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 8: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:34.579528  3854 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:34.579895  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:34.580291  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.534804  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:34.535949  7520 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:28:34.582154  3929 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:34.542389  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.562547  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.586707  3931 raft_consensus.cc:2410] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:28:34.587005  4571 raft_consensus.cc:2410] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:28:34.586908  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.563746  7553 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:34.547887  7365 raft_consensus.cc:697] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:34.467149  7462 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:34.550856  7586 consensus_meta.cc:287] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 12:28:34.567728  7482 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:34.540266  7375 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:34.568764  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.514233  7560 consensus_queue.cc:260] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.567790  7063 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:34.574091  7574 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:34.511492  7490 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:34.446851  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.614503  3856 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 5.
I20260709 12:28:34.580461  4574 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:34.578553  3999 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:34.563290  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.615876  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:34.581545  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.616528  3999 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:34.617271  3932 raft_consensus.cc:2393] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:34.618229  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.589448  4570 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:34.587594  3927 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:34.621361  3927 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:34.621429  4537 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:34.586246  4573 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:34.591408  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.624269  3930 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:34.625746  3930 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:34.632617  3928 raft_consensus.cc:2410] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:28:34.635505  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.636924  3932 raft_consensus.cc:2410] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:28:34.593813  3821 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:34.599118  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 143255us
I20260709 12:28:34.586004  7353 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.639305  7353 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.602160  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:34.640851  3971 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:34.641673  7483 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:34.642149  3971 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:34.642261  7483 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.643664  3999 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:34.643955  3971 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:34.570422  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.644526  7483 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:34.600209  4006 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:34.645021  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.603399  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.604943  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.646522  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.646818  3931 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
W20260709 12:28:34.605841  7599 log.cc:927] Time spent T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.280s	user 0.004s	sys 0.000s
I20260709 12:28:34.601459  3929 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:34.649859  4537 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:34.610040  3970 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:34.592012  7543 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:34.651564  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:34.652879  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.616448  7368 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:34.660359  7465 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10.
W20260709 12:28:34.667786  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:34.667667  7462 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:34.668522  7063 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:34.649226  7482 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:34.670864  7273 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:34.672385  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.673069  4567 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:34.674484  7365 consensus_queue.cc:237] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:34.675349  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:34.676122  4001 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:34.676957  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.677548  4001 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:34.614080  7375 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.065s
W20260709 12:28:34.647037  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 53315us
I20260709 12:28:34.647156  3999 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:34.690235  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.690806  3999 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:28:34.691540  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.692130  4574 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:34.692385  3999 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:34.651142  7519 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.681457  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.693687  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.694182  4567 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:34.694384  3821 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:34.694989  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.694989  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.696681  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:34.682515  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 72562.2us
I20260709 12:28:34.646162  7490 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.650664  7586 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:34.685681  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:34.704922  3970 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:34.705188  3932 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:34.705544  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:34.686612  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.706686  4573 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:34.706732  3997 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:34.682346  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:34.707902  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:34.708119  4570 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:34.592316  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 199638us
I20260709 12:28:34.698107  3999 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:34.637699  7539 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:34.710451  3821 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:34.712306  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.713075  4574 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:34.713210  3897 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:34.710421  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:34.715059  3897 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:34.695839  3969 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:34.717480  3969 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:34.695052  7063 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:34.721657  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:34.714176  7539 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:34.725654  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:34.727289  7520 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:34.727705  7520 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:34.728032  7520 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:34.714321  7509 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:34.729139  7446 consensus_queue.cc:1059] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:34.730486  7539 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:34.730297  7595 consensus_queue.cc:1059] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:34.731369  7595 raft_consensus.cc:3055] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:34.731762  7595 raft_consensus.cc:740] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:34.732666  7595 consensus_queue.cc:260] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:34.716634  7362 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:34.734463  7362 raft_consensus.cc:697] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:34.735023  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:34.735371  7362 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.730131  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.738355  7564 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:34.738902  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.739513  3998 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:34.739543  7377 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.740569  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.741710  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.693120  7574 raft_consensus.cc:2764] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:28:34.757761  3897 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:34.758630  3821 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:34.702733  3971 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:34.689471  7483 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:34.743425  3926 raft_consensus.cc:2393] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:34.759918  3897 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:34.758570  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.760911  3999 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:34.757640  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:34.750567  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:34.764386  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:34.765762  4570 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:34.751057  4538 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:34.720047  7465 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:34.776285  3821 leader_election.cc:400] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10.
I20260709 12:28:34.776628  3821 leader_election.cc:403] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:28:34.761778  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.717509  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.730230  7446 raft_consensus.cc:3055] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:34.769578  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.769850  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:34.770629  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 68000.9us
I20260709 12:28:34.773051  4538 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:34.775022  7409 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:34.797029  7409 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:34.797328  7519 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:34.775092  7553 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:34.715534  7551 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:28:34.742537  7573 consensus_queue.cc:1059] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:28:34.742923  7590 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.724817  7582 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:34.733768  7595 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:34.814916  7553 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:34.779309  4574 raft_consensus.cc:2393] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:34.818421  7540 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.820303  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.820778  4566 raft_consensus.cc:2393] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 8: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:34.821126  4574 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:34.821781  7540 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:34.822945  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:34.824103  4574 raft_consensus.cc:2410] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:28:34.780894  3895 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:34.780957  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.724385  7462 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:34.767637  3897 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:34.782287  3932 raft_consensus.cc:1275] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:28:34.783354  3997 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:34.828127  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.785310  3928 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:28:34.831070  3928 pending_rounds.cc:85] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 3
I20260709 12:28:34.831449  3928 pending_rounds.cc:107] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:28:34.831766  3928 raft_consensus.cc:2889] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:34.757133  7285 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:34.742620  7567 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:34.757138  7596 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.803534  4538 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:34.896432  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 92986.4us
I20260709 12:28:34.897971  4538 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:34.801997  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:34.770412  7569 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:34.818449  7553 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:34.779608  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 243984us
I20260709 12:28:34.825124  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.904678  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.906373  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.779558  7482 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 12:28:34.716182  7490 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:34.835958  7581 consensus_meta.cc:287] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.001s
I20260709 12:28:34.805106  7525 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:34.836789  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:34.837205  7476 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:34.838040  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.973927  3998 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:34.804368  7465 raft_consensus.cc:697] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:34.787652  7486 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:34.839152  7590 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.778244  7483 raft_consensus.cc:697] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:34.797734  7409 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:34.788545  7446 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:34.772107  7063 raft_consensus.cc:697] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:34.782146  7377 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:34.839159  7539 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.843276  7593 raft_consensus.cc:3055] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:34.815747  7582 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:34.844213  7519 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:34.771934  7067 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:34.847528  7559 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.018043  7353 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:35.019783  7559 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:34.849562  7543 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:35.020581  7543 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:34.826454  7462 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:34.907097  7596 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:34.895735  7556 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:34.913540  7542 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:34.914126  7540 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:34.997665  7483 consensus_queue.cc:237] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.004132  7582 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:35.004313  7593 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:35.015061  7579 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:35.015566  7490 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:35.017033  7539 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:28:34.974016  7581 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:34.995769  7486 raft_consensus.cc:697] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:35.056107  7486 consensus_queue.cc:237] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:35.032073  7600 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.700s	user 0.000s	sys 0.003s
W20260709 12:28:35.044276  7603 log.cc:927] Time spent T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.708s	user 0.002s	sys 0.000s
I20260709 12:28:35.063495  7560 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:35.069087  7590 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:35.074505  7520 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:35.025861  7492 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:35.033390  7542 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:35.075548  7492 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:35.076529  7492 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:35.077421  7596 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:35.075642  7542 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:35.074385  7593 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.077837  7492 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:35.049016  7543 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.084172  7593 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:35.104460  7582 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.110401  7586 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:28:35.143533  3855 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.004s	sys 0.010s
W20260709 12:28:35.144711  3855 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.005s	sys 0.010s
I20260709 12:28:34.846268  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:34.935031  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:35.148626  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:34.829703  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:35.165307  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:35.167582  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:35.168687  3997 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
W20260709 12:28:35.149905  3856 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.002s	sys 0.000s
I20260709 12:28:34.904333  4536 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:34.909760  4538 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:34.910811  4568 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
W20260709 12:28:34.858157  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 90668us
I20260709 12:28:34.907238  4574 raft_consensus.cc:2393] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:35.175505  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:35.176347  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 266535us
I20260709 12:28:35.176858  7353 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:35.177064  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:34.901770  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:35.178027  7353 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:34.888512  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:35.180433  3932 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:35.181464  7353 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:35.014338  7063 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.181821  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:35.183525  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:35.184460  3932 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:34.882519  7285 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:35.018016  7067 raft_consensus.cc:697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:35.186381  7285 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:35.188205  7378 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:35.187995  7067 consensus_queue.cc:237] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:35.189054  7378 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:35.025595  7462 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:35.190363  7261 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:35.191216  7261 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:34.894433  7326 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:35.191908  7378 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:35.192303  7326 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:35.192770  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.902729  4001 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:35.157263  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:34.889945  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:35.194284  7440 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:35.194831  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:34.974987  4006 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 8: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:35.195084  7440 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:35.195936  3927 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:35.159510  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:35.197099  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:34.839900  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:35.083551  7520 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:35.198256  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:35.198635  4565 raft_consensus.cc:2376] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8. Re-sending same reply.
I20260709 12:28:35.199009  7520 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:35.199514  7441 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:34.850982  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:35.195046  4573 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:35.200006  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.200371  7441 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.200938  4565 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:35.201413  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.015610  7446 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:35.192893  7326 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:35.185528  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:35.153368  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:35.212970  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:35.213892  4570 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:35.216053  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.041854  7465 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.199787  7520 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.219238  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.220638  7520 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:35.221984  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:35.223963  7520 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:35.226720  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:35.203677  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.227778  4565 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:35.228181  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 975) took 1338 ms. Trace:
I20260709 12:28:35.228432  3932 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:35.228617  4565 rpcz_store.cc:276] 0709 12:28:33.894862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.201860 (+1306998us) service_pool.cc:224] Handling call
0709 12:28:35.228101 (+ 26241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.197142  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:35.230365  3927 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:35.231436  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:35.231886  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.232743  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:35.205441  7362 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:35.207386  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:35.234442  7362 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:35.235162  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:35.236002  3997 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:35.208976  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:35.199941  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:35.236953  7362 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:35.238340  3998 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:35.238411  7539 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:35.239084  7539 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:35.239538  7539 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:35.242066  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.242383  3930 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:35.243242  4565 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 10: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:35.244958  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.210381  7519 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:35.246630  7519 raft_consensus.cc:697] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:35.173287  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 268870us
I20260709 12:28:35.248467  7519 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:34.780922  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:34.843338  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 62537.1us
I20260709 12:28:35.250744  3999 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:35.251936  3895 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:35.252756  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:35.203006  4006 raft_consensus.cc:2393] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 8: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:35.152032  4567 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 7: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:35.254690  7261 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:35.252986  7543 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:35.255033  4006 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:35.255247  7261 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:35.255754  7261 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:35.084326  7553 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.259148  7558 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:35.260304  7567 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:35.260810  7567 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:35.252277  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:35.261396  7553 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:35.233824  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.203248  4574 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:35.202317  4573 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
W20260709 12:28:35.274128  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 96446.6us
I20260709 12:28:35.307196  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:35.226421  7326 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:35.318122  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 64427us
I20260709 12:28:35.328681  4570 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 5.
I20260709 12:28:35.332906  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:35.329530  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 918) took 1074 ms. Trace:
I20260709 12:28:35.335897  3928 raft_consensus.cc:2393] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 10: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:35.338035  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:35.338999  7273 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:35.339836  7273 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.334102  4570 rpcz_store.cc:276] 0709 12:28:34.255556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.233447 (+977891us) service_pool.cc:224] Handling call
0709 12:28:35.329449 (+ 96002us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.349450  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.357014  3932 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:35.372737  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:35.373571  3932 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:35.373980  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.374854  4565 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 8: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:35.374687  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:35.375274  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 920) took 1089 ms. Trace:
I20260709 12:28:35.375871  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:35.376575  3932 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:35.376730  7441 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:35.377357  4574 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:35.377998  4573 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 11: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:35.380968  4537 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:35.350616  7440 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:35.382336  3971 leader_election.cc:336] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Timed out: RequestConsensusVote RPC to 127.2.157.4:41095 timed out after 1.663s (SENT)
I20260709 12:28:35.387313  4536 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:35.391456  3895 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:35.396555  3930 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:35.375609  4565 rpcz_store.cc:276] 0709 12:28:34.286287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.314461 (+1028174us) service_pool.cc:224] Handling call
0709 12:28:35.375205 (+ 60744us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.377171  7520 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:35.404388  3927 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:35.410851  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:35.414944  3930 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 11: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:35.415983  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:35.416611  3930 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:35.418711  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 652) took 1097 ms. Trace:
I20260709 12:28:35.439905  4574 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:35.441282  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.448590  4574 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 11: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:28:35.452275  3857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.000s	sys 0.021s
I20260709 12:28:35.452641  7590 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:28:35.453143  3853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.002s	sys 0.019s
W20260709 12:28:35.453553  3853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.003s	sys 0.019s
I20260709 12:28:35.452929  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.454490  4574 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:35.454674  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:35.439931  7542 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.455565  3931 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:35.455530  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.455809  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:35.456542  3849 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 5.
I20260709 12:28:35.456809  7542 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:35.456941  4574 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:35.453922  7261 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.457474  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1913) took 1089 ms. Trace:
I20260709 12:28:35.457856  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:35.458104  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.458963  4574 raft_consensus.cc:2410] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:28:35.459345  7261 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:35.460516  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.460932  3930 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:35.419227  4006 rpcz_store.cc:276] 0709 12:28:34.321558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.256351 (+934793us) service_pool.cc:224] Handling call
0709 12:28:35.256672 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.256930 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:28:35.257388 (+   458us) log.cc:844] Serialized 14 byte log entry
0709 12:28:35.417722 (+160334us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:35.417796 (+    74us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:28:35.417862 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.418452 (+   590us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.418609 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":56173,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":15109,"raft.queue_time_us":124,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":230,"thread_start_us":159829,"threads_started":1}
W20260709 12:28:35.452714  3857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.001s	sys 0.021s
I20260709 12:28:35.464706  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:35.393779  7409 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.457907  3856 rpcz_store.cc:276] 0709 12:28:34.367632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.615251 (+247619us) service_pool.cc:224] Handling call
0709 12:28:34.615567 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:34.615787 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:35.170615 (+554828us) log.cc:844] Serialized 14 byte log entry
0709 12:28:35.456961 (+286346us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:35.457041 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:35.457117 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.457204 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.457357 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20450,"prepare.queue_time_us":397660,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":756327,"threads_started":2}
I20260709 12:28:35.482249  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1914) took 1114 ms. Trace:
W20260709 12:28:35.482311  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 88673.1us
I20260709 12:28:35.476707  3932 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:35.478634  7440 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:35.510387  3931 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 12:28:35.467983  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.475226  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:35.511278  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:35.512768  4569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 981) took 1608 ms (client timeout 1663 ms). Trace:
I20260709 12:28:35.510390  7440 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:35.513571  7440 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:35.514170  7609 consensus_queue.cc:1048] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:28:35.514081  7465 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:28:35.514801  3821 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:35.517756  7285 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:35.519166  7465 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:35.519641  7465 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:35.520080  7465 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:35.520196  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:35.516366  7273 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:35.510684  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:35.523126  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:35.524099  4002 raft_consensus.cc:2410] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:28:35.525182  3850 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:35.525429  4002 raft_consensus.cc:1240] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:35.508371  3857 rpcz_store.cc:276] 0709 12:28:34.367878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.660369 (+292491us) service_pool.cc:224] Handling call
0709 12:28:34.660776 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:34.688519 (+ 27743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:34.688555 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:34.689071 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:28:35.475721 (+786650us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:35.475792 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.475878 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:35.481951 (+  6073us) raft_consensus.cc:1685] finished
0709 12:28:35.481968 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.482171 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27308,"raft.queue_time_us":28245,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":17338,"thread_start_us":774394,"threads_started":1,"wal-append.queue_time_us":785948}
I20260709 12:28:35.527411  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:35.528167  3857 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:35.478852  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:35.515514  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 113946us
I20260709 12:28:35.510756  3895 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:35.421437  7553 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:28:35.478062  3822 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.000s	sys 0.020s
W20260709 12:28:35.513343  4569 rpcz_store.cc:269] 0709 12:28:33.904155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:33.937973 (+ 33818us) service_pool.cc:224] Handling call
0709 12:28:35.512291 (+1574318us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b540055c8d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:35.512524 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388371712}
I20260709 12:28:35.475544  3971 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:35.532114  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2371) took 1195 ms. Trace:
I20260709 12:28:35.524122  4003 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:28:35.507870  3854 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:35.532493  4570 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:35.532596  4002 rpcz_store.cc:276] 0709 12:28:34.334049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.524807 (+1190758us) service_pool.cc:224] Handling call
0709 12:28:35.525242 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.529602 (+  4360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.529776 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.531198  4537 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:35.534484  3927 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:35.441810  7525 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10.
W20260709 12:28:35.477722  7569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.016s	sys 0.011s
W20260709 12:28:35.536901  3822 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.002s	sys 0.024s
I20260709 12:28:35.539885  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2367) took 1206 ms. Trace:
I20260709 12:28:35.541659  4003 rpcz_store.cc:276] 0709 12:28:34.328801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.523209 (+1194408us) service_pool.cc:224] Handling call
0709 12:28:35.523653 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:35.534564 (+ 10911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.534754 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.468652  7590 raft_consensus.cc:697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:35.547673  3999 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:35.531737  7553 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:35.547087  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 654) took 1224 ms. Trace:
I20260709 12:28:35.552024  4569 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:28:35.552469  4569 pending_rounds.cc:85] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 6
I20260709 12:28:35.474887  7449 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:35.553978  4571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 878) took 2934 ms (client timeout 3551 ms). Trace:
I20260709 12:28:35.556494  4565 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:28:35.540313  7285 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:35.485239  7462 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:35.561208  4006 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 12: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:35.552748  4569 pending_rounds.cc:107] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:28:35.565557  4569 raft_consensus.cc:2889] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:35.556936  4571 rpcz_store.cc:269] 0709 12:28:32.615576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.294108 (+1678532us) service_pool.cc:224] Handling call
0709 12:28:35.547410 (+1253302us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54006f1dd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:35.550023 (+  2613us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504590080}
I20260709 12:28:35.562529  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 973) took 1668 ms. Trace:
I20260709 12:28:35.567198  4565 rpcz_store.cc:276] 0709 12:28:33.889329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.461480 (+1572151us) service_pool.cc:224] Handling call
0709 12:28:35.461871 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:35.557346 (+ 95475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.557544 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.540678  7569 raft_consensus.cc:697] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:35.565497  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 805768us
I20260709 12:28:35.553364  7553 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:35.574649  4002 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:35.576136  7586 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:35.576759  7632 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:35.577322  7359 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:35.580682  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 133293us
I20260709 12:28:35.582183  3932 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:35.584347  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2373) took 1182 ms. Trace:
I20260709 12:28:35.586118  7273 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:35.587028  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:35.552073  3997 rpcz_store.cc:276] 0709 12:28:34.322309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.258328 (+936019us) service_pool.cc:224] Handling call
0709 12:28:35.258809 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:35.259352 (+   543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:35.259386 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:35.260005 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 12:28:35.318900 (+ 58895us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:28:35.544728 (+225828us) log.cc:844] Serialized 14 byte log entry
0709 12:28:35.545747 (+  1019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.545828 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:35.545868 (+    40us) raft_consensus.cc:1685] finished
0709 12:28:35.545901 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.546994 (+  1093us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51040,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":419,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":5073,"thread_start_us":254946,"threads_started":2,"wal-append.queue_time_us":222533}
I20260709 12:28:35.589639  4002 rpcz_store.cc:276] 0709 12:28:34.401320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.547436 (+1146116us) service_pool.cc:224] Handling call
0709 12:28:35.569759 (+ 22323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.583221 (+ 13462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.583427 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.591270  4570 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:28:35.588506  3821 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:35.591621  3925 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:35.595595  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 977) took 1696 ms. Trace:
I20260709 12:28:35.595942  4570 rpcz_store.cc:276] 0709 12:28:33.895444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.539287 (+1643843us) service_pool.cc:224] Handling call
0709 12:28:35.572545 (+ 33258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.591743 (+ 19198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.591965 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.583559  7326 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:35.602227  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 978) took 1702 ms. Trace:
W20260709 12:28:35.603089  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 92605.2us
I20260709 12:28:35.603927  4569 rpcz_store.cc:276] 0709 12:28:33.900437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.539640 (+1639203us) service_pool.cc:224] Handling call
0709 12:28:35.547303 (+  7663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.597596 (+ 50293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.602149 (+  4553us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.600504  3927 raft_consensus.cc:1240] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:35.611852  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:35.619369  3854 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
W20260709 12:28:35.619781  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 144362us
I20260709 12:28:35.621047  4003 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:28:35.597675  7273 raft_consensus.cc:697] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:28:35.628958  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:35.630208  3998 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:28:35.631528  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2374) took 1221 ms. Trace:
I20260709 12:28:35.631922  4003 rpcz_store.cc:276] 0709 12:28:34.401649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.544503 (+1142854us) service_pool.cc:224] Handling call
0709 12:28:35.587540 (+ 43037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.621413 (+ 33873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.622904 (+  1491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.633462  4569 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:35.636345  7409 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:35.637223  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 988) took 1595 ms. Trace:
I20260709 12:28:35.637579  4569 rpcz_store.cc:276] 0709 12:28:34.041412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.611172 (+1569760us) service_pool.cc:224] Handling call
0709 12:28:35.633206 (+ 22034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.633860 (+   654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.637142 (+  3282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.641691  3849 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:35.642292  4536 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:35.644304  4569 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:35.646919  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 989) took 1603 ms. Trace:
I20260709 12:28:35.647287  4569 rpcz_store.cc:276] 0709 12:28:34.041715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.638341 (+1596626us) service_pool.cc:224] Handling call
0709 12:28:35.644065 (+  5724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.644721 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.644901 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.650354  4565 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:35.653098  4569 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:35.654610  4003 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:35.652547  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:35.655736  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 922) took 1368 ms. Trace:
I20260709 12:28:35.656055  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 984) took 1661 ms. Trace:
I20260709 12:28:35.646179  7525 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:35.656356  4569 rpcz_store.cc:276] 0709 12:28:34.286985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.650246 (+1363261us) service_pool.cc:224] Handling call
0709 12:28:35.652877 (+  2631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.653498 (+   621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.655683 (+  2185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.656502  4565 rpcz_store.cc:276] 0709 12:28:33.994376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.597361 (+1602985us) service_pool.cc:224] Handling call
0709 12:28:35.621069 (+ 23708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.653272 (+ 32203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.656003 (+  2731us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.662997  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:35.663785  3857 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:35.661695  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:35.665405  3998 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:35.665474  4570 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:35.666749  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 891) took 1633 ms. Trace:
I20260709 12:28:35.667174  4570 rpcz_store.cc:276] 0709 12:28:34.033127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.599888 (+1566761us) service_pool.cc:224] Handling call
0709 12:28:35.647149 (+ 47261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.666487 (+ 19338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.666678 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.668649  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 898) took 1172 ms. Trace:
W20260709 12:28:35.668859  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 48541.1us
I20260709 12:28:35.669080  4565 rpcz_store.cc:276] 0709 12:28:34.496203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.660705 (+1164502us) service_pool.cc:224] Handling call
0709 12:28:35.661078 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.661301 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:35.661330 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:35.661366 (+    36us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:28:35.668354 (+  6988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.668416 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.668551 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.669767  7273 consensus_queue.cc:237] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.670514  4536 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:35.671465  4536 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:35.675833  4006 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:35.677137  3997 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:28:35.657780  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:35.681520  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 49053.8us
I20260709 12:28:35.662787  7525 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:35.685201  4537 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:35.684049  3821 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:35.695163  7378 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:35.695721  7378 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:35.696172  7378 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:35.698189  7409 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:35.699646  7543 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:35.700137  7543 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:35.700510  7543 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:35.702966  7638 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:28:35.686818  7525 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:35.709363  7237 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:35.687675  7542 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:28:35.722975  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 187220us
I20260709 12:28:35.724761  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:35.727385  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 56000.9us
W20260709 12:28:35.731587  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:35.731928  4537 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:35.719604  7261 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:35.737179  3895 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:35.723014  7359 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:28:35.741624  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 80202.4us
W20260709 12:28:35.741894  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 93881.9us
I20260709 12:28:35.725831  7462 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:35.740643  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:35.739503  7384 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:35.747397  7384 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:35.747769  7384 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:35.755172  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 195565us
I20260709 12:28:35.757256  3857 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
W20260709 12:28:35.771260  7593 consensus_meta.cc:287] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.676s	user 0.004s	sys 0.011s
I20260709 12:28:35.772782  3971 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:35.773102  7483 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:35.773814  7483 raft_consensus.cc:697] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:35.774051  3971 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:35.774718  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1910) took 1408 ms. Trace:
I20260709 12:28:35.775122  7483 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.775164  7409 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:35.777195  7409 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:35.777558  7409 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:35.779636  7586 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:35.780148  7586 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:35.780592  7586 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:35.705906  7569 consensus_queue.cc:237] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:35.782100  3822 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:35.687655  7590 consensus_queue.cc:237] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:35.757644  7539 consensus_meta.cc:287] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.005s
I20260709 12:28:35.775183  3855 rpcz_store.cc:276] 0709 12:28:34.366762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.553217 (+186455us) service_pool.cc:224] Handling call
0709 12:28:34.553483 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:34.573442 (+ 19959us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:35.145632 (+572190us) log.cc:844] Serialized 14 byte log entry
0709 12:28:35.337730 (+192098us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:35.337848 (+   118us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:35.337999 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.774348 (+436349us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b540001aed4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:35.774407 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.774625 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17378,"prepare.queue_time_us":439765,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":17539,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":166,"spinlock_wait_cycles":45360384,"thread_start_us":740371,"threads_started":2,"wal-append.queue_time_us":332076}
I20260709 12:28:35.755775  7261 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:35.826470  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:35.824572  3969 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:35.818212  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 86422.8us
I20260709 12:28:35.824671  3854 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:35.751557  7567 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.835949  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1926) took 1143 ms. Trace:
I20260709 12:28:35.837200  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:35.836457  3854 rpcz_store.cc:276] 0709 12:28:34.687327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.706590 (+1019263us) service_pool.cc:224] Handling call
0709 12:28:35.831091 (+124501us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:28:35.840583  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 58613.7us
I20260709 12:28:35.841862  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:35.842554  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:35.843281  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:35.844007  7608 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:35.803017  7539 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.844485  7608 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:35.844882  7608 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:35.844146  7440 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:35.846293  7539 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:35.826628  7542 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:35.852190  7607 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:35.853044  7560 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:35.853531  7560 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:35.853960  7560 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:35.852226  7542 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.858547  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:35.850960  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:35.846791  7440 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:35.862792  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 969) took 1970 ms. Trace:
I20260709 12:28:35.863301  4574 rpcz_store.cc:276] 0709 12:28:33.888220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.459525 (+1571305us) service_pool.cc:224] Handling call
0709 12:28:35.459948 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:35.474932 (+ 14984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:35.474974 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:35.475526 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:28:35.720261 (+244735us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:35.720314 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.720396 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:35.858574 (+138178us) raft_consensus.cc:1685] finished
0709 12:28:35.858594 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.858733 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7798,"raft.queue_time_us":16095,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"thread_start_us":234315,"threads_started":1,"wal-append.queue_time_us":312681}
I20260709 12:28:35.839772  7449 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:35.872990  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 894) took 1371 ms. Trace:
I20260709 12:28:35.873799  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:35.874486  3932 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:35.879081  3854 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:35.879576  7553 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.880329  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:35.882309  4565 raft_consensus.cc:1240] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:35.881580  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:35.887800  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:35.833686  7609 consensus_queue.cc:1059] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:28:35.881686  7553 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:35.892323  3854 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:35.896350  3930 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:28:35.898723  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:35.938138  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 46436.4us
W20260709 12:28:35.939615  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 205091us
W20260709 12:28:35.939886  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 151594us
I20260709 12:28:35.942121  4574 raft_consensus.cc:1240] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:35.873488  4569 rpcz_store.cc:276] 0709 12:28:34.495204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.659597 (+1164393us) service_pool.cc:224] Handling call
0709 12:28:35.659943 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.660187 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:35.760189 (+100002us) log.cc:844] Serialized 14 byte log entry
0709 12:28:35.860193 (+100004us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:35.860242 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:35.866448 (+  6206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.866522 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.866649 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12797,"prepare.queue_time_us":197634,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":88,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4627,"thread_start_us":197393,"threads_started":2}
I20260709 12:28:35.950965  3932 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
W20260709 12:28:35.949873  3850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1925) took 1259 ms (client timeout 1678 ms). Trace:
W20260709 12:28:35.954680  3850 rpcz_store.cc:269] 0709 12:28:34.686497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.174989 (+488492us) service_pool.cc:224] Handling call
0709 12:28:35.946059 (+771070us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b5400082354. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:35.946203 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802111232}
I20260709 12:28:35.955891  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:35.956875  7063 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:35.957990  7574 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:28:35.959503  7649 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:28:35.960815  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2372) took 1626 ms. Trace:
I20260709 12:28:35.896163  7237 consensus_queue.cc:1059] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 12:28:35.961165  7647 log.cc:927] Time spent T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:28:35.962100  7237 raft_consensus.cc:3055] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:35.962697  3854 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:35.963457  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1880) took 1114 ms. Trace:
I20260709 12:28:35.963850  3929 rpcz_store.cc:276] 0709 12:28:34.849234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.504821 (+655587us) service_pool.cc:224] Handling call
0709 12:28:35.505341 (+   520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:35.505995 (+   654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:35.506039 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:35.506686 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 12:28:35.733395 (+226709us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:35.733422 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.733512 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:35.963111 (+229599us) raft_consensus.cc:1685] finished
0709 12:28:35.963133 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.963266 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1486,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":210,"thread_start_us":226276,"threads_started":1,"wal-append.queue_time_us":249976}
I20260709 12:28:35.866514  3857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:28:35.981846  4569 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:28:35.987354  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 924) took 1242 ms. Trace:
I20260709 12:28:35.987711  4569 rpcz_store.cc:276] 0709 12:28:34.744845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.950472 (+1205627us) service_pool.cc:224] Handling call
0709 12:28:35.981570 (+ 31098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:35.987063 (+  5493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.987288 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.895956  7261 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:35.988768  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.961196  4004 rpcz_store.cc:276] 0709 12:28:34.334292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.526810 (+1192518us) service_pool.cc:224] Handling call
0709 12:28:35.527305 (+   495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:35.527916 (+   611us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:35.527952 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:35.528551 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:28:35.738681 (+210130us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:35.738719 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.738786 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:35.960464 (+221678us) raft_consensus.cc:1685] finished
0709 12:28:35.960482 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.960609 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":168,"thread_start_us":205151,"threads_started":1,"wal-append.queue_time_us":223230}
I20260709 12:28:35.992089  3969 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:35.986531  3857 raft_consensus.cc:606] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:35.962473  7237 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:35.957144  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.007884  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:35.965765  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:36.012547  3929 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:36.018118  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:36.018620  3852 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.624s	user 0.024s	sys 0.026s
W20260709 12:28:36.019076  3852 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.624s	user 0.024s	sys 0.026s
I20260709 12:28:36.013373  7593 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:36.019312  7384 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.020208  7593 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:36.021771  7581 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:36.022709  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 71766.8us
I20260709 12:28:36.023448  7543 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.023957  7463 raft_consensus.cc:3055] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:36.024345  3895 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:36.025322  7449 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:36.025766  7449 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:36.026199  7449 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:36.026226  7543 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:36.029119  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:36.027886  7378 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.031038  3855 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:36.033931  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.034771  3857 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:36.024358  7463 raft_consensus.cc:740] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:36.035302  7378 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:36.019057  3851 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:36.036492  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.039593  7449 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.040117  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1879) took 1225 ms. Trace:
I20260709 12:28:36.040650  3931 rpcz_store.cc:276] 0709 12:28:34.814844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.456326 (+641482us) service_pool.cc:224] Handling call
0709 12:28:35.510034 (+ 53708us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:35.510943 (+   909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.039911 (+528968us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b54000efbd0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.040046 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122470784}
I20260709 12:28:36.042017  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:36.042779  3931 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:36.038528  4004 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:36.039515  7237 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.037573  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.044665  3895 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:36.047642  3929 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:36.082617  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:36.083513  3969 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:36.086175  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:36.087744  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:36.089064  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 120862us
W20260709 12:28:36.089542  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 63688.1us
I20260709 12:28:36.090708  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:36.094503  3851 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:36.096899  3850 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:36.094875  3897 leader_election.cc:336] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Timed out: RequestConsensusVote RPC to 127.2.157.4:41095 timed out after 1.855s (SENT)
I20260709 12:28:36.099080  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:36.099695  3895 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:36.099993  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:36.102919  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:36.104523  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:36.014041  7586 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.108747  4536 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:36.096427  7543 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:36.096578  7590 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:36.099426  7558 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:36.110018  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:36.114780  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:36.114944  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 99330.5us
I20260709 12:28:36.115504  4000 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:36.109962  4006 raft_consensus.cc:2376] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10. Re-sending same reply.
I20260709 12:28:36.021461  7593 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.115201  3997 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:36.118415  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:36.121011  3854 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:36.108016  7581 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:36.117714  3822 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:36.124768  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:36.125541  3932 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 10: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:36.126698  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:36.127343  3998 raft_consensus.cc:2376] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10. Re-sending same reply.
I20260709 12:28:36.129685  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:36.131436  7483 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:36.131946  7483 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:36.132360  7483 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:36.135447  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 923) took 1414 ms. Trace:
I20260709 12:28:36.135854  4574 rpcz_store.cc:276] 0709 12:28:34.721221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.868357 (+1147136us) service_pool.cc:224] Handling call
0709 12:28:35.900368 (+ 32011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.942652 (+ 42284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.135136 (+192484us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b54007a2720. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f4edc0 00007fe051fdaa02 00007fe051fd6dd6 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:28:36.135382 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8457088}
I20260709 12:28:36.137058  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:36.137764  7596 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:36.138815  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1000) took 1490 ms. Trace:
I20260709 12:28:36.139134  3895 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:36.139222  4565 rpcz_store.cc:276] 0709 12:28:34.648215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.670103 (+1021888us) service_pool.cc:224] Handling call
0709 12:28:35.670439 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.882885 (+212446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.138595 (+255710us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54006e7154. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:36.138763 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486576512}
W20260709 12:28:36.142506  4567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 890) took 2111 ms (client timeout 2059 ms). Trace:
W20260709 12:28:36.142629  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 47799.2us
W20260709 12:28:36.142915  4567 rpcz_store.cc:269] 0709 12:28:34.031422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.694783 (+663361us) service_pool.cc:224] Handling call
0709 12:28:36.142252 (+1447469us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54005aee54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.142427 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044941056}
I20260709 12:28:36.127029  7237 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:36.144678  3897 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:36.147171  4571 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:36.130380  4569 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:36.151031  4574 raft_consensus.cc:2410] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:28:36.160481  3741 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 95a53a95fd9f44e59c1b1615b9281948 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 34711da9380944d2969a2bc3e203db3d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:36.164072  7664 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:36.164507  7664 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:36.164888  7664 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:36.165951  7662 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:36.166194  7449 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:36.166872  7449 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:36.166610  7662 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.169176  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:36.161562  3895 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:36.170348  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:36.171119  3932 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:36.176746  7464 raft_consensus.cc:2764] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:28:36.178239  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:36.180979  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:36.183454  7464 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:36.184108  7464 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:36.186046  4574 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:36.186445  7586 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:36.124698  7543 raft_consensus.cc:697] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:36.122113  7462 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:36.188089  7558 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:36.188323  7462 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:36.188694  7558 raft_consensus.cc:697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:36.188791  7462 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:36.189642  7558 consensus_queue.cc:237] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.188128  7543 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.196202  3932 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:36.197080  3897 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:36.198796  7483 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.127243  7590 raft_consensus.cc:697] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:36.207947  7590 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.127441  7384 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:36.211078  7464 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:36.212160  3848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2328) took 1959 ms (client timeout 2533 ms). Trace:
W20260709 12:28:36.212553  3848 rpcz_store.cc:269] 0709 12:28:34.252521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.334420 (+ 81899us) service_pool.cc:224] Handling call
0709 12:28:36.211819 (+1877399us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540001a9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.211972 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437736832}
W20260709 12:28:36.128413  7465 consensus_meta.cc:287] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.607s	user 0.014s	sys 0.000s
I20260709 12:28:36.188086  4574 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:36.206116  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:36.213773  7465 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:36.206799  7596 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:36.215801  7582 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:36.216132  7465 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:36.217576  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2435) took 1066 ms. Trace:
I20260709 12:28:36.225689  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.220582  3925 rpcz_store.cc:276] 0709 12:28:35.152227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.512276 (+360049us) service_pool.cc:224] Handling call
0709 12:28:35.512702 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.592149 (+ 79447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.217353 (+625204us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x7b540018c754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:36.217522 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175219072}
W20260709 12:28:36.228879  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 104621us
I20260709 12:28:36.213651  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:36.224658  7663 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:28:36.238160  3895 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:36.232774  3848 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:36.251473  3857 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:36.256255  3854 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:36.261099  4536 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:36.265347  3851 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:36.266784  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:36.266047  7596 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:36.277561  7596 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.277787  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:36.278530  7454 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:36.279628  7596 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:36.280725  7464 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:36.281113  7464 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:36.281479  7464 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:36.292053  7519 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:36.270258  3850 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:36.272538  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:36.274588  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:36.260246  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 113298us
I20260709 12:28:36.303804  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:36.303920  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:36.304924  4003 raft_consensus.cc:2410] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:28:36.305579  4000 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:36.306110  3998 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:36.307049  3997 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:36.307621  7671 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:36.308247  7671 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:36.310295  7671 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:36.307603  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:36.322197  7668 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:36.267390  7542 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:36.322830  3854 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
W20260709 12:28:36.323047  4001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 639) took 2004 ms (client timeout 2153 ms). Trace:
I20260709 12:28:36.323423  7542 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:36.323915  7542 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:36.324019  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:36.324682  4568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 892) took 2264 ms (client timeout 1855 ms). Trace:
I20260709 12:28:36.325279  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.232016  7409 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.326436  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.326956  3854 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:36.327667  7409 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:36.334163  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.334594  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 902) took 1738 ms. Trace:
I20260709 12:28:36.334843  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2376) took 1561 ms. Trace:
I20260709 12:28:36.335309  3999 rpcz_store.cc:276] 0709 12:28:34.773205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.251781 (+478576us) service_pool.cc:224] Handling call
0709 12:28:36.334702 (+1082921us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540032d054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.334790 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651425536}
I20260709 12:28:36.335726  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:36.337677  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.322938  7668 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:36.338307  3857 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:36.338765  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1853) took 2439 ms. Trace:
I20260709 12:28:36.339100  3924 rpcz_store.cc:276] 0709 12:28:33.898879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:33.899088 (+   209us) service_pool.cc:224] Handling call
0709 12:28:33.899434 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:34.340120 (+440686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.338296 (+1998176us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54002364d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:36.338564 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859975552}
I20260709 12:28:36.340159  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:36.340677  3924 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:36.337863  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1863) took 1810 ms. Trace:
I20260709 12:28:36.334995  4570 rpcz_store.cc:276] 0709 12:28:34.595790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.668073 (+1072283us) service_pool.cc:224] Handling call
0709 12:28:35.707014 (+ 38941us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:35.746084 (+ 39070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:35.746128 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:35.746591 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:28:36.095539 (+348948us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:36.095575 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.095636 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:36.334376 (+238740us) raft_consensus.cc:1685] finished
0709 12:28:36.334392 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:36.334504 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1947,"raft.queue_time_us":16114,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":32426,"thread_start_us":343813,"threads_started":1,"wal-append.queue_time_us":370255}
W20260709 12:28:36.323628  4001 rpcz_store.cc:269] 0709 12:28:34.318440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.709515 (+391075us) service_pool.cc:224] Handling call
0709 12:28:36.322666 (+1613151us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540032c154. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.322860 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367428480}
I20260709 12:28:36.346711  3854 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:36.366142  4536 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:36.325063  4568 rpcz_store.cc:269] 0709 12:28:34.060256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.593947 (+533691us) service_pool.cc:224] Handling call
0709 12:28:36.324371 (+1730424us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b540052c454. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.324512 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377328384}
I20260709 12:28:36.343737  3848 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:28:36.342447  3998 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:36.370041  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:36.373768  4536 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:36.373979  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.376976  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.345144  3931 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:36.384575  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:36.385344  3931 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:36.341841  7596 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:36.341846  3923 rpcz_store.cc:276] 0709 12:28:34.527726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.529681 (+  1955us) service_pool.cc:224] Handling call
0709 12:28:34.562496 (+ 32815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:34.612029 (+ 49533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:34.612072 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:34.638666 (+ 26594us) log.cc:844] Serialized 26 byte log entry
0709 12:28:35.156040 (+517374us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:35.156167 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.337368 (+1181201us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b54002e3954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:36.337410 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:36.337449 (+    39us) raft_consensus.cc:1685] finished
0709 12:28:36.337461 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:36.337682 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":15280,"spinlock_wait_cycles":112787200,"thread_start_us":440582,"threads_started":1,"wal-append.queue_time_us":372192,"wal-append.run_cpu_time_us":1984,"wal-append.run_wall_time_us":1040066}
I20260709 12:28:36.395287  3929 raft_consensus.cc:1240] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:28:36.380609  4536 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:36.371388  7608 consensus_meta.cc:287] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.526s	user 0.006s	sys 0.008s
I20260709 12:28:36.346031  3897 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:36.401271  3928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2429) took 1587 ms (client timeout 1558 ms). Trace:
I20260709 12:28:36.403982  3857 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
W20260709 12:28:36.404577  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 101883us
I20260709 12:28:36.337117  7560 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:36.414665  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:36.403625  3928 rpcz_store.cc:269] 0709 12:28:34.792904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.832808 (+ 39904us) service_pool.cc:224] Handling call
0709 12:28:36.369669 (+1536861us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54000ef1d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.380027 (+ 10358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361171712}
W20260709 12:28:36.402125  7525 consensus_meta.cc:287] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.003s
W20260709 12:28:36.431115  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 49858.9us
I20260709 12:28:36.437528  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:36.364925  7464 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:36.401728  7596 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:36.400660  7655 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:36.438252  3923 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:36.441197  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.406769  7553 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:28:36.442162  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 330569us
I20260709 12:28:36.448489  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.449044  3857 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:36.445497  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:36.438696  7273 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:28:36.459954  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 80285.4us
I20260709 12:28:36.452397  3931 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:36.461205  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:36.442780  7596 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:36.406729  7671 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:28:36.461910  3923 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:36.477532  3822 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:36.409400  7608 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.443367  7668 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:36.452968  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 80488.9us
I20260709 12:28:36.493180  3850 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:36.499315  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:36.502192  3931 raft_consensus.cc:2393] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:36.501053  3895 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:36.478406  7666 log.cc:927] Time spent T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 12:28:36.437758  7525 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:36.515622  3857 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:36.519345  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.520156  3857 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:36.503932  3895 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:36.530563  3923 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: []
W20260709 12:28:36.530747  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 89819.4us
I20260709 12:28:36.464831  7662 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:36.540468  4565 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:36.479955  7569 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:36.542801  3848 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:36.447435  7664 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.551229  3931 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:28:36.507019  7273 raft_consensus.cc:697] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:36.550707  3854 raft_consensus.cc:2393] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:36.519064  7655 raft_consensus.cc:697] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:36.537583  7409 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:36.546876  3895 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:36.555032  3923 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:36.556226  3850 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
W20260709 12:28:36.553987  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 121206us
I20260709 12:28:36.615654  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 927) took 1841 ms. Trace:
I20260709 12:28:36.614212  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2443) took 1008 ms. Trace:
I20260709 12:28:36.574666  3931 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:36.580305  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:36.583283  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 129993us
W20260709 12:28:36.607542  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 313817us
I20260709 12:28:36.586735  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:36.582434  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 931) took 1763 ms. Trace:
I20260709 12:28:36.660693  3850 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
W20260709 12:28:36.607350  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:36.652716  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1912) took 2285 ms. Trace:
I20260709 12:28:36.572520  3857 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:36.588876  3821 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:36.628731  3969 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:36.613068  3926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54068 (request call id 831) took 2064 ms (client timeout 1914 ms). Trace:
I20260709 12:28:36.599514  7525 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:36.696566  3926 rpcz_store.cc:269] 0709 12:28:34.548946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.593607 (+ 44661us) service_pool.cc:224] Handling call
0709 12:28:36.612623 (+2019016us) spinlock_profiling.cc:243] Waited 96.5 ms on lock 0x7b540031c9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.612863 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221996416}
W20260709 12:28:36.583535  4566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 889) took 2554 ms (client timeout 1665 ms). Trace:
I20260709 12:28:36.551410  7553 raft_consensus.cc:697] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:36.701913  7449 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:28:36.586302  7593 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:36.580343  7558 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:36.659497  3932 rpcz_store.cc:276] 0709 12:28:35.605904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.204400 (+598496us) service_pool.cc:224] Handling call
0709 12:28:36.204869 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:36.243923 (+ 39054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:36.243969 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:36.261594 (+ 17625us) log.cc:844] Serialized 26 byte log entry
0709 12:28:36.443203 (+181609us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:36.443261 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.443354 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:36.613899 (+170545us) raft_consensus.cc:1685] finished
0709 12:28:36.613933 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:36.614134 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":3558,"thread_start_us":72172,"threads_started":1,"wal-append.queue_time_us":239265}
I20260709 12:28:36.702194  7683 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:28:36.617092  3927 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:36.658725  4565 rpcz_store.cc:276] 0709 12:28:34.774511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.140241 (+1365730us) service_pool.cc:224] Handling call
0709 12:28:36.540269 (+400028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:36.540889 (+   620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.615433 (+ 74544us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540069d550. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.615587 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919149440}
W20260709 12:28:36.704869  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 116057us
I20260709 12:28:36.553998  7668 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:36.607421  7664 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:36.623975  7483 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:36.711614  3924 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:36.662251  3853 rpcz_store.cc:276] 0709 12:28:34.367358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.587967 (+220609us) service_pool.cc:224] Handling call
0709 12:28:34.661236 (+ 73269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:34.661477 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:34.661513 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:34.662236 (+   723us) log.cc:844] Serialized 26 byte log entry
0709 12:28:35.454047 (+791811us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:35.454103 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.454207 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:35.577987 (+123780us) raft_consensus.cc:1685] finished
0709 12:28:35.578014 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:36.630537 (+1052523us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b5400377dd0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.652630 (+ 22093us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157230336,"thread_start_us":791238,"threads_started":1,"wal-append.queue_time_us":906691,"wal-append.run_cpu_time_us":2491,"wal-append.run_wall_time_us":1010196}
I20260709 12:28:36.726137  3928 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:36.573563  3895 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:36.713505  3926 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:28:36.706576  4566 rpcz_store.cc:269] 0709 12:28:34.003036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.436101 (+433065us) service_pool.cc:224] Handling call
0709 12:28:36.531863 (+2095762us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b540069d554. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.556978 (+ 25115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613336960}
W20260709 12:28:36.586510  7676 log.cc:927] Time spent T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:28:36.594841  7560 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:36.703562  7608 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:36.723639  4569 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:36.661307  4567 rpcz_store.cc:276] 0709 12:28:34.818629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.143813 (+1325184us) service_pool.cc:224] Handling call
0709 12:28:36.144146 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:36.144608 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:36.144636 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:36.145116 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:28:36.430115 (+284999us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:36.430157 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.430231 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:36.582157 (+151926us) raft_consensus.cc:1685] finished
0709 12:28:36.582187 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:36.582364 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33389,"raft.queue_time_us":10192,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":284660,"threads_started":1,"wal-append.queue_time_us":435212}
I20260709 12:28:36.612317  7464 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:36.571213  7409 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:36.739079  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:36.732486  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 160233us
I20260709 12:28:36.735304  3857 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:36.729524  4537 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:36.593314  7567 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:36.735754  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:36.589083  7662 consensus_queue.cc:1059] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.149s
I20260709 12:28:36.737677  3931 raft_consensus.cc:1240] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:28:36.580760  7450 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:36.741497  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:36.569310  7569 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:36.736294  7582 raft_consensus.cc:2764] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:28:36.767592  7383 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:36.768170  7383 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.755571  7409 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:36.757937  7543 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:36.758311  7672 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:36.758529  7483 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:28:36.759269  3850 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:36.625862  7462 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:36.760632  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1924) took 2068 ms. Trace:
I20260709 12:28:36.764586  3926 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:36.724520  7525 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:36.765467  4565 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
W20260709 12:28:36.692322  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 105639us
I20260709 12:28:36.763814  7519 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:36.736361  7378 consensus_queue.cc:1059] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:28:36.773494  3969 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:36.613452  7273 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.779712  3857 rpcz_store.cc:276] 0709 12:28:34.685853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.713059 (+2027206us) service_pool.cc:224] Handling call
0709 12:28:36.735100 (+ 22041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:36.754300 (+ 19200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.754573 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:36.791008  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:36.782068  3821 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:36.775298  3854 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:36.795526  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1929) took 1991 ms. Trace:
I20260709 12:28:36.795850  3854 rpcz_store.cc:276] 0709 12:28:34.803975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.763320 (+1959345us) service_pool.cc:224] Handling call
0709 12:28:36.775082 (+ 11762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:36.795288 (+ 20206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.795472 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:36.776935  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:36.784374  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1921) took 2409 ms. Trace:
I20260709 12:28:36.738590  7593 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:36.797042  3850 rpcz_store.cc:276] 0709 12:28:34.370931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.704557 (+2333626us) service_pool.cc:224] Handling call
0709 12:28:36.742775 (+ 38218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:36.778415 (+ 35640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.780386 (+  1971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:36.783159  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:36.804057  3971 leader_election.cc:336] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Timed out: RequestConsensusVote RPC to 127.2.157.4:41095 timed out after 1.950s (SENT)
I20260709 12:28:36.741770  7542 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.804967  3853 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:36.588104  7655 consensus_queue.cc:237] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.773265  7567 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:36.804912  4566 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:36.813515  3971 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:36.813833  4570 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:36.817523  7542 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:36.817914  4568 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []
W20260709 12:28:36.832613  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 55889.2us
I20260709 12:28:36.818565  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:36.833472  3926 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:36.819649  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2318) took 2572 ms. Trace:
I20260709 12:28:36.797425  7672 raft_consensus.cc:697] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:36.791008  7464 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:36.824860  7593 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:36.826478  7582 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:36.827533  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2339) took 1993 ms. Trace:
I20260709 12:28:36.845176  3853 rpcz_store.cc:276] 0709 12:28:34.864236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.765837 (+1901601us) service_pool.cc:224] Handling call
0709 12:28:36.791114 (+ 25277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:36.813600 (+ 22486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.827467 (+ 13867us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:36.827970  3925 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:36.773241  7662 consensus_queue.cc:1243] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:28:36.846269  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:36.838874  3970 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:36.822793  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 61301.7us
I20260709 12:28:36.785441  7450 raft_consensus.cc:697] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:36.785595  7569 raft_consensus.cc:697] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:36.841660  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:36.785704  7525 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:36.804886  7543 raft_consensus.cc:697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:36.846903  4566 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:36.789987  7558 raft_consensus.cc:697] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:36.848891  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.854414  3857 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:36.784056  7664 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:28:36.834374  3852 rpcz_store.cc:276] 0709 12:28:34.240351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.252940 (+ 12589us) service_pool.cc:224] Handling call
0709 12:28:34.271305 (+ 18365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:36.019514 (+1748209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:36.019564 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:36.020077 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:28:36.108358 (+ 88281us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:36.108393 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.782940 (+674547us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400190354. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:36.783009 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:36.783075 (+    66us) raft_consensus.cc:1685] finished
0709 12:28:36.783096 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:36.812275 (+ 29179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1581,"raft.queue_time_us":58427,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6979,"spinlock_wait_cycles":279025920,"thread_start_us":1712665,"threads_started":2,"wal-append.queue_time_us":93919}
I20260709 12:28:36.858997  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:36.858837  7596 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.859483  7543 consensus_queue.cc:237] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.860096  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:36.860653  4565 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:36.862071  4572 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:36.864634  7463 consensus_queue.cc:260] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.851764  3897 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:36.855140  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:36.880581  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 308143us
W20260709 12:28:36.883467  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 79465.9us
W20260709 12:28:36.879668  3897 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.506s (SENT) [suppressed 28 similar messages]
I20260709 12:28:36.848243  7582 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:36.849483  7464 raft_consensus.cc:697] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:36.856462  7586 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:36.852487  7525 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:36.837134  7567 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.896872  4570 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:28:36.897267  4570 pending_rounds.cc:85] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 8
I20260709 12:28:36.897490  4570 pending_rounds.cc:107] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:28:36.897750  4570 raft_consensus.cc:2889] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:36.880339  7590 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:36.902048  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:36.879508  7463 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:36.879462  7670 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:36.881537  7449 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:36.911069  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:36.812403  7553 consensus_queue.cc:237] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:36.927433  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2440) took 1704 ms. Trace:
I20260709 12:28:36.927903  3927 rpcz_store.cc:276] 0709 12:28:35.223340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.629936 (+406596us) service_pool.cc:224] Handling call
0709 12:28:36.616850 (+986914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:36.716915 (+100065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.927062 (+210147us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b540031c9d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.927350 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227248896}
I20260709 12:28:36.929186  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:36.890833  7582 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:36.931001  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:36.931869  3851 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:36.932953  3851 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:36.934406  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2434) took 2095 ms. Trace:
I20260709 12:28:36.935143  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:36.935817  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2442) took 1337 ms. Trace:
I20260709 12:28:36.934796  3930 rpcz_store.cc:276] 0709 12:28:34.839008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.462067 (+623059us) service_pool.cc:224] Handling call
0709 12:28:35.462561 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:35.896726 (+434165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.934185 (+1037459us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54003061d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:36.934352 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996962048}
I20260709 12:28:36.936203  3929 rpcz_store.cc:276] 0709 12:28:35.598555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.098652 (+500097us) service_pool.cc:224] Handling call
0709 12:28:36.379092 (+280440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:36.397097 (+ 18005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.935642 (+538545us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400236ed0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.935763 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":624808192}
I20260709 12:28:36.937407  3930 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:28:36.937602  3929 raft_consensus.cc:1240] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:36.914683  3857 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:28:36.854830  7542 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:28:36.919847  7383 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:36.919936  7551 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 12:28:36.970100  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 188095us
W20260709 12:28:36.921434  7688 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:28:36.922036  7450 consensus_queue.cc:237] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:36.923959  7464 consensus_queue.cc:237] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:36.924548  7672 consensus_queue.cc:237] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:36.925011  7586 consensus_queue.cc:1059] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:36.938423  4571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 980) took 3034 ms. Trace:
I20260709 12:28:36.929755  3927 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:28:36.939476  3849 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2333) took 2119 ms (client timeout 1720 ms). Trace:
I20260709 12:28:36.915751  3895 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:36.981155  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 65532.6us
I20260709 12:28:36.980424  4571 rpcz_store.cc:276] 0709 12:28:33.903902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.575186 (+1671284us) service_pool.cc:224] Handling call
0709 12:28:36.146987 (+571801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:36.147575 (+   588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.938227 (+790652us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54005aee50. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.938342 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1233768704}
I20260709 12:28:36.900741  7378 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:36.977159  4537 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:36.909442  7664 raft_consensus.cc:3055] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:36.915472  4574 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:36.991091  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:36.980865  3849 rpcz_store.cc:269] 0709 12:28:34.820059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.457525 (+637466us) service_pool.cc:224] Handling call
0709 12:28:36.939305 (+1481780us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400019fd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:36.939402 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235183872}
I20260709 12:28:36.984751  3853 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:36.992767  3971 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:36.993582  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 909) took 1127 ms. Trace:
I20260709 12:28:36.994235  3853 rpcz_store.cc:276] 0709 12:28:35.866451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.867791 (+1001340us) service_pool.cc:224] Handling call
0709 12:28:36.903569 (+ 35778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:36.993236 (+ 89667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.993503 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:36.916663  7670 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:36.917008  7449 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:36.988972  3924 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: []
W20260709 12:28:36.989377  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:36.978454  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 95294.1us
W20260709 12:28:36.999190  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:36.999231  3929 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:37.004222  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:37.009341  3849 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:36.990309  7519 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:37.016045  3924 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:28:37.010118  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 99951.3us
I20260709 12:28:37.013428  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:36.991469  7664 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:37.000497  7449 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:36.995914  7670 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:37.021449  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 44387.8us
I20260709 12:28:37.023793  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:37.023914  3929 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:37.001410  7383 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:37.021370  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:36.996978  7378 raft_consensus.cc:697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:37.026702  3853 raft_consensus.cc:2376] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10. Re-sending same reply.
I20260709 12:28:36.917909  7590 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.015679  7519 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:37.035791  3924 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:37.044728  3924 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:37.046353  3924 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:37.046526  7696 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:37.048252  7696 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:37.058943  7383 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:37.063395  7567 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:37.064038  7661 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.922s	user 0.001s	sys 0.001s
W20260709 12:28:37.066260  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 62002.5us
I20260709 12:28:37.068295  3849 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
W20260709 12:28:37.070672  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:37.071219  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:37.021541  7462 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:37.084367  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 82148.8us
I20260709 12:28:37.086274  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:37.089213  3822 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:37.094767  3927 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:37.035497  7655 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:37.098479  4566 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:37.058019  7483 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:28:36.990206  7569 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.103127  4571 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: [6.7-7.8]
I20260709 12:28:37.043262  7519 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:37.140187  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 51051.7us
I20260709 12:28:37.044363  7596 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:37.142681  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:37.001137  7558 consensus_queue.cc:237] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:37.146332  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 105682us
I20260709 12:28:37.155864  3848 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:37.044067  7691 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 12:28:37.100636  7655 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:37.170869  3848 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:37.102888  7378 consensus_queue.cc:237] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:37.167879  3822 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:37.168761  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 176058us
I20260709 12:28:37.169333  4566 raft_consensus.cc:3055] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:37.175963  4566 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:37.183126  3897 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:37.167953  7596 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:37.173493  7655 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:37.185441  4566 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.145697  7664 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.200973  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2349) took 1020 ms. Trace:
I20260709 12:28:37.201287  3857 rpcz_store.cc:276] 0709 12:28:36.175927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.946160 (+770233us) service_pool.cc:224] Handling call
0709 12:28:36.987763 (+ 41603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:37.007780 (+ 20017us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:28:37.039510 (+ 31730us) log.cc:844] Serialized 14 byte log entry
0709 12:28:37.196021 (+156511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:37.196086 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:37.196222 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:37.196467 (+   245us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:37.196591 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29669,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":3149,"thread_start_us":90822,"threads_started":1}
I20260709 12:28:37.206007  7492 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:37.206868  7698 consensus_queue.cc:1059] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:28:37.208135  7698 raft_consensus.cc:3055] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:37.208460  7698 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:37.209957  7695 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:37.210489  7695 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:37.210883  7695 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:37.211373  3822 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:37.212073  7261 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.212597  7261 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.213093  7347 raft_consensus.cc:2764] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:28:37.213796  7347 consensus_queue.cc:1059] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:37.214640  7347 consensus_queue.cc:1059] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:37.215768  7697 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:37.216014  7446 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:37.216616  7697 raft_consensus.cc:3055] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:37.217064  7697 raft_consensus.cc:740] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:37.218346  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 936) took 1233 ms. Trace:
I20260709 12:28:37.217985  7697 consensus_queue.cc:260] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:37.218743  4569 rpcz_store.cc:276] 0709 12:28:35.984785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.150017 (+165232us) service_pool.cc:224] Handling call
0709 12:28:36.220379 (+ 70362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:36.742382 (+522003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:37.218112 (+475730us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54004cbdd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:37.218287 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156939520}
I20260709 12:28:37.219434  7701 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:37.221017  7701 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:28:37.221733  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:37.222040  7567 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:37.224229  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:37.224809  4569 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:37.225821  3897 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:37.203907  4537 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:37.226649  4565 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:37.199023  7450 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:37.232137  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1919) took 2862 ms. Trace:
I20260709 12:28:37.222772  7567 consensus_queue.cc:1243] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer f3cab225ecb7488386a1a19239498cfe log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:28:37.247048  7699 log.cc:927] Time spent T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:28:37.247936  7710 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:37.249346  7590 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:37.292193  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 66453.4us
I20260709 12:28:37.294397  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:37.250942  7359 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:37.277814  3855 rpcz_store.cc:276] 0709 12:28:34.369229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.041958 (+1672729us) service_pool.cc:224] Handling call
0709 12:28:36.219855 (+177897us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:36.223944 (+  4089us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:36.223978 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:36.224528 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:28:36.296177 (+ 71649us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:36.296214 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.296278 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:36.410788 (+114510us) raft_consensus.cc:1685] finished
0709 12:28:36.410807 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:37.222928 (+812121us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540001a9d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:37.232058 (+  9130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1777,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":10425,"spinlock_wait_cycles":408125184,"thread_start_us":71289,"threads_started":1,"wal-append.queue_time_us":51064}
I20260709 12:28:37.282141  4566 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:37.304754  3926 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:37.306181  7261 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:37.307202  7409 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:37.308367  7582 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:37.309458  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:37.310240  3850 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:37.311544  3851 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:28:37.311894  3851 pending_rounds.cc:85] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 6
I20260709 12:28:37.312083  3851 pending_rounds.cc:107] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:28:37.312279  3851 raft_consensus.cc:2889] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:37.286046  3857 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:37.287427  7716 consensus_queue.cc:1059] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:37.194231  7525 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:37.292074  3923 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:37.200493  7483 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.244307  7492 raft_consensus.cc:3055] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:37.326247  4566 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:28:37.209314  7698 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:37.313534  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.282543  7697 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:37.315351  4569 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
W20260709 12:28:37.315841  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 95884.9us
I20260709 12:28:37.287642  7567 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:28:37.285584  7664 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:37.309558  7409 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:37.325098  7569 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:37.291560  7596 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.324968  7492 raft_consensus.cc:740] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:37.334342  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:37.231959  7696 consensus_queue.cc:1059] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:28:37.345124  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:37.311210  7590 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:37.344434  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.343511  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.354714  3998 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:37.365101  4005 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:37.320219  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 107627us
I20260709 12:28:37.359850  3926 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:37.333230  3850 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:37.342381  7672 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.374384  4004 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:37.375042  4001 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:28:37.379786  4006 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:37.381417  3971 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:37.384627  7582 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:37.385061  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:37.385321  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.385767  4002 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:37.386078  3997 raft_consensus.cc:2368] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7.
W20260709 12:28:37.387279  7656 log.cc:927] Time spent T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 1.239s	user 0.004s	sys 0.000s
I20260709 12:28:37.387074  7492 consensus_queue.cc:260] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:37.388314  7492 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:37.388569  7409 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.389192  7409 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.335583  7483 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.384696  3999 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:28:37.391618  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.384949  3855 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:37.393407  3998 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:37.393435  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:37.373522  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:37.398037  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:37.400467  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.407677  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:37.408552  7543 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:28:37.412298  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:37.412519  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.391258  7698 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:37.420629  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:37.421393  3855 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:37.422197  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:37.422370  7700 raft_consensus.cc:2764] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:28:37.423429  3855 raft_consensus.cc:3055] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:37.423796  3855 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:37.395550  7590 raft_consensus.cc:697] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:37.424587  3855 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.425516  3855 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:37.426142  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:37.365000  7596 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.426322  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.396528  7582 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.422197  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.433313  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:37.423202  7706 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:28:37.426182  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:37.426791  4006 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:37.429366  3998 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:37.432878  4000 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:37.435803  3897 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:37.390187  7672 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:37.447229  3924 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:37.437012  3822 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:37.443426  4005 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:37.444836  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.449390  4002 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:37.451205  4001 raft_consensus.cc:3055] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:37.451673  4001 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:37.390676  7695 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.406301  7463 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:28:37.424871  7590 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.469050  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.444380  7462 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:28:37.444604  7543 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:37.470706  3999 raft_consensus.cc:2376] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13. Re-sending same reply.
I20260709 12:28:37.471647  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.471355  4001 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.474846  3848 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:37.437705  7519 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:37.478777  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:37.463675  7716 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:37.481017  4001 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:37.441805  7582 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:37.444506  7691 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:28:37.488842  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.420682  7712 consensus_queue.cc:1059] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:28:37.484810  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1891) took 1242 ms. Trace:
I20260709 12:28:37.444211  7450 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 12:28:37.492477  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 55599.5us
I20260709 12:28:37.492419  3930 rpcz_store.cc:276] 0709 12:28:36.242723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.938526 (+695803us) service_pool.cc:224] Handling call
0709 12:28:36.938841 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:36.939048 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:28:37.155511 (+216463us) log.cc:844] Serialized 14 byte log entry
0709 12:28:37.483395 (+327884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:37.483451 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:37.484563 (+  1112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:37.484636 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:37.484753 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58054,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":337,"thread_start_us":543636,"threads_started":2}
I20260709 12:28:37.494318  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.477813  7464 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:37.505688  3997 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:37.487627  7525 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:37.511303  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 75572.9us
I20260709 12:28:37.511540  4538 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:37.504441  7464 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:37.525722  7463 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:37.542459  7450 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:28:37.550113  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 45154.2us
I20260709 12:28:37.518903  7384 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:37.545419  7464 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:37.569319  4001 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:28:37.569856  4001 pending_rounds.cc:85] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 9
I20260709 12:28:37.570200  4001 pending_rounds.cc:107] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:28:37.570487  4001 raft_consensus.cc:2889] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:37.571050  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 66576.8us
I20260709 12:28:37.550314  7409 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:37.547946  7719 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:37.576750  3822 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:37.584189  7463 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:37.589359  3853 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
W20260709 12:28:37.593429  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:37.579190  7596 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:37.594625  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:37.595147  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:37.595597  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:37.596627  7731 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:37.602741  4004 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
W20260709 12:28:37.604337  7670 consensus_meta.cc:287] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.560s	user 0.001s	sys 0.009s
I20260709 12:28:37.605002  7670 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.606424  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:37.608165  7721 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 12:28:37.609588  7709 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:28:37.610891  3853 raft_consensus.cc:1240] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:37.612239  3853 raft_consensus.cc:1240] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:37.612490  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1883) took 1827 ms. Trace:
I20260709 12:28:37.612891  4538 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:37.613948  7519 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:37.614148  3854 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:28:37.602578  7655 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.615615  4538 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:37.617210  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 921) took 1574 ms. Trace:
I20260709 12:28:37.617067  7543 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:28:37.617676  4538 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:37.619341  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 107139us
I20260709 12:28:37.612867  3928 rpcz_store.cc:276] 0709 12:28:35.784831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.451177 (+666346us) service_pool.cc:224] Handling call
0709 12:28:36.725966 (+274789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:36.726413 (+   447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:37.612282 (+885869us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54000d5f50. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:37.612423 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563477888}
I20260709 12:28:37.617630  3851 rpcz_store.cc:276] 0709 12:28:36.043162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.934409 (+891247us) service_pool.cc:224] Handling call
0709 12:28:36.934719 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:37.317931 (+383212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:37.616953 (+299022us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b5400191754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:37.617139 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":865875328}
W20260709 12:28:37.600668  7707 log.cc:927] Time spent T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:28:37.620792  4537 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:37.617534  7655 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:37.630694  4569 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:28:37.601171  7695 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:37.634681  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:37.634944  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:37.632841  3856 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:37.621400  7686 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:37.624931  7384 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:37.790359  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 172751us
I20260709 12:28:37.791693  4538 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:37.806808  7728 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.235s
I20260709 12:28:37.808185  7670 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:37.809077  7729 log.cc:927] Time spent T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 12:28:37.810173  3854 raft_consensus.cc:3055] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:28:37.810582  7725 log.cc:927] Time spent T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:28:37.810551  3854 raft_consensus.cc:740] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:37.811628  4002 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:37.811594  3854 consensus_queue.cc:260] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.812618  3854 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:37.636711  7731 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.814199  7731 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:37.816913  7731 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:37.819783  7449 consensus_meta.cc:287] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.776s	user 0.007s	sys 0.003s
I20260709 12:28:37.820430  7449 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.832141  4538 leader_election.cc:400] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 6. Current term is 7.
I20260709 12:28:37.838095  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:37.838332  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:37.838847  4566 raft_consensus.cc:2368] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7.
I20260709 12:28:37.838948  4565 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:37.838948  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:37.842682  4002 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:28:37.842947  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:37.843911  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.844493  4002 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:37.845990  3851 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:28:37.846379  3851 pending_rounds.cc:85] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 5
I20260709 12:28:37.846263  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.846690  3851 pending_rounds.cc:107] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:28:37.846969  3851 raft_consensus.cc:2889] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:37.847347  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:37.848754  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:37.850054  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:28:37.850293  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:37.851148  3999 raft_consensus.cc:2410] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:28:37.852288  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.853096  7727 raft_consensus.cc:3055] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:37.853404  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:37.853565  7727 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:37.854842  7727 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.856194  7727 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:37.857023  7713 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
W20260709 12:28:37.857565  7658 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 1.439s	user 0.004s	sys 0.000s
I20260709 12:28:37.865676  3999 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:37.866099  7237 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:28:37.867713  7063 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:28:37.870373  7582 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:37.877305  4002 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:37.635529  7261 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:37.882098  7463 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:28:37.883451  3822 connection.cc:256] RPC call timeout handler was delayed by -1.2397575720001441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2575s for a response
W20260709 12:28:37.992766  3822 connection.cc:256] RPC call timeout handler was delayed by -1.0282575720002569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.281s for a response
I20260709 12:28:37.598740  7719 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:37.996812  7719 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:37.997378  4003 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
W20260709 12:28:37.962791  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 129152us
I20260709 12:28:38.002074  4574 raft_consensus.cc:3055] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:38.002509  4574 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:38.003328  4574 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.004379  4574 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:37.992532  7463 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:38.006211  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:38.006534  7463 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:38.006880  4002 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:38.008694  7731 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:38.008944  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:38.010177  7492 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:38.010653  7492 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:38.011020  7492 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:38.013391  4572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 934) took 2029 ms. Trace:
I20260709 12:28:38.013813  4572 rpcz_store.cc:276] 0709 12:28:35.984268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.148241 (+163973us) service_pool.cc:224] Handling call
0709 12:28:36.148521 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:36.862538 (+714017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.013067 (+1150529us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54004880d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:38.013322 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460598656}
I20260709 12:28:38.015147  7596 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:38.015301  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1881) took 2231 ms. Trace:
I20260709 12:28:38.015743  7596 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.015872  3925 rpcz_store.cc:276] 0709 12:28:35.783832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.238101 (+454269us) service_pool.cc:224] Handling call
0709 12:28:36.238421 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:36.846092 (+607671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.015009 (+1168917us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b540031bfd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:38.015227 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355497856}
I20260709 12:28:38.019908  7237 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:38.020663  7237 consensus_queue.cc:1243] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:28:37.987619  7608 raft_consensus.cc:3055] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:38.024909  7608 raft_consensus.cc:740] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:38.025934  7608 consensus_queue.cc:260] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:38.027316  7608 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:37.990290  7261 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:38.030635  7261 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:38.032647  7449 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:38.009434  7731 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:38.040417  3999 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:38.045601  4574 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:28:38.053809  4536 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:37.967706  3854 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:28:37.972745  3929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.097s	sys 0.137s
I20260709 12:28:37.644151  7668 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:37.966248  7569 consensus_meta.cc:287] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.519s	user 0.002s	sys 0.005s
I20260709 12:28:38.064662  7569 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:37.879381  4001 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:38.065163  3755 catalog_manager.cc:5697] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 3 to 5, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 5 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:38.066157  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:38.066780  4001 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:38.066947  3755 catalog_manager.cc:5697] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 4, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 4 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:38.067655  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:38.068223  4001 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
W20260709 12:28:38.070271  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.070628  7596 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:37.989269  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:38.063373  7558 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:38.073589  7558 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:38.074463  3856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2332) took 3254 ms (client timeout 1937 ms). Trace:
I20260709 12:28:38.074704  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:38.074862  3856 rpcz_store.cc:269] 0709 12:28:34.819805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.519794 (+699989us) service_pool.cc:224] Handling call
0709 12:28:38.074281 (+2554487us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54002ed954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:38.074381 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4856652160}
I20260709 12:28:38.075548  3999 raft_consensus.cc:2368] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7.
I20260709 12:28:38.075636  7558 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:38.076618  3999 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: []
W20260709 12:28:38.077289  7697 consensus_meta.cc:287] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.726s	user 0.010s	sys 0.001s
I20260709 12:28:38.077436  7720 raft_consensus.cc:3055] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:38.077862  7720 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:38.078493  4566 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:28:38.078661  7720 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.079464  7655 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:38.079871  7720 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:38.080053  7464 consensus_meta.cc:287] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.000s
I20260709 12:28:38.080552  7464 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:38.081707  7708 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:38.082273  3850 raft_consensus.cc:2410] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:28:38.070712  3822 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:38.083981  3822 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:38.079939  7655 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:38.085461  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.064569  7731 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:38.086087  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.086344  7731 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:38.087059  7655 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:38.087623  7731 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:38.074582  4567 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:28:38.089233  7347 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.635506  7711 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:38.089711  7347 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:38.090211  7711 raft_consensus.cc:697] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:38.090732  4000 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: [9.11-9.11]
W20260709 12:28:37.978807  7664 consensus_meta.cc:287] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.619s	user 0.006s	sys 0.006s
I20260709 12:28:38.091739  7347 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:38.091280  7711 consensus_queue.cc:237] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.062448  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:38.044442  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:38.076269  7668 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:38.059190  3929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.097s	sys 0.137s
I20260709 12:28:37.652190  7672 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:38.095645  3822 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:38.098994  4000 raft_consensus.cc:1217] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-11.10]   Dedup: 7.8->[9.9-11.10]
I20260709 12:28:38.109244  4000 pending_rounds.cc:85] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 8
W20260709 12:28:38.109794  7691 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.000s	sys 0.008s
I20260709 12:28:38.109603  4000 pending_rounds.cc:107] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:28:38.110685  4000 raft_consensus.cc:2889] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:38.110805  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:38.111553  4006 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:38.100062  4538 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:38.115412  4538 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:38.102650  4002 raft_consensus.cc:2410] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:28:38.115963  4571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 916) took 1265 ms. Trace:
I20260709 12:28:38.116241  7543 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:38.116807  7543 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:38.116508  4571 rpcz_store.cc:276] 0709 12:28:36.851045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.982380 (+131335us) service_pool.cc:224] Handling call
0709 12:28:37.100773 (+118393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:37.145383 (+ 44610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.115720 (+970337us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540052b550. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:38.115890 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270031232}
W20260709 12:28:38.110236  7691 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.000s	sys 0.008s
I20260709 12:28:38.118418  7691 consensus_queue.cc:1243] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:28:38.118726  7237 consensus_queue.cc:1059] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:28:38.119860  7237 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:38.120349  7237 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:38.120648  7686 raft_consensus.cc:3055] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:38.117520  7543 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:38.121210  7686 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:38.122409  7686 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.124102  7686 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:38.126605  7607 raft_consensus.cc:3055] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:38.127159  7607 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:38.128309  7607 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.120793  7237 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:38.132145  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 848) took 1988 ms. Trace:
I20260709 12:28:38.132664  3923 rpcz_store.cc:276] 0709 12:28:36.143425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.624718 (+481293us) service_pool.cc:224] Handling call
0709 12:28:36.625067 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:37.321571 (+696504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.131827 (+810256us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54000d4b54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:38.132058 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1533508480}
W20260709 12:28:38.140126  7726 log.cc:927] Time spent T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.622s	user 0.007s	sys 0.000s
I20260709 12:28:38.147842  7543 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.157912  7409 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:38.107894  4536 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:38.158740  7063 consensus_queue.cc:1059] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:38.159181  4568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 914) took 1383 ms. Trace:
I20260709 12:28:38.159523  7654 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:38.160190  7582 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:38.160424  7543 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:38.161661  7582 raft_consensus.cc:3055] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:38.162170  7582 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:38.162972  7237 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.163247  7582 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:38.164516  7582 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:38.108045  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:38.113966  3852 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:28:38.159250  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 51457.1us
I20260709 12:28:38.167251  7483 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:38.167531  3852 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:28:38.167757  7483 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:38.158069  7567 consensus_queue.cc:1059] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:38.168840  7710 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:38.168004  7384 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:38.168972  7567 raft_consensus.cc:3055] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:38.170687  7567 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:38.165522  4567 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:38.171671  7567 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:38.172253  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:38.172860  7567 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:38.173444  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:38.159662  7063 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:28:38.179364  3999 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:38.167940  3852 pending_rounds.cc:85] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 7
I20260709 12:28:38.180070  3852 pending_rounds.cc:107] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:28:38.174217  7409 raft_consensus.cc:3055] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:38.180706  7409 raft_consensus.cc:740] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:38.178495  7710 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:38.107733  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:38.181735  7409 consensus_queue.cc:260] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.183317  7409 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:38.174633  4571 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:38.175525  3925 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:28:38.184769  7701 raft_consensus.cc:3055] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:38.185190  7701 raft_consensus.cc:740] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:38.177366  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:38.184528  3755 catalog_manager.cc:5697] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:28:38.177727  3851 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:38.186231  7701 consensus_queue.cc:260] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.178011  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:38.187731  7701 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:38.188198  4005 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:38.188068  3755 catalog_manager.cc:5697] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 2 to 3, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 3 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:38.178293  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:38.180347  3852 raft_consensus.cc:2889] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:38.174372  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:38.191349  3932 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:38.193367  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 926) took 1886 ms. Trace:
I20260709 12:28:38.193552  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:38.193756  3848 rpcz_store.cc:276] 0709 12:28:36.307053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:37.179954 (+872901us) service_pool.cc:224] Handling call
0709 12:28:37.180378 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:37.475308 (+294930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.193155 (+717847us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54001e7154. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:38.193315 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676770048}
I20260709 12:28:38.194239  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:38.194671  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:38.194988  3923 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:38.195757  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:38.196386  3923 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:38.198065  4574 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:28:38.159799  4568 rpcz_store.cc:276] 0709 12:28:36.775858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.784309 (+  8451us) service_pool.cc:224] Handling call
0709 12:28:36.804363 (+ 20054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:36.836281 (+ 31918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.158881 (+1322600us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5400243bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:38.159104 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30475648}
I20260709 12:28:38.199276  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 915) took 1348 ms. Trace:
I20260709 12:28:38.199669  4570 rpcz_store.cc:276] 0709 12:28:36.850712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.963979 (+113267us) service_pool.cc:224] Handling call
0709 12:28:36.980939 (+ 16960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:37.090516 (+109577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:37.090567 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:37.091219 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 12:28:37.173692 (+ 82473us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:37.173754 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.198884 (+1025130us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400512054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:38.198934 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:38.198983 (+    49us) raft_consensus.cc:1685] finished
0709 12:28:38.198998 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:38.199217 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7231,"raft.queue_time_us":56618,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4573,"spinlock_wait_cycles":251621120,"thread_start_us":70228,"threads_started":1,"wal-append.queue_time_us":102461}
I20260709 12:28:38.201941  7710 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:38.202315  7483 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:38.093132  7378 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:38.204538  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:38.186000  4004 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:38.206274  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:38.209010  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:38.082103  7359 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:38.205225  4537 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:38.215925  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 54638.4us
I20260709 12:28:38.216549  3932 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:38.220224  4005 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
W20260709 12:28:38.109541  7671 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.000s	sys 0.009s
I20260709 12:28:38.226995  3854 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:38.228879  3857 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:38.237236  7450 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:38.210132  7378 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:38.296413  3969 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:38.104238  7383 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:38.285516  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 199636us
I20260709 12:28:38.289589  4538 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:28:38.294250  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 92633.2us
I20260709 12:28:38.203400  7687 consensus_queue.cc:1059] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:28:38.217336  7237 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:38.223639  7609 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:38.306246  3969 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:38.308744  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:38.309240  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:38.330721  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:38.290036  7671 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.000s	sys 0.009s
I20260709 12:28:38.082201  7708 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:38.333500  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 43712.9us
I20260709 12:28:38.217598  7483 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:28:38.291229  7654 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:38.287458  7359 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:38.353272  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:38.316665  7691 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:38.348796  3821 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:38.357592  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 51445.5us
I20260709 12:28:38.362051  3969 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:38.301657  7543 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:28:38.370376  3895 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:38.365165  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:38.374761  3969 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:38.383440  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.334724  7719 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:38.333628  7383 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.402434  7359 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.403659  7383 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:38.356745  7706 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:38.381696  3821 leader_election.cc:336] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.558s (SENT)
I20260709 12:28:38.348449  7670 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:38.304592  7450 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:38.388578  7347 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:28:38.400833  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 47667us
I20260709 12:28:38.423506  3822 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:38.346589  7738 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:38.354370  7654 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:38.407763  3895 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:38.395895  7609 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:38.395277  7716 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:38.426116  3923 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:38.430100  7670 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:38.430549  7450 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:38.407418  7698 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:28:38.435158  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 342085us
I20260709 12:28:38.371639  7662 raft_consensus.cc:3055] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:38.351763  4004 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:38.413592  7569 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:28:38.438844  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.451691  3854 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:38.426860  7654 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:38.476564  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:38.482148  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 58740us
W20260709 12:28:38.483003  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.454492  3895 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:38.497359  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 115699us
I20260709 12:28:38.448307  7700 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:28:38.500908  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 195939us
I20260709 12:28:38.444844  7673 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:38.444648  7662 raft_consensus.cc:740] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:38.451476  7738 raft_consensus.cc:697] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:38.447221  7609 raft_consensus.cc:697] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:38.513001  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:38.460500  7698 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:38.554726  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 43893us
I20260709 12:28:38.555751  3971 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:38.558223  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:38.504983  7586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.497s	user 0.045s	sys 0.081s
I20260709 12:28:38.561575  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:38.565259  3849 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:38.450099  7492 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:38.572487  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 134960us
I20260709 12:28:38.594261  3895 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:38.524506  7569 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:38.553308  7700 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:38.570039  7586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.569s	user 0.046s	sys 0.081s
W20260709 12:28:38.567817  7734 log.cc:927] Time spent T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:28:38.579672  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1932) took 1358 ms. Trace:
I20260709 12:28:38.609967  3857 rpcz_store.cc:276] 0709 12:28:37.221708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:37.462187 (+240479us) service_pool.cc:224] Handling call
0709 12:28:38.092941 (+630754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:38.290952 (+198011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.578348 (+287396us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54002ed954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:38.579383 (+  1035us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54002ed950. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:38.579590 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739050624}
W20260709 12:28:38.580756  3931 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2453) took 1831 ms (client timeout 1558 ms). Trace:
I20260709 12:28:38.602386  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:38.611331  3931 rpcz_store.cc:269] 0709 12:28:36.748982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.772590 (+ 23608us) service_pool.cc:224] Handling call
0709 12:28:38.580466 (+1807876us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54000ef1d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:38.580664 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1516704512}
I20260709 12:28:38.586618  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2392) took 1172 ms. Trace:
I20260709 12:28:38.604018  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:38.613153  3927 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:38.591889  3926 raft_consensus.cc:2393] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:38.590027  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:38.612663  3997 rpcz_store.cc:276] 0709 12:28:37.413748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:37.414060 (+   312us) service_pool.cc:224] Handling call
0709 12:28:37.433377 (+ 19317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:37.506284 (+ 72907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.586268 (+1079984us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b540007eed4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:38.586510 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162461952}
I20260709 12:28:38.497529  7716 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 12:28:38.561666  7483 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:38.415915  7706 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.654392  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:38.655308  4004 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:38.604351  7632 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:28:38.656418  7595 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:38.656909  7595 raft_consensus.cc:697] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:38.604766  7063 consensus_queue.cc:1059] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:28:38.658179  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:38.653550  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:38.663913  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:38.455510  7378 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:38.376360  7691 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:38.601318  7744 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:28:38.680365  3997 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:28:38.627974  7720 consensus_meta.cc:287] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.535s	user 0.005s	sys 0.009s
I20260709 12:28:38.692535  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:38.693784  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:38.694667  3927 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:38.695353  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:38.696220  3999 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
W20260709 12:28:38.652206  7608 consensus_meta.cc:287] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.004s
I20260709 12:28:38.707330  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:38.599263  7740 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:38.707119  4002 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
W20260709 12:28:38.708425  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 313851us
I20260709 12:28:38.593031  7698 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.707052  7483 raft_consensus.cc:697] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:38.722770  3850 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:38.725108  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:38.600513  7450 consensus_queue.cc:1059] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 12:28:38.562628  7673 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.719918  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:38.734282  3931 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:38.694866  7463 consensus_meta.cc:287] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.004s
I20260709 12:28:38.605981  7558 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:28:38.689442  7731 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:38.731701  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1944) took 1480 ms. Trace:
I20260709 12:28:38.869758  3853 rpcz_store.cc:276] 0709 12:28:37.251496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:37.612854 (+361358us) service_pool.cc:224] Handling call
0709 12:28:37.613128 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:37.632823 (+ 19695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:37.632869 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:37.644619 (+ 11750us) log.cc:844] Serialized 26 byte log entry
0709 12:28:38.297747 (+653128us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:38.731112 (+433365us) log.cc:844] Serialized 14 byte log entry
0709 12:28:38.731357 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.731434 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:38.731491 (+    57us) raft_consensus.cc:1685] finished
0709 12:28:38.731505 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:38.731640 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65396,"raft.queue_time_us":21251,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":9199,"thread_start_us":861136,"threads_started":2,"wal-append.queue_time_us":661614}
I20260709 12:28:38.875648  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:38.738293  3850 raft_consensus.cc:2393] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:38.768607  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:38.769516  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.781230  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:38.712133  7708 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:38.781852  4005 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:38.782631  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:38.878430  3931 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:38.695734  7593 consensus_queue.cc:1059] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 12:28:38.739878  7261 consensus_meta.cc:287] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.709s	user 0.009s	sys 0.001s
W20260709 12:28:38.768474  7744 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:28:38.605158  7662 consensus_queue.cc:260] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.796545  3969 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:38.800920  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.782229  7738 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.721983  7586 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:28:38.721906  7608 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
W20260709 12:28:38.809682  7686 consensus_meta.cc:287] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.685s	user 0.014s	sys 0.000s
I20260709 12:28:38.767498  7378 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:38.657778  7595 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.828881  7483 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.836760  7450 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:38.794896  7739 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.363s	user 0.000s	sys 0.002s
I20260709 12:28:38.846870  4538 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:28:38.969532  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 122799us
I20260709 12:28:38.848031  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:38.730852  7753 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 12:28:38.781837  7463 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.852056  3997 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:28:38.722276  7609 consensus_queue.cc:237] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:38.600813  7486 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:28:38.877669  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.882440  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:38.932327  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 360082us
W20260709 12:28:38.933806  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 137498us
W20260709 12:28:38.934093  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.935333  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:38.945554  4567 raft_consensus.cc:2410] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:28:38.813714  7700 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:38.980803  3850 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 8: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:38.983013  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:38.983856  3853 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:38.882331  7731 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:38.988281  4003 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:28:38.989395  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:38.989933  4003 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:38.992363  4004 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:28:38.993108  7462 raft_consensus.cc:3055] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:38.995362  7462 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:38.993646  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:39.000877  3998 raft_consensus.cc:2410] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:28:38.993350  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:38.981417  3971 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:38.951110  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 293548us
W20260709 12:28:38.931787  7743 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
W20260709 12:28:38.958882  3852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.003s	sys 0.019s
W20260709 12:28:39.012780  3852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.003s	sys 0.019s
I20260709 12:28:38.961345  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:38.928072  7261 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:38.965586  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:39.006570  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.955497  7492 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:39.010972  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:39.021679  4004 raft_consensus.cc:2376] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8. Re-sending same reply.
I20260709 12:28:39.015729  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:39.023299  4004 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:28:39.023881  3850 raft_consensus.cc:2410] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:28:39.013579  3857 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:38.904114  7759 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:38.981952  7359 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.017s	sys 0.012s
I20260709 12:28:38.938813  7712 consensus_queue.cc:1059] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 12:28:38.999326  7748 log.cc:927] Time spent T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.287s	user 0.001s	sys 0.001s
I20260709 12:28:39.025058  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:38.980067  7708 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:39.027755  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:39.032373  3999 raft_consensus.cc:2410] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:28:39.033071  7698 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:38.967653  7691 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:39.027807  7359 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.017s	sys 0.012s
I20260709 12:28:39.045734  7715 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:39.052017  3926 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:38.980445  7553 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 12:28:39.031100  7761 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:28:39.058600  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:39.013218  7716 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:28:38.975028  7450 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:39.063763  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:39.067852  3850 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
W20260709 12:28:39.071609  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 392421us
I20260709 12:28:39.024773  7558 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:28:39.044935  7712 consensus_queue.cc:1243] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Peer f3cab225ecb7488386a1a19239498cfe log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:28:38.997280  7462 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:39.078891  3856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.006s	sys 0.016s
I20260709 12:28:39.054498  7492 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:39.085841  3856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.006s	sys 0.016s
I20260709 12:28:39.063413  7763 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.061740  7691 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:39.028358  7740 consensus_queue.cc:1059] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:28:39.053498  7673 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:39.085152  7715 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.043931  7519 consensus_queue.cc:1059] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 12:28:39.090713  7755 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 12:28:39.030891  7759 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.110996  7063 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:39.130817  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 867) took 1719 ms. Trace:
I20260709 12:28:39.118582  7632 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:39.171099  7758 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:28:39.066140  7581 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:28:39.165434  4003 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:28:39.121481  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2397) took 1277 ms. Trace:
I20260709 12:28:39.244115  4001 rpcz_store.cc:276] 0709 12:28:37.844361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.068809 (+224448us) service_pool.cc:224] Handling call
0709 12:28:38.069126 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:38.093944 (+ 24818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:38.093974 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:38.094414 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 12:28:38.562835 (+468421us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:38.653273 (+ 90438us) log.cc:844] Serialized 14 byte log entry
0709 12:28:39.121069 (+467796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:39.121185 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:39.121231 (+    46us) raft_consensus.cc:1685] finished
0709 12:28:39.121253 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:39.121415 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5390,"prepare.queue_time_us":101477,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":191328,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":107650,"thread_start_us":711172,"threads_started":2,"wal-append.queue_time_us":571363}
I20260709 12:28:39.128801  7462 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:39.088606  7492 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:39.123057  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:39.182412  7754 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
W20260709 12:28:39.241456  7765 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
W20260709 12:28:39.263770  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 140759us
W20260709 12:28:39.259735  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 278368us
I20260709 12:28:39.173700  3928 rpcz_store.cc:276] 0709 12:28:37.411332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:37.620480 (+209148us) service_pool.cc:224] Handling call
0709 12:28:37.620806 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:37.630616 (+  9810us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:37.790250 (+159634us) log.cc:844] Serialized 14 byte log entry
0709 12:28:38.204368 (+414118us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:38.221247 (+ 16879us) log.cc:844] Serialized 26 byte log entry
0709 12:28:38.236077 (+ 14830us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:38.236119 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.236187 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:39.130594 (+894407us) raft_consensus.cc:1685] finished
0709 12:28:39.130616 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:39.130754 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80122,"prepare.queue_time_us":22543,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":111148,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":20479,"spinlock_wait_cycles":1792,"thread_start_us":288708,"threads_started":1,"wal-append.queue_time_us":557702}
I20260709 12:28:39.130693  7691 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.268687  7670 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.275063  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 939) took 1098 ms. Trace:
I20260709 12:28:39.277318  3822 leader_election.cc:400] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7.
I20260709 12:28:39.178644  7383 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:39.279222  3822 leader_election.cc:403] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:28:39.279162  3848 rpcz_store.cc:276] 0709 12:28:38.176730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.194896 (+ 18166us) service_pool.cc:224] Handling call
0709 12:28:38.195177 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:38.195379 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:38.195402 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:38.195828 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 12:28:38.475131 (+279303us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:38.475196 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.475297 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:39.270679 (+795382us) raft_consensus.cc:1685] finished
0709 12:28:39.270708 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:39.274980 (+  4272us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":278864,"threads_started":1,"wal-append.queue_time_us":482284}
W20260709 12:28:39.257932  7409 consensus_meta.cc:287] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.074s	user 0.008s	sys 0.006s
I20260709 12:28:39.122960  7763 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.261471  7465 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.261106  7673 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:39.151480  7715 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:39.265743  7558 raft_consensus.cc:3055] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:39.303131  7378 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.304721  7463 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:39.239691  7632 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.306763  7671 raft_consensus.cc:3055] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:39.356909  7759 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:39.359275  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2361) took 1726 ms. Trace:
I20260709 12:28:39.347304  7409 raft_consensus.cc:3055] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:39.391527  3855 rpcz_store.cc:276] 0709 12:28:37.632663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:37.649395 (+ 16732us) service_pool.cc:224] Handling call
0709 12:28:37.649740 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:37.834875 (+185135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:37.834927 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:37.835644 (+   717us) log.cc:844] Serialized 26 byte log entry
0709 12:28:38.336954 (+501310us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b18000f9700. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:28:38.767519 (+430565us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:38.767569 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.767654 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:39.347106 (+579452us) raft_consensus.cc:1685] finished
0709 12:28:39.347138 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:39.359177 (+ 12039us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148639,"raft.queue_time_us":148138,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":113,"spinlock_wait_cycles":167826816,"thread_start_us":396635,"threads_started":1,"wal-append.queue_time_us":1163224}
I20260709 12:28:39.320489  7558 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:39.301798  7670 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.397661  7450 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:39.389971  7754 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:28:39.339618  7789 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:39.407454  7771 log.cc:927] Time spent T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:28:39.408321  7776 log.cc:927] Time spent T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 12:28:39.309381  7383 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.412767  7715 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:39.321307  7465 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.408757  7763 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:39.433780  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.364059  7378 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.434232  7785 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:39.434566  7789 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:39.435086  7654 consensus_meta.cc:287] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.942s	user 0.012s	sys 0.000s
I20260709 12:28:39.391116  7671 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:39.348107  7673 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:39.396368  7261 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:39.392437  7409 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:39.414637  7463 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7.
I20260709 12:28:39.448767  7492 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:39.449623  4569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.016s	sys 0.006s
W20260709 12:28:39.462394  4569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.017s	sys 0.006s
I20260709 12:28:38.238169  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:39.449221  7632 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:39.471858  3925 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 12:28:39.471607  3755 catalog_manager.cc:5697] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:28:39.472525  7465 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:39.473169  7465 consensus_queue.cc:1059] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:39.474355  7409 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:39.475438  7409 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:39.449271  7558 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.477156  7558 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:39.479135  7378 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:39.479681  7378 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.480139  7378 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:39.481395  3854 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:39.483618  7670 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:39.486182  7378 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:39.491796  7727 raft_consensus.cc:3055] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:39.492475  7727 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:39.493590  7671 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.495267  7671 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:39.503257  7701 consensus_meta.cc:287] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.315s	user 0.010s	sys 0.005s
I20260709 12:28:39.471637  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 865) took 2113 ms. Trace:
W20260709 12:28:39.537796  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:39.491708  7582 consensus_meta.cc:287] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.286s	user 0.007s	sys 0.007s
I20260709 12:28:39.539728  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 938) took 1363 ms. Trace:
I20260709 12:28:39.543004  7378 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.493607  7727 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.505657  3924 rpcz_store.cc:276] 0709 12:28:37.357783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:37.488392 (+130609us) service_pool.cc:224] Handling call
0709 12:28:37.503018 (+ 14626us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:37.541622 (+ 38604us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:37.553931 (+ 12309us) log.cc:844] Serialized 14 byte log entry
0709 12:28:38.174552 (+620621us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b1800037e40. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b7723a 00007fe051fe1a2a
0709 12:28:38.867296 (+692744us) log.cc:844] Serialized 14 byte log entry
0709 12:28:38.867524 (+   228us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:38.941239 (+ 73715us) log.cc:844] Serialized 52 byte log entry
0709 12:28:38.941404 (+   165us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:38.941626 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.941735 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:39.471375 (+529640us) raft_consensus.cc:1685] finished
0709 12:28:39.471397 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:39.471575 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21980,"prepare.queue_time_us":67175,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":104,"raft.queue_time_us":45070,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":44416,"spinlock_wait_cycles":3004672,"thread_start_us":687101,"threads_started":2,"wal-append.queue_time_us":1214823}
I20260709 12:28:39.545521  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 946) took 1107 ms. Trace:
I20260709 12:28:39.546057  3854 rpcz_store.cc:276] 0709 12:28:38.438613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.480524 (+1041911us) service_pool.cc:224] Handling call
0709 12:28:39.480967 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:39.481865 (+   898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:39.545447 (+ 63582us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:39.541617  3852 rpcz_store.cc:276] 0709 12:28:38.176435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.190841 (+ 14406us) service_pool.cc:224] Handling call
0709 12:28:38.191173 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:38.227922 (+ 36749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:38.227958 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:38.228448 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:28:39.013145 (+784697us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:39.539101 (+525956us) log.cc:844] Serialized 14 byte log entry
0709 12:28:39.539370 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:39.539458 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:39.539503 (+    45us) raft_consensus.cc:1685] finished
0709 12:28:39.539515 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:39.539671 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36348,"prepare.queue_time_us":81409,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":38210,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":2861,"thread_start_us":1244072,"threads_started":2,"wal-append.queue_time_us":944800}
I20260709 12:28:39.458606  3895 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:39.552107  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 93577.5us
W20260709 12:28:39.540192  7719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.112s	user 0.005s	sys 0.023s
W20260709 12:28:39.540706  7567 consensus_meta.cc:287] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.367s	user 0.017s	sys 0.005s
W20260709 12:28:39.564313  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.565394  3924 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:39.580628  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2454) took 1005 ms. Trace:
I20260709 12:28:39.581230  3924 rpcz_store.cc:276] 0709 12:28:38.575082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.545142 (+970060us) service_pool.cc:224] Handling call
0709 12:28:39.565145 (+ 20003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:39.580307 (+ 15162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:39.580555 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:39.452015  7654 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:39.589352  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.595311  3854 raft_consensus.cc:1275] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:28:39.595904  3854 pending_rounds.cc:85] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 3
I20260709 12:28:39.596258  3854 pending_rounds.cc:107] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:28:39.596603  3854 raft_consensus.cc:2889] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:39.553681  3895 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:39.597558  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 43933.3us
I20260709 12:28:39.565007  7492 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.543565  7378 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:39.613969  4536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.015s
W20260709 12:28:39.614346  4536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.000s	sys 0.015s
W20260709 12:28:39.567193  7719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.143s	user 0.005s	sys 0.023s
I20260709 12:28:39.567189  7632 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:39.610342  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1952) took 1114 ms. Trace:
W20260709 12:28:39.611958  3897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.044s	sys 0.091s
W20260709 12:28:39.658169  3897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.044s	sys 0.092s
I20260709 12:28:39.657999  3854 rpcz_store.cc:276] 0709 12:28:38.495595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.567486 (+1071891us) service_pool.cc:224] Handling call
0709 12:28:39.594879 (+ 27393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:39.609977 (+ 15098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:39.610259 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:28:39.658675  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 606342us
I20260709 12:28:39.564674  7569 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:28:39.607195  7727 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:39.611891  7582 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:39.656322  7670 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.656498  7237 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.666491  7670 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:39.666678  7237 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.667374  7450 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.667884  7450 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:39.668735  7670 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:39.668932  7237 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:39.669620  7711 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:39.670019  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.670181  7711 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.670703  7582 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:39.672477  7788 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 12:28:39.672607  7711 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:39.656468  7463 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.674343  7778 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:39.674656  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.674590  4536 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:39.674677  7551 raft_consensus.cc:3055] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:39.675626  7551 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:39.674386  7463 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:39.676194  7237 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:39.676448  7551 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:39.674993  7683 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:39.617214  7798 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.679474  7798 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:39.660880  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:39.651105  7719 raft_consensus.cc:697] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:39.681897  7273 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:39.682463  7683 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:39.682875  7683 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:39.683221  7683 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:39.682883  7719 consensus_queue.cc:237] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.609740  7691 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:39.615095  7492 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:39.675241  7797 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.712306  7797 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:39.716449  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 940) took 1514 ms. Trace:
I20260709 12:28:39.692730  3897 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:39.721338  3897 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:39.711410  3821 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:39.743953  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:39.744947  3854 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 5.
I20260709 12:28:39.745710  3931 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:28:39.745981  7778 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.692579  7672 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.747114  7672 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.747378  7654 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:39.748307  7778 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:39.663578  7632 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:39.749073  7632 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:39.749183  7672 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:39.750654  7797 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:39.693289  7383 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:39.700505  7440 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.752342  7440 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.715698  7798 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:39.754343  7440 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:39.705196  7449 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:39.756052  4567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 1020) took 1660 ms (client timeout 2053 ms). Trace:
W20260709 12:28:39.756450  4567 rpcz_store.cc:269] 0709 12:28:38.095606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.173233 (+ 77627us) service_pool.cc:224] Handling call
0709 12:28:39.755852 (+1582619us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b5400484754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:39.755982 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1761953152}
I20260709 12:28:39.753953  7462 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:39.746426  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2458) took 1012 ms. Trace:
W20260709 12:28:39.759174  3851 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.013s	sys 0.023s
I20260709 12:28:39.716852  3856 rpcz_store.cc:276] 0709 12:28:38.202007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.234831 (+ 32824us) service_pool.cc:224] Handling call
0709 12:28:38.295884 (+ 61053us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:38.296255 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:28:38.339966 (+ 43711us) log.cc:844] Serialized 14 byte log entry
0709 12:28:39.086923 (+746957us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:39.153016 (+ 66093us) log.cc:844] Serialized 26 byte log entry
0709 12:28:39.175527 (+ 22511us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:39.175593 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:39.175715 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:39.671735 (+496020us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:39.716173 (+ 44438us) raft_consensus.cc:1685] finished
0709 12:28:39.716259 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:39.716390 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51296,"raft.queue_time_us":93312,"raft.run_cpu_time_us":467,"raft.run_wall_time_us":116087,"spinlock_wait_cycles":24647936,"thread_start_us":691069,"threads_started":1,"wal-append.queue_time_us":946846}
I20260709 12:28:39.759414  3931 rpcz_store.cc:276] 0709 12:28:38.734381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.745136 (+1010755us) service_pool.cc:224] Handling call
0709 12:28:39.745456 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:39.746168 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:39.746368 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:39.755559  7449 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:39.761202  3931 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:28:39.769016  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2459) took 1034 ms. Trace:
W20260709 12:28:39.768502  3851 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.013s	sys 0.023s
I20260709 12:28:39.769480  3931 rpcz_store.cc:276] 0709 12:28:38.734775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.760406 (+1025631us) service_pool.cc:224] Handling call
0709 12:28:39.760806 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:39.768748 (+  7942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:39.768961 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:39.771136  3931 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:28:39.771905  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2462) took 1036 ms. Trace:
I20260709 12:28:39.772351  3931 rpcz_store.cc:276] 0709 12:28:38.735694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.770460 (+1034766us) service_pool.cc:224] Handling call
0709 12:28:39.770744 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:39.771635 (+   891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:39.771848 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:39.770301  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 937) took 1594 ms. Trace:
I20260709 12:28:39.779161  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1907) took 1036 ms. Trace:
I20260709 12:28:39.779583  3931 rpcz_store.cc:276] 0709 12:28:38.737508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.773271 (+1035763us) service_pool.cc:224] Handling call
0709 12:28:39.773583 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:39.773794 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:39.773831 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:39.773913 (+    82us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:39.773968 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:39.774045 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:39.774187 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:39.727303  7582 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:39.764621  7738 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.023s	sys 0.023s
W20260709 12:28:39.802708  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.923688  3895 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:39.774767  3851 rpcz_store.cc:276] 0709 12:28:38.176126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.187169 (+ 11043us) service_pool.cc:224] Handling call
0709 12:28:38.187604 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:38.228142 (+ 40538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:38.228188 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:38.238146 (+  9958us) log.cc:844] Serialized 26 byte log entry
0709 12:28:38.618419 (+380273us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:39.011145 (+392726us) log.cc:844] Serialized 14 byte log entry
0709 12:28:39.769763 (+758618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:39.769899 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:39.769961 (+    62us) raft_consensus.cc:1685] finished
0709 12:28:39.769980 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:39.770224 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40077,"prepare.queue_time_us":425836,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":209042,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":111861,"thread_start_us":1493453,"threads_started":3,"wal-append.queue_time_us":611924}
W20260709 12:28:39.929713  3823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.026s	sys 0.009s
W20260709 12:28:39.930200  3823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.026s	sys 0.009s
I20260709 12:28:39.930269  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:39.813766  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:39.931135  3851 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
W20260709 12:28:39.892922  3822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.028s	sys 0.033s
W20260709 12:28:39.932013  3822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.029s	sys 0.034s
I20260709 12:28:39.932305  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:39.932413  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 634018us
I20260709 12:28:39.932646  3895 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:39.892468  3926 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.013s	sys 0.023s
W20260709 12:28:39.933249  3926 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.014s	sys 0.024s
I20260709 12:28:39.811208  3931 raft_consensus.cc:1275] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:28:39.933317  3822 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:39.811784  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 90539.7us
I20260709 12:28:39.935551  3897 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:39.698505  7347 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:39.703344  7731 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:39.939832  3848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.008s	sys 0.025s
I20260709 12:28:39.939867  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1908) took 1202 ms. Trace:
I20260709 12:28:39.940681  3931 rpcz_store.cc:276] 0709 12:28:38.737799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.780545 (+1042746us) service_pool.cc:224] Handling call
0709 12:28:39.780809 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:39.934141 (+153332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:39.939806 (+  5665us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:28:39.940366  3848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.008s	sys 0.025s
W20260709 12:28:39.954281  4538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.003s	sys 0.054s
I20260709 12:28:39.954571  3851 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
W20260709 12:28:39.922695  7738 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.024s	sys 0.024s
W20260709 12:28:39.954739  4538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.003s	sys 0.054s
I20260709 12:28:39.841163  7383 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.955883  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:39.959805  3931 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:39.918681  7492 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:39.920261  7608 raft_consensus.cc:3055] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:39.782179  7596 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:39.844956  7654 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:39.962205  3927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.006s	sys 0.029s
I20260709 12:28:39.776558  7691 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:39.811002  7450 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:39.958930  7609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.030s	sys 0.034s
I20260709 12:28:39.839962  7800 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.923167  7607 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:39.969319  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1909) took 1158 ms. Trace:
W20260709 12:28:39.893323  7708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.004s	sys 0.049s
I20260709 12:28:39.970191  3851 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
W20260709 12:28:40.012074  7708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.004s	sys 0.050s
I20260709 12:28:40.012461  7708 raft_consensus.cc:697] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:39.865139  7462 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:40.013155  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:40.014068  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:40.013692  7708 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.010731  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:39.974799  3855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.005s	sys 0.012s
I20260709 12:28:39.840471  7440 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:39.841163  7789 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:39.979195  3927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.006s	sys 0.029s
I20260709 12:28:39.953856  3856 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
W20260709 12:28:39.955709  7700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.031s	sys 0.044s
I20260709 12:28:39.981943  3971 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:39.959321  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:39.881592  7774 consensus_queue.cc:1059] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.204s
I20260709 12:28:39.965207  7731 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:40.007627  3931 rpcz_store.cc:276] 0709 12:28:38.811184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.959339 (+1148155us) service_pool.cc:224] Handling call
0709 12:28:39.959640 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:39.968996 (+  9356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:39.969250 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:40.013259  7462 raft_consensus.cc:697] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:39.810555  7384 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.015537  4573 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
W20260709 12:28:40.015911  3855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.005s	sys 0.012s
I20260709 12:28:39.972338  7378 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.012853  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:40.004689  7801 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.020371  4001 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:40.022917  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:40.004648  7609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.030s	sys 0.034s
I20260709 12:28:40.027307  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:40.023900  7700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.031s	sys 0.044s
I20260709 12:28:40.023976  7440 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.046399  7806 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:40.048403  7662 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:39.970965  7347 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:40.049585  7795 consensus_queue.cc:1059] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:28:40.050782  7809 raft_consensus.cc:3055] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:40.051208  7809 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:40.051378  7790 log.cc:927] Time spent T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:28:40.051844  7347 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.052134  7809 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:40.053457  7809 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:40.036836  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:40.029218  4004 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:28:40.054200  3856 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:40.004261  7738 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.055135  7738 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.036895  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:40.056119  4565 raft_consensus.cc:2376] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10. Re-sending same reply.
I20260709 12:28:40.057219  7738 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.007916  7450 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.029868  7670 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:40.021520  7691 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:28:40.040859  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 81626.2us
I20260709 12:28:40.041198  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:40.007615  7492 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:40.043514  4003 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:40.045238  7609 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:28:40.029928  7558 consensus_meta.cc:287] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.552s	user 0.012s	sys 0.000s
W20260709 12:28:40.052703  7794 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:28:39.976518  7608 raft_consensus.cc:740] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:39.984414  7596 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.110474  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:40.107936  7593 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:40.002993  7654 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.029654  7731 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:40.132150  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:40.020902  7237 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:28:40.057987  7450 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:39.981010  7383 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.141059  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:40.145429  7789 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:40.146414  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:40.210554  4570 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:40.147153  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 943) took 1919 ms. Trace:
W20260709 12:28:40.147755  7671 consensus_meta.cc:287] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.002s
I20260709 12:28:40.148077  3856 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:28:40.148953  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 213571us
I20260709 12:28:40.115355  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:40.151400  3929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.011s	sys 0.028s
I20260709 12:28:40.165931  7593 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:40.121743  7691 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:40.130795  7609 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:40.169708  7449 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.224162  4536 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:40.022011  7800 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:40.147017  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:40.227762  4536 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:40.212584  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:40.228322  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 81381.6us
W20260709 12:28:40.228729  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:40.229177  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:40.229444  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:40.213358  4003 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
W20260709 12:28:40.214474  3929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.012s	sys 0.028s
I20260709 12:28:40.214295  3897 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:40.213321  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2366) took 1713 ms. Trace:
W20260709 12:28:40.165764  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:40.211139  3848 rpcz_store.cc:276] 0709 12:28:38.227491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.296167 (+1068676us) service_pool.cc:224] Handling call
0709 12:28:39.297125 (+   958us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:39.303957 (+  6832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:39.303988 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:39.310677 (+  6689us) log.cc:844] Serialized 26 byte log entry
0709 12:28:39.942312 (+631635us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:39.942350 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:39.942428 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:40.146932 (+204504us) raft_consensus.cc:1685] finished
0709 12:28:40.146952 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:40.147094 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1296,"raft.queue_time_us":167165,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":593605,"threads_started":1,"wal-append.queue_time_us":760549}
I20260709 12:28:40.231663  4003 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:40.171957  7731 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:40.042208  7384 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.169570  7440 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.135733  7492 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:40.232352  3856 rpcz_store.cc:276] 0709 12:28:38.499702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.054802 (+1555100us) service_pool.cc:224] Handling call
0709 12:28:40.147744 (+ 92942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.212979 (+ 65235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.213248 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:40.234097  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:40.218082  7593 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:40.236666  4536 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:40.078120  7801 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.218863  7558 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.234339  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:40.237555  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:40.244026  3848 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:40.242479  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:40.239724  7449 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:40.221911  7609 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:40.240979  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:40.247654  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:40.255439  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 322849us
I20260709 12:28:40.246987  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:40.221112  7691 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:40.246141  3856 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:28:40.248468  3848 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:28:40.186146  7683 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.308964  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2369) took 1711 ms. Trace:
I20260709 12:28:40.261984  4574 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:40.312633  3848 rpcz_store.cc:276] 0709 12:28:38.597559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.247935 (+1650376us) service_pool.cc:224] Handling call
0709 12:28:40.248200 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.308705 (+ 60505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.308904 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:28:40.316085  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:40.321043  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:40.239269  7789 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:40.322448  3822 leader_election.cc:400] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7.
I20260709 12:28:40.246762  7738 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:40.239727  7803 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:28:40.237388  7785 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.012s	sys 0.052s
I20260709 12:28:40.188701  7462 consensus_queue.cc:237] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:40.323761  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:40.310003  7796 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.242017  7273 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:40.314132  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2368) took 1717 ms. Trace:
I20260709 12:28:40.317149  7795 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.248004  7632 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.261351  7671 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.330004  3822 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:40.378183  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 48276.5us
I20260709 12:28:40.326817  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:40.263569  7558 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:40.318517  7347 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:40.319886  3895 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:40.334569  3856 rpcz_store.cc:276] 0709 12:28:38.596887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.245345 (+1648458us) service_pool.cc:224] Handling call
0709 12:28:40.245715 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.313870 (+ 68155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.314081 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:40.323230  7780 raft_consensus.cc:3055] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:40.324581  7789 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:40.325433  7449 raft_consensus.cc:697] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:40.329037  7785 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.012s	sys 0.053s
I20260709 12:28:40.334398  7273 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:40.329275  7811 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:40.400452  3856 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:28:40.366688  7519 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:40.328577  7825 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:40.339037  7796 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.328150  7738 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:40.396380  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 76570.6us
W20260709 12:28:40.394510  7813 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:28:40.331195  7803 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:40.416920  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:40.365444  7806 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:40.401779  7785 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:40.428496  7808 log.cc:927] Time spent T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.292s	user 0.001s	sys 0.001s
I20260709 12:28:40.494379  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2370) took 1894 ms. Trace:
I20260709 12:28:40.399711  7789 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:40.430346  7273 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:40.382652  7823 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:40.422204  7780 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:40.505091  3856 rpcz_store.cc:276] 0709 12:28:38.600409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.399755 (+1799346us) service_pool.cc:224] Handling call
0709 12:28:40.400066 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.428432 (+ 28366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.494310 (+ 65878us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:40.402361  7596 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.443820  7738 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:40.393455  7671 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.493824  7753 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.401520  7347 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.523435  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:40.512180  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 682) took 2409 ms. Trace:
W20260709 12:28:40.501547  7409 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.009s	sys 0.043s
I20260709 12:28:40.443576  7825 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.451625  7654 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.529598  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.493909  7803 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:40.533613  3856 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:40.533607  4006 rpcz_store.cc:276] 0709 12:28:38.098460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.112298 (+ 13838us) service_pool.cc:224] Handling call
0709 12:28:38.323267 (+210969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:38.323507 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:38.323544 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:38.323601 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:28:38.323654 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.323750 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:40.507848 (+2184098us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b540036e550. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:40.508032 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484445056}
I20260709 12:28:40.509984  7450 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.505424  7811 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:40.399631  7824 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:40.388744  7795 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.494697  7700 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 12:28:40.551128  3848 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:40.532388  7383 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:40.548537  7818 log.cc:927] Time spent T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 12:28:40.628407  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.629312  3932 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:40.505649  7806 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:40.631376  3923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 1896) took 2280 ms (client timeout 1852 ms). Trace:
W20260709 12:28:40.556169  7816 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 12:28:40.635447  3923 rpcz_store.cc:269] 0709 12:28:38.350555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.364827 (+ 14272us) service_pool.cc:224] Handling call
0709 12:28:40.631124 (+2266297us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b54000e8dd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:40.631269 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77666688}
I20260709 12:28:40.636557  3924 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:40.536163  7596 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:28:40.637660  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2364) took 2138 ms. Trace:
I20260709 12:28:40.547870  7824 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:40.661120  3851 rpcz_store.cc:276] 0709 12:28:38.499129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.047254 (+1548125us) service_pool.cc:224] Handling call
0709 12:28:40.047535 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.047727 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:40.048003 (+   276us) log.cc:844] Serialized 14 byte log entry
0709 12:28:40.636651 (+588648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:40.636709 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:40.637306 (+   597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.637404 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:40.637583 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13529,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":8805,"raft.queue_time_us":93665,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8184,"spinlock_wait_cycles":5967232,"thread_start_us":586432,"threads_started":2,"wal-append.queue_time_us":500835}
W20260709 12:28:40.652565  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:40.553153  7812 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:28:40.499974  7822 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.178s
I20260709 12:28:40.659950  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.558316  7823 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.669492  3851 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:28:40.603530  7800 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.670264  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2372) took 1644 ms. Trace:
I20260709 12:28:40.630115  7450 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.670796  3851 rpcz_store.cc:276] 0709 12:28:39.026360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.663657 (+1637297us) service_pool.cc:224] Handling call
0709 12:28:40.664070 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.670001 (+  5931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.670207 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:40.539427  7753 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:40.678911  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 241234us
I20260709 12:28:40.679999  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.657582  7384 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:40.657045  7492 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.657788  7683 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.671373  7716 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.666934  7801 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.692692  7347 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.690079  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.554006  7449 consensus_queue.cc:237] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.699975  3923 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:40.687525  7800 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:40.697531  7819 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
I20260709 12:28:40.660936  7785 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.714700  7706 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.682596  7450 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:40.713775  7825 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.716254  7753 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:40.718073  7800 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:40.726178  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.726373  7806 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.717682  7609 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.725807  7789 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:40.730423  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.773958  3930 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:40.737425  4536 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:40.711084  7683 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 12:28:40.742218  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:40.742417  4002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 686) took 2564 ms (client timeout 2831 ms). Trace:
I20260709 12:28:40.667511  7824 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:40.746215  7821 log.cc:927] Time spent T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.309s	user 0.000s	sys 0.002s
I20260709 12:28:40.746914  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:40.776548  4002 rpcz_store.cc:269] 0709 12:28:38.177788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.178042 (+   254us) service_pool.cc:224] Handling call
0709 12:28:40.742235 (+2564193us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b540032b254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:40.742339 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1188792576}
I20260709 12:28:40.747828  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 880) took 2245 ms. Trace:
I20260709 12:28:40.741756  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.750619  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 879) took 2248 ms. Trace:
I20260709 12:28:40.751645  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2404) took 2115 ms. Trace:
I20260709 12:28:40.752157  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1954) took 1747 ms. Trace:
I20260709 12:28:40.753252  7463 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.754518  7440 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.755296  7795 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.769840  3923 raft_consensus.cc:2410] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:28:40.710067  7558 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.779870  4005 rpcz_store.cc:276] 0709 12:28:38.636301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.636430 (+   129us) service_pool.cc:224] Handling call
0709 12:28:38.653637 (+ 17207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:38.878020 (+224383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.751406 (+1873386us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540021acd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:40.751583 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294407424}
I20260709 12:28:40.638163  7780 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.694199  7817 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.346s
I20260709 12:28:40.676021  7823 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:40.789137  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 882) took 1757 ms. Trace:
I20260709 12:28:40.777549  3927 rpcz_store.cc:276] 0709 12:28:38.502799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.400525 (+897726us) service_pool.cc:224] Handling call
0709 12:28:39.400901 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:39.401368 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:39.401686 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 12:28:40.324305 (+922619us) log.cc:844] Serialized 14 byte log entry
0709 12:28:40.332341 (+  8036us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:40.366279 (+ 33938us) log.cc:844] Serialized 26 byte log entry
0709 12:28:40.366443 (+   164us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:40.366484 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.377489 (+ 11005us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:40.747593 (+370104us) raft_consensus.cc:1685] finished
0709 12:28:40.747619 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:40.747760 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7650,"prepare.queue_time_us":503725,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":4053,"raft.queue_time_us":38418,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":16480,"spinlock_wait_cycles":21034752,"thread_start_us":917987,"threads_started":2,"wal-append.queue_time_us":735223}
I20260709 12:28:40.785065  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.702126  7716 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.786423  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.784236  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 941) took 2582 ms. Trace:
I20260709 12:28:40.779966  3856 rpcz_store.cc:276] 0709 12:28:39.004479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.544518 (+1540039us) service_pool.cc:224] Handling call
0709 12:28:40.544888 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.545156 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:40.559536 (+ 14380us) log.cc:844] Serialized 14 byte log entry
0709 12:28:40.751848 (+192312us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:40.751898 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:40.751949 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.752009 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:40.752102 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":55351,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":50349,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":78,"thread_start_us":141420,"threads_started":1}
I20260709 12:28:40.793613  3853 rpcz_store.cc:276] 0709 12:28:38.202310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.984495 (+782185us) service_pool.cc:224] Handling call
0709 12:28:38.984783 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:39.455376 (+470593us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:39.563803 (+108427us) log.cc:844] Serialized 14 byte log entry
0709 12:28:40.027073 (+463270us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:40.048287 (+ 21214us) log.cc:844] Serialized 26 byte log entry
0709 12:28:40.048466 (+   179us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:40.048514 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.048615 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:40.783981 (+735366us) raft_consensus.cc:1685] finished
0709 12:28:40.784009 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:40.784165 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22542,"prepare.queue_time_us":109366,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":63,"raft.queue_time_us":160440,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":42787,"thread_start_us":880509,"threads_started":2,"wal-append.queue_time_us":616748}
I20260709 12:28:40.777041  3852 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:40.779667  3926 rpcz_store.cc:276] 0709 12:28:38.502417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.060830 (+558413us) service_pool.cc:224] Handling call
0709 12:28:39.081639 (+ 20809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:39.954151 (+872512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:39.954198 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:39.962202 (+  8004us) log.cc:844] Serialized 26 byte log entry
0709 12:28:40.501831 (+539629us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:40.501868 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.501954 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:40.750395 (+248441us) raft_consensus.cc:1685] finished
0709 12:28:40.750414 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:40.750565 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":171940,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":24662,"thread_start_us":1347726,"threads_started":2,"wal-append.queue_time_us":701144}
I20260709 12:28:40.790215  3931 rpcz_store.cc:276] 0709 12:28:39.032038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.030361 (+998323us) service_pool.cc:224] Handling call
0709 12:28:40.030708 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.030969 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:28:40.430811 (+399842us) log.cc:844] Serialized 14 byte log entry
0709 12:28:40.788739 (+357928us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:40.788797 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:28:40.788852 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.788928 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:40.789077 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":518944,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":833,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":739318,"threads_started":2}
I20260709 12:28:40.796636  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.798532  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.797350  4536 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:40.797508  3930 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:40.783632  7384 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:40.802680  3853 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:40.803454  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 948) took 1757 ms. Trace:
I20260709 12:28:40.803835  3853 rpcz_store.cc:276] 0709 12:28:39.046040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.795863 (+1749823us) service_pool.cc:224] Handling call
0709 12:28:40.796128 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.803205 (+  7077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.803401 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:40.807226  7823 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.807715  3852 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:40.808326  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 1956) took 1507 ms. Trace:
W20260709 12:28:40.796515  7662 consensus_meta.cc:287] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.748s	user 0.012s	sys 0.000s
I20260709 12:28:40.809268  7483 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:40.809986  3850 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:28:40.810323  3850 pending_rounds.cc:85] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 7
I20260709 12:28:40.810532  3850 pending_rounds.cc:107] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:28:40.810748  3850 raft_consensus.cc:2889] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:40.790001  7691 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:40.808631  3852 rpcz_store.cc:276] 0709 12:28:39.301487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.796117 (+1494630us) service_pool.cc:224] Handling call
0709 12:28:40.807548 (+ 11431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.808099 (+   551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.808276 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:40.816262  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.817178  3931 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:40.812187  3853 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:28:40.813338  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.818341  3927 raft_consensus.cc:2393] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:40.818295  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.819052  3931 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:40.819329  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.819993  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.820317  3927 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:40.820909  3931 raft_consensus.cc:2393] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:40.821377  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.815137  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.822373  3931 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:40.823792  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 884) took 1791 ms. Trace:
I20260709 12:28:40.792140  7807 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:40.755604  7803 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.825837  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:40.840772  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:40.850389  3852 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:28:40.855890  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:40.800949  7780 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:40.826136  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 949) took 1209 ms. Trace:
I20260709 12:28:40.857575  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1906) took 2303 ms. Trace:
I20260709 12:28:40.857969  3853 rpcz_store.cc:276] 0709 12:28:39.616505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.804418 (+1187913us) service_pool.cc:224] Handling call
0709 12:28:40.804690 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.817967 (+ 13277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.826065 (+  8098us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:40.858613  3929 rpcz_store.cc:276] 0709 12:28:38.553833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.487919 (+934086us) service_pool.cc:224] Handling call
0709 12:28:39.488421 (+   502us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:39.488949 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:39.489004 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:39.502115 (+ 13111us) log.cc:844] Serialized 52 byte log entry
0709 12:28:40.238200 (+736085us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:40.539728 (+301528us) log.cc:844] Serialized 14 byte log entry
0709 12:28:40.539924 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.539993 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:40.857347 (+317354us) raft_consensus.cc:1685] finished
0709 12:28:40.857368 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:40.857512 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":421348,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":2653,"raft.queue_time_us":26627,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":16377,"thread_start_us":878969,"threads_started":2,"wal-append.queue_time_us":750654}
I20260709 12:28:40.814779  7384 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:40.815860  7811 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.816151  7753 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.788708  7440 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.807221  7716 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.823347  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 883) took 1791 ms. Trace:
I20260709 12:28:40.811920  7383 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:40.889521  3931 rpcz_store.cc:276] 0709 12:28:39.032305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.821640 (+1789335us) service_pool.cc:224] Handling call
0709 12:28:40.821984 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.822829 (+   845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.823292 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:40.866678  7464 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.867538  7800 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.867911  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1897) took 2495 ms. Trace:
I20260709 12:28:40.874738  7609 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.875352  7671 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.875883  7450 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:40.877928  7731 consensus_meta.cc:287] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.000s
I20260709 12:28:40.824169  3930 rpcz_store.cc:276] 0709 12:28:39.032551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.822863 (+1790312us) service_pool.cc:224] Handling call
0709 12:28:40.823205 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.823418 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:40.823455 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:40.823509 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:40.823563 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.823633 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:40.823746 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:40.864820  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 950) took 1245 ms. Trace:
I20260709 12:28:40.826141  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 944) took 2590 ms. Trace:
W20260709 12:28:40.878438  7727 consensus_meta.cc:287] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.161s	user 0.014s	sys 0.000s
I20260709 12:28:40.923200  3925 rpcz_store.cc:276] 0709 12:28:38.372678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.375579 (+  2901us) service_pool.cc:224] Handling call
0709 12:28:39.471572 (+1095993us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:39.472275 (+   703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.867733 (+1395458us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000efbd0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:40.867858 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2519390464}
I20260709 12:28:40.865131  7384 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:40.925400  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:40.923401  7607 consensus_meta.cc:287] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.902s	user 0.010s	sys 0.002s
I20260709 12:28:40.925354  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2378) took 1299 ms. Trace:
I20260709 12:28:40.928885  3852 rpcz_store.cc:276] 0709 12:28:39.616893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.816787 (+1199894us) service_pool.cc:224] Handling call
0709 12:28:40.817063 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.856850 (+ 39787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.862074 (+  5224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:40.934124  3927 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:40.934748  3856 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:40.934926  3852 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:28:40.928954  3855 rpcz_store.cc:276] 0709 12:28:38.235842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.422947 (+1187105us) service_pool.cc:224] Handling call
0709 12:28:39.436033 (+ 13086us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:39.436387 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:39.446234 (+  9847us) log.cc:844] Serialized 14 byte log entry
0709 12:28:40.041511 (+595277us) log.cc:844] Serialized 14 byte log entry
0709 12:28:40.509326 (+467815us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:40.509846 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 12:28:40.510012 (+   166us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:40.510051 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.510110 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:40.825857 (+315747us) raft_consensus.cc:1685] finished
0709 12:28:40.825901 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:40.826065 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104515,"prepare.queue_time_us":9060,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":1574,"raft.queue_time_us":64401,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":250,"thread_start_us":1057174,"threads_started":2,"wal-append.queue_time_us":775504}
I20260709 12:28:40.935559  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 952) took 1242 ms. Trace:
I20260709 12:28:40.934002  3853 rpcz_store.cc:276] 0709 12:28:39.626097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.887719 (+1261622us) service_pool.cc:224] Handling call
0709 12:28:40.924142 (+ 36423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.924384 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:40.924423 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:40.924477 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:40.924543 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.924615 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:40.925256 (+   641us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:40.874778  7789 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.919488  7383 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:40.935986  3852 rpcz_store.cc:276] 0709 12:28:39.692950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.934300 (+1241350us) service_pool.cc:224] Handling call
0709 12:28:40.934618 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.935339 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.935509 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:40.977717  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 942) took 2759 ms. Trace:
I20260709 12:28:40.890862  7654 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:28:40.978137  3850 rpcz_store.cc:276] 0709 12:28:38.218014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.068763 (+850749us) service_pool.cc:224] Handling call
0709 12:28:39.069146 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.811187 (+1742041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.977532 (+166345us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54002eed54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:40.977671 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4002763136}
I20260709 12:28:40.980140  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:40.978546  7383 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:40.934722  7683 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.984613  7683 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:40.971172  7828 log.cc:927] Time spent T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.314s	user 0.003s	sys 0.000s
I20260709 12:28:40.944664  7824 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:40.986761  3928 raft_consensus.cc:2393] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:40.987617  7683 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.963760  7273 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.989019  7710 raft_consensus.cc:3055] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:40.989429  7710 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:40.966961  7691 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.990406  7273 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:40.990274  7710 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.992013  7691 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:40.992511  7691 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.993335  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:40.994197  3928 raft_consensus.cc:2410] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:28:40.994617  7691 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.971139  7738 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.933104  7731 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:40.996798  7731 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.973353  7803 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:40.974366  7796 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.974736  7440 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:40.975291  3857 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:40.999051  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1955) took 1994 ms. Trace:
I20260709 12:28:40.999286  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:40.999367  3857 rpcz_store.cc:276] 0709 12:28:39.004945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.024762 (+ 19817us) service_pool.cc:224] Handling call
0709 12:28:40.998909 (+1974147us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54001e7654. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:40.999000 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4470003968}
I20260709 12:28:41.000957  3857 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
W20260709 12:28:40.975659  7809 consensus_meta.cc:287] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.922s	user 0.010s	sys 0.003s
I20260709 12:28:41.002061  7608 consensus_queue.cc:260] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.008508  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:41.005497  7738 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:41.012080  3928 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:40.886940  7811 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:40.941756  7593 consensus_meta.cc:287] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.679s	user 0.008s	sys 0.000s
I20260709 12:28:40.987793  7824 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:40.888794  7753 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:40.961809  7774 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.010887  3923 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:41.014416  7803 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:28:41.030350  7803 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:40.939411  7483 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:41.036484  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:41.042898  3970 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:41.044687  3970 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:41.046223  3970 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:41.049443  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:41.050144  3857 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:41.032048  7803 consensus_queue.cc:1059] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:28:41.028014  7719 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.028249  7586 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.027693  7738 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:41.052664  7772 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:41.033365  7850 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:28:41.065977  7753 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:41.047063  7843 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.068701  3857 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:41.054596  7670 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:41.035312  7593 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.060547  7409 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:41.033090  7774 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.064136  7586 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.067127  7772 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.053308  7671 consensus_queue.cc:1048] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:28:41.062940  7719 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:41.205895  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.318785  4005 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
W20260709 12:28:41.253446  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:41.253532  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:41.321694  4002 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:41.075338  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:41.100095  7847 log.cc:927] Time spent T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:28:41.073935  7738 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:41.071871  7670 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:41.318274  7851 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:28:41.294166  7273 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.358642  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 954) took 1665 ms. Trace:
I20260709 12:28:41.359365  3853 rpcz_store.cc:276] 0709 12:28:39.693558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.936209 (+1242651us) service_pool.cc:224] Handling call
0709 12:28:40.978957 (+ 42748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.979165 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:28:41.015658 (+ 36493us) log.cc:844] Serialized 14 byte log entry
0709 12:28:41.358134 (+342476us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:41.358183 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:41.358248 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:41.358438 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:41.358572 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38269,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":5352,"raft.queue_time_us":352,"thread_start_us":342124,"threads_started":1}
I20260709 12:28:41.098961  7383 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.369167  4002 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:41.354568  7593 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:41.357265  7831 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.358457  7670 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:41.366631  7738 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:41.431177  7586 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:41.374656  7273 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.087849  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:41.456609  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:41.468604  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.465036  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2373) took 2438 ms. Trace:
I20260709 12:28:41.469480  3851 rpcz_store.cc:276] 0709 12:28:39.026985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.674584 (+1647599us) service_pool.cc:224] Handling call
0709 12:28:40.674836 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:40.808122 (+133286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:40.808155 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:40.808543 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 12:28:40.890607 (+ 82064us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:40.890650 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:41.437617 (+546967us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54002a2bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:41.437686 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:41.437754 (+    68us) raft_consensus.cc:1685] finished
0709 12:28:41.437774 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:41.464961 (+ 27187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1401,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":80,"spinlock_wait_cycles":305715456,"thread_start_us":81689,"threads_started":1,"wal-append.queue_time_us":167589}
I20260709 12:28:41.471252  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:41.472007  3851 raft_consensus.cc:2410] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:28:41.472818  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:41.474181  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.474784  4002 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:28:41.473735  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:41.415759  7831 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:41.535487  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:41.208598  7731 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.574436  7731 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.575743  3851 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:41.576849  7731 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:41.074445  7409 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.578166  7409 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:41.579789  7738 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:41.584607  7384 consensus_meta.cc:287] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.579s	user 0.002s	sys 0.006s
I20260709 12:28:41.585000  7384 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.158105  7796 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.589205  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.464210  7772 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:41.072958  7843 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:41.094136  7809 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:41.568070  7719 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:41.634614  4002 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:41.102069  7856 consensus_queue.cc:1059] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.524s
I20260709 12:28:41.627734  7796 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.627298  7384 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:41.629856  7843 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:41.648542  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.652645  3997 raft_consensus.cc:2393] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:41.654228  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.655067  4006 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
W20260709 12:28:41.650787  7753 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.026s	sys 0.043s
I20260709 12:28:41.663188  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.663715  4001 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:41.666756  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.667387  3997 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:41.675549  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:41.662798  7753 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.027s	sys 0.043s
I20260709 12:28:41.649427  7809 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.684851  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.685501  3997 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:41.692281  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.692981  3997 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:41.692759  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:41.693732  3852 raft_consensus.cc:2368] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9.
I20260709 12:28:41.695551  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:41.697278  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.697947  3997 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:41.686741  7731 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:41.700563  4565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 1024) took 1691 ms (client timeout 1569 ms). Trace:
W20260709 12:28:41.700924  4565 rpcz_store.cc:269] 0709 12:28:40.009649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.009977 (+   328us) service_pool.cc:224] Handling call
0709 12:28:41.700408 (+1690431us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b540052ab54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:41.700509 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97297792}
I20260709 12:28:41.702533  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:41.703028  3852 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:41.708904  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:41.709770  3997 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:28:41.710479  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 243961us
I20260709 12:28:41.730234  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1017) took 3653 ms. Trace:
W20260709 12:28:41.732662  3969 connection.cc:256] RPC call timeout handler was delayed by -1.5945226280000497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
W20260709 12:28:41.733688  3969 connection.cc:256] RPC call timeout handler was delayed by -1.5018226279998999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 12:28:41.740036  3969 connection.cc:256] RPC call timeout handler was delayed by -1.0959226280001531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2405s for a response
I20260709 12:28:41.730634  4569 rpcz_store.cc:276] 0709 12:28:38.072097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.107250 (+ 35153us) service_pool.cc:224] Handling call
0709 12:28:38.107599 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:38.404354 (+296755us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:38.825197 (+420843us) log.cc:844] Serialized 14 byte log entry
0709 12:28:39.465190 (+639993us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:39.465240 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:39.465301 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:41.704270 (+2238969us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b18001213c0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeb82a6 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419
0709 12:28:41.725265 (+ 20995us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400490f54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:41.725325 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:41.725466 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1885,"prepare.queue_time_us":397587,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":2043,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":17983,"spinlock_wait_cycles":817267712,"thread_start_us":1050741,"threads_started":2,"wal-append.queue_time_us":1057617,"wal-append.run_cpu_time_us":2127,"wal-append.run_wall_time_us":1155529}
I20260709 12:28:41.704227  7731 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:41.745867  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:41.746344  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.747323  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:41.747891  4006 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:41.748085  4003 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:28:41.750483  7864 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:28:41.750535  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:41.751394  3851 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:41.751124  7409 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:41.752358  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:41.752983  3851 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:41.754088  4001 raft_consensus.cc:2368] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9.
I20260709 12:28:41.716362  7273 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:41.754405  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:41.755089  3854 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
W20260709 12:28:41.755209  7834 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 1.085s	user 0.003s	sys 0.016s
I20260709 12:28:41.755925  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:41.756536  3854 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:41.757296  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:41.759344  7772 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:41.760687  3999 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
W20260709 12:28:41.760825  7866 log.cc:927] Time spent T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:28:41.762046  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 955) took 2068 ms. Trace:
I20260709 12:28:41.762403  3855 rpcz_store.cc:276] 0709 12:28:39.693840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.979607 (+1285767us) service_pool.cc:224] Handling call
0709 12:28:41.017001 (+ 37394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:41.032764 (+ 15763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:41.032810 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:41.044466 (+ 11656us) log.cc:844] Serialized 52 byte log entry
0709 12:28:41.451949 (+407483us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:41.452007 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:41.452102 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:41.761789 (+309687us) raft_consensus.cc:1685] finished
0709 12:28:41.761808 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:41.761987 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25427,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8138,"thread_start_us":385482,"threads_started":1,"wal-append.queue_time_us":603450}
I20260709 12:28:41.764219  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:41.765004  3855 raft_consensus.cc:2410] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:28:41.725726  7774 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:41.768849  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:41.769116  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:41.769425  4004 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:41.769680  3857 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:41.770342  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:41.770742  3857 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:28:41.771839  4003 raft_consensus.cc:1275] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:41.774873  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:41.775446  3923 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:41.776695  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:41.746493  7843 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.785032  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:41.787324  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:41.789227  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:41.790220  3928 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:41.796556  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:41.746361  7860 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:28:41.783877  7551 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:41.805995  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:41.798764  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:41.799824  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:41.738813  7586 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.813100  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:41.793540  4004 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:41.814998  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:41.815990  4569 raft_consensus.cc:2376] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9. Re-sending same reply.
I20260709 12:28:41.795863  7409 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:41.818892  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:41.819051  4569 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:28:41.819649  4567 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:41.815991  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:41.821707  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:41.821976  4569 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:28:41.798066  7831 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:41.802278  7796 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:41.825366  4570 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:41.797744  7440 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:28:41.795233  7843 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.876488  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:41.924767  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:41.830242  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:41.877857  4537 connection.cc:256] RPC call timeout handler was delayed by -1.3718470589997196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
I20260709 12:28:41.928148  4565 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:41.890607  3931 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:28:41.870091  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:41.930402  3929 raft_consensus.cc:2393] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:41.930495  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:41.925716  4006 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:41.877694  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:41.911687  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:41.932138  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.932685  3932 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:41.825796  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.933887  3931 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:41.934360  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.926563  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1918) took 1683 ms. Trace:
I20260709 12:28:41.935298  3926 rpcz_store.cc:276] 0709 12:28:40.242689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.859625 (+616936us) service_pool.cc:224] Handling call
0709 12:28:40.859900 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.860137 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:28:40.888003 (+ 27866us) log.cc:844] Serialized 14 byte log entry
0709 12:28:41.758183 (+870180us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b1800167f20. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b7723a 00007fe051fe1a2a
0709 12:28:41.926228 (+168045us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:41.926295 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:41.926338 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:41.926400 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:41.926510 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27633,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2403,"spinlock_wait_cycles":4448640,"thread_start_us":167724,"threads_started":1}
I20260709 12:28:41.929234  4537 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:41.931592  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:41.942162  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:41.942739  4006 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:41.816738  7856 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.951351  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:41.924144  7772 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:41.954882  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:41.956388  3928 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:28:41.956653  7670 consensus_meta.cc:287] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.001s
I20260709 12:28:41.957059  7670 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:41.958297  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:41.959127  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:41.959288  7670 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:41.814241  7586 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.868445  7595 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.962175  7595 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.961874  7586 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:41.894851  7809 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:41.826612  7853 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:41.968616  7853 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.894001  7486 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.964887  7673 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:41.970624  7486 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.868709  7409 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.972769  7409 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.883806  7483 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.973991  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:41.974357  7483 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:41.976420  4005 raft_consensus.cc:1240] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 12:28:41.977272  7867 log.cc:927] Time spent T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 12:28:41.952499  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:41.957643  3928 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:28:41.979054  3928 pending_rounds.cc:85] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 8
I20260709 12:28:41.979498  3928 pending_rounds.cc:107] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:28:41.979729  3928 raft_consensus.cc:2889] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:41.953780  4571 raft_consensus.cc:2393] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:41.953294  7857 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:41.824846  7384 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:41.992903  3852 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:41.999622  4004 raft_consensus.cc:2393] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 10: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:41.964628  3923 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
W20260709 12:28:41.994707  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 65561.7us
I20260709 12:28:41.979985  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.008982  4006 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:42.014546  7409 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:41.999059  7857 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:42.015592  7595 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:42.015703  7384 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.018291  4570 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:41.825723  7542 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.021513  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.021803  3928 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:42.022274  4004 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:42.023344  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:42.026595  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.026883  3932 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:42.018234  3969 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:42.018580  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:42.028272  3923 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:42.027598  4006 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:42.028851  3997 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:42.039897  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.040540  3969 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:42.040895  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.041101  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.041522  4005 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:28:42.041692  4004 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:42.041712  3969 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:42.042721  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.043292  4005 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:42.043630  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:42.043913  4538 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.977s (SENT) [suppressed 7 similar messages]
I20260709 12:28:42.046747  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.047322  7772 consensus_queue.cc:1059] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:42.047981  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.048784  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.049028  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:42.047906  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:42.020968  7384 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:42.053042  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.054025  7543 raft_consensus.cc:3055] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:42.054404  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:42.054446  7543 raft_consensus.cc:740] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:42.054787  7853 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:41.993427  7856 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.055541  7543 consensus_queue.cc:260] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.056205  7383 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:42.015563  7857 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:42.056828  7543 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:42.057339  7856 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:42.058130  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2455) took 3460 ms. Trace:
I20260709 12:28:42.058769  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2465) took 1743 ms. Trace:
I20260709 12:28:42.059260  3927 rpcz_store.cc:276] 0709 12:28:40.315429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.821067 (+505638us) service_pool.cc:224] Handling call
0709 12:28:42.058613 (+1237546us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54000ef6d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:42.058712 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257393408}
I20260709 12:28:42.058166  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.060431  4567 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:42.060724  4006 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:42.055230  7843 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:42.048316  7774 raft_consensus.cc:3055] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:42.058497  3924 rpcz_store.cc:276] 0709 12:28:38.597978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.594457 (+996479us) service_pool.cc:224] Handling call
0709 12:28:40.631861 (+1037404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.659390 (+ 27529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:42.057934 (+1398544us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000e8dd0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:42.058057 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336783232}
I20260709 12:28:42.020998  7440 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:42.066574  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.061127  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.067437  4005 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:42.064594  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:42.068447  3924 raft_consensus.cc:2410] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 10 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:28:42.070333  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:42.065627  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.074811  3969 leader_election.cc:400] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9.
I20260709 12:28:42.046352  7409 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:42.050066  7595 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:42.075764  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:42.076006  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:42.061213  7772 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:42.078644  4005 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:28:42.079129  3969 leader_election.cc:403] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:28:42.078220  4004 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:28:42.062314  7774 raft_consensus.cc:740] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:42.040431  7542 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:42.090180  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 351056us
I20260709 12:28:42.099447  4005 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:28:42.099597  4004 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:28:42.100478  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 226303us
I20260709 12:28:42.049937  7670 consensus_queue.cc:1048] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:28:42.138818  4001 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:28:42.154915  4006 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:28:42.216660  4571 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:42.218757  3854 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:28:42.161448  3971 connection.cc:256] RPC call timeout handler was delayed by -1.442644723000285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
I20260709 12:28:42.237560  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:42.149609  4002 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:42.238229  3853 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:42.240418  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:42.101266  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:42.125317  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.238937  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:42.243930  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 142761us
I20260709 12:28:42.237440  3971 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:42.219758  4536 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:42.075646  7486 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:42.262331  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:42.264895  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:28:42.264014  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 44384.9us
I20260709 12:28:42.258330  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.192216  3744 maintenance_manager.cc:419] P a21ae62b873f4aa28d9c28a3b1bc7936: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033363
W20260709 12:28:42.131218  7768 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 3.101s	user 0.009s	sys 0.003s
I20260709 12:28:42.271095  7273 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:42.274163  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.274375  7774 consensus_queue.cc:260] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.076272  7440 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.275197  4001 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:28:42.178995  7698 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.277595  3969 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:42.256186  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.131389  7720 raft_consensus.cc:3055] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:42.174422  7772 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.286104  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.262027  7595 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:42.287283  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.286691  4005 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:42.126293  7586 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:42.143611  7632 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:42.121585  7409 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9.
I20260709 12:28:42.240135  7853 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:42.300572  3821 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:42.302738  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:42.305835  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:42.285676  7551 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:42.285524  7843 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:42.341097  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 947) took 3297 ms. Trace:
I20260709 12:28:42.327375  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:42.341782  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:42.309180  3971 leader_election.cc:336] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Timed out: RequestConsensusVote RPC to 127.2.157.4:41095 timed out after 1.569s (SENT)
I20260709 12:28:42.250937  7738 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:28:42.333963  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2401) took 3347 ms. Trace:
I20260709 12:28:42.341789  3856 rpcz_store.cc:276] 0709 12:28:39.043381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.794010 (+1750629us) service_pool.cc:224] Handling call
0709 12:28:40.794388 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:40.957117 (+162729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:42.340802 (+1383685us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54001e7154. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:42.341028 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320302336}
I20260709 12:28:42.331313  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 681) took 4233 ms. Trace:
I20260709 12:28:42.343148  3971 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:42.310526  3969 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:42.317237  3821 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:42.307962  7673 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.308153  7853 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.403206  7673 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:42.404698  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 87550.5us
I20260709 12:28:42.404882  7853 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:42.326664  7632 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:42.340696  7486 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:42.336860  7668 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:42.288457  7720 raft_consensus.cc:740] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:42.295908  7595 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.296589  7753 raft_consensus.cc:2764] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:28:42.408578  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 362321us
I20260709 12:28:42.344619  3822 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:42.409623  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 100449us
I20260709 12:28:42.379689  3998 rpcz_store.cc:276] 0709 12:28:38.986466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.010798 (+ 24332us) service_pool.cc:224] Handling call
0709 12:28:39.011250 (+   452us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:28:40.737925 (+1726675us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b1800361180. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe051b7f4bc 00007fe04eecd48b 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee7455 00007fe051fcf060 00007fe051fcfbfb 00007fe051fda64b
0709 12:28:40.738070 (+   145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:40.738094 (+    24us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:28:40.738741 (+   647us) log.cc:844] Serialized 78 byte log entry
0709 12:28:40.922552 (+183811us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:40.935135 (+ 12583us) log.cc:844] Serialized 14 byte log entry
0709 12:28:40.962086 (+ 26951us) log.cc:844] Serialized 14 byte log entry
0709 12:28:40.962291 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:40.962355 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:42.331205 (+1368850us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b1800361180. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:28:42.333735 (+  2530us) raft_consensus.cc:1685] finished
0709 12:28:42.333753 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:42.333906 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126072,"prepare.queue_time_us":19714,"raft.queue_time_us":117687,"raft.run_cpu_time_us":462,"raft.run_wall_time_us":45383,"spinlock_wait_cycles":86982912,"thread_start_us":414945,"threads_started":2,"wal-append.queue_time_us":203149}
I20260709 12:28:42.290413  7273 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:42.381265  4000 rpcz_store.cc:276] 0709 12:28:38.098070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.098225 (+   155us) service_pool.cc:224] Handling call
0709 12:28:38.098720 (+   495us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:28:38.111584 (+ 12864us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:38.431275 (+319691us) log.cc:844] Serialized 14 byte log entry
0709 12:28:38.656010 (+224735us) spinlock_profiling.cc:243] Waited 92.6 ms on lock 0x7b4800062358. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe056f00aa1 00007fe056ef7b37 00007fe056ef79ca 00007fe056fef26f 00007fe056feef37 00007fe05700355c 00007fe057003508 00007fe057003488 00007fe057003443 00007fe0570026ec 00007fe055f2ca96
0709 12:28:38.817228 (+161218us) log.cc:844] Serialized 14 byte log entry
0709 12:28:38.839596 (+ 22368us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:38.847578 (+  7982us) log.cc:844] Serialized 52 byte log entry
0709 12:28:38.848758 (+  1180us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:38.848800 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:38.848883 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:40.964074 (+2115191us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b180048f5e0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea522 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:28:42.097832 (+1133758us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:42.331093 (+233261us) raft_consensus.cc:1685] finished
0709 12:28:42.331112 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:42.331235 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90666,"prepare.queue_time_us":379849,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":1402,"raft.queue_time_us":353431,"raft.run_cpu_time_us":4117,"raft.run_wall_time_us":552526,"spinlock_wait_cycles":264653568,"thread_start_us":643393,"threads_started":2,"wal-append.queue_time_us":509980}
I20260709 12:28:42.325088  7809 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:42.416944  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.421237  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.326344  7440 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:42.422120  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.431173  4574 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:42.432020  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.433072  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.422937  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.338176  7483 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:42.426496  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 81970.1us
I20260709 12:28:42.426644  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:42.327721  7831 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:42.405686  7673 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:42.298288  7772 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:42.326951  7774 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:42.342805  7843 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.435773  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.436040  4537 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:42.447194  4565 raft_consensus.cc:2393] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:42.448669  4537 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:42.428716  7668 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:42.295599  7698 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.436208  3822 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:42.406271  7486 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:42.436879  4569 raft_consensus.cc:2393] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:42.438548  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:42.424759  7595 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:42.449397  7843 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:42.455431  7856 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:42.455835  7807 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:42.456969  7543 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:42.466414  7486 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:42.456552  7877 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:42.474931  7877 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.475405  7877 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:42.434016  7809 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:42.478127  7809 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:42.478827  7519 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:42.405854  7632 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.479303  7519 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:42.473675  7807 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:42.482322  7586 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:42.482885  7586 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:42.484269  7465 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:42.487584  7731 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:42.457841  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 413919us
I20260709 12:28:42.453373  7670 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:42.446194  7831 raft_consensus.cc:697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:42.439796  7853 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:28:42.453300  7668 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.448715  7673 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:42.506886  4569 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:42.513554  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.514288  4571 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:42.515182  7691 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:42.515761  7691 raft_consensus.cc:697] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:42.516541  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.516808  7691 consensus_queue.cc:237] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.518950  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.519519  4571 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:42.521735  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:42.522332  4571 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:42.528879  7824 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:42.529335  7824 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:42.531123  7740 consensus_queue.cc:1059] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:42.532014  7740 consensus_queue.cc:1059] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:28:42.533603  3848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2381) took 2225 ms (client timeout 2158 ms). Trace:
W20260709 12:28:42.534168  3848 rpcz_store.cc:269] 0709 12:28:40.308110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.326486 (+ 18376us) service_pool.cc:224] Handling call
0709 12:28:42.533414 (+2206928us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400191754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:42.533532 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388125056}
I20260709 12:28:42.536744  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.488987  7465 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.504679  7673 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.496182  7738 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:42.542470  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.538213  7673 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:42.529765  7824 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:42.508111  7668 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:42.553802  4567 raft_consensus.cc:2393] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:42.543560  3755 catalog_manager.cc:5697] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 2 to 5, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 5 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:42.552788  4571 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:42.494241  7861 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 12:28:42.544235  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 278246us
I20260709 12:28:42.504901  7731 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:42.495157  7483 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:28:42.558384  7465 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:42.569152  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:42.570120  3925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.031s	sys 0.043s
I20260709 12:28:42.570442  4571 raft_consensus.cc:2410] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:28:42.570466  3925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.031s	sys 0.043s
I20260709 12:28:42.565002  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.552655  7670 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:42.617560  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.624607  4571 raft_consensus.cc:2410] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:28:42.504698  7720 consensus_queue.cc:260] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.576538  7465 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:42.614244  7772 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:42.635852  3971 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:42.655190  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:42.623510  7670 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.652719  3853 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:42.622189  7542 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:42.538882  7273 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:42.655143  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 344704us
I20260709 12:28:42.663782  3969 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:42.664868  3969 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:42.666996  7409 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:28:42.670042  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 233900us
I20260709 12:28:42.669943  3969 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:42.674438  3822 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:42.670936  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:42.577025  7731 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:42.680361  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:42.681362  3856 raft_consensus.cc:2393] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:42.656452  7632 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:42.660593  7670 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:42.679486  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 230914us
I20260709 12:28:42.684247  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:42.668817  7409 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:42.687554  3927 raft_consensus.cc:1240] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 12:28:42.683450  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 225466us
I20260709 12:28:42.690553  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:42.687475  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:42.691339  3923 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:42.693257  3930 raft_consensus.cc:2393] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:42.694864  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:42.696280  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:42.697702  3853 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:42.625608  7831 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.699958  4536 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:42.656736  7856 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:28:42.703766  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:42.704309  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:42.701365  3854 raft_consensus.cc:2410] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:28:42.702600  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:42.705292  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:42.704846  3930 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:42.706027  3929 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:42.695351  4537 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:42.682310  7887 raft_consensus.cc:3055] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:42.713822  3924 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:42.682102  7884 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.658262  7465 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.714485  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:42.716464  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:42.716583  3969 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:42.724720  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 88961.5us
I20260709 12:28:42.686790  7720 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:42.723968  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:42.693873  7409 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.730762  4537 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:42.731001  4536 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:42.732168  3853 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:42.733991  3897 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:42.739210  4537 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:42.704057  7898 raft_consensus.cc:3055] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:42.736330  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:42.703928  7698 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:42.772716  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 129530us
I20260709 12:28:42.749768  3930 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:42.714993  7887 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:42.699261  7891 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:42.777143  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:42.782014  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 65506.7us
I20260709 12:28:42.745290  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:42.781340  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 45072.6us
I20260709 12:28:42.783089  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.764775  3929 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:42.787694  3924 raft_consensus.cc:2410] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:28:42.739151  7409 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:42.771799  7708 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:42.794227  3897 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:42.776857  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 45957.6us
I20260709 12:28:42.793983  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:42.737449  7893 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:42.800289  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:42.796478  4568 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:42.797224  3854 raft_consensus.cc:2410] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:28:42.801393  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:42.744380  7853 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:42.744861  7898 raft_consensus.cc:740] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:42.777493  7897 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:28:42.795077  7883 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 12:28:42.816593  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:42.798050  7708 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.744957  7888 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:42.743713  7440 consensus_queue.cc:1059] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:28:42.730479  7884 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.783987  7889 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:42.774556  7632 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:42.853076  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 969) took 1790 ms. Trace:
I20260709 12:28:42.797765  7542 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:42.783321  7698 consensus_queue.cc:1059] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:28:42.853838  7898 consensus_queue.cc:260] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.799999  7893 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.862880  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:42.849040  7853 raft_consensus.cc:697] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:42.797843  7904 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:42.865680  3850 rpcz_store.cc:276] 0709 12:28:41.062703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.219286 (+156583us) service_pool.cc:224] Handling call
0709 12:28:41.219594 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:41.293726 (+ 74132us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:41.361360 (+ 67634us) log.cc:844] Serialized 14 byte log entry
0709 12:28:42.445949 (+1084589us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b18003d13e0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b7723a 00007fe051fe1a2a
0709 12:28:42.670811 (+224862us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:42.678806 (+  7995us) log.cc:844] Serialized 26 byte log entry
0709 12:28:42.678974 (+   168us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:42.679010 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:42.679071 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:42.832939 (+153868us) raft_consensus.cc:1685] finished
0709 12:28:42.852865 (+ 19926us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:42.853015 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105309,"prepare.queue_time_us":86261,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":177588,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":48198,"spinlock_wait_cycles":6444416,"thread_start_us":224678,"threads_started":1,"wal-append.queue_time_us":1252344}
I20260709 12:28:42.791280  7596 consensus_queue.cc:1059] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:28:42.877614  3927 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:42.860734  7708 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:42.879988  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:42.887027  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:42.859128  7888 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.868881  7889 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:42.873769  7885 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:28:42.898770  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:42.904834  3853 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:28:42.867420  7896 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:28:42.906312  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 112151us
I20260709 12:28:42.876503  7519 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.904763  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.861765  7856 consensus_queue.cc:1059] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:28:42.878916  7893 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:42.899055  7898 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:42.884776  7907 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:42.883355  7632 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:42.918078  4005 raft_consensus.cc:2410] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:28:42.901315  7888 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:42.934077  7907 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:42.934593  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:42.935556  7914 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:42.935277  7907 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.936139  7914 raft_consensus.cc:697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:42.937031  7914 consensus_queue.cc:237] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:42.938014  3856 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:42.939523  7519 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:42.921060  7596 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:28:42.954674  3853 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:42.942050  3897 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:42.904069  7905 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:42.905575  7889 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:42.913005  7896 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:42.959079  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.965526  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.966889  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:42.941177  7632 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:42.969291  7691 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.867262  7887 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.969993  7853 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:42.962778  7843 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:42.963198  7905 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:43.007735  7807 consensus_meta.cc:287] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.526s	user 0.004s	sys 0.005s
I20260709 12:28:43.011499  4538 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:42.969794  7896 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:42.976496  7590 consensus_queue.cc:1059] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:28:43.038578  7887 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:42.977475  7899 log.cc:927] Time spent T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:28:43.034416  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:43.031123  7596 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:28:43.039830  7901 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:28:43.010327  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:43.010661  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:42.985821  7632 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:42.973140  7465 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:42.985373  7586 consensus_meta.cc:287] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.502s	user 0.002s	sys 0.006s
I20260709 12:28:42.979962  7900 raft_consensus.cc:3055] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:28:43.030560  7892 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
W20260709 12:28:43.013562  7857 consensus_meta.cc:287] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.957s	user 0.011s	sys 0.005s
W20260709 12:28:43.011464  7595 consensus_meta.cc:287] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.517s	user 0.004s	sys 0.004s
W20260709 12:28:43.010326  7906 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:28:43.048655  3898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.007s	sys 0.007s
W20260709 12:28:43.101264  3898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.007s	sys 0.007s
I20260709 12:28:43.074396  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:43.102538  4001 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
W20260709 12:28:43.047024  7877 consensus_meta.cc:287] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.002s
I20260709 12:28:43.072377  3970 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:43.075554  7596 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:43.048159  7809 consensus_meta.cc:287] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.002s
W20260709 12:28:43.067936  7486 consensus_meta.cc:287] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.594s	user 0.005s	sys 0.005s
I20260709 12:28:43.031476  7731 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.023120  7884 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.036412  7909 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:43.098987  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:43.120766  4002 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:43.047979  7881 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:28:43.099891  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 133087us
W20260709 12:28:43.109086  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:43.078956  7590 consensus_queue.cc:1243] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Peer 4eedd844c09d456ca0b3614490dd1dbb log is divergent from this leader: its last log entry 9.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:28:43.078912  7698 consensus_queue.cc:1059] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:28:43.139166  4001 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:43.140175  3969 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:43.068478  7807 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:43.098291  7673 consensus_meta.cc:287] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 12:28:43.014380  7859 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
W20260709 12:28:43.116384  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 366364us
I20260709 12:28:43.068331  7668 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.083575  7900 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:43.123206  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:43.096385  7888 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.045275  7691 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.124125  7909 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.125089  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:43.138207  7922 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.110200  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:43.190214  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 451030us
W20260709 12:28:43.190552  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 80416.7us
I20260709 12:28:43.191035  4537 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:43.193243  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:43.136318  7824 consensus_meta.cc:287] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 12:28:43.083928  7586 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.113144  7902 consensus_queue.cc:1059] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 12:28:43.110801  7774 consensus_meta.cc:287] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.664s	user 0.004s	sys 0.013s
I20260709 12:28:43.166558  3969 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:43.171978  7852 raft_consensus.cc:3055] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:43.175763  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:43.177307  7519 raft_consensus.cc:3055] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:43.183370  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 940) took 1239 ms. Trace:
W20260709 12:28:43.185242  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:43.113215  7912 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:43.209564  3928 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 8. Ops: []
I20260709 12:28:43.115252  7596 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:28:43.111387  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 436976us
I20260709 12:28:43.212713  3822 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:43.188063  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 971) took 1033 ms. Trace:
I20260709 12:28:43.188938  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2375) took 4159 ms. Trace:
I20260709 12:28:43.194617  3971 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:43.108711  7595 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.115782  7809 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.142649  7907 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.083189  7708 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.213976  3849 rpcz_store.cc:276] 0709 12:28:39.029492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.755151 (+1725659us) service_pool.cc:224] Handling call
0709 12:28:40.755553 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:40.755964 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:40.756010 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:40.761033 (+  5023us) log.cc:844] Serialized 26 byte log entry
0709 12:28:42.337622 (+1576589us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b18004105c0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:28:42.640194 (+302572us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:42.640238 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:42.640316 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:43.166388 (+526072us) raft_consensus.cc:1685] finished
0709 12:28:43.166410 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:43.188869 (+ 22459us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3378,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2962,"spinlock_wait_cycles":7833984,"thread_start_us":302383,"threads_started":1,"wal-append.queue_time_us":1961501}
I20260709 12:28:43.114970  7877 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.119728  7486 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.210610  3997 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
W20260709 12:28:43.211414  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:43.208505  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 83504.1us
W20260709 12:28:43.220055  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 53610.9us
I20260709 12:28:43.211349  4570 rpcz_store.cc:276] 0709 12:28:41.943805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.943938 (+   133us) service_pool.cc:224] Handling call
0709 12:28:43.183104 (+1239166us) spinlock_profiling.cc:243] Waited 59.3 ms on lock 0x7b540055c8d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:43.183289 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136474496}
I20260709 12:28:43.220868  3969 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:43.220414  3897 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:43.104681  7857 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.223107  3822 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:43.206220  3998 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:43.216784  4001 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:28:43.213479  3852 rpcz_store.cc:276] 0709 12:28:42.154879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:42.155029 (+   150us) service_pool.cc:224] Handling call
0709 12:28:42.155365 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:42.155621 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:42.508650 (+353029us) log.cc:844] Serialized 14 byte log entry
0709 12:28:43.187520 (+678870us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:43.187590 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:43.187721 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:43.187814 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:43.187971 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":476850,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3660,"raft.queue_time_us":140252,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":23993,"thread_start_us":1030645,"threads_started":3,"wal-append.queue_time_us":274081}
I20260709 12:28:43.223749  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:43.225162  4566 raft_consensus.cc:2393] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:43.205425  7738 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:43.168736  7673 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.235397  4006 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 12:28:43.229856  7857 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:43.206270  7859 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:43.208349  7824 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.232877  7809 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:43.233518  3850 raft_consensus.cc:2393] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:43.189769  7909 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:43.241957  3969 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:43.226089  3822 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:43.238351  7924 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:43.213249  7519 raft_consensus.cc:740] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:43.218750  7915 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:43.229923  7378 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:43.245112  7465 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:43.246078  7926 consensus_queue.cc:1059] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:43.246124  7875 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:43.246721  7740 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:43.248095  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:43.248998  7902 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:43.211546  7852 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:43.250103  4568 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:28:43.235332  7884 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:43.311591  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:43.314538  7893 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.315884  4000 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:28:43.317071  7903 raft_consensus.cc:3055] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:43.317546  7903 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:43.251056  7888 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.249603  7409 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.318730  7608 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:43.318562  7903 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.319705  7903 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:43.320218  7409 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.321060  4005 raft_consensus.cc:2368] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8.
I20260709 12:28:43.251844  7673 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:43.187997  7670 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.323889  7670 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.251861  7691 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:43.324892  4004 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:43.252949  7925 consensus_queue.cc:1048] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:28:43.219154  7921 raft_consensus.cc:3055] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:43.326328  7921 raft_consensus.cc:740] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:43.327353  7921 consensus_queue.cc:260] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.330829  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:43.331442  4574 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:28:43.254125  7900 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.256359  7668 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:43.211993  7912 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.256470  7811 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.220191  7907 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.260865  7596 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.262244  7440 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:43.222092  7882 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:28:43.239459  7731 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:43.267318  7486 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.267820  7923 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:28:43.268235  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 975) took 1073 ms. Trace:
I20260709 12:28:43.269785  7708 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:43.235430  7738 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.236282  7774 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:43.270875  3856 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:28:43.271092  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 864860us
I20260709 12:28:43.271858  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2405) took 2187 ms. Trace:
I20260709 12:28:43.272817  7595 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.215749  7720 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:43.236976  7898 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:28:43.275451  7917 log.cc:927] Time spent T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.238s	user 0.002s	sys 0.000s
I20260709 12:28:43.277357  3853 raft_consensus.cc:1240] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:43.279464  7824 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.350725  7731 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:43.280038  3926 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:28:43.280429  7920 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:28:43.215981  7914 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:43.379963  7914 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.380416  7914 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:43.238270  7919 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:28:43.383394  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:43.284047  3969 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:43.298718  4568 pending_rounds.cc:85] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 8
I20260709 12:28:43.384286  4568 pending_rounds.cc:107] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 10.9
W20260709 12:28:43.384337  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 100404us
I20260709 12:28:43.384608  4568 raft_consensus.cc:2889] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:43.291872  7378 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.385753  7915 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:43.302042  7852 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.303203  7926 raft_consensus.cc:3055] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:43.303759  7465 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:43.386782  7670 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:43.387418  7670 raft_consensus.cc:697] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:43.387627  7465 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.388314  7670 consensus_queue.cc:237] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.388935  7902 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:43.303965  7809 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:43.390414  7809 raft_consensus.cc:697] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:43.391430  7809 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.392052  7907 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:43.294911  7904 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:43.394068  7904 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.394203  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:43.394513  7904 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:43.395444  7551 raft_consensus.cc:3055] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:43.395565  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:43.395915  7551 raft_consensus.cc:740] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:43.396871  7551 consensus_queue.cc:260] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.306686  7877 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:43.208611  7922 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.369534  7738 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:43.252354  7905 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.306624  7519 consensus_queue.cc:260] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.281469  7924 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.333101  3970 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:43.334419  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:43.436828  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 103824us
I20260709 12:28:43.334884  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:43.329027  7921 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:43.339516  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:43.343981  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:43.348016  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:43.360809  3857 rpcz_store.cc:276] 0709 12:28:42.194613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:42.194759 (+   146us) service_pool.cc:224] Handling call
0709 12:28:42.535339 (+340580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:42.535521 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:42.535545 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:42.535587 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:42.535638 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:42.535693 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:43.268052 (+732359us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400191750. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:43.268173 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782563072}
I20260709 12:28:43.341919  7912 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:43.370512  4574 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
W20260709 12:28:43.372918  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 129747us
I20260709 12:28:43.373627  3999 rpcz_store.cc:276] 0709 12:28:41.084104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.085555 (+  1451us) service_pool.cc:224] Handling call
0709 12:28:41.085976 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:41.761057 (+675081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:43.271615 (+1510558us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54002bd754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:43.271790 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1551240960}
I20260709 12:28:43.371030  3821 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:43.361444  7900 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:43.377470  7731 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:43.385849  7378 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:43.303141  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 55141.2us
I20260709 12:28:43.386576  7926 raft_consensus.cc:740] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:43.555914  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:43.622889  3970 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:43.623171  3971 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:43.623850  3927 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 11: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:43.623777  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:43.625065  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:43.625699  7811 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:43.530470  7907 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:43.626529  7907 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.629103  7907 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:43.479839  7774 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:43.437196  3931 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:43.409559  7596 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.407747  7922 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.632866  7914 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.633381  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:43.638679  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 1038) took 1105 ms. Trace:
I20260709 12:28:43.639092  4567 rpcz_store.cc:276] 0709 12:28:42.532872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:42.536456 (+  3584us) service_pool.cc:224] Handling call
0709 12:28:43.638465 (+1102009us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b54006a3954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:43.638613 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36013824}
W20260709 12:28:43.479441  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 68202.6us
W20260709 12:28:43.642716  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:43.624426  4570 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:43.623186  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 252261us
I20260709 12:28:43.644938  3822 leader_election.cc:400] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9.
I20260709 12:28:43.643862  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:43.574453  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:43.645216  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 256539us
I20260709 12:28:43.646637  3857 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 12: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:43.375324  7898 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:43.644981  3821 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:43.645320  3822 leader_election.cc:403] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:43.651548  3821 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:43.654760  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:43.655916  4003 raft_consensus.cc:2376] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9. Re-sending same reply.
I20260709 12:28:43.657090  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:43.657630  7807 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.655019  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:43.658866  3997 raft_consensus.cc:2393] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 11: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:43.649345  3971 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:43.659463  3851 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:43.659710  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:43.537072  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:43.660746  3853 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:43.660269  3997 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
W20260709 12:28:43.661655  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:43.662628  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:43.663087  3857 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:28:43.663977  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:43.586221  7896 consensus_meta.cc:287] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.002s
I20260709 12:28:43.405414  7519 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:43.681295  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:43.682009  4002 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:43.596869  7551 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:43.591832  7903 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.703764  4572 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:28:43.480521  7924 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:43.701485  4001 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:43.677321  7668 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9.
I20260709 12:28:43.687489  7698 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:43.648756  7789 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 12:28:43.757980  7903 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.760439  7903 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.659981  7796 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.711417  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 886) took 1938 ms. Trace:
W20260709 12:28:43.716506  3851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1970) took 2055 ms (client timeout 1697 ms). Trace:
W20260709 12:28:43.769013  3851 rpcz_store.cc:269] 0709 12:28:41.661300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.753593 (+ 92293us) service_pool.cc:224] Handling call
0709 12:28:43.716301 (+1962708us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b5400190fd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:43.716429 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4303753600}
I20260709 12:28:43.719120  7926 consensus_queue.cc:260] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.687215  7673 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:28:43.675230  7774 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:43.675292  7877 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:43.678004  7909 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.692678  7896 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.374614  7632 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.564155  7904 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.660307  7898 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:43.779374  7926 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:43.779929  7774 raft_consensus.cc:697] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:28:43.782497  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 159680us
I20260709 12:28:43.783179  7843 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:43.783457  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:43.767477  3925 rpcz_store.cc:276] 0709 12:28:41.773223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.774388 (+  1165us) service_pool.cc:224] Handling call
0709 12:28:42.059884 (+285496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:42.574067 (+514183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:42.574117 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:42.574179 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:28:42.574235 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:42.574318 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:43.711232 (+1136914us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b54000ef6d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:43.711356 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":348221,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4007,"spinlock_wait_cycles":655751552,"thread_start_us":513343,"threads_started":1}
I20260709 12:28:43.797950  3927 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:43.798934  3970 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:43.799988  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:43.800324  3970 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:43.784425  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:43.402868  7889 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.783500  3822 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:28:43.783094  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 131622us
I20260709 12:28:43.803723  3821 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:43.687007  7902 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:43.792317  3923 raft_consensus.cc:1240] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:43.793385  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:43.792373  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:43.807168  3931 raft_consensus.cc:2410] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:28:43.807571  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:43.808194  3997 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:43.800734  3853 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:43.804790  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:43.808564  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:43.790233  4570 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:43.810523  3971 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:43.812492  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:43.818156  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:43.819589  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:43.820459  7632 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:43.822000  3970 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:43.822415  4567 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:28:43.823345  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:43.826799  3822 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:43.789352  7877 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:43.789971  7914 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:43.793031  7903 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.831243  3822 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:43.829795  7789 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:43.834645  7486 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:43.834899  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:43.784268  7796 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.830090  7668 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.835963  7608 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:43.822335  7673 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:43.836580  7925 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:43.826146  3924 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:43.837479  4003 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:43.839406  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:43.844002  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:43.847982  4565 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: []
W20260709 12:28:43.848412  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:43.849251  3927 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:43.851128  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:43.801992  7890 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:43.797173  7919 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:28:43.852514  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:43.852541  3997 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:28:43.821233  7720 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:28:43.871922  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:43.870517  7698 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:28:43.851377  4538 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:43.842288  7877 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:43.852206  7789 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.892107  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:43.893003  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:43.893307  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:43.850924  7902 raft_consensus.cc:697] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:43.887564  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:43.895972  3997 raft_consensus.cc:1240] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:28:43.896205  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:43.888794  3897 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:43.851939  7805 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:43.867679  7673 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.835976  7378 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:43.846179  7859 consensus_queue.cc:1059] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:28:43.846838  7843 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:28:43.921339  3897 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:43.873288  7925 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:43.931115  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:43.888092  7913 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:43.891500  7720 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.894732  7691 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:43.855623  7903 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:43.933262  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 81958.5us
I20260709 12:28:43.941200  4538 leader_election.cc:400] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8.
I20260709 12:28:43.941538  4538 leader_election.cc:403] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:43.881944  7668 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.895223  7789 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:43.878484  7686 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:28:43.894310  7608 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:43.919633  7673 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:43.932312  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:43.924346  7632 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:43.938987  7843 consensus_queue.cc:1243] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:28:43.925371  7805 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:43.935141  7925 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:43.965073  7738 consensus_meta.cc:287] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.003s
I20260709 12:28:43.960920  7383 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8.
I20260709 12:28:43.926065  7891 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.940254  7884 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:43.938772  7863 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:43.937810  7720 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:43.973129  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:43.987253  4537 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:43.945464  7691 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:43.962685  7608 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:43.924585  7774 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.985227  7923 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:28:44.010535  7945 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:28:44.012866  7947 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:28:44.015030  7946 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:28:44.017411  7378 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:44.019595  7904 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:44.022432  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:43.990480  7811 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:43.993570  7891 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:43.990990  7596 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:28:44.028242  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 197059us
I20260709 12:28:43.990604  7884 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.987977  7887 consensus_queue.cc:1059] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:28:44.003187  7608 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:43.988740  7738 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.031647  7383 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:44.035826  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 96476.5us
W20260709 12:28:44.040215  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 97792.6us
I20260709 12:28:44.074481  4538 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:44.077502  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:44.078377  4004 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:44.004289  7857 consensus_queue.cc:1059] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:28:44.006832  7915 consensus_queue.cc:1059] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:28:44.098060  4004 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:28:44.098966  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:44.099617  4004 raft_consensus.cc:2393] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 10: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:44.033953  3822 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:44.101152  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 67291.4us
I20260709 12:28:44.105834  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:44.114606  3856 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:44.116986  3822 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:44.136659  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.037433  7884 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:44.052397  7909 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:44.034693  7896 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:44.140187  4004 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:28:44.145018  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.102974  7959 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.042416  7908 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 12:28:44.150609  7926 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:44.157991  3822 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:44.041311  7923 raft_consensus.cc:697] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:43.999223  7902 consensus_queue.cc:237] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:44.165721  4004 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:44.199553  3822 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:44.155900  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 322870us
I20260709 12:28:44.201606  7891 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:44.201354  7923 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:44.202405  7953 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:28:44.207912  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:44.210429  3930 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:44.210297  3931 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:44.210254  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:44.213967  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:44.222429  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:44.222079  3856 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:44.223507  3931 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:44.225687  3931 raft_consensus.cc:1240] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: []
W20260709 12:28:44.205857  7921 consensus_meta.cc:287] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.559s	user 0.002s	sys 0.006s
I20260709 12:28:44.225005  3970 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:44.053347  7805 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.229607  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:44.232136  3931 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:44.227051  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:44.244256  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:44.235870  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.211470  7915 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:44.267704  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:44.268467  3856 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:44.286535  3930 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:44.265291  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:44.227713  7811 raft_consensus.cc:2764] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:28:44.235793  7903 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:44.165844  7691 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.303867  7863 raft_consensus.cc:3055] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:44.321472  3970 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:44.236552  7908 raft_consensus.cc:3055] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:28:44.344386  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:44.227536  7934 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:28:44.305135  7926 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:44.176728  7959 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.324334  3931 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:44.329571  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 130034us
I20260709 12:28:44.360368  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:44.314087  7668 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:44.331965  3853 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:28:44.326704  7912 consensus_meta.cc:287] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.677s	user 0.006s	sys 0.011s
W20260709 12:28:44.346467  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 272060us
I20260709 12:28:44.327112  7909 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:44.341353  7924 consensus_meta.cc:287] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.000s
I20260709 12:28:44.372524  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:44.373795  3853 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:44.374169  3857 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:28:44.374872  4538 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:44.328651  7863 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:44.385561  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:44.387315  3853 raft_consensus.cc:2393] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:44.390900  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:44.392783  3853 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:28:44.366209  7921 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:44.396500  4538 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:44.399308  3853 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: []
W20260709 12:28:44.400359  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.378927  7967 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:44.395236  7958 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:28:44.397353  7966 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:28:44.388202  7738 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:44.411774  3850 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1978) took 1618 ms (client timeout 2094 ms). Trace:
W20260709 12:28:44.415195  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:44.417045  3850 rpcz_store.cc:269] 0709 12:28:42.793208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:42.886741 (+ 93533us) service_pool.cc:224] Handling call
0709 12:28:44.411611 (+1524870us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400081e54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:44.411722 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":794707840}
I20260709 12:28:44.417397  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:44.418753  7698 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:44.421345  7698 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.423556  7698 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:44.424710  7961 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 12:28:44.428392  7964 log.cc:927] Time spent T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:28:44.429804  7956 log.cc:927] Time spent T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 12:28:44.430840  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:44.409545  7974 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:44.412884  7976 consensus_queue.cc:1059] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:28:44.374480  7912 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:44.380175  7924 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.437032  7889 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:44.437824  4001 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:44.419454  7890 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.439239  7595 raft_consensus.cc:3055] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:44.439677  7595 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:44.439524  7890 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:44.440105  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:44.440834  4002 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 13: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:44.440997  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.437055  7912 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:44.440547  7595 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.429504  7960 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:44.385998  7909 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:44.427434  7877 consensus_meta.cc:287] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
W20260709 12:28:44.445758  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.453725  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:44.457784  3997 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
I20260709 12:28:44.438915  7959 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:44.419303  7843 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:44.464993  3853 raft_consensus.cc:2410] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:28:44.416334  7921 raft_consensus.cc:697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:44.438915  7924 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:44.344566  7908 raft_consensus.cc:740] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:28:44.445977  7969 log.cc:927] Time spent T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:28:44.441605  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:44.474313  4536 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:44.441612  7890 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:44.444981  7972 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:44.486204  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:44.489079  7921 consensus_queue.cc:237] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:44.490232  3853 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:28:44.465624  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:44.491997  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:44.535126  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:44.493758  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:44.497195  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:44.535910  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:44.536639  3853 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:44.537717  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:44.498071  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.482424  7595 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:44.498486  7843 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.511873  7909 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:44.522696  7967 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:44.504253  7378 raft_consensus.cc:3055] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:44.533272  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:44.538954  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:44.539063  3821 connection.cc:256] RPC call timeout handler was delayed by -2.2497203389998504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:28:44.556093  4570 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:44.558451  3853 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:44.540995  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:44.559361  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:44.559593  3930 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
W20260709 12:28:44.544498  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 70307.7us
I20260709 12:28:44.545902  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:44.548534  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:44.560714  3931 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 10: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:44.562975  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:44.563788  3997 raft_consensus.cc:2393] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:44.569252  4002 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:44.579270  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:44.581815  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:44.584259  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:44.586499  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:44.591403  3853 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:44.591625  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:44.591529  4002 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:44.592373  4568 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:44.594133  3971 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:44.546422  7976 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:28:44.601390  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.546072  7590 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.604563  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:44.613324  3923 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:44.534767  7972 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:44.545724  7974 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.638188  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:44.643457  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.643592  3997 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:44.462999  7863 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.477931  7877 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.651273  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:44.629487  3822 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:44.559224  7378 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:44.555028  7483 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:28:44.667392  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.588879  7924 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.637471  7774 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.645468  7904 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:44.687692  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:44.695719  3930 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 13: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:44.559520  7960 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 12:28:44.650761  7974 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.692047  7857 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:44.697021  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:44.709141  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:44.595101  7959 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:44.646080  7972 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:44.645421  7976 raft_consensus.cc:697] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:44.678496  7967 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:44.728706  4570 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:44.678436  7922 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:44.730577  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 185541us
I20260709 12:28:44.731016  3971 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:44.645015  7590 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.711388  7959 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.745153  4002 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:44.617293  7908 consensus_queue.cc:260] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.702037  7483 raft_consensus.cc:697] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:44.749985  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:44.749958  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:44.754745  4002 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 12: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:44.699785  7774 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:44.699258  7924 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:44.751247  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 160426us
I20260709 12:28:44.755870  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:44.820302  7711 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:44.820628  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:44.820837  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2447) took 1165 ms. Trace:
I20260709 12:28:44.822901  4002 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:44.821328  4001 rpcz_store.cc:276] 0709 12:28:43.655026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:43.785071 (+130045us) service_pool.cc:224] Handling call
0709 12:28:43.802269 (+ 17198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:44.438205 (+635936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:44.820609 (+382404us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b5400023354. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:44.820774 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461193984}
I20260709 12:28:44.755997  3853 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:44.824223  4001 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:44.824733  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:44.799839  3970 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:44.826100  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:44.798333  3821 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:44.830022  3821 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:44.737210  7890 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:44.815886  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:44.838245  3821 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:44.747581  7912 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:44.839205  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:44.839900  7912 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.841929  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:44.842990  3931 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 12: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:44.844394  7912 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:44.737675  7922 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.847851  4002 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 8. Ops: []
W20260709 12:28:44.812551  7981 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:28:44.857810  3997 raft_consensus.cc:2410] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:28:44.845569  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:44.751535  7959 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:44.853778  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:44.861915  3923 raft_consensus.cc:2368] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10.
I20260709 12:28:44.820925  7711 raft_consensus.cc:697] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:28:44.863029  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.853840  4002 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:28:44.847447  7608 consensus_meta.cc:287] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.787s	user 0.011s	sys 0.000s
I20260709 12:28:44.738142  7967 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:44.732452  7378 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:44.785569  7898 consensus_meta.cc:287] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.960s	user 0.006s	sys 0.017s
I20260709 12:28:44.741254  7738 consensus_queue.cc:1059] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 12:28:44.858554  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:44.859001  7789 consensus_meta.cc:287] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.888s	user 0.007s	sys 0.011s
I20260709 12:28:44.846457  7809 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:44.817090  7596 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:44.836985  7843 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:44.867364  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 117504us
I20260709 12:28:44.852826  7903 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:44.910524  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:44.855468  7908 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:44.881424  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:44.811723  7698 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:44.859254  7884 consensus_meta.cc:287] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.000s
I20260709 12:28:44.850952  7977 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:28:44.883668  3821 leader_election.cc:400] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10.
I20260709 12:28:44.857060  7811 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:28:44.874280  7608 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.896678  7924 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:44.907393  7596 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:44.882383  7898 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:44.899520  7720 consensus_meta.cc:287] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.891s	user 0.015s	sys 0.002s
W20260709 12:28:44.902458  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.902974  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:44.901412  7925 consensus_meta.cc:287] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.911s	user 0.000s	sys 0.011s
I20260709 12:28:44.985376  7925 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.987569  7925 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:44.872928  7731 consensus_meta.cc:287] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.207s	user 0.014s	sys 0.010s
I20260709 12:28:44.988238  7731 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:44.989441  3848 raft_consensus.cc:2393] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:44.989995  7720 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:44.990996  3848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 1986) took 1585 ms (client timeout 2100 ms). Trace:
I20260709 12:28:44.991144  3855 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 12. Current term is 13. Ops: []
W20260709 12:28:44.991446  3848 rpcz_store.cc:269] 0709 12:28:43.405566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:43.633090 (+227524us) service_pool.cc:224] Handling call
0709 12:28:44.990800 (+1357710us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002a2bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:44.990938 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3116700544}
I20260709 12:28:44.992221  7720 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:44.992457  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 987) took 2130 ms. Trace:
I20260709 12:28:44.992856  3855 rpcz_store.cc:276] 0709 12:28:42.862348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:43.223422 (+361074us) service_pool.cc:224] Handling call
0709 12:28:44.006972 (+783550us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b5800010298. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056fb0fc0 00007fe056f9b929 00007fe056f9b3d2 00007fe050512bd4
0709 12:28:44.007149 (+   177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:44.991576 (+984427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:44.992255 (+   679us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b54000195d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:44.992403 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2268636800}
I20260709 12:28:44.994499  7922 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:44.946871  7877 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:44.901984  7789 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:44.996558  7731 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:44.997045  7789 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:44.997406  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:44.998150  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.004092  3855 raft_consensus.cc:2393] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:45.004303  3999 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:28:45.005151  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:45.005853  3855 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:45.005997  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 706) took 2127 ms. Trace:
I20260709 12:28:45.006604  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:45.006422  4006 rpcz_store.cc:276] 0709 12:28:42.878192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:42.878318 (+   126us) service_pool.cc:224] Handling call
0709 12:28:42.901602 (+ 23284us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:43.235863 (+334261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.005726 (+1769863us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54000c4c54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:45.005937 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767056128}
I20260709 12:28:45.007454  3925 raft_consensus.cc:2393] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:45.008991  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.918217  3850 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 6.
I20260709 12:28:44.897431  7774 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:44.948947  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 722) took 1074 ms. Trace:
W20260709 12:28:44.939489  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 56010.7us
W20260709 12:28:44.945210  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:45.022874  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.024575  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:44.960712  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 95769.4us
I20260709 12:28:44.915642  7903 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.815088  7976 consensus_queue.cc:237] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:44.903465  7670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.323s	user 0.022s	sys 0.033s
I20260709 12:28:44.980819  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:44.909675  7912 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:44.981519  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:44.940156  7967 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:44.944711  7884 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:44.984827  7608 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:45.008912  4572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1032) took 2502 ms. Trace:
I20260709 12:28:44.885285  7926 consensus_queue.cc:1059] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:28:44.992668  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:44.880435  7483 consensus_queue.cc:237] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:44.859135  7890 raft_consensus.cc:697] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:44.934981  7991 raft_consensus.cc:3055] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:28:45.044757  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:45.060707  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.020406  4004 rpcz_store.cc:276] 0709 12:28:43.874342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:44.199129 (+324787us) service_pool.cc:224] Handling call
0709 12:28:44.199426 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:44.199743 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:44.199770 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:44.443298 (+243528us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b2c000e1568. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:28:44.443681 (+   383us) log.cc:844] Serialized 26 byte log entry
0709 12:28:44.630151 (+186470us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:44.630206 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:44.630305 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:44.925575 (+295270us) raft_consensus.cc:1685] finished
0709 12:28:44.925609 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:44.948859 (+ 23250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":782,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4691,"spinlock_wait_cycles":26975488,"thread_start_us":186053,"threads_started":1,"wal-append.queue_time_us":296059}
I20260709 12:28:45.099462  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:45.052317  7897 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.088523  4572 rpcz_store.cc:276] 0709 12:28:42.506380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:42.510129 (+  3749us) service_pool.cc:224] Handling call
0709 12:28:42.510453 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:43.704217 (+1193764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.008694 (+1304477us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540052bcd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:45.008860 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2743757568}
I20260709 12:28:45.091778  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:45.103781  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:45.043318  7673 consensus_meta.cc:287] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.057s	user 0.017s	sys 0.000s
I20260709 12:28:45.092736  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:45.094499  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:45.105002  3930 raft_consensus.cc:2368] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10.
I20260709 12:28:45.094110  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:45.105865  3855 raft_consensus.cc:2410] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:28:45.106657  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:45.076958  7670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.497s	user 0.022s	sys 0.033s
I20260709 12:28:45.077906  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:44.938318  7698 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.114778  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:45.115526  4004 raft_consensus.cc:2393] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:45.116726  3850 raft_consensus.cc:1240] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:45.116832  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:45.116955  3822 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:45.117487  4004 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:45.066960  7903 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:45.110467  3851 raft_consensus.cc:2393] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:45.119378  3851 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:45.121156  3851 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:45.112053  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:45.127224  3851 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:45.128638  3851 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:45.088587  7974 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:45.098244  7991 raft_consensus.cc:740] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:45.099596  7898 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:45.135689  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 228621us
W20260709 12:28:45.136278  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.113354  7995 consensus_queue.cc:1059] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:28:45.137274  7926 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:45.088868  7912 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.043994  7711 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.131168  7789 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:45.156008  7789 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.158289  7789 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:45.162067  7998 log.cc:927] Time spent T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 12:28:45.163501  7994 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:28:45.174889  3848 raft_consensus.cc:1240] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
W20260709 12:28:45.176491  7993 log.cc:927] Time spent T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:28:45.176896  3923 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:45.179841  7670 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:45.180382  7670 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:45.182247  7670 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:45.183327  7861 raft_consensus.cc:3055] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:45.183568  7884 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:45.183890  7861 raft_consensus.cc:740] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:45.114750  7673 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:45.147522  7595 consensus_meta.cc:287] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.012s
I20260709 12:28:45.193591  4004 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:45.183408  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:45.202303  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:45.203590  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:45.109460  7897 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:45.185643  7900 consensus_meta.cc:287] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.543s	user 0.014s	sys 0.000s
I20260709 12:28:45.246104  3850 raft_consensus.cc:1240] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:28:45.204167  7861 consensus_queue.cc:260] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.251777  7861 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:45.272814  7907 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.273469  7907 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:45.276365  7907 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:45.277060  7859 raft_consensus.cc:3055] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:28:45.278831  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 195786us
I20260709 12:28:45.277638  7859 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:28:45.280577  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 182797us
W20260709 12:28:45.288175  3897 leader_election.cc:336] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.639s (SENT)
I20260709 12:28:45.293989  7962 consensus_queue.cc:1059] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:45.293865  7711 consensus_queue.cc:1059] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:28:45.294418  7859 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.295151  7962 raft_consensus.cc:3055] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:45.295540  7962 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:45.295727  7990 raft_consensus.cc:3055] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:45.296110  7893 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:45.296180  7990 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:45.296406  7962 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.294486  7586 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:45.305943  7997 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:45.306792  7937 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 1.744s	user 0.004s	sys 0.002s
I20260709 12:28:45.306538  7997 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:45.279393  7996 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 12:28:45.308249  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.310451  4571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1044) took 2581 ms. Trace:
I20260709 12:28:45.336134  4571 rpcz_store.cc:276] 0709 12:28:42.729280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:42.729467 (+   187us) service_pool.cc:224] Handling call
0709 12:28:42.729865 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:42.773865 (+ 44000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:42.773915 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:43.262938 (+489023us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b2c000201b8. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:28:43.263533 (+   595us) log.cc:844] Serialized 52 byte log entry
0709 12:28:43.353533 (+ 90000us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:43.353567 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:43.353630 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:45.306188 (+1952558us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:45.310238 (+  4050us) raft_consensus.cc:1685] finished
0709 12:28:45.310257 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:45.310395 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43548,"raft.queue_time_us":46888,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":6015,"spinlock_wait_cycles":45937664,"thread_start_us":89483,"threads_started":1,"wal-append.queue_time_us":269633}
I20260709 12:28:45.314708  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 701) took 2541 ms. Trace:
I20260709 12:28:45.338889  4000 rpcz_store.cc:276] 0709 12:28:42.774618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:42.774816 (+   198us) service_pool.cc:224] Handling call
0709 12:28:42.775156 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:43.316264 (+541108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.314443 (+1998179us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b540021b1d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:45.314647 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1242957696}
I20260709 12:28:45.338474  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:45.342341  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.315667  7997 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:45.279832  7596 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.322741  7912 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:45.324491  7608 raft_consensus.cc:3055] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:28:45.328732  3924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54068 (request call id 907) took 1535 ms (client timeout 1863 ms). Trace:
I20260709 12:28:45.328431  7903 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:45.358196  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:45.274317  7922 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.173179  7890 consensus_queue.cc:237] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:45.329726  7894 log.cc:927] Time spent T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 2.456s	user 0.004s	sys 0.004s
I20260709 12:28:45.192231  7959 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.349424  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:45.345639  7967 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.292039  7698 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:45.297766  7962 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:28:45.351967  3924 rpcz_store.cc:269] 0709 12:28:43.793328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:43.793443 (+   115us) service_pool.cc:224] Handling call
0709 12:28:45.328501 (+1535058us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5400143554. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:45.328651 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29803904}
I20260709 12:28:45.353526  3849 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:28:45.347609  7673 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:45.402629  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:45.341857  4002 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
W20260709 12:28:45.360833  4566 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 944) took 3280 ms (client timeout 2244 ms). Trace:
W20260709 12:28:45.346367  7972 consensus_meta.cc:287] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.002s
I20260709 12:28:45.381340  4569 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:45.297191  7990 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.348304  7976 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.249379  7991 consensus_queue.cc:260] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.384454  7884 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:45.351763  7608 raft_consensus.cc:740] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:45.396533  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:45.403798  4566 rpcz_store.cc:269] 0709 12:28:42.081703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:42.093592 (+ 11889us) service_pool.cc:224] Handling call
0709 12:28:45.360631 (+3267039us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b54005af854. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:45.360768 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259127168}
I20260709 12:28:45.413816  4538 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:45.415316  3856 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:45.392810  7905 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:45.409713  7976 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:45.419588  7908 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:45.420043  7908 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.420428  7908 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:45.395490  7922 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.422580  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2457) took 1445 ms. Trace:
I20260709 12:28:45.423012  4001 rpcz_store.cc:276] 0709 12:28:43.977187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:44.851731 (+874544us) service_pool.cc:224] Handling call
0709 12:28:44.852146 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:44.852431 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:45.065717 (+213286us) log.cc:844] Serialized 14 byte log entry
0709 12:28:45.422219 (+356502us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:45.422272 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:45.422345 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.422411 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:45.422525 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":297904,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1772,"thread_start_us":568743,"threads_started":2}
I20260709 12:28:45.424234  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:45.424124  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:45.418428  7884 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.428740  7608 consensus_queue.cc:260] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:45.429752  7608 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:45.431001  7959 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:45.433320  7596 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:45.403080  8009 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:28:45.410017  7972 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.435359  7976 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:45.435622  7897 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:45.435964  7884 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:45.436340  7972 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:45.400252  7967 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.438179  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:45.434538  7990 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:45.438804  3924 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:45.422407  7903 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:45.443683  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:45.444759  4001 raft_consensus.cc:2393] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 6: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:45.438828  7967 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:45.447471  7997 raft_consensus.cc:3055] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:45.447994  7997 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:45.451336  7997 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:45.456372  7809 consensus_meta.cc:287] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.001s
I20260709 12:28:45.458621  7997 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:45.463871  7908 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.512853  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:45.515283  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 993) took 2246 ms. Trace:
I20260709 12:28:45.515512  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:45.513675  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:45.517691  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:45.518750  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:45.515875  3854 rpcz_store.cc:276] 0709 12:28:43.268809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:43.355453 (+ 86644us) service_pool.cc:224] Handling call
0709 12:28:43.355930 (+   477us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:43.363331 (+  7401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:43.363379 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:43.370925 (+  7546us) log.cc:844] Serialized 52 byte log entry
0709 12:28:45.322260 (+1951335us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b1800394660. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:28:45.382142 (+ 59882us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:45.382198 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.382290 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:45.514446 (+132156us) raft_consensus.cc:1685] finished
0709 12:28:45.514491 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:45.515039 (+   548us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5319,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":6252,"spinlock_wait_cycles":9565952,"thread_start_us":59655,"threads_started":1,"wal-append.queue_time_us":2080114}
I20260709 12:28:45.519727  3923 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
W20260709 12:28:45.520841  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 76985.3us
I20260709 12:28:45.521178  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:45.521524  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:45.522701  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.523315  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:45.523303  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:45.526566  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.526496  7809 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:45.531580  7908 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:45.535838  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:45.537536  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2399) took 1025 ms. Trace:
I20260709 12:28:45.519062  3924 raft_consensus.cc:2410] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:28:45.544673  3850 rpcz_store.cc:276] 0709 12:28:44.512458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:45.117443 (+604985us) service_pool.cc:224] Handling call
0709 12:28:45.117714 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:45.279569 (+161855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.536721 (+257152us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540030cd54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:45.537281 (+   560us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294665088}
I20260709 12:28:45.550945  3850 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:28:45.553845  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 1952) took 1062 ms. Trace:
I20260709 12:28:45.555276  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1936) took 2847 ms. Trace:
I20260709 12:28:45.554569  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2487) took 1027 ms. Trace:
I20260709 12:28:45.556114  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:45.556311  3924 rpcz_store.cc:276] 0709 12:28:44.527239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:45.517207 (+989968us) service_pool.cc:224] Handling call
0709 12:28:45.554465 (+ 37258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:45.557338  3930 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
W20260709 12:28:45.559201  4003 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36516 (request call id 2440) took 1906 ms (client timeout 1639 ms). Trace:
I20260709 12:28:45.555891  3928 rpcz_store.cc:276] 0709 12:28:42.707709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:42.772377 (+ 64668us) service_pool.cc:224] Handling call
0709 12:28:42.783495 (+ 11118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:43.212074 (+428579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.554721 (+2342647us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400367754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:45.555053 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979413376}
W20260709 12:28:45.559728  4003 rpcz_store.cc:269] 0709 12:28:43.653029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:43.656864 (+  3835us) service_pool.cc:224] Handling call
0709 12:28:45.558696 (+1901832us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54003a61d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:45.558951 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413007232}
I20260709 12:28:45.547806  3854 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:45.562855  3849 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:45.555429  3925 rpcz_store.cc:276] 0709 12:28:44.491578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:44.491756 (+   178us) service_pool.cc:224] Handling call
0709 12:28:45.553256 (+1061500us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54000ee7d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:45.553581 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084831104}
I20260709 12:28:45.568470  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2444) took 1153 ms. Trace:
I20260709 12:28:45.569074  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1955) took 1072 ms. Trace:
I20260709 12:28:45.568980  3997 rpcz_store.cc:276] 0709 12:28:44.414977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:44.675753 (+260776us) service_pool.cc:224] Handling call
0709 12:28:45.567935 (+892182us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540032ffd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:45.568229 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337079040}
I20260709 12:28:45.565348  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:45.569689  3925 rpcz_store.cc:276] 0709 12:28:44.496560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:45.567475 (+1070915us) service_pool.cc:224] Handling call
0709 12:28:45.568130 (+   655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:45.568549 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:45.568589 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:45.568667 (+    78us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:45.568743 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.568836 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:45.568976 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:28:45.573475  3998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 702) took 2798 ms (client timeout 3332 ms). Trace:
I20260709 12:28:45.573980  3999 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:28:45.574533  3999 pending_rounds.cc:85] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 6
W20260709 12:28:45.574033  3998 rpcz_store.cc:269] 0709 12:28:42.774982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:42.775528 (+   546us) service_pool.cc:224] Handling call
0709 12:28:45.572956 (+2797428us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b540036e054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:45.573223 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962893056}
I20260709 12:28:45.577657  3999 pending_rounds.cc:107] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 7.7
W20260709 12:28:45.581856  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:45.584944  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.587061  7863 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:45.581986  3999 raft_consensus.cc:2889] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:45.593273  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1047) took 2351 ms. Trace:
I20260709 12:28:45.593825  4569 rpcz_store.cc:276] 0709 12:28:43.242477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:43.269869 (+ 27392us) service_pool.cc:224] Handling call
0709 12:28:45.381103 (+2111234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:45.412223 (+ 31120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.592747 (+180524us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b54005af850. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:45.593013 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4790435584}
I20260709 12:28:45.597007  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:45.596675  7843 consensus_queue.cc:1059] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:45.598453  4566 raft_consensus.cc:2393] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 6: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:45.599051  7843 raft_consensus.cc:3055] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:45.599637  7843 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:45.609042  3848 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:45.607986  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:45.618748  4566 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:28:45.619427  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:45.620118  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:45.620743  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:45.622208  4567 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:28:45.622529  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.626295  3925 raft_consensus.cc:1240] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:45.626430  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:45.628093  4571 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:45.628935  3925 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:28:45.619549  7807 raft_consensus.cc:3055] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:45.631460  7807 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:45.632893  3925 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:45.633479  7807 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:45.635620  7807 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:28:45.643306  7940 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 2.072s	user 0.003s	sys 0.009s
I20260709 12:28:45.653441  7896 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.653990  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 922) took 1242 ms. Trace:
I20260709 12:28:45.654284  7896 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:45.654609  3926 rpcz_store.cc:276] 0709 12:28:44.411733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:44.411881 (+   148us) service_pool.cc:224] Handling call
0709 12:28:44.441797 (+ 29916us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:44.442047 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:44.442071 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:44.442542 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:28:44.484978 (+ 42436us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:28:44.521412 (+ 36434us) log.cc:844] Serialized 14 byte log entry
0709 12:28:44.521717 (+   305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:44.521819 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:45.650467 (+1128648us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b1800389b60. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:28:45.653187 (+  2720us) raft_consensus.cc:1685] finished
0709 12:28:45.653341 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:45.653719 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48818,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":112,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":11760000,"thread_start_us":42044,"threads_started":1,"wal-append.queue_time_us":80219}
I20260709 12:28:45.658736  8004 raft_consensus.cc:3055] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:45.659255  8004 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:45.659649  7890 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:45.660641  7890 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:45.626554  3924 raft_consensus.cc:2410] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:28:45.661623  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:45.664206  7904 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:45.664803  7904 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:45.665690  4537 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:45.667752  7974 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:45.668164  7974 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.668579  7974 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:45.660753  8004 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.673013  8004 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:45.679862  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1046) took 2746 ms. Trace:
I20260709 12:28:45.680416  4565 rpcz_store.cc:276] 0709 12:28:42.933733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:43.259005 (+325272us) service_pool.cc:224] Handling call
0709 12:28:43.259332 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:43.879811 (+620479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.679197 (+1799386us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b5400722254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:45.679636 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353215744}
I20260709 12:28:45.687927  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:45.689208  4570 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:45.690387  3930 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:45.692793  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:45.693946  4567 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:28:45.670477  7843 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.671425  7991 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:45.702900  7905 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:45.703197  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:45.704008  7852 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:45.708109  7590 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:45.710042  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 44603.1us
I20260709 12:28:45.712405  7922 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:45.722223  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:45.727108  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:45.732489  7968 log.cc:927] Time spent T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 1.363s	user 0.000s	sys 0.005s
I20260709 12:28:45.735987  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:45.742280  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:45.742419  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:45.743079  4565 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:45.743777  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:45.743995  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:45.744616  4571 raft_consensus.cc:2393] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:45.745405  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:45.745725  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:45.746279  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:45.746888  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:45.747480  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:45.748143  4536 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:45.751405  7383 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:45.752995  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:45.753854  3998 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:45.753988  3997 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:28:45.755821  7859 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:45.759956  4569 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:45.727671  7905 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:45.769654  3848 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:45.774907  3930 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:45.789149  7774 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:28:45.790671  7954 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 1.614s	user 0.000s	sys 0.003s
I20260709 12:28:45.726013  7796 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:45.794387  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.794955  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:45.796998  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 730) took 1208 ms. Trace:
I20260709 12:28:45.797433  3999 rpcz_store.cc:276] 0709 12:28:44.588157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:45.005150 (+416993us) service_pool.cc:224] Handling call
0709 12:28:45.572765 (+567615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:45.594077 (+ 21312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.796735 (+202658us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b540032ffd0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:45.796917 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299194112}
W20260709 12:28:45.799226  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.793766  4536 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:45.809386  3998 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:45.812279  4568 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:45.818030  3930 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:45.819933  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:45.825778  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.829712  3930 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
W20260709 12:28:45.833734  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.842043  4569 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
W20260709 12:28:45.842285  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 48723.5us
I20260709 12:28:45.842797  4566 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:45.844893  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:45.827579  7843 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:45.850735  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:45.838105  3895 connection.cc:256] RPC call timeout handler was delayed by -1.0117771270001867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
I20260709 12:28:45.859248  7710 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:45.859716  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:45.862061  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:45.863010  3851 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:45.870564  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:45.869313  7904 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.872249  7882 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:28:45.872951  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.872994  7903 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:28:45.876021  7882 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.881214  7882 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:45.884912  7904 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:45.885903  7910 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.886018  3971 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:45.886574  7910 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:45.887171  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 71993us
I20260709 12:28:45.888350  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2451) took 2100 ms. Trace:
I20260709 12:28:45.888854  3971 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:45.892266  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:45.844159  7896 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:45.895104  4569 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 8: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:45.899821  4571 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:28:45.899871  3849 raft_consensus.cc:2410] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:28:45.896705  3923 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:45.906014  4565 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:45.909919  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:45.905607  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:45.912388  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:45.898159  7383 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.888810  4005 rpcz_store.cc:276] 0709 12:28:43.787680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:43.918587 (+130907us) service_pool.cc:224] Handling call
0709 12:28:43.918988 (+   401us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:43.931367 (+ 12379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:43.931397 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:43.937496 (+  6099us) log.cc:844] Serialized 52 byte log entry
0709 12:28:44.114101 (+176605us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:44.114145 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:44.114213 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:45.731363 (+1617150us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:45.887808 (+156445us) raft_consensus.cc:1685] finished
0709 12:28:45.887833 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:45.888120 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11933,"raft.queue_time_us":12497,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5043,"spinlock_wait_cycles":17888512,"thread_start_us":147319,"threads_started":1,"wal-append.queue_time_us":356345}
I20260709 12:28:45.922727  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:45.905704  7903 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:45.926775  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:45.934397  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:45.935418  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.927389  7890 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:45.942376  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 53720us
I20260709 12:28:45.900323  7904 consensus_queue.cc:1059] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:28:45.945393  4573 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:28:45.927752  7903 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:45.955261  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:45.953365  3851 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:45.951049  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:45.983512  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:45.926218  7383 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:45.957379  7903 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:45.998669  3852 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 12: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:45.997026  4572 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:46.008208  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:46.023461  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 84025.6us
I20260709 12:28:46.030285  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:46.022446  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:46.037686  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.041443  4569 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:46.054116  7896 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.054600  7884 consensus_queue.cc:1059] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:46.055154  7896 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:46.056149  7959 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:46.063545  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 926) took 1239 ms. Trace:
I20260709 12:28:46.069200  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:46.082195  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 271417us
I20260709 12:28:46.085358  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:46.086366  3924 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:46.086405  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:46.087292  3923 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:46.087685  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:46.089300  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:46.074304  3971 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:46.078984  3999 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:28:46.097486  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:46.100042  7910 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:46.100883  3822 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:46.104734  7796 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:46.105335  7796 raft_consensus.cc:697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:46.108758  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:46.109311  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.064018  3925 rpcz_store.cc:276] 0709 12:28:44.823835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:45.634121 (+810286us) service_pool.cc:224] Handling call
0709 12:28:45.634520 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:45.635026 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:45.831902 (+196876us) log.cc:844] Serialized 14 byte log entry
0709 12:28:46.046035 (+214133us) log.cc:844] Serialized 14 byte log entry
0709 12:28:46.063035 (+ 17000us) log.cc:844] Serialized 14 byte log entry
0709 12:28:46.063226 (+   191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:46.063274 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:46.063317 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:46.063381 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:46.063488 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15475,"prepare.queue_time_us":319740,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":7870,"raft.queue_time_us":32145,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"thread_start_us":365308,"threads_started":2}
I20260709 12:28:46.112934  4565 raft_consensus.cc:2393] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:28:46.121378  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 71786.7us
I20260709 12:28:46.126116  7465 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.126562  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:46.127151  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.126909  7465 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:46.127556  4006 raft_consensus.cc:2410] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:28:46.134737  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 135168us
I20260709 12:28:46.135994  4538 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:46.069087  7890 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.138036  7896 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:46.138710  7991 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:46.138588  7890 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.140717  7991 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:46.141247  7991 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:46.142823  3999 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: [9.9-10.10]
I20260709 12:28:46.143445  4001 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:28:46.144375  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 115229us
W20260709 12:28:46.146898  8026 log.cc:927] Time spent T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:28:46.148511  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:46.149317  4002 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:46.154945  7383 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:46.160303  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.162218  3851 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:46.138999  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:46.187170  7796 consensus_queue.cc:237] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:46.189817  4004 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:28:46.190582  4566 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: []
W20260709 12:28:46.191073  3822 leader_election.cc:336] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095): Timed out: RequestConsensusVote RPC to 127.2.157.4:41095 timed out after 1.505s (SENT)
I20260709 12:28:46.191994  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:46.193140  7896 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:28:46.193401  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:46.194278  7967 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:46.195549  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:46.196187  4003 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:28:46.196410  4566 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 12: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:28:46.197371  8032 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:28:46.206028  7904 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:46.207050  7904 raft_consensus.cc:697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:46.208616  7904 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.210314  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 927) took 1341 ms. Trace:
I20260709 12:28:46.210863  3926 rpcz_store.cc:276] 0709 12:28:44.869123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:45.658116 (+788993us) service_pool.cc:224] Handling call
0709 12:28:45.658750 (+   634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:45.666632 (+  7882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:45.667557 (+   925us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:45.670497 (+  2940us) log.cc:844] Serialized 26 byte log entry
0709 12:28:45.856934 (+186437us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:45.856988 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.857062 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:46.209959 (+352897us) raft_consensus.cc:1685] finished
0709 12:28:46.209992 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:46.210207 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6818,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":282,"thread_start_us":169094,"threads_started":1,"wal-append.queue_time_us":355598}
I20260709 12:28:46.213407  7896 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.214205  7896 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.217260  7896 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:46.221359  7378 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:46.222458  3853 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2406) took 1707 ms (client timeout 1843 ms). Trace:
W20260709 12:28:46.222864  3853 rpcz_store.cc:269] 0709 12:28:44.514605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:44.825803 (+311198us) service_pool.cc:224] Handling call
0709 12:28:46.222064 (+1396261us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b540001a9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:46.222280 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952770432}
I20260709 12:28:46.224445  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:46.225934  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:46.227228  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:46.227854  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.227808  3848 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
W20260709 12:28:46.228343  8004 consensus_meta.cc:287] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.008s
I20260709 12:28:46.229220  4568 raft_consensus.cc:2410] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:28:46.229431  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2387) took 1962 ms. Trace:
I20260709 12:28:46.234190  7890 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:46.234290  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:46.235250  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:46.237141  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:46.238399  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 908) took 2444 ms. Trace:
I20260709 12:28:46.238782  7914 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:46.253108  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:46.240346  3925 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:28:46.193728  3822 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:46.250779  3929 rpcz_store.cc:276] 0709 12:28:43.793626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:43.793724 (+    98us) service_pool.cc:224] Handling call
0709 12:28:43.794018 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:43.794227 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:28:43.859408 (+ 65181us) log.cc:844] Serialized 14 byte log entry
0709 12:28:45.739802 (+1880394us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b18001ac9e0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe051b7f4bc 00007fe04eecd48b 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b7723a
0709 12:28:45.918937 (+179135us) log.cc:844] Serialized 14 byte log entry
0709 12:28:46.170112 (+251175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:46.183052 (+ 12940us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:28:46.237955 (+ 54903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:46.238087 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:46.238229 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":409537,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":12419,"raft.queue_time_us":8938,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":189,"spinlock_wait_cycles":11322112,"thread_start_us":493698,"threads_started":4,"wal-append.queue_time_us":148244,"wal-append.run_cpu_time_us":1610,"wal-append.run_wall_time_us":1172039}
I20260709 12:28:46.256639  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:46.250015  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:46.229024  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:46.178696  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:46.238410  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:46.268443  4565 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 8: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:46.247524  3857 rpcz_store.cc:276] 0709 12:28:44.267076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:44.307340 (+ 40264us) service_pool.cc:224] Handling call
0709 12:28:44.322264 (+ 14924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:44.380489 (+ 58225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:46.228922 (+1848433us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b54003778d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:46.229238 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118652672}
I20260709 12:28:46.252422  3852 raft_consensus.cc:2410] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:28:46.259502  3998 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:28:46.264935  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:46.254125  3925 pending_rounds.cc:85] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 8
I20260709 12:28:46.270208  3925 pending_rounds.cc:107] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 8.9
W20260709 12:28:46.270367  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 248939us
I20260709 12:28:46.270514  3925 raft_consensus.cc:2889] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:46.260470  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 66801.4us
I20260709 12:28:46.270810  7896 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:28:46.270632  7863 consensus_meta.cc:287] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.008s
I20260709 12:28:46.283166  4002 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:46.287995  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:46.288547  3928 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:46.290927  4006 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:46.292331  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:46.269246  7465 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:46.274994  7896 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:46.294072  7859 consensus_meta.cc:287] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.004s
I20260709 12:28:46.313647  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:46.315973  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:46.317230  4571 raft_consensus.cc:2410] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:28:46.317727  3848 raft_consensus.cc:2393] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:46.304816  7896 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:46.326977  3852 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
W20260709 12:28:46.328474  7974 consensus_meta.cc:287] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.007s
I20260709 12:28:46.339538  3854 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:28:46.341733  3854 pending_rounds.cc:85] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 6
I20260709 12:28:46.342716  4536 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:46.346556  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.296566  7991 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.350526  3854 pending_rounds.cc:107] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:28:46.350993  3854 raft_consensus.cc:2889] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:46.354063  3822 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:46.358412  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:46.368711  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:46.373917  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 64102.7us
I20260709 12:28:46.370338  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:46.379448  8041 log.cc:927] Time spent T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:28:46.383955  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:46.385457  3848 raft_consensus.cc:2393] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:46.387372  7960 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:46.387439  8038 consensus_queue.cc:1059] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:46.387956  7960 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:46.388360  7960 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:46.388664  8038 raft_consensus.cc:3055] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:46.389019  8038 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:46.389263  3850 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:46.387470  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:46.381474  8034 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:28:46.348083  7974 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.400158  3849 raft_consensus.cc:1275] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:28:46.401116  7974 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:46.402287  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.403578  7486 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:46.404129  7486 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:46.404529  7486 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:46.405592  8025 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.535s	user 0.004s	sys 0.000s
I20260709 12:28:43.539665  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:46.408380  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:46.412647  4567 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:46.413497  8046 consensus_queue.cc:1059] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:46.414352  8046 consensus_queue.cc:1243] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer 4eedd844c09d456ca0b3614490dd1dbb log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:28:46.414860  8046 raft_consensus.cc:3055] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:46.415197  8046 raft_consensus.cc:740] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:46.415963  8046 consensus_queue.cc:260] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:46.417378  8046 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:46.410020  7852 consensus_meta.cc:287] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.679s	user 0.011s	sys 0.001s
W20260709 12:28:46.430076  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.418092  8004 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.434244  8004 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:46.434835  7882 consensus_meta.cc:287] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.553s	user 0.012s	sys 0.000s
W20260709 12:28:46.435313  3969 connection.cc:256] RPC call timeout handler was delayed by -1.0016946769997048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
I20260709 12:28:46.436977  7483 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:46.436977  3895 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:46.444396  7774 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:46.445293  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 107787us
I20260709 12:28:46.446202  3850 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:28:46.441537  7843 consensus_meta.cc:287] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.005s
I20260709 12:28:46.447567  7973 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.440081  7890 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:46.456056  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.458142  7973 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.459525  4574 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:46.459640  7383 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:46.389853  8038 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:46.435324  7882 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.477030  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:46.477835  4572 raft_consensus.cc:2393] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 11: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:46.478660  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:46.479272  4572 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:46.480801  3753 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51802 (request call id 334) took 24786 ms (client timeout 15000 ms). Trace:
I20260709 12:28:46.482909  3755 catalog_manager.cc:5697] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:46.489243  4570 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 8. Ops: []
I20260709 12:28:46.485153  3755 catalog_manager.cc:5697] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 3 to 5, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 5 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:46.497321  4572 raft_consensus.cc:2410] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:28:46.457335  7774 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:46.498476  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 61624.4us
I20260709 12:28:46.460630  7890 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.459556  7486 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.506691  7891 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.485726  7896 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:46.507285  7891 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:46.508085  7905 consensus_meta.cc:287] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.003s
I20260709 12:28:46.510874  8044 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:46.510944  7905 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.512337  7891 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:46.512658  8004 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:46.513163  7905 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:46.515924  8038 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:46.516780  3855 raft_consensus.cc:2410] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:28:46.518229  7608 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.518707  7608 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:46.473928  7903 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.510212  3822 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:46.528007  3895 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:46.481237  3753 rpcz_store.cc:269] 0709 12:28:21.701750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:21.745344 (+ 43594us) service_pool.cc:224] Handling call
0709 12:28:46.480551 (+24735207us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:29.915062 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:30.099614 (+184552us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:30.099681 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:28:30.099708 (+    27us) tablet.cc:662] Decoding operations
0709 12:28:30.339326 (+239618us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:30.339412 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:30.339441 (+    29us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:28:30.341280 (+  1839us) tablet.cc:701] Row locks acquired
0709 12:28:30.341338 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:28:30.341550 (+   212us) write_op.cc:270] Start()
0709 12:28:30.341706 (+   156us) write_op.cc:276] Timestamp: P: 1783600110341480 usec, L: 0
0709 12:28:30.341728 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:28:30.464819 (+123091us) log.cc:844] Serialized 8895 byte log entry
0709 12:28:31.553488 (+1088669us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b180046d7a0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:28:31.798940 (+245452us) op_driver.cc:464] REPLICATION: finished
0709 12:28:31.985217 (+186277us) write_op.cc:301] APPLY: starting
0709 12:28:31.985324 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:31.985867 (+   543us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:31.985925 (+    58us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:32.496457 (+510532us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:32.496877 (+   420us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 12:28:32.496928 (+    51us) write_op.cc:312] APPLY: finished
0709 12:28:32.497420 (+   492us) log.cc:844] Serialized 158 byte log entry
0709 12:28:32.497630 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:32.497834 (+   204us) write_op.cc:454] Released schema lock
0709 12:28:32.497929 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:32.498370 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:32.498397 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21167,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":157442,"apply.run_cpu_time_us":7793,"apply.run_wall_time_us":513146,"num_ops":23,"prepare.queue_time_us":302987,"prepare.run_cpu_time_us":46423,"prepare.run_wall_time_us":924155,"raft.queue_time_us":87624,"raft.run_cpu_time_us":13751,"raft.run_wall_time_us":197408,"replication_time_us":1443002,"spinlock_wait_cycles":11246976,"thread_start_us":419191,"threads_started":4,"wal-append.queue_time_us":365837,"wal-append.run_cpu_time_us":10817,"wal-append.run_wall_time_us":1943004}]]}
I20260709 12:28:46.531384  7882 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:46.531952  8044 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:46.537050  7378 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:46.537156  7896 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:46.531303  7774 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:46.541133  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 48226.4us
I20260709 12:28:46.532069  7903 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:46.539592  7486 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:46.545631  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.546202  7686 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.548377  7686 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.549338  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:46.550812  7378 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:46.550830  7686 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:46.551704  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:46.559403  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:46.563014  7378 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:46.566793  7378 raft_consensus.cc:697] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:46.567936  7378 consensus_queue.cc:237] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.574683  3822 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:46.574990  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:46.577212  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:46.577934  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:46.585233  8047 consensus_queue.cc:1059] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:28:46.585558  7843 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:28:46.586623  7486 consensus_queue.cc:1059] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:28:46.571848  7903 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:46.590868  3822 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:46.591920  7979 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:46.593150  7896 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:46.593590  7896 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:46.577168  7905 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:46.584100  7960 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.584586  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 956) took 4167 ms. Trace:
I20260709 12:28:46.598510  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:46.597476  4573 rpcz_store.cc:276] 0709 12:28:42.417616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:42.423467 (+  5851us) service_pool.cc:224] Handling call
0709 12:28:42.423786 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:45.954605 (+3530819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:46.578733 (+624128us) spinlock_profiling.cc:243] Waited 3.47 s on lock 0x7b5400488ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:46.584505 (+  5772us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7971033856}
I20260709 12:28:46.602614  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:46.602672  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:46.603339  3998 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:46.603960  3997 raft_consensus.cc:2410] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:28:46.605227  7890 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:46.605134  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:46.606518  4000 raft_consensus.cc:2393] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 11: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:46.594002  7896 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:46.612874  8044 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:46.614130  4572 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:28:46.616149  8047 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:28:46.619300  7796 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:28:46.621588  8053 raft_consensus.cc:3055] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:46.622040  8053 raft_consensus.cc:740] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:46.622988  8053 consensus_queue.cc:260] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:46.624313  8053 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:46.624629  4574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 1053) took 2819 ms (client timeout 2891 ms). Trace:
I20260709 12:28:46.624919  4565 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:28:46.625051  4574 rpcz_store.cc:269] 0709 12:28:43.804866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:43.804994 (+   128us) service_pool.cc:224] Handling call
0709 12:28:46.624385 (+2819391us) spinlock_profiling.cc:243] Waited 2.64 s on lock 0x7b54005dd9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:46.624544 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6072819072}
I20260709 12:28:46.626142  8044 raft_consensus.cc:697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:46.626446  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:46.627229  8044 consensus_queue.cc:237] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:46.611536  7905 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:46.630095  8047 consensus_queue.cc:1243] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:28:46.631062  7905 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.633136  7608 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:46.634646  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:46.635361  7960 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:46.617837  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:46.641718  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 116011us
I20260709 12:28:46.611958  7843 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:28:46.650345  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 82581us
W20260709 12:28:46.655781  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 78631.4us
I20260709 12:28:46.646678  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:46.653280  4567 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:46.661201  3998 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:46.662920  3822 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:46.664309  7486 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.670204  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:46.670324  3969 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:46.666667  7796 consensus_queue.cc:1059] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:28:46.671844  7796 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:46.672207  7796 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:46.672688  7843 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:46.672092  3969 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:46.673132  7796 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:46.670289  7486 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:46.668706  7809 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:46.681349  7809 raft_consensus.cc:697] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:46.681550  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:46.682536  7843 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:46.682823  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:46.683105  7486 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:46.683583  4000 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:46.682547  7809 consensus_queue.cc:237] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:46.684366  7796 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:46.664628  7608 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:46.687790  3895 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:46.688616  7903 consensus_queue.cc:1059] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:46.689579  7903 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:46.694054  8053 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:46.695971  8053 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:46.680027  4574 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:46.689796  3895 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:46.701249  7843 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:28:46.712431  3895 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:46.723412  4567 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:28:46.723884  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 48551.1us
I20260709 12:28:46.724834  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:46.741791  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:46.713351  7903 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:28:46.757615  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.756664  3822 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:46.725245  7960 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.725646  7914 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:46.725831  8038 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:28:46.768477  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 55266.2us
I20260709 12:28:46.757302  7608 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:46.730693  7796 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:28:46.766848  8038 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:46.777343  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 64983.4us
W20260709 12:28:46.768529  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 195070us
I20260709 12:28:46.765811  7960 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.773484  7486 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:46.777808  8038 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:46.788303  3895 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:46.789536  7811 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:46.793720  4005 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:46.785969  7905 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:28:46.799834  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 75827.6us
W20260709 12:28:46.802449  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.793170  7809 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.850132  7809 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.852938  7809 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:46.853531  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:46.854614  8047 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:46.855310  3897 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:46.856267  8047 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:46.856769  3998 raft_consensus.cc:3055] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:46.857307  3998 raft_consensus.cc:740] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:46.858485  3999 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:46.858268  3998 consensus_queue.cc:260] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.859586  3998 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:46.860273  7960 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:46.860608  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:46.861364  3999 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:46.862253  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:46.863040  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:46.863448  8053 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:46.789789  7486 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.866547  7486 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:46.806016  8054 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:28:46.808604  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.812800  7378 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.816012  8046 raft_consensus.cc:3055] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:46.822436  3969 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:46.823035  3855 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2417) took 2298 ms (client timeout 2907 ms). Trace:
I20260709 12:28:46.825867  7896 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.827641  3895 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:46.804225  7905 raft_consensus.cc:697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:46.823058  7979 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:46.869570  7973 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:46.848642  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.833451  4566 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:28:46.798511  7608 raft_consensus.cc:697] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:46.906381  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 149807us
W20260709 12:28:46.909335  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.909809  4566 pending_rounds.cc:85] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 9
I20260709 12:28:46.910130  4566 pending_rounds.cc:107] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:28:46.910590  4566 raft_consensus.cc:2889] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:46.908797  3855 rpcz_store.cc:269] 0709 12:28:44.524210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:45.106389 (+582179us) service_pool.cc:224] Handling call
0709 12:28:46.822694 (+1716305us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400064fd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:46.822944 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3240414592}
I20260709 12:28:46.915220  4538 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:46.915050  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 59851.8us
I20260709 12:28:46.916374  4538 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:46.869776  3998 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:28:46.922724  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:46.921394  4568 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:46.924439  3822 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:46.923125  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:46.926282  3853 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:46.917023  3998 pending_rounds.cc:85] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 6
I20260709 12:28:46.926890  3998 pending_rounds.cc:107] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:28:46.927213  3998 raft_consensus.cc:2889] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:46.893373  7960 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.928906  3857 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:28:46.922915  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:46.929471  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:46.931196  4571 raft_consensus.cc:2368] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11.
I20260709 12:28:46.925138  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:46.883406  8038 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:46.935113  7796 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:46.953629  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:46.954317  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.914196  7904 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:46.908615  8046 raft_consensus.cc:740] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:46.924767  7811 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.954226  8007 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:46.958678  3848 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:28:46.983819  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 156298us
I20260709 12:28:46.979861  4006 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 6.
W20260709 12:28:46.977674  8062 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.001s
W20260709 12:28:46.971645  7884 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.009s	sys 0.012s
W20260709 12:28:46.981160  7805 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:28:46.972987  3856 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:46.920297  8060 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:46.982223  3897 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:46.985407  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 182092us
I20260709 12:28:46.988179  3969 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:46.988684  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 63959.6us
I20260709 12:28:46.989741  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:46.990984  3897 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:46.991813  8053 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:46.992599  8053 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:46.993316  8053 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:46.994386  3897 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:46.994185  7608 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:46.979944  7796 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:46.995375  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 77099.1us
W20260709 12:28:46.985512  7884 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.011s	sys 0.012s
I20260709 12:28:46.923720  7378 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:47.003753  7974 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:28:47.004134  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:47.004554  7896 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:47.005954  3927 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:47.006634  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1964) took 1010 ms. Trace:
I20260709 12:28:47.001053  4538 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:47.007301  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:46.985301  7811 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:46.973124  7960 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:47.010010  7859 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:28:47.008831  8060 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:47.001613  7796 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:47.035799  7378 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:47.037737  7811 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:47.029181  7809 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:28:47.038513  3821 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:47.039304  4536 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:47.011590  3927 rpcz_store.cc:276] 0709 12:28:45.998298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:46.995026 (+996728us) service_pool.cc:224] Handling call
0709 12:28:47.005487 (+ 10461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:47.006353 (+   866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:47.006558 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:47.034137  3895 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:47.006829  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:47.049656  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.999236  7774 raft_consensus.cc:2764] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:28:47.059070  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 58115.2us
I20260709 12:28:47.007937  8038 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:47.035701  7852 raft_consensus.cc:3055] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:47.069796  4538 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:47.011215  8054 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:47.068567  8007 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:47.073439  8007 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.073855  8007 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:47.077572  7960 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:47.072093  7863 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:47.078644  7863 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.078961  7811 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.079582  7811 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:47.072520  8054 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.067090  7884 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:47.079011  7863 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:47.051505  7686 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:28:47.099575  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.101699  3895 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:47.091346  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.009253  7905 consensus_queue.cc:237] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:47.103799  3895 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:47.056854  7896 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:47.106021  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 108814us
I20260709 12:28:47.106866  3969 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:47.106284  7896 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:47.107987  3969 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:47.109177  3969 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:47.093381  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:47.094275  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:47.094954  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 56564.6us
I20260709 12:28:47.066195  7486 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:28:47.098197  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:47.090862  8038 consensus_queue.cc:1059] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:28:47.112183  3930 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:47.098215  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.098902  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:47.099280  7811 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:47.102631  7990 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.102655  3927 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:47.091807  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.087414  8053 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:47.122932  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:47.124379  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.111058  3895 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:47.034093  8046 consensus_queue.cc:260] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:47.071794  7852 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:47.113639  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.128126  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.113309  8050 consensus_queue.cc:1059] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:28:47.113476  7903 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:47.113574  7807 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:47.109817  7896 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:47.118857  8047 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:47.113597  7843 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:47.119757  3928 raft_consensus.cc:2368] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10.
I20260709 12:28:47.149191  3971 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:47.122385  3853 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:47.149546  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:47.112838  3932 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:47.150281  4569 raft_consensus.cc:2393] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:47.088510  8054 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:47.089617  7960 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:47.130403  3925 raft_consensus.cc:2410] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:28:47.137609  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 130849us
W20260709 12:28:47.128127  8070 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:28:47.119459  7486 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:47.144130  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:47.144284  3821 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:47.146171  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:47.146776  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.147001  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:47.151940  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:47.158736  4571 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:47.154845  3927 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:47.145733  8071 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:28:47.163771  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:47.157998  4573 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:47.140395  8044 raft_consensus.cc:3055] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:47.148061  8053 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:47.167299  3929 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 12: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:47.168982  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 129743us
W20260709 12:28:47.205282  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 56184.9us
I20260709 12:28:47.204967  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.206820  4574 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:28:47.170177  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.218886  3928 raft_consensus.cc:2410] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:28:47.223145  3930 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:28:47.225602  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:47.229252  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.123922  7990 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:47.168143  7903 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:28:47.234477  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 123558us
W20260709 12:28:47.234829  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.235980  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.235930  3930 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:47.169775  8044 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:47.239648  4536 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:47.154042  8048 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:28:47.163076  7890 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:28:47.246502  3925 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:28:47.254189  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.258834  3895 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:47.262698  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 55184.1us
I20260709 12:28:47.264479  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:47.265019  4006 raft_consensus.cc:1240] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:28:47.265767  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:47.265692  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:47.266707  3997 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 12: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:47.266579  4004 raft_consensus.cc:2393] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 10: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:47.266471  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:47.267500  4000 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:47.268011  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:47.268641  3997 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:47.268661  4004 raft_consensus.cc:2393] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 10: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:47.277830  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:47.279435  3929 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:47.281174  3822 leader_election.cc:400] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11.
I20260709 12:28:47.281564  3822 leader_election.cc:403] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:47.272406  7973 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:47.310464  3930 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:28:47.311177  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:47.313092  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 60599us
I20260709 12:28:47.247006  8073 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:47.272595  7882 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:47.464949  7882 raft_consensus.cc:697] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:47.253829  8068 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:47.465952  7882 consensus_queue.cc:237] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:47.334514  8088 consensus_queue.cc:1059] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:47.470546  7890 raft_consensus.cc:3055] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:47.471067  7890 raft_consensus.cc:740] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:47.311681  8085 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:47.238826  7852 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:47.350692  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.305289  7796 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:47.361012  7465 raft_consensus.cc:3055] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:47.344559  8044 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:47.333686  8086 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 12:28:47.480016  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.393393  7991 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.400947  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:47.484144  4572 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
W20260709 12:28:47.405639  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.411942  3927 raft_consensus.cc:1275] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:28:47.485337  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:47.486271  3930 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:47.427904  7922 raft_consensus.cc:3055] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:47.430380  8038 raft_consensus.cc:3055] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:47.434211  4568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 966) took 1394 ms. Trace:
I20260709 12:28:47.238620  7903 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:47.466180  8068 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:47.328490  7905 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:28:47.476251  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 340317us
W20260709 12:28:47.477960  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.373873  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2006) took 1148 ms. Trace:
W20260709 12:28:47.420861  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.490895  4568 rpcz_store.cc:276] 0709 12:28:46.040097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:46.230440 (+190343us) service_pool.cc:224] Handling call
0709 12:28:46.230715 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:46.925450 (+694735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:47.433939 (+508489us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54006a3954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:47.434119 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1587990400}
I20260709 12:28:47.495054  3931 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:47.503417  4566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 963) took 1557 ms. Trace:
I20260709 12:28:47.500751  3857 rpcz_store.cc:276] 0709 12:28:46.225681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:46.296320 (+ 70639us) service_pool.cc:224] Handling call
0709 12:28:46.622879 (+326559us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b5800010298. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056fb0fc0 00007fe056f9b929 00007fe056f9b3d2 00007fe050512bd4
0709 12:28:46.623074 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:46.930627 (+307553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:47.373559 (+442932us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400190fd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:47.373790 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693753472}
I20260709 12:28:47.502575  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:47.503790  4566 rpcz_store.cc:276] 0709 12:28:45.946191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:46.197136 (+250945us) service_pool.cc:224] Handling call
0709 12:28:46.832830 (+635694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:46.917505 (+ 84675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:47.489941 (+572436us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b5400512050. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:47.503355 (+ 13414us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461052800}
I20260709 12:28:47.512694  3821 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:47.514935  8060 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:47.519946  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:47.524099  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:47.524350  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.524777  3931 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:47.489646  8046 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:47.479643  7465 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:47.524238  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:47.524114  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:47.529335  3822 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:47.529695  3852 raft_consensus.cc:2393] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:47.526880  3930 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:47.506168  7903 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:47.525183  3927 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:47.490586  8038 raft_consensus.cc:740] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:47.533479  3850 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 6.
I20260709 12:28:47.490211  7922 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:47.494414  7990 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:47.503026  8085 raft_consensus.cc:697] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:47.539842  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.540668  3930 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:47.542973  3895 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:47.547039  4567 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:47.528311  7811 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:47.549220  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:47.553445  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 289498us
I20260709 12:28:47.554401  4000 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:47.550348  3927 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
W20260709 12:28:47.542711  7904 consensus_meta.cc:287] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.019s
I20260709 12:28:47.563776  8085 consensus_queue.cc:237] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:47.564430  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:47.503211  7991 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:47.542001  7608 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:47.539995  8044 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:47.558866  3970 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 2.216s (SENT) [suppressed 42 similar messages]
I20260709 12:28:47.575832  3969 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:47.527460  8079 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:28:47.555325  8050 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:47.592661  3927 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:47.573432  7774 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:47.574611  7904 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:47.606067  3821 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:47.606218  3971 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:47.611071  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.541652  8038 consensus_queue.cc:260] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:47.613770  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 87913.9us
I20260709 12:28:47.581434  7979 consensus_queue.cc:1059] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:28:47.623668  4566 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:47.623751  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.625334  3923 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:47.625377  7774 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:47.566845  7890 consensus_queue.cc:260] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:47.626236  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.626911  7890 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:47.627029  7774 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:47.627625  7774 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:47.627050  8090 consensus_queue.cc:1175] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4eedd844c09d456ca0b3614490dd1dbb" responder_term: 8 status { last_received { term: 6 index: 8 } last_committed_idx: 8 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:28:47.628126  7774 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:47.628523  3923 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:47.630400  7796 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:47.631561  8077 log.cc:927] Time spent T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 12:28:47.633683  8093 log.cc:927] Time spent T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:28:47.635108  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:47.636369  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:47.637158  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.638916  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:47.643453  3931 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:47.644268  3923 raft_consensus.cc:2393] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:47.648731  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:47.649115  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:47.649338  4000 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
I20260709 12:28:47.649489  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.650300  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:47.618433  7805 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:47.647382  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.655198  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:47.649686  4004 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:47.591399  7465 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:47.655668  7805 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:47.655980  3923 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:47.657140  7465 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:47.657346  7805 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:47.648846  7796 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:47.659219  7991 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:47.659777  8103 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:28:47.660933  8092 log.cc:927] Time spent T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:28:47.604892  7922 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:47.664150  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 58172.1us
I20260709 12:28:47.663183  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:47.651813  7863 consensus_meta.cc:287] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.559s	user 0.028s	sys 0.008s
I20260709 12:28:47.718693  3923 raft_consensus.cc:2393] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:47.652385  8080 raft_consensus.cc:3055] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:47.653995  8060 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:47.723637  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 69218.1us
I20260709 12:28:47.725728  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.727434  3923 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:47.710561  8086 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:47.791352  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.792279  3931 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:47.662376  7896 consensus_queue.cc:1175] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34711da9380944d2969a2bc3e203db3d" responder_term: 12 status { last_received { term: 12 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:28:47.721966  7990 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.723773  8080 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:47.815712  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.817287  3821 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:47.794358  8038 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:47.795599  8086 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.791354  8060 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:47.831528  3927 raft_consensus.cc:3055] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:47.831933  3927 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:47.833086  8060 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:47.832778  3927 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:47.834540  8095 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 12:28:47.835114  3927 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:47.836300  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:47.838095  8104 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:28:47.838745  8082 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:47.839336  8082 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:47.842453  8073 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:47.842898  8073 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:47.843262  8073 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:47.850301  3853 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:47.885425  3929 consensus_meta.cc:287] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.605s	user 0.014s	sys 0.007s
I20260709 12:28:47.852376  3970 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:47.724030  7863 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:47.816646  8068 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:47.888625  3929 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:28:47.890059  3927 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:28:47.890655  3927 pending_rounds.cc:85] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 8
I20260709 12:28:47.890985  3927 pending_rounds.cc:107] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:28:47.891324  3927 raft_consensus.cc:2889] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:47.895287  8101 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:28:47.896324  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 44075.6us
I20260709 12:28:47.897069  3970 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:47.902191  7890 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:47.828205  7922 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:28:47.903434  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:47.855464  8053 consensus_meta.cc:287] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.001s
I20260709 12:28:47.909255  8053 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:47.910418  3924 raft_consensus.cc:2368] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11.
I20260709 12:28:47.915275  3930 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:47.920367  7863 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:47.849465  8086 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:47.899299  3970 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:47.924564  3853 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:47.930626  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:47.822377  7990 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:47.935647  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.937692  3927 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
W20260709 12:28:47.928421  3932 consensus_meta.cc:287] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.775s	user 0.005s	sys 0.021s
I20260709 12:28:47.941099  3932 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:47.922843  8090 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:28:47.942737  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 43502.6us
I20260709 12:28:47.951743  8082 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:47.909515  8050 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:47.953053  7990 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:47.961529  4537 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:47.936144  8103 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:47.974332  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:47.975309  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.978117  3931 raft_consensus.cc:1275] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:28:47.964186  8080 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:47.978324  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:47.982730  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:47.983469  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:47.983659  3923 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:47.992925  3927 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
W20260709 12:28:47.994627  8105 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:28:47.967986  8090 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:28:48.002501  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 185311us
I20260709 12:28:47.949013  7805 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.004519  3821 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:48.003290  8080 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:48.018728  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:48.028541  7774 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:48.030248  8109 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:28:48.031339  8099 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 12:28:48.029953  8098 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:28:48.009444  7378 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:47.979503  8103 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:48.035019  8101 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:48.036262  8113 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:28:48.085536  8113 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:48.038813  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:48.050036  7905 consensus_meta.cc:287] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.005s
I20260709 12:28:48.050674  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:48.052919  8007 consensus_meta.cc:287] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.979s	user 0.012s	sys 0.015s
W20260709 12:28:48.055706  7903 consensus_meta.cc:287] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.000s
I20260709 12:28:48.056432  4005 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:48.057740  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:48.060552  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:48.061918  3821 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:48.106334  3927 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
W20260709 12:28:48.106805  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 45022.8us
I20260709 12:28:48.107959  3821 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:48.076948  3923 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:48.084059  8103 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:48.086943  4000 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:28:48.106266  4002 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:28:48.089797  3854 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:28:48.113690  3854 pending_rounds.cc:85] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 6
I20260709 12:28:48.114079  3854 pending_rounds.cc:107] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:28:48.114431  3854 raft_consensus.cc:2889] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:48.092625  3997 raft_consensus.cc:2393] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 10: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:48.086647  4003 raft_consensus.cc:2376] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13. Re-sending same reply.
I20260709 12:28:48.088760  7890 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:48.135181  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 76191.7us
I20260709 12:28:48.093492  7905 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11.
I20260709 12:28:48.137107  3821 leader_election.cc:400] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10.
I20260709 12:28:48.139417  3821 leader_election.cc:403] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:28:48.122598  8047 consensus_meta.cc:287] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.957s	user 0.011s	sys 0.010s
W20260709 12:28:48.134349  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 186532us
I20260709 12:28:48.086082  8113 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:48.141744  3897 connection.cc:256] RPC call timeout handler was delayed by -1.1459535820004021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260709 12:28:48.146117  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:48.133342  7378 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:48.151846  3821 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:48.154479  8117 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:48.155396  8098 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:48.155565  8117 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:48.122237  7903 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.144518  7486 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10.
I20260709 12:28:48.172868  3932 raft_consensus.cc:2410] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:28:48.143371  8047 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:48.117630  8007 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.157227  3821 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:48.184787  7378 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:48.185314  7378 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.185384  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:48.185814  7378 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:48.190275  3821 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:48.190943  8117 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:48.191048  3821 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:48.191367  8117 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.191761  8117 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:48.192022  7905 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:48.192318  3821 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:48.192680  7905 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:48.193331  7905 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:48.193996  3821 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:48.194799  8115 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:48.195210  8115 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:48.195583  8115 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:48.198132  7796 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:48.198764  7796 raft_consensus.cc:697] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:48.173240  8073 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:48.121503  8090 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:48.202987  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:48.203892  4568 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:48.179286  7774 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.207245  8007 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:48.212224  7805 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.221688  3928 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:48.256121  7796 consensus_queue.cc:237] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:48.220316  8054 consensus_meta.cc:287] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.056s	user 0.009s	sys 0.013s
I20260709 12:28:48.258984  8054 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.260506  3926 raft_consensus.cc:2368] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10.
I20260709 12:28:48.261488  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:48.266608  8073 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:48.269353  7608 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.269951  7608 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:48.280175  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:48.281275  7774 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:48.281896  7805 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:48.282051  7774 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:48.289057  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:48.402815  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:48.410247  7890 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:48.455189  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:48.471237  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 277304us
I20260709 12:28:48.491102  4568 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
W20260709 12:28:48.506856  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:48.509549  3970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.035s	sys 0.043s
W20260709 12:28:48.509975  3970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.036s	sys 0.043s
W20260709 12:28:48.510403  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 503809us
W20260709 12:28:48.510053  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:48.504578  3895 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:48.511482  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 310335us
I20260709 12:28:48.261721  8054 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.411020  7890 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.516265  7486 consensus_queue.cc:1048] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:28:48.522291  3970 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:48.520220  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1049) took 1033 ms. Trace:
I20260709 12:28:48.523921  3855 rpcz_store.cc:276] 0709 12:28:47.486884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:48.469254 (+982370us) service_pool.cc:224] Handling call
0709 12:28:48.516479 (+ 47225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:48.519790 (+  3311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:48.519825 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:48.519875 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:48.519918 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:48.519997 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:48.520146 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:48.538338  3970 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:48.538443  3897 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:48.516742  8073 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:48.519218  8085 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:48.530246  8071 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:48.537855  8086 consensus_meta.cc:287] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.616s	user 0.012s	sys 0.000s
W20260709 12:28:48.542712  8044 consensus_meta.cc:287] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.957s	user 0.012s	sys 0.000s
I20260709 12:28:48.551440  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:48.517298  7378 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:48.541080  8128 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.544618  8127 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:48.559922  3970 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:48.568039  3929 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:28:48.568540  3929 pending_rounds.cc:85] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 4
I20260709 12:28:48.568825  3929 pending_rounds.cc:107] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:28:48.569097  3929 raft_consensus.cc:2889] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:48.552829  8054 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:48.557708  7486 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.554756  8085 raft_consensus.cc:697] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:48.563382  8124 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:48.598218  8124 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:48.598704  8124 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:48.565930  8128 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.603149  7486 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:48.605129  8128 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.606050  8128 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:48.552068  8073 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.605207  7486 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:48.602733  7890 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.608453  8073 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.554605  8071 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.610777  8071 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.611812  8085 consensus_queue.cc:237] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:48.615438  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:48.588598  8044 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:48.624298  7852 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:48.558497  8086 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:48.624455  8115 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.630219  8073 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:48.630769  8073 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.631604  8086 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:48.626323  7905 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.632061  8115 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.570870  8117 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:48.613649  8090 consensus_queue.cc:1059] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 12:28:48.659556  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 108227us
W20260709 12:28:48.662078  3998 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.000s	sys 0.009s
W20260709 12:28:48.663494  3998 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.000s	sys 0.009s
W20260709 12:28:48.666302  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:48.661793  7608 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:48.674724  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 114894us
I20260709 12:28:48.668641  8044 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:28:48.679746  7608 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:48.663813  8127 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:48.682585  8073 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.682142  8127 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.686322  3897 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:48.688009  3970 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:48.688880  8044 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:28:48.690227  8100 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.780s	user 0.008s	sys 0.027s
I20260709 12:28:48.690495  8044 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.691063  8044 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:48.694801  7905 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.689661  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:48.700593  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 739134us
I20260709 12:28:48.701938  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 984) took 1450 ms. Trace:
I20260709 12:28:48.703461  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1082) took 1081 ms. Trace:
I20260709 12:28:48.703886  4567 rpcz_store.cc:276] 0709 12:28:47.622261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.622398 (+   137us) service_pool.cc:224] Handling call
0709 12:28:47.622702 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:47.622918 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:47.946289 (+323371us) log.cc:844] Serialized 14 byte log entry
0709 12:28:48.703159 (+756870us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:48.703203 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:48.703247 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:48.703309 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:48.703412 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":639213,"prepare.queue_time_us":102764,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"thread_start_us":440225,"threads_started":2,"wal-append.queue_time_us":200396}
I20260709 12:28:48.708963  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:48.709685  3929 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:48.707918  3970 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:48.710713  3971 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:48.703677  8088 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:48.702438  7990 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:28:48.722967  7863 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.723658  7863 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:48.731940  8106 log.cc:927] Time spent T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.764s	user 0.003s	sys 0.018s
I20260709 12:28:48.702385  4570 rpcz_store.cc:276] 0709 12:28:47.251621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.459965 (+208344us) service_pool.cc:224] Handling call
0709 12:28:47.460419 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:47.460895 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:47.460940 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:47.461564 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 12:28:47.602938 (+141374us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:28:47.711788 (+108850us) log.cc:844] Serialized 14 byte log entry
0709 12:28:48.695302 (+983514us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b180044dd60. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04ee64c0a 00007fe0585a4219 00007fe04eeeca40 00007fe04eee74e4 00007fe04eee7455 00007fe051fcf060 00007fe051fe1716 00007fe051ff2287 00007fe051ff2208
0709 12:28:48.695473 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:48.695550 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:48.695591 (+    41us) raft_consensus.cc:1685] finished
0709 12:28:48.700714 (+  5123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:48.701838 (+  1124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27724,"prepare.queue_time_us":45803,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":985774,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":188,"spinlock_wait_cycles":3542784,"thread_start_us":202912,"threads_started":2,"wal-append.queue_time_us":247190}
I20260709 12:28:48.711510  8135 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:28:48.733983  3926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2520) took 1645 ms (client timeout 1541 ms). Trace:
I20260709 12:28:48.734169  8135 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:48.734440  3926 rpcz_store.cc:269] 0709 12:28:47.088420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.093121 (+  4701us) service_pool.cc:224] Handling call
0709 12:28:48.733749 (+1640628us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540031c9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:48.733907 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2645068544}
I20260709 12:28:48.735201  8135 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:48.738438  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2024) took 1163 ms. Trace:
I20260709 12:28:48.738842  3857 rpcz_store.cc:276] 0709 12:28:47.575122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.575347 (+   225us) service_pool.cc:224] Handling call
0709 12:28:47.599256 (+ 23909us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:47.599731 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:47.626099 (+ 26368us) log.cc:844] Serialized 14 byte log entry
0709 12:28:47.719774 (+ 93675us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:47.720283 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:28:47.720429 (+   146us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:47.720478 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:47.720550 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:48.731371 (+1010821us) spinlock_profiling.cc:243] Waited 9.98 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:48.738136 (+  6765us) raft_consensus.cc:1685] finished
0709 12:28:48.738250 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:48.738380 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10086,"prepare.queue_time_us":26853,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":201,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":63021,"spinlock_wait_cycles":22947712,"thread_start_us":92078,"threads_started":1,"wal-append.queue_time_us":267129}
W20260709 12:28:48.698382  8098 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.043s	sys 0.045s
W20260709 12:28:48.747503  8098 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.043s	sys 0.045s
I20260709 12:28:48.755155  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:48.755831  3854 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:48.710383  7378 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:48.715265  8079 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.756755  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:48.757493  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 49761.8us
I20260709 12:28:48.756841  3855 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:48.763005  3857 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:28:48.763501  3970 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:48.751240  8090 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:48.767747  7884 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:48.776328  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 58433.9us
I20260709 12:28:48.778482  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:48.780983  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:48.781613  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:48.782382  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:48.781982  3929 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:48.782778  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:48.783123  3848 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:48.784931  3931 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:48.785825  4537 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:48.788340  3927 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:28:48.758157  8139 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:48.770076  8054 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.790197  3926 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:28:48.795289  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:48.796211  3930 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:48.795259  4537 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:48.797699  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:48.801995  8139 raft_consensus.cc:697] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:48.802999  8139 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:48.805332  8130 log.cc:927] Time spent T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:28:48.794730  7904 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:48.809425  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2023) took 1252 ms. Trace:
I20260709 12:28:48.810078  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 945) took 1557 ms. Trace:
I20260709 12:28:48.778092  8088 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:48.774340  8079 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.813313  8079 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:48.781788  7378 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:48.814214  7378 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.816378  7378 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.817034  8071 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:48.817579  8071 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.819553  8071 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.790423  7884 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.821503  3925 rpcz_store.cc:276] 0709 12:28:47.252182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.326647 (+ 74465us) service_pool.cc:224] Handling call
0709 12:28:47.405414 (+ 78767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:47.414451 (+  9037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:47.414531 (+    80us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:47.476250 (+ 61719us) log.cc:844] Serialized 26 byte log entry
0709 12:28:47.643232 (+166982us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:47.643283 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:47.643347 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:48.689645 (+1046298us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:48.698668 (+  9023us) raft_consensus.cc:1685] finished
0709 12:28:48.698705 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:48.809903 (+111198us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b54000d4b50. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:48.810021 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5238,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":174413568,"thread_start_us":112026,"threads_started":1,"wal-append.queue_time_us":315692}
I20260709 12:28:48.823639  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:48.823788  7884 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.809827  3856 rpcz_store.cc:276] 0709 12:28:47.557155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.557329 (+   174us) service_pool.cc:224] Handling call
0709 12:28:47.572565 (+ 15236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:47.586968 (+ 14403us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:47.608489 (+ 21521us) log.cc:844] Serialized 14 byte log entry
0709 12:28:48.807382 (+1198893us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b1800439cc0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe051b7f4bc 00007fe04eecd48b 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee7455 00007fe051fcf060 00007fe051fe1716 00007fe051ff2287
0709 12:28:48.807473 (+    91us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:48.807904 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 12:28:48.808055 (+   151us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:48.808100 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:48.808158 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:48.809147 (+   989us) raft_consensus.cc:1685] finished
0709 12:28:48.809231 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:48.809360 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22753,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":14539,"raft.queue_time_us":24861,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":4049,"spinlock_wait_cycles":2861824,"thread_start_us":297718,"threads_started":2,"wal-append.queue_time_us":320848}
I20260709 12:28:48.835120  3822 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:48.836194  7378 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:48.829933  8054 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.836699  7378 raft_consensus.cc:697] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:48.838312  3928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2533) took 1604 ms (client timeout 1621 ms). Trace:
W20260709 12:28:48.838847  3928 rpcz_store.cc:269] 0709 12:28:47.233794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.233951 (+   157us) service_pool.cc:224] Handling call
0709 12:28:48.838116 (+1604165us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b54002387d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:48.838244 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204615552}
W20260709 12:28:48.847137  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 64427.8us
I20260709 12:28:48.848690  8117 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:48.849246  7378 consensus_queue.cc:237] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.849714  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:48.850255  3927 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:48.848738  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:48.858903  8145 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:48.859395  8145 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.859736  8145 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:48.860481  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:48.861830  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:48.865036  4567 raft_consensus.cc:2410] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:28:48.829460  8044 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:48.868794  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 118216us
I20260709 12:28:48.868793  3854 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:48.869062  3848 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:48.846797  8071 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.871845  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:48.870072  3821 leader_election.cc:336] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.541s (SENT)
I20260709 12:28:48.867524  3927 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:48.873809  3821 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:48.875102  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 79916.5us
I20260709 12:28:48.876709  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:48.877415  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:48.877306  4570 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:48.856357  7774 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.878060  3927 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:48.863364  7990 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:48.883276  3998 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:28:48.890159  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:48.873950  8038 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:48.881840  7991 raft_consensus.cc:2764] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:28:48.893196  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:48.876279  8071 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:48.893843  3998 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:28:48.890964  7990 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.895751  7990 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:48.895817  8071 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:48.864252  7884 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:28:48.896636  8071 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.863417  7903 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:48.813326  8124 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:48.901844  4536 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:48.890065  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:48.904224  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:48.905301  4000 raft_consensus.cc:2410] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:28:48.897244  8071 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.904615  3821 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:48.908262  8082 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:48.908761  8082 raft_consensus.cc:697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:48.909761  3895 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:48.910146  8073 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:48.908607  8140 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:48.909623  8082 consensus_queue.cc:237] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:48.911798  3821 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:48.912585  3821 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:48.913256  8073 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:48.913611  8073 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.913740  8140 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:48.914029  8073 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:48.914157  8140 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.914556  8140 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:48.908767  7884 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.918565  7884 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:48.942116  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:48.942319  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:48.942849  3854 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:28:48.949824  7884 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:48.951066  7884 consensus_queue.cc:1059] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:48.952183  3895 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:48.921751  8073 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:48.956591  7884 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:48.883632  8117 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:48.977370  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:48.963896  3927 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:48.966956  7904 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:48.948648  8140 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:48.880162  8101 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:28:49.010946  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:49.011523  8073 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:49.015208  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:48.957635  7905 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:49.019819  4000 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:49.030313  7905 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:49.020697  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:49.030855  7905 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:49.031354  3998 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:48.903297  8038 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.022394  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:49.037107  8038 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.037526  3927 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:49.039695  8145 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.043179  8124 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:49.047863  8054 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.048628  8141 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:28:49.050068  7973 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:28:49.052866  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:49.051826  3927 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:49.054677  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1085) took 1130 ms. Trace:
I20260709 12:28:49.055044  4565 rpcz_store.cc:276] 0709 12:28:47.924211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.924439 (+   228us) service_pool.cc:224] Handling call
0709 12:28:47.936546 (+ 12107us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:28:48.702463 (+765917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:48.702502 (+    39us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:28:48.712034 (+  9532us) log.cc:844] Serialized 78 byte log entry
0709 12:28:48.767195 (+ 55161us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:48.767437 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:48.767504 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:49.054429 (+286925us) raft_consensus.cc:1685] finished
0709 12:28:49.054454 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:49.054622 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":769630,"raft.queue_time_us":763315,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3476,"thread_start_us":45087,"threads_started":1,"wal-append.queue_time_us":165532}
I20260709 12:28:49.060194  3998 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 6. Current term is 7. Ops: []
W20260709 12:28:49.063958  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 161990us
I20260709 12:28:49.064679  4537 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:49.068568  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:49.069118  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:49.069072  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.075217  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:49.076263  3999 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:49.076464  3998 raft_consensus.cc:2410] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:28:49.078469  3848 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
W20260709 12:28:49.078646  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 176878us
I20260709 12:28:49.080375  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:49.081349  3848 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:49.073577  7805 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.021741  8101 consensus_queue.cc:1243] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:28:49.082805  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:49.083621  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.095155  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.095269  4537 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:49.094781  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:49.098011  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 59299.8us
I20260709 12:28:49.098666  3999 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:28:49.061918  8073 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:49.100862  3856 raft_consensus.cc:2393] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:49.102339  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:49.103050  3998 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:49.100140  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:49.108294  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:49.109501  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.110273  8038 raft_consensus.cc:3055] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:49.104548  4005 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:28:49.111229  3897 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:49.083549  8145 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.158538  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.159924  3998 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:28:49.093386  7809 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:49.084796  7859 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.085011  7991 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:49.124696  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:49.085187  7990 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.104028  7884 raft_consensus.cc:697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:49.117704  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:49.100163  8054 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:49.197937  3999 raft_consensus.cc:1275] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:28:49.106016  7974 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:49.099895  7686 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:49.188230  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:49.158973  8038 raft_consensus.cc:740] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:49.193992  4006 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:49.219903  3999 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []
W20260709 12:28:49.219818  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 139560us
I20260709 12:28:49.222206  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.111593  8141 consensus_queue.cc:1059] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:28:49.222906  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:49.233727  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:49.223634  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:49.097187  7805 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:49.224716  3848 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:49.238004  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.222400  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.238946  3856 raft_consensus.cc:2393] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:49.117229  8073 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.233263  4565 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:49.236320  3854 raft_consensus.cc:2393] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 7: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:49.236760  4570 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:28:49.192473  8082 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:49.230602  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 119468us
I20260709 12:28:49.220746  8044 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.262879  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:49.220643  7974 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.278811  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.279187  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:49.279457  4566 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:28:49.279721  4006 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:49.229842  7890 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:49.287689  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:49.288345  4565 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:49.196115  7859 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:49.296511  3924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2526) took 2151 ms (client timeout 1514 ms). Trace:
I20260709 12:28:49.205714  7991 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.235812  8048 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.241047  8156 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:49.285410  8142 consensus_queue.cc:1059] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:49.287732  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.255344  7686 raft_consensus.cc:697] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:49.267961  3853 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:49.303417  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:49.217033  8054 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:49.297142  3924 rpcz_store.cc:269] 0709 12:28:47.131320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.131483 (+   163us) service_pool.cc:224] Handling call
0709 12:28:49.281817 (+2150334us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b54000d5a54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:49.281996 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729600896}
I20260709 12:28:49.304344  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:49.205185  7990 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.311317  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:49.301213  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 61442.7us
I20260709 12:28:49.231859  7809 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.288383  7974 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:49.318604  4567 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:28:49.319286  4005 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:28:49.303715  8038 consensus_queue.cc:260] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:49.322428  8152 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:49.322881  8152 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:49.323258  8152 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:49.327471  7796 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:49.328075  7796 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:49.329353  7863 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.330219  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.332376  7796 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.337522  3853 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:28:49.338832  8161 consensus_queue.cc:1059] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:49.299875  7890 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.309410  8127 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.266367  8082 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.303292  8158 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:49.314347  8144 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:49.300469  8154 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:49.321683  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.378376  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:49.389897  3929 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:49.390992  4006 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:49.363317  4565 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:49.385227  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.399076  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:49.367686  8155 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:28:49.406320  3821 leader_election.cc:336] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.684s (SENT)
W20260709 12:28:49.344553  8149 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:28:49.346074  8148 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:28:49.413859  3821 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:49.364300  8082 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.414625  3929 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:28:49.357199  7991 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.377941  7990 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:49.423203  3898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.001s	sys 0.001s
W20260709 12:28:49.426188  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 165194us
W20260709 12:28:49.436748  3898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.001s	sys 0.002s
I20260709 12:28:49.375137  8160 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.352396  7890 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.347878  8054 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.383605  8140 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.354075  7809 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.381491  8154 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.447361  8154 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:49.366690  8073 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.342270  8086 raft_consensus.cc:3055] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:49.450196  7378 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.450620  8086 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:49.450943  7378 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:49.451758  8086 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:49.349213  7805 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:49.361732  8071 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.452682  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.437842  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:49.403970  7979 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.453560  8141 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.454075  7979 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.454119  8141 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.455436  3853 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:49.456374  7979 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.307632  8048 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.375862  8144 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.458506  8048 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.441381  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:49.458827  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:49.459179  3929 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:49.460060  8144 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.460103  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:49.460872  3929 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
W20260709 12:28:49.442855  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 346684us
I20260709 12:28:49.462347  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:49.416083  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.456558  8141 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:49.442322  3822 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:49.472384  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.473138  4565 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:49.461611  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:49.463423  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.467366  3971 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:49.474516  3854 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:49.475723  3929 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:49.477090  3929 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:28:49.478475  3929 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:28:49.480340  4571 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:28:49.361660  8127 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:49.404855  7905 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:49.494899  4566 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:28:49.495215  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.496408  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.497107  4565 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:49.453692  7378 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.440133  8156 raft_consensus.cc:697] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:49.506803  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:49.470806  7811 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:28:49.469923  7890 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:49.345305  7686 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.484143  8048 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.349411  7884 consensus_queue.cc:237] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.485546  8073 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:49.485895  8054 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:49.486471  7991 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:49.488854  7809 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:28:49.540733  7890 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.488618  7979 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:28:49.558662  8170 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:49.559226  8170 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:49.558959  7991 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.559670  8170 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:49.560103  7890 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.560611  7905 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.561209  4569 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:49.561359  7991 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.513279  8141 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:49.569765  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.570062  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.561674  7890 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.546850  8054 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:49.545212  8048 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.469666  8160 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.575665  7890 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:49.575222  8054 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:49.597003  4568 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:49.601346  8127 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:49.601701  7890 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:49.576295  8156 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.605295  8048 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.612075  8154 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:49.572090  8141 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:49.614683  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 140833us
I20260709 12:28:49.619375  4568 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:28:49.633050  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.635358  8173 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:49.636169  8173 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:49.639727  8154 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.642216  8170 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.642612  8152 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.644569  8141 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.646818  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:49.647389  7974 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.648540  4570 raft_consensus.cc:2368] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11.
I20260709 12:28:49.652019  7905 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:28:49.658802  4536 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:49.644903  8152 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.644541  8170 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.662578  8178 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:28:49.662861  8180 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:28:49.663091  8178 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:49.663496  8178 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:49.654845  8103 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.514s	user 0.004s	sys 0.026s
I20260709 12:28:49.655026  7974 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.662158  8141 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:28:49.666980  8103 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.526s	user 0.004s	sys 0.026s
I20260709 12:28:49.661343  8073 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:28:49.670506  8141 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.681818  8141 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:49.673687  8173 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:49.681036  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:49.697050  8054 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.707839  8054 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.708711  8038 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:49.709591  8178 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.715216  8178 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.715756  8178 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:49.716392  8178 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.717851  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.734493  3857 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:49.723307  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:49.721287  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:49.738394  8073 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:49.738782  8073 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:49.739171  8073 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:49.749500  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.750234  4569 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:49.751996  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:49.752890  7608 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:49.753268  7608 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:49.753619  7608 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:49.723456  8178 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.764472  8073 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:49.771498  3895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.013s	sys 0.005s
I20260709 12:28:49.771282  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:49.772816  3895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.013s	sys 0.005s
I20260709 12:28:49.773743  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:49.784373  8191 log.cc:927] Time spent T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.055s	user 0.003s	sys 0.000s
I20260709 12:28:49.787428  3857 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 8: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:49.793744  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.795980  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:49.796677  4574 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:28:49.800026  8141 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.803076  8141 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.804044  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:49.804234  7859 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.806041  8173 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:49.803520  8073 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.832934  7608 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.839704  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2545) took 1062 ms. Trace:
I20260709 12:28:49.840159  3923 rpcz_store.cc:276] 0709 12:28:48.777254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:49.070816 (+293562us) service_pool.cc:224] Handling call
0709 12:28:49.077810 (+  6994us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:49.744308 (+666498us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b18003a1440. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe051b7f4bc 00007fe04eecd48b 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee7455 00007fe051fcf060 00007fe051fcfbfb 00007fe051fda64b
0709 12:28:49.744431 (+   123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:49.744455 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:49.745074 (+   619us) log.cc:844] Serialized 52 byte log entry
0709 12:28:49.786975 (+ 41901us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:49.787015 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:49.787090 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:49.839368 (+ 52278us) raft_consensus.cc:1685] finished
0709 12:28:49.839388 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:49.839633 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27749,"raft.queue_time_us":143425,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":29956,"spinlock_wait_cycles":5099904,"thread_start_us":201299,"threads_started":2,"wal-append.queue_time_us":76603}
I20260709 12:28:49.850718  7608 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.863423  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:49.884399  8192 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.185s	user 0.004s	sys 0.000s
W20260709 12:28:49.884562  8157 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.518s	user 0.001s	sys 0.001s
I20260709 12:28:49.887166  8159 raft_consensus.cc:3055] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:49.887635  8159 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:49.888473  8159 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.892520  8159 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:49.895444  7979 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:49.907996  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:49.908562  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:49.908890  4004 raft_consensus.cc:2393] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 7: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:49.909191  4005 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:28:49.911374  3969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.005s	sys 0.014s
W20260709 12:28:49.911724  3969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.005s	sys 0.014s
I20260709 12:28:49.916517  4005 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:49.918944  7979 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.919586  7979 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:49.923241  7979 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.926772  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:49.927497  3999 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:49.930111  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:49.930644  4005 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:49.931011  3999 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:28:49.932118  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:49.932701  3998 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:49.934310  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:49.935120  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:49.935685  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:49.937501  4005 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:28:49.938359  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:49.939087  3998 raft_consensus.cc:2410] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:28:49.939145  8113 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:49.939678  8088 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:49.940263  8088 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.942317  8088 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.943423  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:49.947346  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:49.947630  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:49.947950  4004 raft_consensus.cc:2376] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11. Re-sending same reply.
I20260709 12:28:49.953228  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:49.953907  4005 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:49.961582  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:49.962584  4005 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:28:49.968436  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.970408  3856 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:49.971360  8113 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.972084  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.971850  8113 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:49.974578  8113 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:49.974978  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.976485  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.976579  8179 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:49.977329  3856 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:49.977237  8179 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.978683  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.979146  8150 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.979532  8179 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.979643  8150 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.980327  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:49.981688  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:49.981837  8150 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.982963  8158 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:50.005496  8158 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.007715  8158 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.984944  8038 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.008803  8038 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.010958  8038 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.978807  8135 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.011941  8135 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:49.985226  8174 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:50.014580  8174 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.016770  8174 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:49.985266  3895 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:50.021203  8135 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.021829  8135 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:50.022361  8135 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:50.023262  8135 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:49.982497  3856 raft_consensus.cc:2410] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:28:49.997818  7979 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.026760  7979 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.027347  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:50.027923  3856 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:50.028853  7979 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:49.996773  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:50.030383  3857 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:50.042007  8185 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:50.042621  8185 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.044934  8185 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.045708  8174 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.046283  8174 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.048466  8174 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.050807  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.052186  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:50.053831  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.053993  3999 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:50.054392  4004 raft_consensus.cc:2376] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11. Re-sending same reply.
I20260709 12:28:50.052772  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:50.047032  3969 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:50.057427  3924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.016s	sys 0.020s
W20260709 12:28:50.057745  3924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.016s	sys 0.020s
I20260709 12:28:50.059011  8185 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:50.060006  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2554) took 1135 ms. Trace:
I20260709 12:28:50.061228  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:50.060386  3924 rpcz_store.cc:276] 0709 12:28:48.924215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:49.314075 (+389860us) service_pool.cc:224] Handling call
0709 12:28:49.326280 (+ 12205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:49.326662 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:28:49.428756 (+102094us) log.cc:844] Serialized 14 byte log entry
0709 12:28:50.058108 (+629352us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:50.058612 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:28:50.058817 (+   205us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:50.058861 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:50.058925 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:50.059794 (+   869us) raft_consensus.cc:1685] finished
0709 12:28:50.059812 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:50.059936 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":131566,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":4984,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":185,"thread_start_us":701518,"threads_started":2,"wal-append.queue_time_us":173953}
I20260709 12:28:50.063799  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:50.064950  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:50.065433  3848 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:28:50.067802  3743 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.779s	user 0.003s	sys 0.001s
I20260709 12:28:50.067902  3969 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:50.074472  3895 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:50.075748  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:50.053169  3927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.002s	sys 0.006s
W20260709 12:28:50.077139  3927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.003s	sys 0.007s
I20260709 12:28:50.054838  4000 raft_consensus.cc:2410] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:28:50.078090  8174 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:50.078502  8174 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:50.078939  8174 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:50.028818  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:50.081394  3856 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:50.077174  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1051) took 1649 ms. Trace:
I20260709 12:28:50.082285  3851 rpcz_store.cc:276] 0709 12:28:48.427941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:48.428095 (+   154us) service_pool.cc:224] Handling call
0709 12:28:48.511133 (+ 83038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:49.406988 (+895855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:49.407027 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:49.407092 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:49.407142 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:50.076955 (+669813us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b5400018bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:50.077008 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:50.077122 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2059825664}
W20260709 12:28:50.077147  3997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 757) took 2436 ms (client timeout 2120 ms). Trace:
W20260709 12:28:50.083645  3997 rpcz_store.cc:269] 0709 12:28:47.640552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.640719 (+   167us) service_pool.cc:224] Handling call
0709 12:28:50.076918 (+2436199us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b540030ff54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:50.077071 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015131904}
I20260709 12:28:50.084190  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:50.084401  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:50.085314  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:50.086747  3856 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:28:50.090838  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2025) took 2427 ms. Trace:
I20260709 12:28:50.090935  8174 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.092473  8160 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:50.091305  3849 rpcz_store.cc:276] 0709 12:28:47.663449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.663620 (+   171us) service_pool.cc:224] Handling call
0709 12:28:47.664014 (+   394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:47.814273 (+150259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:47.814323 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:48.054466 (+240143us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b1800439d20. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeb82a6 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a
0709 12:28:48.471200 (+416734us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b2c00060638. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:28:48.519331 (+ 48131us) log.cc:844] Serialized 52 byte log entry
0709 12:28:48.657098 (+137767us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:48.657151 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:50.090522 (+1433371us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400063bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:50.090569 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:50.090625 (+    56us) raft_consensus.cc:1685] finished
0709 12:28:50.090637 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:50.090781 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1745,"raft.queue_time_us":8297,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2873,"spinlock_wait_cycles":348564992,"thread_start_us":101157,"threads_started":1,"wal-append.queue_time_us":147579,"wal-append.run_cpu_time_us":1709,"wal-append.run_wall_time_us":1001685}
I20260709 12:28:50.093156  8174 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.086365  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2553) took 1162 ms. Trace:
I20260709 12:28:50.094327  3927 rpcz_store.cc:276] 0709 12:28:48.923633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:49.118404 (+194771us) service_pool.cc:224] Handling call
0709 12:28:49.177255 (+ 58851us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:49.237112 (+ 59857us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:49.413431 (+176319us) log.cc:844] Serialized 14 byte log entry
0709 12:28:50.077711 (+664280us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:50.078186 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:28:50.078330 (+   144us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:50.078362 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:50.078424 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:50.086145 (+  7721us) raft_consensus.cc:1685] finished
0709 12:28:50.086168 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:50.086306 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94482,"prepare.queue_time_us":220810,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":80075,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":17035,"thread_start_us":741277,"threads_started":2,"wal-append.queue_time_us":191857}
I20260709 12:28:50.093858  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:50.083664  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:50.097926  3851 raft_consensus.cc:2393] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:50.100597  8080 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:50.093756  8174 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.101363  8174 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.101289  8080 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.103657  8174 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:50.100062  3821 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:50.085367  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:50.111677  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:50.112587  3848 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:28:50.111310  3855 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:50.117832  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:50.118076  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 50196.3us
I20260709 12:28:50.119557  3927 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:28:50.114825  3821 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:50.120424  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:50.113124  3895 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:50.121109  3924 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:50.122263  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:50.122730  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:50.123515  3849 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:28:50.124992  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 51482.6us
I20260709 12:28:50.125433  3895 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:50.119009  7608 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:50.127174  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.127300  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.121639  3821 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:50.129068  3857 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:28:50.130731  3821 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:50.131850  3821 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:50.135677  3857 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:50.139415  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:50.133221  7905 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:50.127527  8140 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:50.120805  8185 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:50.143224  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:50.128268  8174 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:50.148705  3969 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:50.136036  8073 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:50.149840  8073 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:50.150810  8073 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.151499  8187 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:50.151952  8187 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:50.152312  8187 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:50.144479  7608 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:50.154373  3855 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:50.119518  7979 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:28:50.155453  3931 raft_consensus.cc:2410] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:28:50.159068  8038 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:50.160230  7903 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:50.159910  8038 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.148229  3821 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:50.156307  3924 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:50.157248  3969 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:50.133642  8135 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:50.146752  8048 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:50.166549  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:50.144714  7905 raft_consensus.cc:697] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:50.167483  3821 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:50.147015  8140 raft_consensus.cc:697] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:50.170463  3821 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:50.165362  8178 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:28:50.167296  8117 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.020s	sys 0.010s
I20260709 12:28:50.164176  8174 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:50.189152  4003 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:28:50.166249  8185 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:50.165547  8135 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:50.193780  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.171734  7608 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:50.180720  8158 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:50.190629  8117 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.025s	sys 0.010s
I20260709 12:28:50.194636  4003 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:50.190739  8048 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.187672  8178 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:50.196110  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:50.195415  7608 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:50.194947  8135 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:50.196590  7979 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:50.206262  8038 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.206719  4573 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:50.194281  8080 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.191013  8174 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:50.208949  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.216056  4003 raft_consensus.cc:2410] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:28:50.208819  8178 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:50.196178  8158 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.213512  7979 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:50.222846  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.225265  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.226097  3923 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:28:50.226272  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:50.226858  3928 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:50.213825  7608 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:50.223449  4003 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:50.207213  8048 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.212571  8117 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:28:50.233111  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.233623  3930 raft_consensus.cc:1240] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:28:50.234180  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.243134  3924 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:50.198696  7905 consensus_queue.cc:237] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.227715  7979 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:50.241726  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:50.243964  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.245370  3925 raft_consensus.cc:2410] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:28:50.245293  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.246508  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.247145  4003 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:50.219266  7903 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:28:50.246395  3927 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:50.249416  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:50.251333  4003 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:50.253928  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.254828  4000 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:50.258162  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.259500  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:50.261986  3927 pending_rounds.cc:85] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 7
I20260709 12:28:50.262311  3927 pending_rounds.cc:107] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:28:50.262190  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:50.262569  3927 raft_consensus.cc:2889] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:50.262760  3999 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:50.264569  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.265165  3925 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:50.253661  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.266129  3930 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:50.278422  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.279240  3924 raft_consensus.cc:2393] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:50.288487  8214 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:50.289279  8214 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.231423  8080 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:28:50.244767  8124 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.292081  4004 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:50.302021  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.303059  4004 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 12: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:50.293601  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.218030  8140 consensus_queue.cc:237] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:50.294755  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 106340us
I20260709 12:28:50.296766  3849 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:50.300130  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.305768  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.305709  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:50.284616  8103 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.307277  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:50.308940  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.308595  4536 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:50.313755  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 83161.1us
I20260709 12:28:50.315817  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.316821  8141 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:50.318589  8141 raft_consensus.cc:697] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:50.319505  8141 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.321595  8079 raft_consensus.cc:3055] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:50.321995  8079 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:50.326287  8211 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:50.328238  3928 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:50.328523  8211 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:28:50.330655  8158 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.329696  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:50.318303  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.336227  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:50.336747  4004 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:50.339056  3924 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:50.348675  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.350287  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.350200  8178 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.351465  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.348548  7973 consensus_queue.cc:1059] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:50.353947  3855 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: []
W20260709 12:28:50.318608  8209 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:28:50.308545  8207 consensus_queue.cc:1059] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:28:50.354931  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:50.357838  3970 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:50.359220  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 52371.2us
I20260709 12:28:50.307576  8124 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.362154  3855 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 13: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:50.364197  3928 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:50.325786  8187 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.313180  8103 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.371040  3925 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:50.370117  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.381217  3930 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:50.352304  8210 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.379026  8207 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:50.382843  8210 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.383232  8207 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.370584  8187 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:50.387176  8207 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.389496  3852 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:50.390712  3852 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:50.391983  3852 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:28:50.392627  8197 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.689s	user 0.002s	sys 0.000s
I20260709 12:28:50.392995  3852 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:50.393509  3999 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:50.397475  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.397642  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.398644  3999 raft_consensus.cc:2376] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9. Re-sending same reply.
I20260709 12:28:50.401367  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:50.404933  3852 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:50.410409  8210 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.411568  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:50.412379  4006 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:50.414551  8214 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.394608  8215 consensus_queue.cc:1048] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:28:50.351884  3743 maintenance_manager.cc:643] P a21ae62b873f4aa28d9c28a3b1bc7936: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.056s	user 0.210s	sys 0.040s Metrics: {"bytes_written":29653,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":40466,"dirs.run_cpu_time_us":411,"dirs.run_wall_time_us":1227,"drs_written":1,"lbm_read_time_us":18762,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":1,"lbm_write_time_us":269609,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":8,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":176027,"threads_started":2,"update_count":8,"wal-append.queue_time_us":334373}
I20260709 12:28:50.418768  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:50.420321  3970 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:50.422041  4003 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:50.422976  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:50.423435  4003 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:50.426391  3970 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:50.427450  8187 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:50.428359  8210 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:50.430033  3970 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:50.430457  3852 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:28:50.431460  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:50.432312  3852 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:50.432912  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.433774  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.431385  3970 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:50.434500  4000 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:50.436187  8187 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:50.436311  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:50.436964  4000 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:50.436916  3897 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:50.442180  4006 raft_consensus.cc:2410] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:28:50.443009  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.436848  8187 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:50.444478  8187 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:50.444643  8210 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:50.445101  8210 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:50.445469  8210 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:50.447999  4000 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:28:50.452248  4003 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:28:50.453504  3970 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:50.455091  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:50.456117  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:50.456779  3970 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:50.456964  3999 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:50.457623  4004 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
W20260709 12:28:50.458164  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 85319.3us
W20260709 12:28:50.458945  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 144356us
I20260709 12:28:50.427757  8214 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:50.474855  3897 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:50.433365  8216 consensus_queue.cc:1059] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:28:50.494000  3970 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:50.491405  3744 maintenance_manager.cc:419] P a21ae62b873f4aa28d9c28a3b1bc7936: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10094 bytes on disk
I20260709 12:28:50.490305  8214 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:50.495728  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:50.499132  3743 maintenance_manager.cc:643] P a21ae62b873f4aa28d9c28a3b1bc7936: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":390,"lbm_reads_lt_1ms":4}
I20260709 12:28:50.499660  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:50.498343  8214 raft_consensus.cc:3055] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:50.501431  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.512965  3970 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:50.513505  3997 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:50.514508  3897 leader_election.cc:400] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11.
I20260709 12:28:50.514475  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.512699  8223 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:50.494055  3999 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:28:50.517761  4004 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:50.521390  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.522221  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:50.523540  3999 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:50.497532  8158 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.526177  8158 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.528141  8158 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.513013  8214 raft_consensus.cc:740] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:50.496279  8216 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:50.530524  3852 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:50.504424  8187 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.531916  3852 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:28:50.533039  3852 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:50.533743  8154 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.534286  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.535347  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:50.535974  3930 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:50.538614  3851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:28:50.539258  3851 raft_consensus.cc:606] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:50.532631  8214 consensus_queue.cc:260] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.539178  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.540683  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.541309  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:50.541476  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:50.542413  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:50.543057  3928 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:50.534307  8154 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.545548  3927 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:28:50.368727  8038 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.546624  8154 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.546914  8038 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.547338  8154 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:50.547803  8154 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:50.548249  8154 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:50.550316  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:50.551240  8139 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:50.551641  8139 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:50.551932  8139 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:50.551831  3897 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:50.556242  3928 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:50.559801  3897 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:50.559834  3999 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:50.562332  8223 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:50.561506  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:50.567327  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:50.570343  4002 raft_consensus.cc:2393] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 7: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:50.569315  3930 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:50.573935  3930 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:50.529234  8210 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.575543  3930 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:50.565703  8103 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.567337  8086 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:50.583074  3999 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:28:50.588409  8187 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.577383  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:50.529239  8158 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.591856  8158 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.594748  8158 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.595489  8158 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.596136  8158 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.592020  8210 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.598062  3926 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:50.591764  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:50.598886  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 85976.7us
I20260709 12:28:50.597461  8154 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.600024  8038 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:50.602030  8038 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:50.602708  8038 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:50.603236  8154 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.603305  8038 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:50.608758  8038 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:50.609293  8038 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:50.609778  8038 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:50.374405  8178 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:50.612385  8210 consensus_queue.cc:1059] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:50.616806  8135 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.622746  8223 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:50.622731  8154 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:50.624287  8154 raft_consensus.cc:697] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:50.627525  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:50.628333  3928 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:50.630465  8227 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:50.630956  8227 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:50.630720  8038 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.631342  8227 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:50.633066  8038 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:50.634346  8038 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:50.634847  8038 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:50.636586  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.639137  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:50.625253  8154 consensus_queue.cc:237] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.685108  3928 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:28:50.758551  8150 consensus_queue.cc:1059] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:50.760071  8150 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:50.760463  8150 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:50.643105  8223 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:50.766417  8223 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:50.746735  8139 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.767838  8135 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.770665  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:50.772303  3932 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2535) took 2795 ms (client timeout 1684 ms). Trace:
W20260709 12:28:50.772706  3932 rpcz_store.cc:269] 0709 12:28:47.976652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.979079 (+  2427us) service_pool.cc:224] Handling call
0709 12:28:50.772109 (+2793030us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54000ef1d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:50.772235 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433251712}
I20260709 12:28:50.776203  8158 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:50.777941  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:50.773839  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:50.635740  8038 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.907935  8187 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:50.953665  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:50.944063  8150 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:50.952639  8187 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.988430  8187 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.990532  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1067) took 1386 ms. Trace:
I20260709 12:28:50.991211  3850 rpcz_store.cc:276] 0709 12:28:49.619302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:50.989122 (+1369820us) service_pool.cc:224] Handling call
0709 12:28:50.989628 (+   506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:50.989943 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:50.989997 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:50.990070 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:50.990139 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:50.990241 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:50.990429 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:51.001302  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1016) took 1103 ms. Trace:
I20260709 12:28:51.002007  4567 rpcz_store.cc:276] 0709 12:28:49.897585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:49.897734 (+   149us) service_pool.cc:224] Handling call
0709 12:28:49.898067 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:49.898413 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:49.898440 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:49.898966 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 12:28:49.913921 (+ 14955us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:49.913970 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:49.914041 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:50.499305 (+585264us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b54006e7420. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f4cdbe 00007fe051f57930 00007fe051f578d8 00007fe051f57858 00007fe051f57813 00007fe051f56a9c 00007fe057e422f6 00007fe057e3caa8 00007fe051f937cb 00007fe051f962c0
0709 12:28:51.000806 (+501501us) raft_consensus.cc:1685] finished
0709 12:28:51.000842 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:51.001204 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4785,"raft.queue_time_us":986,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":40926976,"thread_start_us":7323,"threads_started":1,"wal-append.queue_time_us":7778}
I20260709 12:28:50.964553  8227 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.012077  8227 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:50.368665  7903 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:51.016839  8139 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:51.025173  8079 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.026656  8079 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:51.027040  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:51.034679  8048 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:51.061059  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1073) took 1415 ms. Trace:
I20260709 12:28:51.061651  3856 rpcz_store.cc:276] 0709 12:28:49.645425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.059819 (+1414394us) service_pool.cc:224] Handling call
0709 12:28:51.060259 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:51.060539 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:51.060585 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:51.060650 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:51.060711 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:51.060790 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:51.060979 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:51.072599  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:51.073360  4005 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:51.075412  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:51.075995  4005 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:51.076941  8038 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.077607  8038 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.083896  4005 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:51.085425  3897 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:51.086374  8054 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:51.086912  8054 raft_consensus.cc:697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:51.087862  8054 consensus_queue.cc:237] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.091876  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:51.095568  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:51.096272  4005 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:51.100059  8038 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:51.106343  4005 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:28:51.107673  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:51.108374  4005 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:28:51.109297  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:51.109902  4005 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:28:51.110833  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:51.111511  4005 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:28:51.112442  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:51.113306  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:51.113915  4005 raft_consensus.cc:2393] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 11: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:28:51.114282  8174 consensus_meta.cc:287] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.893s	user 0.012s	sys 0.000s
I20260709 12:28:51.115237  4005 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:28:51.115502  3897 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:51.116607  8174 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.117200  3897 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:51.116081  8181 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:51.118320  8181 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:51.118448  8179 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:51.118872  8179 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:51.119233  8179 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:51.119284  8181 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.125711  8054 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:51.130905  8038 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:51.131374  8038 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:51.131763  8038 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:51.132522  3932 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: [7.5-10.6]
I20260709 12:28:51.133127  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:51.136375  3930 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:51.134603  8179 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.138423  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:51.141979  8140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.020s	sys 0.017s
I20260709 12:28:51.149358  3930 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
W20260709 12:28:51.146217  8140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.020s	sys 0.017s
I20260709 12:28:51.175957  8038 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.177438  8179 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:51.178668  4566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1005) took 1514 ms. Trace:
I20260709 12:28:51.179095  4566 rpcz_store.cc:276] 0709 12:28:49.664761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:49.664910 (+   149us) service_pool.cc:224] Handling call
0709 12:28:49.668597 (+  3687us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:49.670234 (+  1637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:49.670254 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:49.670683 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:28:49.688355 (+ 17672us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:28:49.693148 (+  4793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:49.693226 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:50.392068 (+698842us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:51.178340 (+786272us) raft_consensus.cc:1685] finished
0709 12:28:51.178371 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:51.178608 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":364,"raft.queue_time_us":1301,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3405,"spinlock_wait_cycles":44179840,"thread_start_us":7432,"threads_started":1,"wal-append.queue_time_us":22423}
I20260709 12:28:51.180557  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:51.181200  4005 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:51.186556  8038 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:51.187443  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1061) took 1783 ms. Trace:
I20260709 12:28:51.187880  3853 rpcz_store.cc:276] 0709 12:28:49.403998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:49.404204 (+   206us) service_pool.cc:224] Handling call
0709 12:28:49.404499 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:49.455805 (+ 51306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:51.187149 (+1731344us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b5400190354. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:51.187356 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116393216}
I20260709 12:28:51.188977  4005 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:28:51.190007  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:51.190310  3897 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:51.190517  4005 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:51.191113  8038 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:51.191591  8038 raft_consensus.cc:697] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:51.192382  8038 consensus_queue.cc:237] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.176352  4000 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:28:51.197790  8225 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.198330  8225 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.200531  8225 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:51.200945  4537 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:51.202543  8145 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:51.201792  7863 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:51.203409  4005 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:28:51.203641  7863 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.204434  3897 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:51.205235  8181 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:51.202368  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:51.205478  7863 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:51.206676  8181 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:28:51.206979  4568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 1000) took 1732 ms (client timeout 1702 ms). Trace:
I20260709 12:28:51.207194  8181 raft_consensus.cc:697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:51.207247  4537 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:51.208194  8181 consensus_queue.cc:237] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.209035  7863 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:51.209956  7863 raft_consensus.cc:697] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:51.210824  7863 consensus_queue.cc:237] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:50.364744  7979 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.214094  8079 consensus_queue.cc:1059] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:51.215528  8145 raft_consensus.cc:3055] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:51.215981  8145 raft_consensus.cc:740] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:51.216938  8145 consensus_queue.cc:260] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.218024  8080 raft_consensus.cc:3055] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:51.218263  8179 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.218489  8080 raft_consensus.cc:740] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:51.218815  8179 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.219455  8080 consensus_queue.cc:260] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.221220  8080 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:51.221755  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 762055us
I20260709 12:28:51.222983  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:50.368993  7914 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:28:51.226022  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 766335us
I20260709 12:28:51.226293  3932 raft_consensus.cc:1240] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:28:51.227409  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:51.227617  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:51.229246  8220 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:51.229686  8222 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:51.225188  7914 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.230733  8220 consensus_queue.cc:1059] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:28:51.230867  7905 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:51.231757  8220 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:51.233564  8215 raft_consensus.cc:3055] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:51.234025  8215 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:51.235482  8178 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:51.236181  8178 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.236608  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:51.207454  4568 rpcz_store.cc:269] 0709 12:28:49.474930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:49.475092 (+   162us) service_pool.cc:224] Handling call
0709 12:28:51.206774 (+1731682us) spinlock_profiling.cc:243] Waited 88.5 ms on lock 0x7b54007c2754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:51.206882 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203608960}
I20260709 12:28:51.238739  3969 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:51.239591  7979 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:51.240192  3969 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:51.242597  8140 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.243111  8140 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.246022  3853 raft_consensus.cc:1240] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:51.246130  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:51.246934  8161 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:51.247581  8161 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.248286  7890 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:51.248999  7890 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:51.249671  7890 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:28:50.367707  8091 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.883s
I20260709 12:28:51.250806  7805 raft_consensus.cc:3055] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:51.251117  8161 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:51.251175  7805 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:51.252417  7805 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.253463  7805 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:51.253650  3857 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:51.247859  8166 consensus_queue.cc:1059] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:28:51.255754  8166 raft_consensus.cc:3055] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:51.256167  8166 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:51.259300  7914 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:51.247557  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:51.263226  7914 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:51.263813  7914 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:51.264978  7914 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.277863  4004 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:51.282838  4003 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:28:51.279659  8214 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:51.280395  8165 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.279836  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:51.286178  8165 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.288540  8165 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:51.289167  8165 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:51.290092  8247 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.290786  8247 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.292712  7884 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:51.297459  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:51.305341  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 767) took 1053 ms. Trace:
I20260709 12:28:51.305748  4001 rpcz_store.cc:276] 0709 12:28:50.252312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.297110 (+1044798us) service_pool.cc:224] Handling call
0709 12:28:51.305275 (+  8165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:51.305575  8223 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.241839  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:51.306730  8223 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:28:51.307328  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 65572.1us
I20260709 12:28:51.308744  8185 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:51.309602  8185 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:51.310267  8086 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:51.310726  7843 raft_consensus.cc:3055] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:51.311161  7843 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:51.312086  7843 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.313488  7914 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.313773  8088 raft_consensus.cc:3055] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:51.314947  8088 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:51.315742  8088 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.316533  4567 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:51.317013  8088 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:51.317828  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.319433  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.319837  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:51.320029  4567 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:51.320499  4006 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:51.321765  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:51.323558  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:51.324410  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:51.301210  8247 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:51.314183  7914 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.289636  8165 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:51.342177  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:51.342890  7914 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:51.343605  8165 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:51.301901  3931 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:51.303974  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:51.304117  8085 consensus_queue.cc:1059] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:51.257179  8166 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.346606  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.347025  8166 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:51.348382  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:51.348721  8225 consensus_queue.cc:1175] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f3cab225ecb7488386a1a19239498cfe" responder_term: 12 status { last_received { term: 12 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 12 index: 7 } }
I20260709 12:28:51.351007  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.351262  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:51.351611  4570 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:28:51.330641  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:51.334007  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.352583  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.352694  4565 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:51.353320  4571 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
W20260709 12:28:51.353811  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:51.354087  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.354664  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.355499  4567 raft_consensus.cc:2410] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:28:51.356467  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.358881  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.359177  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:51.360428  8179 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:51.361079  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.361344  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.362077  4565 raft_consensus.cc:2393] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 11: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:51.337406  8174 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:51.361677  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.363178  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:51.363757  7608 consensus_meta.cc:287] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.128s	user 0.010s	sys 0.002s
I20260709 12:28:51.365242  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:51.365581  7843 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:51.361718  4572 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:51.364494  7608 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.378888  4570 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:28:51.379004  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.380235  3849 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:51.381999  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 2050) took 1213 ms. Trace:
I20260709 12:28:51.382453  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 770) took 1104 ms. Trace:
I20260709 12:28:51.382354  3849 rpcz_store.cc:276] 0709 12:28:50.168504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:50.307107 (+138603us) service_pool.cc:224] Handling call
0709 12:28:51.381783 (+1074676us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540001a9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:51.381939 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2462116096}
I20260709 12:28:51.382863  4002 rpcz_store.cc:276] 0709 12:28:50.278004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:50.290829 (+ 12825us) service_pool.cc:224] Handling call
0709 12:28:51.382268 (+1091439us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b5400127354. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:51.382394 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598212992}
W20260709 12:28:51.383759  4027 debug-util.cc:398] Leaking SignalData structure 0x7b0800306e40 after lost signal to thread 2679
W20260709 12:28:51.384892  4027 debug-util.cc:398] Leaking SignalData structure 0x7b08001fd8a0 after lost signal to thread 3789
I20260709 12:28:51.384740  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.385219  3854 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:51.385386  4568 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:28:51.385900  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1066) took 1781 ms. Trace:
W20260709 12:28:51.386205  4027 debug-util.cc:398] Leaking SignalData structure 0x7b080036eac0 after lost signal to thread 3881
W20260709 12:28:51.387456  4027 debug-util.cc:398] Leaking SignalData structure 0x7b08001041a0 after lost signal to thread 3956
W20260709 12:28:51.387739  4027 debug-util.cc:398] Leaking SignalData structure 0x7b08003ea020 after lost signal to thread 3957
W20260709 12:28:51.388803  4027 debug-util.cc:398] Leaking SignalData structure 0x7b08003d96a0 after lost signal to thread 4030
W20260709 12:28:51.389082  4027 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1520 after lost signal to thread 4031
I20260709 12:28:51.391335  3897 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:51.392624  8174 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:51.386224  3854 rpcz_store.cc:276] 0709 12:28:49.604115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.384767 (+1780652us) service_pool.cc:224] Handling call
0709 12:28:51.385050 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:51.385644 (+   594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:51.385833 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:51.394742  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.380127  7608 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:51.397852  8215 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:51.340337  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 127263us
I20260709 12:28:51.361804  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.399279  8215 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:51.370481  3848 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:51.399633  3897 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:51.400041  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1074) took 1754 ms. Trace:
I20260709 12:28:51.400439  3848 rpcz_store.cc:276] 0709 12:28:49.645738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.369909 (+1724171us) service_pool.cc:224] Handling call
0709 12:28:51.370267 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:51.399796 (+ 29529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:51.399987 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:51.371141  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:51.372687  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:51.401366  4573 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:51.373921  8150 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:28:51.404168  8224 log.cc:927] Time spent T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.825s	user 0.002s	sys 0.000s
I20260709 12:28:51.376899  8140 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:51.406731  3897 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:51.400974  7884 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:51.412806  3897 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:51.414831  8160 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:51.313830  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:51.414994  8174 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:51.414670  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:51.416452  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 102696us
I20260709 12:28:51.366441  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.409206  4573 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:28:51.420192  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:51.421954  8085 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:51.426231  8161 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:51.426698  8086 consensus_queue.cc:1059] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:51.427693  8086 raft_consensus.cc:3055] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:51.428081  8086 raft_consensus.cc:740] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:51.429013  8086 consensus_queue.cc:260] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.429960  8173 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:51.430315  3969 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:51.415534  7884 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:51.418692  4567 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:51.334790  4538 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:51.438308  8223 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:51.462343  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:51.462724  8223 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:51.463189  4006 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:51.463358  8223 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:51.415642  8179 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:51.452037  8173 raft_consensus.cc:697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:28:51.466425  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 131729us
I20260709 12:28:51.466454  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 1986) took 1238 ms. Trace:
I20260709 12:28:51.461532  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:51.468225  4002 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:51.461687  8086 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:51.470194  3997 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:51.467177  8173 consensus_queue.cc:237] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.462407  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:51.474319  4000 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
W20260709 12:28:51.459704  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 85558.7us
I20260709 12:28:51.475502  3970 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:51.437772  8160 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:51.467576  8124 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:51.435067  3897 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:51.452423  8085 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:51.487870  8258 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:51.488484  8258 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:51.488903  8258 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:51.467379  4538 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:51.482978  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 47996us
I20260709 12:28:51.467929  3929 rpcz_store.cc:276] 0709 12:28:50.228386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.166037 (+937651us) service_pool.cc:224] Handling call
0709 12:28:51.166371 (+   334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:51.171387 (+  5016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:51.171419 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:51.171983 (+   564us) log.cc:844] Serialized 52 byte log entry
0709 12:28:51.387952 (+215969us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b1800058840. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:28:51.435305 (+ 47353us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:51.435364 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:51.435454 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:51.466164 (+ 30710us) raft_consensus.cc:1685] finished
0709 12:28:51.466181 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:51.466396 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3090,"raft.queue_time_us":4694,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":78,"spinlock_wait_cycles":2896768,"thread_start_us":47124,"threads_started":1,"wal-append.queue_time_us":287574}
I20260709 12:28:51.485939  4006 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
W20260709 12:28:51.497346  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 78281us
I20260709 12:28:51.494627  3970 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:51.499078  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:51.498296  4537 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:51.508800  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 281256us
I20260709 12:28:51.458968  7884 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:51.510560  3822 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:51.511775  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:51.512383  3925 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:51.513226  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:51.516192  4000 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:28:51.517366  3928 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:51.518316  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:51.518885  4006 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:28:51.485131  8103 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:51.494344  8150 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:51.497898  8140 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.525725  3897 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:51.532548  3822 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:51.516018  8136 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:51.550379  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:51.552975  3897 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:51.552825  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:51.554006  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:51.521467  8085 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:51.560672  3822 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:51.556582  3854 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:51.563611  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:51.564239  3850 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:28:51.565197  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:51.567094  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 99837.6us
I20260709 12:28:51.568974  3855 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:51.494503  8160 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.569324  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:51.573007  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:51.530659  8152 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.571728  3897 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:51.573518  3856 raft_consensus.cc:2393] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:51.569265  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:51.527307  8222 raft_consensus.cc:697] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:51.533106  8150 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:51.570856  3854 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:28:51.520447  8124 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:28:51.576116  3897 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:51.521358  8038 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:28:51.521373  8113 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:28:51.551203  8247 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:51.551018  7608 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:51.595523  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:51.609684  3854 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:28:51.577560  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:51.574988  4538 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:51.571007  8207 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:51.563922  8174 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:51.570776  8243 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:51.576752  7905 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:28:51.638306  8247 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:51.639076  7960 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:51.627066  7608 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.642740  7608 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:51.601575  8152 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.643905  8161 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:51.644469  8161 raft_consensus.cc:697] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:51.645380  8161 consensus_queue.cc:237] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.645468  8152 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:51.604216  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:51.559557  8085 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:51.515581  8179 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:28:51.546613  8165 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:28:51.588219  8150 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:51.576450  8136 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:51.605047  8124 consensus_queue.cc:1243] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:28:51.625428  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 49375.8us
I20260709 12:28:51.626803  8207 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:51.552421  8140 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:51.573611  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 65262.7us
I20260709 12:28:51.602118  8212 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:51.600791  8229 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:51.614562  8255 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:51.608095  8038 consensus_queue.cc:1243] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:28:51.628995  8174 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:51.577276  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:51.699498  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:51.682475  8085 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:51.700214  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:51.700349  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:51.727598  3854 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:28:51.727721  3852 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:28:51.698532  3897 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:51.720762  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 143582us
I20260709 12:28:51.731503  3822 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:51.699777  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:51.732313  3848 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:51.722826  8244 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:51.704795  8207 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:51.729692  3897 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:51.735154  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:51.744221  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:51.735369  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 98583.6us
I20260709 12:28:51.747778  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:51.749150  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:51.721480  8229 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:51.709725  8255 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:28:51.827471  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 84548.5us
I20260709 12:28:51.726279  8174 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:28:51.754750  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 179814us
W20260709 12:28:51.861737  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 112654us
I20260709 12:28:51.862666  3822 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:51.727190  8212 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:51.864799  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:51.865653  3854 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:51.866554  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:51.733383  8152 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:51.746716  8158 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:51.861258  4538 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:51.871073  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 123368us
I20260709 12:28:51.873487  7905 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:51.858628  8214 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:51.874461  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:51.755012  8136 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:51.884246  8241 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:28:51.884025  8214 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.887660  8047 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:51.827003  8243 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:51.888132  8047 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:51.888569  8047 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:51.891530  7905 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:28:51.866329  8044 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:51.892299  8243 raft_consensus.cc:697] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:51.892504  8214 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:51.892683  8044 raft_consensus.cc:697] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:51.893438  8243 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.893721  8044 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.882035  3848 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:28:51.897665  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:51.899760  4573 raft_consensus.cc:3055] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:51.900215  4573 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:28:51.901648  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 403409us
I20260709 12:28:51.901506  4536 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:51.902369  4537 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:51.904863  3822 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:51.857024  8229 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:51.906914  3822 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:51.909224  4567 raft_consensus.cc:3055] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:51.909673  4567 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:51.910557  4567 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.911652  4567 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:51.911834  3997 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:28:51.860277  8246 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:51.916055  4573 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:51.868528  7608 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:51.929962  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:51.856896  8255 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:51.920821  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.918481  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.746141  8261 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.157s
I20260709 12:28:51.947196  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:51.950335  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:51.951248  4001 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
W20260709 12:28:51.952992  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:51.925370  3929 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:51.927326  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:51.954988  3848 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:51.956175  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:51.960256  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:51.960327  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 62770.9us
I20260709 12:28:51.745959  8223 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.944144  4574 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:51.946182  3932 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:28:51.968103  3927 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:51.947130  4573 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:51.961169  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:51.961892  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:51.971987  3930 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:51.973160  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:51.965438  3925 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:51.918766  8244 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:51.966396  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:51.966620  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:51.976677  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 75263.6us
I20260709 12:28:51.975890  3928 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:28:51.727443  8222 consensus_queue.cc:237] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:51.978613  3932 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:28:51.870216  8260 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 12:28:51.979796  3925 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:28:51.923655  8256 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:51.986755  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:51.987550  3924 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:51.988607  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:51.983944  4573 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:28:51.976326  7805 consensus_meta.cc:287] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.000s
I20260709 12:28:51.918555  8211 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:28:51.995908  3927 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 13: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:52.038126  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:52.042850  8166 consensus_meta.cc:287] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.005s
I20260709 12:28:52.044549  8178 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:52.048693  4027 debug-util.cc:398] Leaking SignalData structure 0x7b0800366d00 after lost signal to thread 4598
W20260709 12:28:52.080010  4027 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9340 after lost signal to thread 4599
I20260709 12:28:52.080235  4567 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:28:52.080883  4567 pending_rounds.cc:85] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 8
W20260709 12:28:52.081667  4027 debug-util.cc:398] Leaking SignalData structure 0x7b0800382580 after lost signal to thread 8142
I20260709 12:28:52.081179  4567 pending_rounds.cc:107] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:28:52.082441  4567 raft_consensus.cc:2889] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:52.082592  4027 debug-util.cc:398] Leaking SignalData structure 0x7b0800325880 after lost signal to thread 8175
W20260709 12:28:52.053025  8262 log.cc:927] Time spent T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.192s	user 0.002s	sys 0.000s
W20260709 12:28:52.056803  8259 log.cc:927] Time spent T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:28:52.062304  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:52.062981  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:51.966449  8073 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:51.922230  8245 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:51.976457  8244 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:51.978926  7863 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:51.978767  8165 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:51.983448  8247 raft_consensus.cc:2764] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:28:52.076476  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:52.117129  3854 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:51.982209  8160 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
W20260709 12:28:52.098162  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 137667us
I20260709 12:28:52.070369  8267 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:28:52.092571  7843 consensus_meta.cc:287] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.703s	user 0.010s	sys 0.004s
W20260709 12:28:52.088594  8257 log.cc:927] Time spent T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:28:52.119278  3927 raft_consensus.cc:1217] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 5.6->[6.7-10.9]   Dedup: 6.7->[8.8-10.9]
I20260709 12:28:52.147142  3927 pending_rounds.cc:85] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 7
I20260709 12:28:52.147480  3927 pending_rounds.cc:107] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:28:52.147771  3927 raft_consensus.cc:2889] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:52.145349  3856 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:28:52.145834  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:52.105567  8244 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:52.151594  3998 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:52.153359  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:52.158699  3848 raft_consensus.cc:2393] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:28:52.153919  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 192806us
I20260709 12:28:52.105567  8140 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:52.111121  8165 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:52.157727  3822 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:52.163661  8258 consensus_meta.cc:287] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.003s
I20260709 12:28:52.069126  8212 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:52.169257  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:52.174140  8145 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:52.167579  8165 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:52.181025  7608 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:52.181634  7608 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:52.182124  7608 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:52.168459  7843 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.186612  7843 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:52.187528  8263 log.cc:927] Time spent T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 12:28:52.188990  8223 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:52.193014  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:52.194043  8258 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:52.200649  8258 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:52.202409  4572 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:52.204368  3854 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:52.205554  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:52.207048  4004 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
W20260709 12:28:52.192862  8086 consensus_meta.cc:287] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.724s	user 0.007s	sys 0.000s
I20260709 12:28:52.105072  8073 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:52.209646  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:52.210368  4005 raft_consensus.cc:2393] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 12: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:52.213045  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:52.218617  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:52.221338  4538 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:52.222198  4537 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:52.233379  4537 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:52.202956  7843 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:52.246230  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:52.246948  3929 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:52.247056  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:52.247885  3925 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 11: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:52.253926  3925 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:28:52.254689  4538 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:52.260809  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:52.261721  3854 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:52.274886  3821 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:52.282395  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:52.192934  8255 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:52.284739  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:52.229966  8275 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.288401  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:52.290033  3928 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:28:52.285279  3821 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:52.289178  8271 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:28:52.289628  8044 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
W20260709 12:28:52.310036  8150 consensus_meta.cc:287] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.005s
I20260709 12:28:52.310544  8150 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:52.312407  8158 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:52.312793  8150 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:52.312884  8158 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:52.314380  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:52.314566  8047 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:52.315766  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:52.316735  8047 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:52.317368  3924 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:52.318907  8185 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.319588  8185 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:52.320508  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:52.321538  8214 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.322055  8214 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:52.324309  8214 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:52.324625  8136 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.325131  8136 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:52.324309  8140 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.327261  3923 raft_consensus.cc:1275] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:28:52.327872  3849 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:28:52.328239  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:52.233408  8247 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:52.331380  3923 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:28:52.332868  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:52.244357  8160 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:28:52.377015  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:52.400455  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:52.401132  3851 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:52.341055  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:52.435925  4006 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:28:52.437237  4006 pending_rounds.cc:85] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 5
I20260709 12:28:52.437566  4006 pending_rounds.cc:107] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:28:52.437888  4006 raft_consensus.cc:2889] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:52.365172  4004 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:28:52.431785  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:52.229794  8211 consensus_queue.cc:1059] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:28:52.348693  4574 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:28:52.428151  4002 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:52.243129  8261 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.156s
I20260709 12:28:52.273281  8264 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.128s
I20260709 12:28:52.456447  4004 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:28:52.456818  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 202245us
I20260709 12:28:52.326882  8140 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:52.459709  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 332723us
I20260709 12:28:52.332510  8223 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.291301  8278 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:52.399395  8260 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:52.448153  3854 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
W20260709 12:28:52.516453  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 54732.6us
I20260709 12:28:52.334717  8275 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:52.518590  4004 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:28:52.519757  8278 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.520259  8278 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:52.431741  8244 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:52.522445  8278 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:52.522943  8278 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:52.523515  8278 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:52.478554  8103 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.523682  8244 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:52.523941  8278 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:52.524446  8278 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:52.524307  8103 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:52.283325  8267 consensus_queue.cc:1059] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.176s
I20260709 12:28:52.526935  8103 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:52.528163  8073 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:52.530599  8229 consensus_meta.cc:287] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.000s
I20260709 12:28:52.341029  8256 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.127s
I20260709 12:28:52.531906  3848 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:28:52.531453  4571 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:52.540622  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:52.541078  3851 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:52.541486  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:52.397480  8047 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.169s
I20260709 12:28:52.397203  8214 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:28:52.545500  3895 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:52.356482  8179 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 12:28:52.542937  3969 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:52.329376  8243 consensus_queue.cc:1059] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.173s
W20260709 12:28:52.589562  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 46643.8us
I20260709 12:28:52.444124  8160 raft_consensus.cc:697] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:52.555629  3895 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:52.479197  8136 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:52.540346  8247 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:28:52.545387  8085 consensus_meta.cc:287] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.802s	user 0.010s	sys 0.001s
I20260709 12:28:52.531268  8260 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:28:52.574687  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 289447us
I20260709 12:28:52.554945  8185 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:52.628018  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 374365us
W20260709 12:28:52.608019  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:52.641800  3821 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:52.543898  8150 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:52.643153  3971 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.4:41095 timed out after 1.745s (SENT) [suppressed 16 similar messages]
W20260709 12:28:52.688164  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 45037.4us
I20260709 12:28:52.531067  8229 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:52.587340  8103 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:52.697368  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 55606.8us
I20260709 12:28:52.622138  8256 consensus_queue.cc:1243] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:28:52.620031  7805 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:52.685597  8247 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:52.619580  8086 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.593106  8044 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:28:52.535590  8223 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:52.739823  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 48900.2us
I20260709 12:28:52.647591  8260 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:52.698535  8145 raft_consensus.cc:3055] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:28:52.755038  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 536458us
I20260709 12:28:52.703985  8073 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:52.645852  8136 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.101s
W20260709 12:28:52.753212  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:52.559158  8270 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.179s
W20260709 12:28:52.745476  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 350186us
I20260709 12:28:52.741968  3821 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:52.747272  8283 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:28:52.557377  8165 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:52.744906  8247 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:52.838836  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 248245us
I20260709 12:28:52.695521  8296 consensus_queue.cc:1059] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.121s
I20260709 12:28:52.773262  4574 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:28:52.774770  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 257289us
I20260709 12:28:52.746027  8179 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:52.759852  7863 consensus_meta.cc:287] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.000s
W20260709 12:28:52.845041  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 289550us
I20260709 12:28:52.699975  8150 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:52.846482  4538 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:52.760814  8145 raft_consensus.cc:740] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:52.687043  8085 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:52.742134  8103 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:52.700178  8285 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 12:28:52.884275  4570 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 11: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:52.885470  4538 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:52.753222  8086 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:52.833310  8264 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:52.887795  3897 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:52.861270  8214 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.962281  3926 raft_consensus.cc:2368] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14.
W20260709 12:28:52.943836  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 201971us
I20260709 12:28:52.963429  3821 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:28:52.957764  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 193201us
I20260709 12:28:52.952719  3929 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
W20260709 12:28:52.959045  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 71326.6us
I20260709 12:28:52.860129  8255 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:52.867120  7843 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.964210  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:52.870390  7863 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:52.870123  8044 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:52.969820  3851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:28:53.030543  3851 raft_consensus.cc:606] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:53.031203  3851 raft_consensus.cc:614] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:28:52.906500  7960 consensus_meta.cc:287] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 1.267s	user 0.008s	sys 0.012s
I20260709 12:28:52.972869  3897 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:52.886906  8185 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.874799  8275 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:53.032977  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 67512.2us
I20260709 12:28:53.039275  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:52.953956  8267 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:53.042886  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.049019  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.043627  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:52.968647  8211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.014s	sys 0.009s
W20260709 12:28:53.044996  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 72209.8us
I20260709 12:28:52.975044  8214 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:52.969463  8264 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.052166  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2458) took 1498 ms. Trace:
I20260709 12:28:52.939721  8295 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:53.055338  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:53.022383  8140 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.051414  8312 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:53.054205  8286 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.516s	user 0.000s	sys 0.001s
I20260709 12:28:52.851140  8160 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.070086  4004 raft_consensus.cc:2393] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 10: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:53.102401  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.064606  3852 rpcz_store.cc:276] 0709 12:28:51.553656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.553754 (+    98us) service_pool.cc:224] Handling call
0709 12:28:53.052005 (+1498251us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540030cd54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:53.052109 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392405888}
I20260709 12:28:52.969177  8073 raft_consensus.cc:697] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:53.054409  8211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.022s	sys 0.015s
I20260709 12:28:53.116333  4538 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:53.065390  8275 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:53.031479  8047 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:28:53.052495  8145 consensus_queue.cc:260] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.043315  8270 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:28:53.058458  8178 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.047435  7960 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:28:53.102597  8281 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.511s	user 0.000s	sys 0.001s
I20260709 12:28:53.041622  7843 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:53.118975  8278 consensus_meta.cc:287] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.000s
W20260709 12:28:53.119212  7608 consensus_meta.cc:287] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.937s	user 0.012s	sys 0.000s
W20260709 12:28:53.139555  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 170758us
I20260709 12:28:53.053586  8185 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:53.122382  8140 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:53.041320  8044 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:53.102597  8312 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.207264  8044 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:53.207667  8312 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:53.207858  7884 consensus_meta.cc:287] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.681s	user 0.014s	sys 0.001s
I20260709 12:28:53.208279  7884 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.209286  3925 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:53.209771  8173 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.210170  7843 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.210359  8173 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.144295  8291 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:53.211338  8291 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:53.211372  8245 raft_consensus.cc:3055] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:53.211819  8291 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:53.213165  8173 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.148108  7608 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.215723  7608 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.215958  8140 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:53.146255  8278 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.216436  8140 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:53.217988  8278 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.220865  8264 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:53.221315  8158 consensus_meta.cc:287] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.908s	user 0.010s	sys 0.000s
W20260709 12:28:53.224773  8174 consensus_meta.cc:287] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.353s	user 0.010s	sys 0.001s
I20260709 12:28:53.226421  8103 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:53.226751  8214 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:53.227371  8165 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:53.100438  8215 consensus_queue.cc:1059] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:28:53.146952  4569 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:28:53.147619  8223 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:53.148630  8145 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:53.215677  8295 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:53.205096  8319 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:28:53.235440  8185 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:53.148883  8303 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:28:53.143092  8178 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:53.149623  8297 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 12:28:53.152163  8150 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.152849  8073 consensus_queue.cc:237] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.103058  8179 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:28:53.154170  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1006) took 1257 ms. Trace:
I20260709 12:28:53.154767  4004 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:28:53.156045  8313 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.157321  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2514) took 1247 ms. Trace:
W20260709 12:28:53.162029  8284 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.402s	user 0.000s	sys 0.001s
I20260709 12:28:53.138185  8229 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:53.131210  8243 consensus_queue.cc:1059] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:28:53.136336  8211 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:28:53.196436  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:53.221745  8158 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:53.267125  8215 raft_consensus.cc:3055] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:28:53.294162  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 229409us
I20260709 12:28:53.310730  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:53.271703  3972 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.000s	sys 0.010s
W20260709 12:28:53.322963  3972 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.000s	sys 0.011s
I20260709 12:28:53.290061  8243 consensus_queue.cc:1243] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:28:53.136884  8275 raft_consensus.cc:697] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:53.205091  8326 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:53.225173  8174 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:53.240752  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:53.241392  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 65944.4us
I20260709 12:28:53.250051  4565 rpcz_store.cc:276] 0709 12:28:51.897246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.898474 (+  1228us) service_pool.cc:224] Handling call
0709 12:28:51.898891 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:51.915178 (+ 16287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:51.915228 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:51.931706 (+ 16478us) log.cc:844] Serialized 52 byte log entry
0709 12:28:52.228749 (+297043us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:52.228787 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:52.228855 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:53.153960 (+925105us) raft_consensus.cc:1685] finished
0709 12:28:53.153981 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:53.154111 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":60475,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":16875,"thread_start_us":243247,"threads_started":1,"wal-append.queue_time_us":583923}
I20260709 12:28:53.331472  3930 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:53.249086  7608 consensus_queue.cc:1059] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:28:53.262844  8313 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:53.266345  8207 consensus_meta.cc:287] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.511s	user 0.012s	sys 0.000s
I20260709 12:28:53.256513  4000 rpcz_store.cc:276] 0709 12:28:51.909915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.910118 (+   203us) service_pool.cc:224] Handling call
0709 12:28:51.949713 (+ 39595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:51.962537 (+ 12824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:51.962566 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:51.962982 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 12:28:52.242548 (+279566us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:52.242610 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:52.242713 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:53.157116 (+914403us) raft_consensus.cc:1685] finished
0709 12:28:53.157135 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:53.157264 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15475,"raft.queue_time_us":18869,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":7946,"thread_start_us":162237,"threads_started":1,"wal-append.queue_time_us":405179}
I20260709 12:28:53.211886  8245 raft_consensus.cc:740] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:53.324136  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:53.318068  8251 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 1.635s	user 0.000s	sys 0.005s
I20260709 12:28:53.350749  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:53.331794  3821 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:53.294318  8215 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:53.351431  3930 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
W20260709 12:28:53.199247  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 83054us
I20260709 12:28:53.352440  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:53.372491  3931 raft_consensus.cc:1240] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:53.350405  8207 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.354480  4000 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:28:53.377254  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 45555.1us
W20260709 12:28:53.354858  8290 log.cc:927] Time spent T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.585s	user 0.002s	sys 0.000s
I20260709 12:28:53.348905  7608 consensus_queue.cc:1243] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:28:53.364214  8265 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 1.294s	user 0.004s	sys 0.000s
I20260709 12:28:53.367668  8174 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:53.368876  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.369068  8158 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:53.369922  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.370915  8313 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.370756  7884 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.312362  8229 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:28:53.352389  3970 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:53.399245  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 46949.2us
I20260709 12:28:53.403726  3970 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:28:53.379161  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:53.314910  8268 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:28:53.382324  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:53.390527  4565 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:53.392489  4000 raft_consensus.cc:1240] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:53.393429  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:53.397616  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2044) took 3482 ms. Trace:
I20260709 12:28:53.407179  3855 rpcz_store.cc:276] 0709 12:28:49.914701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:50.364540 (+449839us) service_pool.cc:224] Handling call
0709 12:28:50.364777 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:51.573854 (+1209077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:53.397363 (+1823509us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400082354. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:53.397548 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2768981760}
I20260709 12:28:53.389127  8211 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:53.412107  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:53.409446  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:53.409761  4566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.001s	sys 0.014s
I20260709 12:28:53.414712  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:53.415832  4566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.001s	sys 0.014s
I20260709 12:28:53.442276  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:53.441540  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:53.446448  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:53.448226  3854 raft_consensus.cc:3055] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:53.450827  3854 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:53.452574  3930 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:53.453737  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:53.455120  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:53.459896  3895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.008s	sys 0.019s
I20260709 12:28:53.461144  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:53.462314  3855 raft_consensus.cc:3055] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:53.474123  3855 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:53.484081  3895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.008s	sys 0.019s
W20260709 12:28:53.486147  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 619537us
W20260709 12:28:53.487250  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:53.463200  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 497336us
W20260709 12:28:53.492796  4005 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.015s	sys 0.015s
W20260709 12:28:53.493281  4005 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.015s	sys 0.016s
I20260709 12:28:53.494691  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.410805  8313 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:53.393606  7608 consensus_queue.cc:1048] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:28:53.451656  3854 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:53.509790  3851 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:53.510214  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:53.510756  3854 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:53.511013  3857 raft_consensus.cc:2393] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:53.499842  4538 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:53.499728  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:53.500857  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:53.502519  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:53.416095  8222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.008s	sys 0.015s
I20260709 12:28:53.492272  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:53.518235  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:53.519436  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:53.519981  3930 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:53.483412  3855 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:53.513794  4000 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:53.513113  3821 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:53.509830  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2521) took 1446 ms. Trace:
I20260709 12:28:53.521669  4003 rpcz_store.cc:276] 0709 12:28:52.063345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.063878 (+   533us) service_pool.cc:224] Handling call
0709 12:28:52.075150 (+ 11272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:52.075514 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:28:52.075550 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:52.081725 (+  6175us) log.cc:844] Serialized 26 byte log entry
0709 12:28:52.247246 (+165521us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:52.247301 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:52.247376 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:53.354166 (+1106790us) spinlock_profiling.cc:243] Waited 63.2 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:53.498616 (+144450us) raft_consensus.cc:1685] finished
0709 12:28:53.498639 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:53.509757 (+ 11118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2856,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":7718,"spinlock_wait_cycles":145339264,"thread_start_us":107992,"threads_started":1,"wal-append.queue_time_us":581365}
I20260709 12:28:53.523257  4537 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:53.525671  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:53.526139  4572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1022) took 1609 ms. Trace:
I20260709 12:28:53.526777  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:53.445055  8291 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:53.415231  8256 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 12:28:53.411052  8245 consensus_queue.cc:260] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.440925  8275 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.520232  8178 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.526023  8285 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:53.543346  8225 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.554438  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:53.563278  8225 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.564144  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 2024) took 1024 ms. Trace:
I20260709 12:28:53.564227  7843 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:53.564679  3929 rpcz_store.cc:276] 0709 12:28:52.540210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.540359 (+   149us) service_pool.cc:224] Handling call
0709 12:28:53.563952 (+1023593us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54000e83d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:53.564084 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945690368}
I20260709 12:28:53.568524  8140 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.569121  3822 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:53.482585  8223 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.490641  8185 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:53.490409  8214 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:53.527904  8222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.008s	sys 0.016s
I20260709 12:28:53.414145  8258 consensus_queue.cc:1059] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 12:28:53.414388  8215 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.566430  3969 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:53.547796  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:53.548724  8321 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:28:53.555941  4567 raft_consensus.cc:3055] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:53.543318  8124 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:53.575599  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:53.558503  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 1013) took 1230 ms. Trace:
I20260709 12:28:53.503827  8313 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:53.526537  4572 rpcz_store.cc:276] 0709 12:28:51.917094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.917246 (+   152us) service_pool.cc:224] Handling call
0709 12:28:51.957786 (+ 40540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:52.202826 (+245040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:53.525867 (+1323041us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5400705154. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:53.526078 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562131712}
I20260709 12:28:53.592509  3970 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:53.561491  8278 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:28:53.593848  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 101391us
I20260709 12:28:53.557504  8207 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:53.653548  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 87265.9us
I20260709 12:28:53.654543  3895 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:53.604549  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 61376.2us
I20260709 12:28:53.608858  3822 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:53.656745  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 47972.1us
I20260709 12:28:53.657608  3822 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:28:53.549508  8309 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:28:53.670652  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 78229.3us
I20260709 12:28:53.557719  8299 raft_consensus.cc:3055] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:53.554807  8085 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.615020  7608 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:53.615396  8258 raft_consensus.cc:3055] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:53.615454  8185 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.616449  3854 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:28:53.683110  3854 pending_rounds.cc:85] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 7
I20260709 12:28:53.683506  3854 pending_rounds.cc:107] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:28:53.683913  3854 raft_consensus.cc:2889] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:53.685575  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:53.617412  3930 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:28:53.414053  8328 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:28:53.546883  8282 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 1.105s	user 0.003s	sys 0.000s
I20260709 12:28:53.620350  4569 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:53.514950  8103 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.151s
I20260709 12:28:53.622216  4567 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:53.679370  8222 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:28:53.539151  8314 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:28:53.541275  8322 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.626643  4570 rpcz_store.cc:276] 0709 12:28:52.327630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.328014 (+   384us) service_pool.cc:224] Handling call
0709 12:28:53.558226 (+1230212us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b540052c454. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:53.558414 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1247372160}
I20260709 12:28:53.581768  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 2018) took 1476 ms. Trace:
I20260709 12:28:53.691035  8328 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:53.628827  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:53.629499  8289 log.cc:927] Time spent T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.876s	user 0.003s	sys 0.004s
I20260709 12:28:53.630172  3929 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 11: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:53.632457  3998 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 772) took 3354 ms (client timeout 1617 ms). Trace:
W20260709 12:28:53.753865  3998 rpcz_store.cc:269] 0709 12:28:50.278498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.303627 (+1025129us) service_pool.cc:224] Handling call
0709 12:28:53.632275 (+2328648us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b54001329d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:53.632378 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1852074368}
W20260709 12:28:53.638569  3926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54068 (request call id 975) took 1713 ms (client timeout 1567 ms). Trace:
I20260709 12:28:53.640529  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:53.754927  3926 rpcz_store.cc:269] 0709 12:28:51.925357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.925483 (+   126us) service_pool.cc:224] Handling call
0709 12:28:53.638303 (+1712820us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b54002387d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:53.638476 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2266084224}
I20260709 12:28:53.646837  8215 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:53.647789  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:53.549705  8320 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:53.650166  3851 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:28:53.526875  7863 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:53.662443  3895 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:53.663640  3971 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:53.782248  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 118677us
I20260709 12:28:53.784261  3971 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:53.788225  8185 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.789235  8296 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:53.792349  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2517) took 1394 ms. Trace:
I20260709 12:28:53.792761  4006 rpcz_store.cc:276] 0709 12:28:52.397965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.436679 (+ 38714us) service_pool.cc:224] Handling call
0709 12:28:52.437026 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:52.461776 (+ 24750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:52.461807 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:52.462438 (+   631us) log.cc:844] Serialized 52 byte log entry
0709 12:28:52.774436 (+311998us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:52.774481 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:52.774571 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:53.792123 (+1017552us) raft_consensus.cc:1685] finished
0709 12:28:53.792146 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:53.792289 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5895,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":36064,"thread_start_us":243197,"threads_started":1,"wal-append.queue_time_us":852454}
I20260709 12:28:53.794754  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:53.795363  4006 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:53.754849  8265 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:28:53.651796  8260 consensus_meta.cc:287] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.881s	user 0.008s	sys 0.003s
W20260709 12:28:53.652299  8267 consensus_meta.cc:287] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.000s
I20260709 12:28:53.687170  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:53.688370  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2515) took 1371 ms. Trace:
I20260709 12:28:53.661415  8278 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:53.619141  8214 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.619274  8223 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.620464  4000 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:53.674700  8299 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:53.678683  8258 raft_consensus.cc:740] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:53.675382  8181 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:28:53.676218  8333 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:53.682636  8331 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:53.687624  8165 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:53.846240  8178 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.670984  8225 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.707427  4567 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:53.552102  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:53.708428  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:53.708508  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:53.878268  4572 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:53.698937  4569 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:53.652861  8313 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:53.886405  4567 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:53.880757  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:53.700681  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:53.699606  3854 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:53.711369  3822 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:53.699307  8316 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:53.745992  3853 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:28:53.621096  8086 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:53.749611  3924 rpcz_store.cc:276] 0709 12:28:52.105382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.106035 (+   653us) service_pool.cc:224] Handling call
0709 12:28:52.106500 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:52.317730 (+211230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:53.581443 (+1263713us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b540031b5d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:53.581691 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484522880}
I20260709 12:28:53.643749  8291 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:53.710088  8080 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.758889  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:53.759086  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:53.759467  8306 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:28:53.759902  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:53.762235  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:53.700565  8335 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:53.764714  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2519) took 1703 ms. Trace:
W20260709 12:28:53.767149  4002 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2516) took 1854 ms (client timeout 1526 ms). Trace:
W20260709 12:28:53.903263  4002 rpcz_store.cc:269] 0709 12:28:51.912271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.912418 (+   147us) service_pool.cc:224] Handling call
0709 12:28:53.766969 (+1854551us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b540007e9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:53.767078 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612615552}
I20260709 12:28:53.768889  8279 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:53.705282  8140 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.770052  3897 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:53.905903  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 135918us
W20260709 12:28:53.770435  4571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 988) took 2416 ms (client timeout 1837 ms). Trace:
W20260709 12:28:53.907555  4571 rpcz_store.cc:269] 0709 12:28:51.354286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.356181 (+  1895us) service_pool.cc:224] Handling call
0709 12:28:53.770229 (+2414048us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540069d554. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:53.770354 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2700402048}
I20260709 12:28:53.908659  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:53.771381  8211 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:53.713521  8222 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:53.753026  8247 consensus_meta.cc:287] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.895s	user 0.007s	sys 0.004s
I20260709 12:28:53.782377  8103 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:28:53.604701  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 81559us
I20260709 12:28:53.908190  8080 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.918587  8247 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.920454  8080 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.920914  8247 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:53.921581  4568 raft_consensus.cc:1240] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:53.923429  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.924559  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:53.926759  8340 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:28:53.927501  3971 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:53.928350  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.928792  3971 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:53.929472  8345 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:28:53.929497  8086 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:53.908627  8299 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.930464  8103 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:53.930959  8299 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:53.932637  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 988) took 1046 ms. Trace:
I20260709 12:28:53.799919  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.809427  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:53.808589  4005 rpcz_store.cc:276] 0709 12:28:52.317030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.348088 (+ 31058us) service_pool.cc:224] Handling call
0709 12:28:52.348491 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:52.348767 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:28:53.493742 (+1144975us) log.cc:844] Serialized 14 byte log entry
0709 12:28:53.687588 (+193846us) log.cc:844] Serialized 14 byte log entry
0709 12:28:53.688036 (+   448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:53.688086 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:53.688132 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:53.688202 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:53.688308 (+   106us) inbound_call.cc:177] Queueing success response
0709 12:28:53.788947 (+100639us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b18003895c0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
Metrics: {"mutex_wait_us":89710,"prepare.queue_time_us":513505,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":92,"raft.queue_time_us":1527,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":10253,"spinlock_wait_cycles":39694336,"thread_start_us":1220327,"threads_started":2,"wal-append.queue_time_us":260710}
I20260709 12:28:53.933075  3932 rpcz_store.cc:276] 0709 12:28:52.886140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.887132 (+   992us) service_pool.cc:224] Handling call
0709 12:28:53.567240 (+680108us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:53.567594 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:53.567627 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:53.568122 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:28:53.705599 (+137477us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:53.705640 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:53.705709 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:53.931361 (+225652us) raft_consensus.cc:1685] finished
0709 12:28:53.931388 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:53.932373 (+   985us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b54000e83d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:53.932573 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2796,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":16309,"spinlock_wait_cycles":1563312000,"thread_start_us":137124,"threads_started":1,"wal-append.queue_time_us":221785}
I20260709 12:28:53.934859  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:53.935370  3932 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:53.803021  3856 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
W20260709 12:28:53.847186  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 184840us
I20260709 12:28:53.936120  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:53.698894  8207 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.847857  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:53.936841  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:53.755328  8328 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:53.938047  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:53.938618  3997 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:53.937456  8207 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.848534  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2581) took 1566 ms. Trace:
I20260709 12:28:53.940104  3925 rpcz_store.cc:276] 0709 12:28:52.282544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.284467 (+  1923us) service_pool.cc:224] Handling call
0709 12:28:53.848402 (+1563935us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b54002bd254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:53.848490 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2124453760}
I20260709 12:28:53.862565  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:53.940902  8207 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.914464  7884 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:53.845963  8314 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:28:53.936892  4005 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:53.941725  7884 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.847949  8278 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:53.942763  3930 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:53.673022  8295 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:53.755492  8322 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.944418  4565 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:53.945561  8322 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.848865  8267 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:53.945842  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.849220  8270 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:53.849617  7805 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:53.946978  7805 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:53.943843  7884 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:53.947391  7805 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:53.947810  4570 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:53.948026  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:53.948763  3923 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:28:53.949226  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 2023) took 1468 ms. Trace:
I20260709 12:28:53.949827  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.950181  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1010) took 1652 ms. Trace:
I20260709 12:28:53.951129  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.888998  3928 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:53.952256  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.952387  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:53.953353  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.954030  8318 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:28:53.865562  8333 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:53.954828  8333 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:53.950614  4573 rpcz_store.cc:276] 0709 12:28:52.298260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.300323 (+  2063us) service_pool.cc:224] Handling call
0709 12:28:52.300715 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:52.546779 (+246064us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:52.756257 (+209478us) log.cc:844] Serialized 14 byte log entry
0709 12:28:52.884912 (+128655us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:52.885422 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:28:52.885572 (+   150us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:52.885603 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:52.885665 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:53.949946 (+1064281us) raft_consensus.cc:1685] finished
0709 12:28:53.949980 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:53.950121 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77969,"prepare.queue_time_us":766036,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":261004,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":57526,"thread_start_us":567783,"threads_started":3,"wal-append.queue_time_us":618086}
I20260709 12:28:53.789819  8296 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:53.959259  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:53.959445  8296 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:53.897816  4003 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:53.898296  3926 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:53.937475  3895 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:53.897532  3998 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:53.965960  3998 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 12:28:53.951170  8258 consensus_queue.cc:260] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.953640  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:53.967593  3971 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:53.968140  3853 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:28:53.889830  8212 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.784420  8320 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:53.902637  3929 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:53.902756  3924 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:53.910357  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:53.848721  8260 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:53.914431  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:53.914379  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:53.914403  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 2016) took 1819 ms. Trace:
I20260709 12:28:53.968899  3971 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:53.897751  8225 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 12:28:53.928529  8336 log.cc:927] Time spent T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:28:53.946511  4565 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
W20260709 12:28:53.892238  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 180984us
I20260709 12:28:54.017995  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:53.959805  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:54.019009  4537 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:54.020265  4537 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:54.007280  3753 catalog_manager.cc:5697] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:54.020615  4572 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:28:54.022193  4573 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:53.949550  3923 rpcz_store.cc:276] 0709 12:28:52.480678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.515183 (+ 34505us) service_pool.cc:224] Handling call
0709 12:28:53.947877 (+1432694us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b5800132998. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056f9d0a0 00007fe056f9c984 00007fe0505176d4 00007fe050517662
0709 12:28:53.949169 (+  1292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37141376}
I20260709 12:28:53.976497  3926 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:54.024205  3926 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:28:54.025575  3926 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:28:53.913218  8245 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:53.912917  8179 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.938047  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:53.998226  7905 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:53.986228  3927 rpcz_store.cc:276] 0709 12:28:52.095030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.095178 (+   148us) service_pool.cc:224] Handling call
0709 12:28:52.119005 (+ 23827us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:28:52.192260 (+ 73255us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:52.192312 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:53.562539 (+1370227us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b2c0005c0c8. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:28:53.563144 (+   605us) log.cc:844] Serialized 52 byte log entry
0709 12:28:53.758064 (+194920us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:53.758103 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:53.758183 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:53.913722 (+155539us) raft_consensus.cc:1685] finished
0709 12:28:53.913743 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:53.914342 (+   599us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8430,"raft.queue_time_us":8639,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8861,"spinlock_wait_cycles":43588480,"thread_start_us":194520,"threads_started":1,"wal-append.queue_time_us":242239}
I20260709 12:28:53.903120  3999 rpcz_store.cc:276] 0709 12:28:52.061314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.061493 (+   179us) service_pool.cc:224] Handling call
0709 12:28:52.068770 (+  7277us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:28:52.072709 (+  3939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:52.072744 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:28:52.080924 (+  8180us) log.cc:844] Serialized 78 byte log entry
0709 12:28:52.329282 (+248358us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:52.641679 (+312397us) log.cc:844] Serialized 14 byte log entry
0709 12:28:52.645561 (+  3882us) log.cc:844] Serialized 14 byte log entry
0709 12:28:52.954611 (+309050us) log.cc:844] Serialized 14 byte log entry
0709 12:28:52.955203 (+   592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:52.955271 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:53.209552 (+254281us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4800062358. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe056f00aa1 00007fe056ef7b37 00007fe056ef79ca 00007fe056fef26f 00007fe056feef37 00007fe05700355c 00007fe057003508 00007fe057003488 00007fe057003443 00007fe0570026ec 00007fe055f2ca96
0709 12:28:53.222956 (+ 13404us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b18004bc400. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:28:53.628751 (+405795us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:53.764484 (+135733us) raft_consensus.cc:1685] finished
0709 12:28:53.764508 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:53.764654 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3478,"prepare.queue_time_us":758986,"prepare.run_cpu_time_us":149,"prepare.run_wall_time_us":5866,"raft.queue_time_us":372342,"raft.run_cpu_time_us":3691,"raft.run_wall_time_us":1139400,"spinlock_wait_cycles":129035136,"thread_start_us":655834,"threads_started":3,"wal-append.queue_time_us":490851}
I20260709 12:28:53.990563  3930 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:53.925630  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.863013  4006 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:53.914891  3897 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:53.999362  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:53.993335  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:54.001699  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:53.895804  8277 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:54.003511  8270 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.119s
I20260709 12:28:54.002462  4003 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:28:54.005462  3969 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:53.902933  8335 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:54.009259  3852 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:28:54.104393  8179 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:54.009500  4567 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:53.896627  8332 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:53.877204  8165 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.011471  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:53.879956  8178 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:54.090425  8185 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:54.021734  3753 catalog_manager.cc:5697] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 6 to 11, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 11 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:28:54.027657  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 58836.6us
W20260709 12:28:54.027386  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 170642us
W20260709 12:28:53.960125  3755 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51804 (request call id 330) took 35813 ms (client timeout 15000 ms). Trace:
I20260709 12:28:53.969122  8222 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:54.029599  3822 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:54.091559  3970 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:53.874070  8331 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.092762  3856 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:53.987279  4002 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:28:54.113847  3821 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:54.119094  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:54.148377  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:54.122941  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2576) took 1877 ms. Trace:
I20260709 12:28:54.102855  4570 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:54.102324  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2474) took 1941 ms. Trace:
W20260709 12:28:54.029906  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:54.123974  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:54.150489  3848 rpcz_store.cc:276] 0709 12:28:52.161045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.161186 (+   141us) service_pool.cc:224] Handling call
0709 12:28:52.203831 (+ 42645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:52.538292 (+334461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.031076 (+1492784us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400081e54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:54.102237 (+ 71161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753792384}
I20260709 12:28:54.107084  3932 raft_consensus.cc:2410] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:28:54.093993  3923 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:28:54.107419  7905 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:54.108798  8330 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.107s	user 0.003s	sys 0.000s
I20260709 12:28:54.108912  3927 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:54.130091  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:54.113497  8080 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:54.008837  8212 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.010123  8318 consensus_queue.cc:1059] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:28:53.915959  8279 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.170774  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:28:54.126910  8079 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:28:54.094012  8207 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:54.149370  3997 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:28:54.008534  7884 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:28:54.124432  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 119027us
I20260709 12:28:54.176986  3927 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:54.177533  3853 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:54.124647  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 789) took 1150 ms. Trace:
I20260709 12:28:54.126385  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1009) took 1900 ms. Trace:
I20260709 12:28:54.177986  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:54.179451  4567 rpcz_store.cc:276] 0709 12:28:52.225772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.225959 (+   187us) service_pool.cc:224] Handling call
0709 12:28:52.226358 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:53.555818 (+1329460us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54006deaa0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f4edc0 00007fe051fd91c0 00007fe051fda231 00007fe051fd6d8f 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c
0709 12:28:54.126076 (+570258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.126313 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238712064}
I20260709 12:28:54.149967  3931 rpcz_store.cc:276] 0709 12:28:52.245428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.281997 (+ 36569us) service_pool.cc:224] Handling call
0709 12:28:52.288799 (+  6802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:53.372960 (+1084161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.122717 (+749757us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400236ed4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:54.122879 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2491753216}
I20260709 12:28:54.154935  3854 raft_consensus.cc:2368] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10.
I20260709 12:28:54.139937  8331 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.181092  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:54.179072  4004 rpcz_store.cc:276] 0709 12:28:52.974214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:53.111996 (+137782us) service_pool.cc:224] Handling call
0709 12:28:53.112380 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:53.250225 (+137845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.124414 (+874189us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b540032b254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:54.124591 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96943360}
I20260709 12:28:54.181826  3854 raft_consensus.cc:2393] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 8: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:54.132507  3928 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 12:28:54.182000  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:54.138003  3855 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:54.029489  8319 consensus_queue.cc:1059] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.137s
W20260709 12:28:54.138473  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 47030.1us
I20260709 12:28:54.140842  3925 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:28:54.128830  8165 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:54.138798  7843 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:54.194183  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:54.126793  8332 raft_consensus.cc:697] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:54.123974  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:54.169723  8136 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:54.198379  3857 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:54.132941  3753 catalog_manager.cc:5697] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:54.199820  3753 catalog_manager.cc:5697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:54.161861  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:54.162609  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:54.203869  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:54.010859  8274 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:54.030067  8256 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:28:54.173967  3997 raft_consensus.cc:1240] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:54.205387  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:54.012008  8211 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.147s
I20260709 12:28:54.193138  8325 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:54.177976  3969 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:54.171550  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:54.126921  8225 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:28:54.134640  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:54.138468  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 108956us
I20260709 12:28:54.143584  3971 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:54.132056  8178 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:54.124405  8335 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:54.117810  8320 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:54.116362  8260 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:54.274610  4536 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:54.141824  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 227006us
I20260709 12:28:54.275858  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:54.158607  8246 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:54.188735  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:54.123169  8277 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:54.161051  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 47297.4us
I20260709 12:28:54.201189  3753 catalog_manager.cc:5697] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 5 to 8, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 8 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:54.026624  8103 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:54.152406  3923 pending_rounds.cc:85] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 8
I20260709 12:28:54.172197  8312 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:28:54.134784  3755 rpcz_store.cc:269] 0709 12:28:18.146651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:18.146953 (+   302us) service_pool.cc:224] Handling call
0709 12:28:53.960029 (+35813076us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:46.598660 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:46.599352 (+   692us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:46.599402 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:28:46.599422 (+    20us) tablet.cc:662] Decoding operations
0709 12:28:46.698646 (+ 99224us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:46.698737 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:46.698770 (+    33us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:28:46.699556 (+   786us) tablet.cc:701] Row locks acquired
0709 12:28:46.699611 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:28:46.699850 (+   239us) write_op.cc:270] Start()
0709 12:28:46.700023 (+   173us) write_op.cc:276] Timestamp: P: 1783600126699752 usec, L: 0
0709 12:28:46.700050 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:28:46.727226 (+ 27176us) log.cc:844] Serialized 3185 byte log entry
0709 12:28:47.402238 (+675012us) op_driver.cc:464] REPLICATION: finished
0709 12:28:47.917962 (+515724us) write_op.cc:301] APPLY: starting
0709 12:28:47.918101 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:47.918940 (+   839us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:47.919079 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:47.919931 (+   852us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:47.920287 (+   356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:28:47.920340 (+    53us) write_op.cc:312] APPLY: finished
0709 12:28:47.920717 (+   377us) log.cc:844] Serialized 65 byte log entry
0709 12:28:47.920922 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:47.921062 (+   140us) write_op.cc:454] Released schema lock
0709 12:28:47.921141 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:47.921636 (+   495us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:47.921673 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9104120,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":427484,"apply.run_cpu_time_us":3676,"apply.run_wall_time_us":28272,"num_ops":8,"prepare.queue_time_us":55137,"prepare.run_cpu_time_us":21464,"prepare.run_wall_time_us":278213,"raft.queue_time_us":394897,"raft.run_cpu_time_us":53528,"raft.run_wall_time_us":321444,"replication_time_us":701993,"thread_start_us":525696,"threads_started":4,"wal-append.queue_time_us":189803,"wal-append.run_cpu_time_us":54373,"wal-append.run_wall_time_us":2015056}]]}
I20260709 12:28:54.211433  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:54.212738  3969 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:54.136109  8278 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.165482  8333 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.214202  8136 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.216542  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:54.216563  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:54.194787  8296 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:54.117983  8273 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.195s
I20260709 12:28:54.170019  8080 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.180033  8328 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:54.215963  8225 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:54.185109  7884 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.283958  3851 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:28:54.353749  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:54.364413  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:54.265825  8319 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:54.162043  8275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.008s	sys 0.039s
I20260709 12:28:54.276957  3854 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 12: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:54.383172  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:54.278558  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:54.283334  3923 pending_rounds.cc:107] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:28:54.384361  3923 raft_consensus.cc:2889] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:54.285662  3753 catalog_manager.cc:5697] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 9, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 9 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:54.387236  3753 catalog_manager.cc:5697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 7 to 9, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 9 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:28:54.202966  7843 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:54.304513  8343 log.cc:927] Time spent T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.396s	user 0.000s	sys 0.001s
I20260709 12:28:54.371961  3856 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:28:54.353193  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:54.272678  3857 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:54.283919  8274 raft_consensus.cc:697] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:28:54.373343  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 156806us
I20260709 12:28:54.325551  4572 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:28:54.377534  3855 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:28:54.379825  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:54.372618  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:54.277034  4566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1011) took 1978 ms. Trace:
I20260709 12:28:54.390039  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:54.290052  8271 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:28:54.391494  8275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.008s	sys 0.039s
I20260709 12:28:54.276417  8223 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.285214  3821 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:54.393388  3753 catalog_manager.cc:5697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:54.395499  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:54.466517  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 181407us
W20260709 12:28:54.467674  8244 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 12:28:54.397013  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:54.383402  8215 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:54.401525  8212 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.285607  8247 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:54.403270  8136 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.300210  8332 consensus_queue.cc:237] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:54.291363  8207 consensus_queue.cc:1059] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.172s
I20260709 12:28:54.405263  7884 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:54.405812  7863 consensus_meta.cc:287] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.001s
I20260709 12:28:54.335348  8258 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:54.408929  3854 raft_consensus.cc:1240] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:54.409247  3925 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:54.281095  8264 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:54.410037  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:54.284382  8325 raft_consensus.cc:697] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:54.454355  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:54.391517  7805 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.317631  8214 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.425171  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:54.298497  8308 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:54.458424  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2477) took 1013 ms. Trace:
I20260709 12:28:54.410889  8313 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:54.412389  3856 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:28:54.298892  8280 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:54.297050  8277 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.305569  7905 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.298300  8348 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:54.328960  8243 raft_consensus.cc:3055] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:54.463675  3851 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:28:54.348009  8322 raft_consensus.cc:3055] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:54.464267  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:54.281545  8295 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.133s
I20260709 12:28:54.324911  8318 raft_consensus.cc:3055] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:54.458700  4566 rpcz_store.cc:276] 0709 12:28:52.298649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.299104 (+   455us) service_pool.cc:224] Handling call
0709 12:28:52.299548 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:52.540210 (+240662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:52.540240 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:52.559968 (+ 19728us) log.cc:844] Serialized 26 byte log entry
0709 12:28:53.442588 (+882620us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:28:53.442633 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:53.442699 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:53.968235 (+525536us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:54.265989 (+297754us) raft_consensus.cc:1685] finished
0709 12:28:54.266013 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:54.276947 (+ 10934us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50612,"raft.queue_time_us":244409,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":36069,"spinlock_wait_cycles":14253440,"thread_start_us":995278,"threads_started":2,"wal-append.queue_time_us":1130476}
I20260709 12:28:54.556595  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:54.469638  4537 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:54.400403  8355 log.cc:927] Time spent T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:28:54.394399  8319 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.472442  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:54.472868  3753 catalog_manager.cc:5697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 5 to 8, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 8 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:54.561169  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 348559us
I20260709 12:28:54.302336  8246 raft_consensus.cc:697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:54.432258  4569 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:28:54.489410  8178 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:54.490706  8333 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.384347  8124 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:54.495654  3848 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:28:54.569099  8308 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:54.570114  8308 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.325492  8165 consensus_queue.cc:1059] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 12:28:54.575443  8165 raft_consensus.cc:3055] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:54.575886  8165 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:54.578920  8246 consensus_queue.cc:237] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:54.581579  8222 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.556777  8318 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:54.583803  8222 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.576951  8165 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.584306  8318 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.298724  8327 raft_consensus.cc:2764] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:28:54.583884  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2518) took 2523 ms. Trace:
I20260709 12:28:54.587213  8274 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.587949  8165 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:54.588555  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36508 (request call id 98) took 1064 ms. Trace:
I20260709 12:28:54.588927  3999 rpcz_store.cc:276] 0709 12:28:53.542017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.141121 (+599104us) service_pool.cc:224] Handling call
0709 12:28:54.588284 (+447163us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b540021b1d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdd735 00007fe051fd59fa 00007fe056f9d4c9 00007fe050519c54 00007fe050519be2 00007fe050519b11 00007fe050519a8c 00007fe050518d42 00007fe05031248c 00007fe0503118c6
0709 12:28:54.588476 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74962176}
I20260709 12:28:54.384088  8300 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:54.590073  8300 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:54.590492  8300 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:54.586380  4001 rpcz_store.cc:276] 0709 12:28:52.060563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.060943 (+   380us) service_pool.cc:224] Handling call
0709 12:28:52.078449 (+ 17506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:52.078806 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:28:53.804985 (+1726179us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b1800399fa0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee7455 00007fe0559cf3c7 00007fe051fe19a7 00007fe051fea5e5 00007fe051fea568
0709 12:28:53.911448 (+106463us) log.cc:844] Serialized 14 byte log entry
0709 12:28:54.158105 (+246657us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:54.160955 (+  2850us) log.cc:844] Serialized 26 byte log entry
0709 12:28:54.161223 (+   268us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:54.166276 (+  5053us) log.cc:844] Serialized 14 byte log entry
0709 12:28:54.167244 (+   968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.167384 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:54.399779 (+232395us) spinlock_profiling.cc:243] Waited 9.89 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:54.583573 (+183794us) raft_consensus.cc:1685] finished
0709 12:28:54.583602 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:54.583780 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16425,"prepare.queue_time_us":667191,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":81,"raft.queue_time_us":3121,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":16291,"spinlock_wait_cycles":27608704,"thread_start_us":238554,"threads_started":2,"wal-append.queue_time_us":225532}
I20260709 12:28:54.465828  3822 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:54.493428  3849 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:28:54.291831  8317 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.172s
I20260709 12:28:54.322240  8179 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:54.404975  3924 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:28:54.502846  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 359349us
I20260709 12:28:54.597021  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:54.376402  8044 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:54.409659  8173 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:54.506779  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:54.552589  8243 raft_consensus.cc:740] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:54.291627  8311 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.213s
I20260709 12:28:54.515343  3923 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:54.585685  8318 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:54.491331  8320 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:54.374636  8225 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:54.492815  7843 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:54.493220  8080 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.528628  3855 rpcz_store.cc:276] 0709 12:28:53.444966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:53.445292 (+   326us) service_pool.cc:224] Handling call
0709 12:28:53.445596 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:54.137573 (+691977us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b58004e0ed0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f330aa 00007fe051fb5447 00007fe051fcdfe7 00007fe051fcf7de 00007fe051fd9b49 00007fe051fda416 00007fe051fd6d8f 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4
0709 12:28:54.458156 (+320583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.458375 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414987136}
I20260709 12:28:54.299055  8315 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:54.382067  8296 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.530205  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:54.491349  8215 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.516899  7863 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:54.598250  7905 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:54.598467  8185 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:54.600028  8173 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:54.558048  8280 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.679774  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40038 (request call id 1085) took 1024 ms. Trace:
I20260709 12:28:54.328392  8279 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.561358  4573 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:54.608062  8124 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:54.422290  3850 raft_consensus.cc:1240] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:54.561868  3753 catalog_manager.cc:5697] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:54.707168  3753 catalog_manager.cc:5697] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 3 to 9, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 9 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:28:54.564029  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 94481.8us
I20260709 12:28:54.565165  3851 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:28:54.565280  7608 raft_consensus.cc:3055] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:54.709128  4537 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:54.709584  7608 raft_consensus.cc:740] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:54.711172  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:54.563903  4536 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:54.712163  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 148329us
W20260709 12:28:54.594342  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 128604us
I20260709 12:28:54.554807  8322 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:54.557265  8348 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:54.600311  3928 raft_consensus.cc:2368] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14.
I20260709 12:28:54.329258  8312 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:54.604688  3971 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:54.579833  7805 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.543428  8247 consensus_queue.cc:1059] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:28:54.728067  8247 raft_consensus.cc:3055] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:54.728437  8247 raft_consensus.cc:740] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:54.521203  8264 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:54.603044  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 415149us
I20260709 12:28:54.562345  3969 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:54.666141  4001 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:54.734179  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2530) took 1061 ms. Trace:
I20260709 12:28:54.680397  8320 raft_consensus.cc:697] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:54.555358  4565 raft_consensus.cc:2393] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 11: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:54.556249  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:54.678040  3999 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:54.702931  8260 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:54.607827  8079 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:28:54.686262  8315 raft_consensus.cc:697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:54.687261  8319 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.687759  8325 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.691188  7905 raft_consensus.cc:697] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:54.693496  8215 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.410647  8335 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.710677  7608 consensus_queue.cc:260] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:54.775516  7608 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:54.714840  3753 catalog_manager.cc:5697] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 8 to 10, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 10 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:54.717767  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:54.726328  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 121738us
I20260709 12:28:54.779106  3971 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:54.779433  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:54.728888  3997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.014s	sys 0.011s
I20260709 12:28:54.603101  8044 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.699893  8173 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:54.734665  4001 rpcz_store.cc:276] 0709 12:28:53.672793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.601422 (+928629us) service_pool.cc:224] Handling call
0709 12:28:54.657802 (+ 56380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:54.733792 (+ 75990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.734097 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:54.669064  3923 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:54.738207  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2531) took 1065 ms. Trace:
I20260709 12:28:54.782815  3999 rpcz_store.cc:276] 0709 12:28:53.672952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.667349 (+994397us) service_pool.cc:224] Handling call
0709 12:28:54.677792 (+ 10443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:54.737946 (+ 60154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.738139 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:54.783993  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:54.784905  3999 raft_consensus.cc:2393] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 13: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:54.680249  3849 rpcz_store.cc:276] 0709 12:28:53.640185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:53.640300 (+   115us) service_pool.cc:224] Handling call
0709 12:28:54.664623 (+1024323us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b5400377154. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:54.664746 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697710976}
W20260709 12:28:54.740358  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:54.728935  8299 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:54.750772  7805 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:54.808225  7805 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:54.811184  7805 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:54.705752  8124 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:54.748129  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 185904us
I20260709 12:28:54.749785  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:54.816694  3969 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:54.713011  8295 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:54.726550  8255 consensus_queue.cc:1059] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 12:28:54.773490  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 306246us
I20260709 12:28:54.780309  4573 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
W20260709 12:28:54.780872  3997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.015s	sys 0.011s
I20260709 12:28:54.777273  3753 catalog_manager.cc:5697] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:28:54.782102  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:54.725374  8328 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:54.724882  8256 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:28:54.729420  8348 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:54.833214  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:54.813241  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:54.734735  8278 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:54.837037  3932 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:54.839438  4570 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:54.837522  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:54.816546  4568 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:54.754283  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:54.840934  4572 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:54.840293  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:54.840271  4001 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:54.833125  4000 raft_consensus.cc:2393] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 11: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:54.754343  7843 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:54.826068  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:54.830473  3753 catalog_manager.cc:5697] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 1 to 7, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 7 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:54.856125  4573 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:54.857237  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:54.785815  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:54.856115  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 98216.2us
I20260709 12:28:54.813372  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:54.862085  4565 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:54.858855  3999 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:28:54.750046  8222 consensus_queue.cc:1059] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 12:28:54.720551  8243 consensus_queue.cc:260] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:54.822161  8124 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:54.889791  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:54.891481  4572 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:28:54.891986  4572 pending_rounds.cc:85] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 7
I20260709 12:28:54.892328  4572 pending_rounds.cc:107] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:28:54.879658  3753 catalog_manager.cc:5697] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 5 to 8, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 8 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:54.749713  8212 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 12:28:54.754305  8207 consensus_queue.cc:1059] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:28:54.875948  3856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:28:54.907428  3856 raft_consensus.cc:606] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:54.907627  3971 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:54.907891  3856 raft_consensus.cc:614] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:54.832052  8360 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:54.876592  8214 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:54.895780  4572 raft_consensus.cc:2889] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:54.898550  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:54.944765  4001 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:54.935773  7608 consensus_queue.cc:1059] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:28:54.887984  8340 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:28:54.876675  8223 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:54.865447  8357 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:54.900314  8328 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:54.887863  8278 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:54.834347  8136 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:28:54.898279  8313 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:54.821990  8247 consensus_queue.cc:260] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.825491  8322 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.894263  3753 catalog_manager.cc:5697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 5 to 9, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 9 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:54.991904  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 168377us
I20260709 12:28:54.875466  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:54.998392  3753 catalog_manager.cc:5697] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 9 to 13, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 13 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:55.004884  3895 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:55.004702  3753 catalog_manager.cc:5697] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 11, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 11 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:55.008330  3895 leader_election.cc:400] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10.
I20260709 12:28:55.009959  8277 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:28:54.971131  8222 raft_consensus.cc:3055] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:55.011155  8222 raft_consensus.cc:740] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:54.973019  8328 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:55.011860  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36516 (request call id 2528) took 1496 ms. Trace:
I20260709 12:28:55.017808  4000 rpcz_store.cc:276] 0709 12:28:53.515565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:53.862318 (+346753us) service_pool.cc:224] Handling call
0709 12:28:55.011564 (+1149246us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54003a5cd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:55.011774 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2051112192}
I20260709 12:28:55.018424  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:55.019045  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:55.020062  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:55.020861  4001 raft_consensus.cc:2410] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:28:55.020778  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:55.012486  4005 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:28:54.938160  8358 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 12:28:55.016997  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:55.020430  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:55.026986  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:55.011335  8323 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:55.028870  3851 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:55.030315  3924 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:54.989542  8212 raft_consensus.cc:3055] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:54.990572  8361 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:55.030223  4573 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:55.034839  4000 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:55.012039  8333 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.097s
W20260709 12:28:55.043296  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 184314us
I20260709 12:28:54.997531  8360 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:55.015581  3895 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:55.047614  3927 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:55.048738  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:55.007375  8136 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:28:55.049985  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:55.132352  3924 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:28:55.050668  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:28:55.058173  3741 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 95a53a95fd9f44e59c1b1615b9281948 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 34711da9380944d2969a2bc3e203db3d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:55.021080  8296 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:54.957636  7905 consensus_queue.cc:237] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.059795  8335 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.062345  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:55.063261  8246 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:55.029429  8367 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:28:55.068228  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2484) took 1069 ms. Trace:
I20260709 12:28:55.172108  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:55.172423  3857 rpcz_store.cc:276] 0709 12:28:53.998804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.457257 (+458453us) service_pool.cc:224] Handling call
0709 12:28:54.457547 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:54.457942 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:54.464112 (+  6170us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:54.464551 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:28:54.885713 (+421162us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:54.885784 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.885893 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:55.067423 (+181530us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4800080358. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe056f00aa1 00007fe056ef7b37 00007fe056ef79ca 00007fe056fef26f 00007fe056feef37 00007fe05700355c 00007fe057003508 00007fe057003488 00007fe057003443 00007fe0570026ec 00007fe055f2ca96
0709 12:28:55.067920 (+   497us) raft_consensus.cc:1685] finished
0709 12:28:55.067945 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:55.068160 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":3947,"raft.run_wall_time_us":603614,"spinlock_wait_cycles":47440640,"thread_start_us":370624,"threads_started":1,"wal-append.queue_time_us":552963}
I20260709 12:28:55.070323  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2533) took 1521 ms. Trace:
I20260709 12:28:55.174211  4573 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:28:55.174384  4006 rpcz_store.cc:276] 0709 12:28:53.549061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.168406 (+619345us) service_pool.cc:224] Handling call
0709 12:28:54.168756 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:54.169149 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:28:54.169190 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:54.177688 (+  8498us) log.cc:844] Serialized 26 byte log entry
0709 12:28:54.597246 (+419558us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:54.597282 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.597349 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:55.070087 (+472738us) raft_consensus.cc:1685] finished
0709 12:28:55.070113 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:55.070255 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2145,"raft.queue_time_us":84,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":10799,"thread_start_us":393264,"threads_started":1,"wal-append.queue_time_us":814872}
I20260709 12:28:55.176672  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:55.004050  8313 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:54.975435  8223 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:55.006695  8322 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:55.073275  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:55.184803  4572 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:28:55.076728  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:55.186115  4565 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:55.141659  8044 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.073019  8363 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:28:55.085084  8173 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.230118  8173 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:55.230350  8359 log.cc:927] Time spent T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.395s	user 0.003s	sys 0.000s
W20260709 12:28:55.088951  8258 consensus_meta.cc:287] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.000s
W20260709 12:28:55.091889  8300 consensus_meta.cc:287] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.001s
I20260709 12:28:55.231653  8300 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.234244  8300 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.235185  4574 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:54.990855  8278 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:55.236477  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2534) took 1573 ms. Trace:
I20260709 12:28:55.100709  4003 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:55.029762  8328 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:54.911901  8315 consensus_queue.cc:237] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:54.943830  8320 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:54.988240  8317 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:28:55.109812  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 800) took 1436 ms. Trace:
I20260709 12:28:55.246500  4000 rpcz_store.cc:276] 0709 12:28:53.673096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:55.034281 (+1361185us) service_pool.cc:224] Handling call
0709 12:28:55.034522 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:55.109477 (+ 74955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:55.109743 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:55.248350  4000 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:28:55.249004  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2536) took 1570 ms. Trace:
I20260709 12:28:55.026391  3753 catalog_manager.cc:5697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 8, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 8 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:28:55.250545  8372 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:28:55.094465  8207 raft_consensus.cc:3055] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:55.250840  3753 catalog_manager.cc:5697] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 5 to 6, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 6 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
W20260709 12:28:55.252599  8365 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:28:55.129293  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:55.139508  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:55.139865  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:55.258661  3855 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
W20260709 12:28:55.145946  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 131923us
I20260709 12:28:55.141611  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:55.170267  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 262705us
I20260709 12:28:55.116639  8264 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:55.261237  3851 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:55.261507  8264 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:55.262069  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:55.262686  3851 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:28:55.177485  4006 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:28:55.263268  3971 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:55.264160  3971 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:55.107558  8212 raft_consensus.cc:740] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:55.169971  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:55.141433  8136 raft_consensus.cc:697] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:55.157133  8333 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:55.182184  8246 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:55.218205  8368 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:28:55.218307  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:55.218209  8379 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:55.220464  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2497) took 1107 ms. Trace:
I20260709 12:28:55.221323  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:55.222018  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:55.251706  8207 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:55.259881  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:55.078416  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:55.315424  3855 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:55.249388  4000 rpcz_store.cc:276] 0709 12:28:53.678661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:55.247578 (+1568917us) service_pool.cc:224] Handling call
0709 12:28:55.247941 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:55.248736 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:55.248942 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:55.318899  4000 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:28:55.319255  4000 pending_rounds.cc:85] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 8
I20260709 12:28:55.319499  4000 pending_rounds.cc:107] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:28:55.319753  4000 raft_consensus.cc:2889] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:55.267045  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:55.252661  3753 catalog_manager.cc:5697] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 3 to 8, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 8 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:55.267222  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:55.320928  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 53780us
I20260709 12:28:55.307938  3848 rpcz_store.cc:276] 0709 12:28:54.112700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.569423 (+456723us) service_pool.cc:224] Handling call
0709 12:28:54.569743 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:54.570132 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:28:54.570166 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:54.570750 (+   584us) log.cc:844] Serialized 52 byte log entry
0709 12:28:54.945680 (+374930us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:54.945724 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.945798 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:55.220247 (+274449us) raft_consensus.cc:1685] finished
0709 12:28:55.220271 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:55.220404 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14320,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":374562,"threads_started":1,"wal-append.queue_time_us":534156}
I20260709 12:28:55.268455  3971 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:55.272197  8277 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:55.114930  8361 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:55.273749  8278 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:55.305805  8173 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:55.331307  8173 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:55.273793  8373 log.cc:927] Time spent T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:28:55.149124  3741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 128266us
I20260709 12:28:55.283339  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:55.341560  4570 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:55.283560  7805 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:55.370517  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:55.138911  8332 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:28:55.265259  8212 consensus_queue.cc:260] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:55.236918  4004 rpcz_store.cc:276] 0709 12:28:53.663043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.182630 (+519587us) service_pool.cc:224] Handling call
0709 12:28:54.182931 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:54.195793 (+ 12862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:54.195821 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:54.196362 (+   541us) log.cc:844] Serialized 52 byte log entry
0709 12:28:54.516606 (+320244us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:54.559514 (+ 42908us) log.cc:844] Serialized 14 byte log entry
0709 12:28:54.565232 (+  5718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.565304 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:55.102676 (+537372us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:55.236087 (+133411us) raft_consensus.cc:1685] finished
0709 12:28:55.236224 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:55.236405 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12476,"prepare.queue_time_us":37002,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":3254,"raft.queue_time_us":31287,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":183,"spinlock_wait_cycles":46768384,"thread_start_us":248136,"threads_started":1,"wal-append.queue_time_us":525902}
I20260709 12:28:55.376284  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:55.377444  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:55.378476  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:55.379390  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:55.321480  3753 catalog_manager.cc:5697] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 6 to 8, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 8 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:55.323861  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 55575.5us
I20260709 12:28:55.334070  3855 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:28:55.380970  3753 catalog_manager.cc:5697] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 6 to 9, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 9 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:55.139199  8360 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.382475  3753 catalog_manager.cc:5697] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:28:55.337580  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 804) took 1381 ms. Trace:
I20260709 12:28:55.327240  8277 consensus_queue.cc:1243] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer 4eedd844c09d456ca0b3614490dd1dbb log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:28:55.383744  4000 rpcz_store.cc:276] 0709 12:28:53.956024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:55.318226 (+1362202us) service_pool.cc:224] Handling call
0709 12:28:55.318556 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:55.337316 (+ 18760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:55.337518 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:55.275002  8300 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:28:55.326838  8258 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:55.324918  8086 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:55.188728  8313 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.324321  8311 consensus_queue.cc:1059] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:28:55.303295  8044 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:28:55.413611  3857 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:55.339752  8173 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:55.414259  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:55.441181  3856 raft_consensus.cc:2410] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:28:55.414985  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:55.313977  8323 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:28:55.323474  8357 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:55.387423  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:55.420233  4000 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:55.416448  7805 raft_consensus.cc:697] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:55.419646  3971 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:55.425438  8383 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:55.458710  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2077) took 1551 ms. Trace:
W20260709 12:28:55.463433  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 43880.6us
I20260709 12:28:55.464206  3971 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:55.422495  8258 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:55.437853  4570 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
W20260709 12:28:55.433436  8370 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 12:28:55.449631  8311 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:55.451112  3851 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:55.304813  8136 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.323282  8379 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.433921  8212 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:28:55.466322  3972 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.000s	sys 0.015s
W20260709 12:28:55.436424  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 296629us
W20260709 12:28:55.492612  3972 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.000s	sys 0.016s
I20260709 12:28:55.459141  3853 rpcz_store.cc:276] 0709 12:28:53.907795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.413851 (+506056us) service_pool.cc:224] Handling call
0709 12:28:54.454941 (+ 41090us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:54.455960 (+  1019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:54.456010 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:54.456624 (+   614us) log.cc:844] Serialized 52 byte log entry
0709 12:28:54.822600 (+365976us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:55.055572 (+232972us) log.cc:844] Serialized 14 byte log entry
0709 12:28:55.055788 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:55.055870 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:55.458483 (+402613us) raft_consensus.cc:1685] finished
0709 12:28:55.458505 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:55.458647 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":554,"prepare.queue_time_us":459882,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":13436,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":12948,"thread_start_us":533404,"threads_started":2,"wal-append.queue_time_us":491469}
I20260709 12:28:55.475989  3971 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:55.423992  8384 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:55.448101  8333 raft_consensus.cc:3055] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:55.484607  3931 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:55.505236  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 996) took 1128 ms. Trace:
I20260709 12:28:55.505716  3931 rpcz_store.cc:276] 0709 12:28:54.377007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.377124 (+   117us) service_pool.cc:224] Handling call
0709 12:28:54.397586 (+ 20462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:55.484455 (+1086869us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54001a93a0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f4edc0 00007fe051fd91c0 00007fe051fda231 00007fe051fd6d8f 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c
0709 12:28:55.504883 (+ 20428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:55.505161 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472076160}
I20260709 12:28:55.434590  8086 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:55.502718  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:55.475512  8382 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:55.478976  8258 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:55.477546  8332 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:28:55.514184  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:55.537689  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:55.539347  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:55.480187  8387 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:55.461395  8357 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:55.551990  8357 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:55.553018  8391 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:55.553176  8361 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:55.554168  8223 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:55.556413  8267 raft_consensus.cc:3055] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:55.556833  8267 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:55.557669  8267 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.558710  8267 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:28:55.563611  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:55.566061  7805 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.566900  8222 consensus_queue.cc:260] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.568018  8222 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:55.570737  4574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 1133) took 1765 ms (client timeout 2080 ms). Trace:
W20260709 12:28:55.571122  4574 rpcz_store.cc:269] 0709 12:28:53.805703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:53.928126 (+122423us) service_pool.cc:224] Handling call
0709 12:28:55.570571 (+1642445us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400618d54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:55.570680 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3003655552}
W20260709 12:28:55.573217  8364 log.cc:927] Time spent T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.615s	user 0.001s	sys 0.000s
I20260709 12:28:55.574999  8360 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.575448  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2592) took 2065 ms. Trace:
I20260709 12:28:55.576098  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:55.576453  8313 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.575824  3929 rpcz_store.cc:276] 0709 12:28:53.510487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:53.998453 (+487966us) service_pool.cc:224] Handling call
0709 12:28:53.998780 (+   327us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:28:54.026035 (+ 27255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:54.026069 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:28:54.030884 (+  4815us) log.cc:844] Serialized 78 byte log entry
0709 12:28:54.181125 (+150241us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b1800188da0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:28:54.603466 (+422341us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:54.703449 (+ 99983us) log.cc:844] Serialized 14 byte log entry
0709 12:28:54.703659 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.703747 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:55.546729 (+842982us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b1800188da0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:28:55.572586 (+ 25857us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:55.575211 (+  2625us) raft_consensus.cc:1685] finished
0709 12:28:55.575236 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:55.575388 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":101317,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":27213,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":16369,"spinlock_wait_cycles":98208128,"thread_start_us":422120,"threads_started":1,"wal-append.queue_time_us":724841}
I20260709 12:28:55.578181  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:55.541404  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2535) took 1868 ms. Trace:
I20260709 12:28:55.579147  4570 raft_consensus.cc:2393] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 12: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:55.580232  4574 raft_consensus.cc:2393] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:55.579326  3997 rpcz_store.cc:276] 0709 12:28:53.672636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.206381 (+533745us) service_pool.cc:224] Handling call
0709 12:28:54.207221 (+   840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:54.823402 (+616181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:54.823447 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:54.871390 (+ 47943us) log.cc:844] Serialized 26 byte log entry
0709 12:28:55.198105 (+326715us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:55.198154 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:55.198238 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:55.541143 (+342905us) raft_consensus.cc:1685] finished
0709 12:28:55.541166 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:55.541319 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95931,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":68,"thread_start_us":845454,"threads_started":2,"wal-append.queue_time_us":413074}
I20260709 12:28:55.499539  8384 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:55.547803  8390 consensus_queue.cc:1059] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:28:55.597334  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:55.504596  8333 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:55.585738  3997 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:28:55.596969  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:55.610317  3997 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:55.598201  3929 raft_consensus.cc:2393] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:55.548663  8380 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:55.535724  8244 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:28:55.612119  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 146335us
I20260709 12:28:55.582767  8278 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:28:55.598749  8368 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:28:55.620617  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2524) took 2135 ms. Trace:
I20260709 12:28:55.631477  4002 rpcz_store.cc:276] 0709 12:28:53.485250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.158972 (+673722us) service_pool.cc:224] Handling call
0709 12:28:54.193719 (+ 34747us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:54.493965 (+300246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:54.494015 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:54.506821 (+ 12806us) log.cc:844] Serialized 26 byte log entry
0709 12:28:54.871046 (+364225us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:28:54.871083 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.871155 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:55.432774 (+561619us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:55.613538 (+180764us) raft_consensus.cc:1685] finished
0709 12:28:55.613568 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:55.620517 (+  6949us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2479,"raft.queue_time_us":15392,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":71439,"spinlock_wait_cycles":50143104,"thread_start_us":625681,"threads_started":2,"wal-append.queue_time_us":492118}
I20260709 12:28:55.617663  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:55.621724  3851 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:28:55.540676  8394 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:28:55.607393  8165 consensus_meta.cc:287] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 1.019s	user 0.012s	sys 0.000s
I20260709 12:28:55.490200  8311 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.598080  8384 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:55.590746  8319 raft_consensus.cc:3055] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:55.586843  8246 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:55.614900  8323 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:55.619109  8382 raft_consensus.cc:3055] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:28:55.622640  8299 consensus_meta.cc:287] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.801s	user 0.012s	sys 0.000s
I20260709 12:28:55.612330  8380 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:55.613981  8390 consensus_queue.cc:1243] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:28:55.647374  3822 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:55.620091  8379 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.616896  8244 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:55.615274  8391 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:28:55.656996  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:55.618880  8279 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:55.630800  8278 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:55.657399  8225 consensus_meta.cc:287] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.982s	user 0.013s	sys 0.000s
I20260709 12:28:55.672524  3822 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:28:55.659221  8348 consensus_meta.cc:287] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.782s	user 0.008s	sys 0.004s
I20260709 12:28:55.650749  8394 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:55.654220  8319 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:55.660645  8244 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:55.691211  3822 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:55.690214  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:55.660005  8380 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:55.695835  3822 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:55.656123  8382 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:55.663100  8299 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:55.582027  8387 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.661859  8246 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:55.693529  8320 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:55.679157  8278 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:55.709906  8382 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.711220  8382 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:55.711745  8280 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:55.715075  8211 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:55.679433  8279 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:55.661372  8323 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.719609  8279 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:55.702474  8246 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:55.721095  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:55.721302  8246 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:55.722725  8387 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.723774  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:55.728188  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:55.730013  4573 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:55.731053  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:55.721748  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:55.717727  8311 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.730603  8207 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.733636  4537 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:55.733785  8319 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:55.736433  8393 log.cc:927] Time spent T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:28:55.736135  8173 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.737993  8367 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:55.738564  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:55.767035  4565 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:55.701414  8395 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:55.767598  4006 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: []
W20260709 12:28:55.738857  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:55.767881  8395 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.700412  8391 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:28:55.690240  8379 raft_consensus.cc:2764] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:28:55.756435  4571 raft_consensus.cc:2410] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:28:55.698853  8404 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:55.766124  4537 leader_election.cc:400] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14.
W20260709 12:28:55.755697  8124 consensus_meta.cc:287] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.001s
W20260709 12:28:55.759431  8328 consensus_meta.cc:287] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.519s	user 0.004s	sys 0.008s
I20260709 12:28:55.758576  8207 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:55.690516  8333 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:55.739315  8267 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:55.721115  8323 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.703518  8320 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:55.690586  8225 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:55.793582  8396 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:28:55.794590  8258 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.786664  8328 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:55.795660  8392 log.cc:927] Time spent T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.141s	user 0.001s	sys 0.001s
I20260709 12:28:55.746933  8279 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:55.766629  8367 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:55.693781  8348 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:55.774199  8299 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:55.774706  8319 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:55.783478  8404 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:55.806663  8384 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.802248  8333 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:55.811367  8395 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:55.826318  8388 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.352s	user 0.002s	sys 0.000s
I20260709 12:28:55.801708  8320 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:55.831238  8328 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:55.833132  8404 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:55.835131  8384 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.835577  8367 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:55.836890  8367 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:55.799894  8380 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.843329  8380 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.805565  8394 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.846376  8348 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:55.908524  3931 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:55.922821  3998 raft_consensus.cc:1240] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:55.923821  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2533) took 1178 ms. Trace:
I20260709 12:28:55.924499  4000 rpcz_store.cc:276] 0709 12:28:54.744988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:55.451790 (+706802us) service_pool.cc:224] Handling call
0709 12:28:55.480606 (+ 28816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:55.480805 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:28:55.624409 (+143604us) log.cc:844] Serialized 14 byte log entry
0709 12:28:55.922859 (+298450us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:55.922986 (+   127us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:55.923100 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:55.923243 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:55.923503 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":201570,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"thread_start_us":419410,"threads_started":2,"wal-append.queue_time_us":187118}
I20260709 12:28:55.927829  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:55.929255  3927 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:55.929626  3926 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:28:55.930277  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:55.931147  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:55.931885  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 801) took 2258 ms. Trace:
I20260709 12:28:55.932507  4004 raft_consensus.cc:1240] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 9. Ops: []
W20260709 12:28:55.934607  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 168431us
W20260709 12:28:55.956169  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:55.954402  4001 rpcz_store.cc:276] 0709 12:28:53.673246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:55.033149 (+1359903us) service_pool.cc:224] Handling call
0709 12:28:55.033460 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:55.034103 (+   643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:55.034137 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:55.034549 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 12:28:55.285526 (+250977us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:55.285583 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:55.285671 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:55.819269 (+533598us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:55.931144 (+111875us) raft_consensus.cc:1685] finished
0709 12:28:55.931187 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:55.931628 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":266,"raft.queue_time_us":2451,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":33603,"spinlock_wait_cycles":8434944,"thread_start_us":227031,"threads_started":1,"wal-append.queue_time_us":358692}
I20260709 12:28:55.935371  8086 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:55.786119  8124 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.810590  8246 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.963269  8124 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.963418  8225 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.964248  8246 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.965795  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:55.966797  4568 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:55.969291  8280 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:55.970058  3999 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 11: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:55.943150  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:55.972198  4573 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:55.972602  8258 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:55.792042  8261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.498s	user 0.010s	sys 0.012s
W20260709 12:28:55.974144  8261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.680s	user 0.011s	sys 0.012s
I20260709 12:28:55.974630  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:55.943544  8173 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:55.951833  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:55.952909  3897 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:55.956483  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:55.940268  8158 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:55.941774  8165 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:55.970700  8280 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.965508  8246 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:55.800858  8267 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:55.989296  4565 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:55.989984  4570 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:28:55.992959  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:55.993119  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:55.992852  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:56.002554  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.002247  8279 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.004688  8299 raft_consensus.cc:697] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:56.006434  8299 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.019989  4573 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:56.023154  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:56.025511  8323 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:28:56.028738  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 332849us
I20260709 12:28:56.029892  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:56.034166  8380 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:56.034974  8380 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.037295  8380 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:56.037755  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:55.994608  8158 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:56.040273  8325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.017s	sys 0.010s
I20260709 12:28:56.040345  8158 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:56.040872  8325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.017s	sys 0.010s
I20260709 12:28:56.051717  4568 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:56.027297  8280 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:56.019294  8279 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:56.056556  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:56.058704  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:56.059573  3931 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:28:56.070585  8412 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:56.071130  8412 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:56.071549  8412 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:56.073161  4565 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:56.077153  8279 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.077858  8279 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:56.079167  8212 consensus_meta.cc:287] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.013s
I20260709 12:28:56.080686  8279 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:56.081225  3971 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:56.083693  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 131346us
I20260709 12:28:56.088605  4570 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:28:56.072142  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1092) took 2189 ms. Trace:
I20260709 12:28:56.097393  3850 rpcz_store.cc:276] 0709 12:28:53.882644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:53.883725 (+  1081us) service_pool.cc:224] Handling call
0709 12:28:53.884134 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:54.706126 (+821992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.071518 (+1365392us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b5400191754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:56.071910 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237016320}
W20260709 12:28:56.069871  3852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2489) took 2059 ms (client timeout 2204 ms). Trace:
W20260709 12:28:56.102527  3852 rpcz_store.cc:269] 0709 12:28:54.009803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.177729 (+167926us) service_pool.cc:224] Handling call
0709 12:28:56.069134 (+1891405us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b5400063bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:56.069509 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808991488}
I20260709 12:28:56.085532  8244 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.108345  8244 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:56.102571  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 80653.2us
I20260709 12:28:56.121203  8267 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:56.021202  8246 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:56.129051  3971 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:56.135353  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.022440  8165 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.143127  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:56.149421  4570 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:28:56.130998  8357 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:56.155517  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:56.155563  3926 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:56.160213  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:56.160944  8332 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:56.161051  8312 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:56.161809  8332 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.164216  8322 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:56.164994  8322 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:56.157975  8124 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.166410  8124 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.166509  8322 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.172156  8165 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:56.172967  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:56.173651  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:56.174046  3855 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:28:56.152490  8173 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:56.175369  8173 raft_consensus.cc:697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:56.176726  8173 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.177974  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2541) took 1395 ms. Trace:
I20260709 12:28:56.178376  3997 rpcz_store.cc:276] 0709 12:28:54.747074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:55.611277 (+864203us) service_pool.cc:224] Handling call
0709 12:28:55.611563 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:55.611764 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:55.912404 (+300640us) log.cc:844] Serialized 14 byte log entry
0709 12:28:56.057699 (+145295us) log.cc:844] Serialized 14 byte log entry
0709 12:28:56.097364 (+ 39665us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:56.115578 (+ 18214us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:56.127451 (+ 11873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.136975 (+  9524us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:56.142788 (+  5813us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75956,"prepare.queue_time_us":73695,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":99550,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":38866,"thread_start_us":357872,"threads_started":2,"wal-append.queue_time_us":148318}
I20260709 12:28:56.180927  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:56.172065  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:56.178376  8357 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.188485  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:56.188850  3897 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:56.196794  8382 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:56.197431  8382 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:56.194207  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:56.199129  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2539) took 1452 ms. Trace:
I20260709 12:28:56.199158  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:56.199736  8419 log.cc:927] Time spent T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:28:56.200337  3928 raft_consensus.cc:2393] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 11: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:56.200714  4565 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:28:56.199549  3999 rpcz_store.cc:276] 0709 12:28:54.746592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.875149 (+128557us) service_pool.cc:224] Handling call
0709 12:28:56.198779 (+1323630us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b540021acd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:56.198979 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2207795968}
I20260709 12:28:56.202466  8319 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:56.198710  8382 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.207580  3931 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:56.210878  3850 raft_consensus.cc:2393] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:56.213335  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1042) took 1474 ms. Trace:
W20260709 12:28:56.214761  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 60792.7us
I20260709 12:28:56.214423  8179 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:56.213775  4569 rpcz_store.cc:276] 0709 12:28:54.732058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.732206 (+   148us) service_pool.cc:224] Handling call
0709 12:28:54.732637 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:54.756543 (+ 23906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:54.756582 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:54.756633 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:54.756690 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.181769 (+1425079us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b54004f01d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:56.181844 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:56.206799 (+ 24955us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54484224}
I20260709 12:28:56.202102  8246 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:56.225606  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:56.238832  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:56.243532  3857 raft_consensus.cc:2368] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14.
W20260709 12:28:56.245294  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:56.250658  3850 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:56.217077  8179 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:28:56.256847  8375 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 1.177s	user 0.000s	sys 0.003s
I20260709 12:28:56.256467  8384 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:28:56.258057  3855 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:56.258862  8258 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:56.268606  7843 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:56.260372  4536 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:56.269269  8418 log.cc:927] Time spent T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.154s	user 0.002s	sys 0.000s
I20260709 12:28:56.269441  7843 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.270920  8390 raft_consensus.cc:3055] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:56.271431  8390 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:28:56.272131  8378 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 1.116s	user 0.000s	sys 0.003s
I20260709 12:28:56.272738  8390 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:56.273247  8298 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:56.260339  8348 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:28:56.268961  8258 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.286046  3999 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:28:56.287266  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:56.287976  8258 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:56.273375  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.276190  8390 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:56.276742  4566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1036) took 1680 ms. Trace:
I20260709 12:28:56.277299  8267 consensus_queue.cc:1059] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:56.274318  8298 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:28:56.280133  8124 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:56.282449  3924 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:56.282598  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.283685  8280 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.283854  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:56.284739  8427 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:28:56.257534  8179 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:56.285696  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 190547us
I20260709 12:28:56.298864  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2532) took 2750 ms. Trace:
I20260709 12:28:56.299340  4003 rpcz_store.cc:276] 0709 12:28:53.548688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.165739 (+617051us) service_pool.cc:224] Handling call
0709 12:28:54.184746 (+ 19007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:55.238211 (+1053465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.298352 (+1060141us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b540021a2d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:56.298663 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2096516480}
I20260709 12:28:56.300753  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:56.301489  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 802) took 2596 ms. Trace:
I20260709 12:28:56.301949  4006 rpcz_store.cc:276] 0709 12:28:53.704513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:55.263525 (+1559012us) service_pool.cc:224] Handling call
0709 12:28:55.263833 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:55.768001 (+504168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.300996 (+532995us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54000c4754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:56.301293 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158136192}
I20260709 12:28:56.287992  3999 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
W20260709 12:28:56.290686  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 93734.4us
I20260709 12:28:56.256484  8361 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.304167  3970 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:28:56.262761  8261 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:56.309737  3927 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:56.311650  4536 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:56.291431  4566 rpcz_store.cc:276] 0709 12:28:54.596603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.596788 (+   185us) service_pool.cc:224] Handling call
0709 12:28:54.597185 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:54.597446 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:54.597483 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:54.601393 (+  3910us) log.cc:844] Serialized 26 byte log entry
0709 12:28:54.895956 (+294563us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:54.896003 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:54.896070 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:56.255893 (+1359823us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:56.276202 (+ 20309us) raft_consensus.cc:1685] finished
0709 12:28:56.276227 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:56.276525 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52449024,"thread_start_us":294253,"threads_started":1,"wal-append.queue_time_us":478078}
I20260709 12:28:56.321910  3970 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:56.319423  4536 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:56.329268  4536 leader_election.cc:400] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14.
W20260709 12:28:56.331399  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:56.331979  8079 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:56.332465  8079 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:56.332840  8079 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:56.308303  8332 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:56.338068  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:56.349587  8420 log.cc:927] Time spent T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.203s	user 0.002s	sys 0.000s
I20260709 12:28:56.351143  3857 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:28:56.351722  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 810) took 1085 ms. Trace:
I20260709 12:28:56.353432  8412 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.353850  8298 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:28:56.354468  8333 consensus_meta.cc:287] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.522s	user 0.006s	sys 0.011s
I20260709 12:28:56.355222  8261 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.355991  8412 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:56.357174  3930 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:28:56.358671  8425 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:28:56.361513  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2490) took 2334 ms. Trace:
I20260709 12:28:56.362047  8361 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.362056  3854 rpcz_store.cc:276] 0709 12:28:54.026836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.512663 (+485827us) service_pool.cc:224] Handling call
0709 12:28:54.513014 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:54.517606 (+  4592us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:55.594217 (+1076611us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b180046c8a0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee7455 00007fe0559cf3c7 00007fe051fe19a7 00007fe051ff10bf 00007fe051ff1038
0709 12:28:55.989093 (+394876us) log.cc:844] Serialized 14 byte log entry
0709 12:28:56.139367 (+150274us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:56.247234 (+107867us) log.cc:844] Serialized 52 byte log entry
0709 12:28:56.247429 (+   195us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:56.292756 (+ 45327us) log.cc:844] Serialized 14 byte log entry
0709 12:28:56.293186 (+   430us) log.cc:844] Serialized 14 byte log entry
0709 12:28:56.293369 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.308519 (+ 15150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:56.360993 (+ 52474us) raft_consensus.cc:1685] finished
0709 12:28:56.361024 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:56.361267 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34260,"prepare.queue_time_us":719795,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":127,"raft.queue_time_us":25719,"raft.run_cpu_time_us":845,"raft.run_wall_time_us":46547,"spinlock_wait_cycles":22861184,"thread_start_us":458053,"threads_started":2,"wal-append.queue_time_us":198178}
W20260709 12:28:56.368662  8426 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:28:56.310081  8280 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.373901  8383 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:28:56.352144  4001 rpcz_store.cc:276] 0709 12:28:55.266251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:55.957185 (+690934us) service_pool.cc:224] Handling call
0709 12:28:55.957859 (+   674us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:55.958681 (+   822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:55.958734 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:55.959620 (+   886us) log.cc:844] Serialized 52 byte log entry
0709 12:28:56.008868 (+ 49248us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:56.040523 (+ 31655us) log.cc:844] Serialized 14 byte log entry
0709 12:28:56.076089 (+ 35566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.076173 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:56.303012 (+226839us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:56.351419 (+ 48407us) raft_consensus.cc:1685] finished
0709 12:28:56.351529 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:56.351664 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41603,"prepare.queue_time_us":31095,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":37989,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":277,"spinlock_wait_cycles":2664320,"thread_start_us":48790,"threads_started":1,"wal-append.queue_time_us":157543}
W20260709 12:28:56.378616  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 56802.8us
I20260709 12:28:56.316345  8215 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:28:56.387068  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:56.357860  8261 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:56.394114  8328 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:56.394222  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:56.395135  3855 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:28:56.394840  7863 consensus_queue.cc:1059] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:28:56.376732  8357 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:56.414830  4536 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:56.389603  8246 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:56.402899  8319 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.395198  8348 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:56.422259  3924 raft_consensus.cc:1275] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:28:56.413318  8124 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:56.418334  8328 raft_consensus.cc:697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:56.426133  8383 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:56.402559  8320 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.439038  8246 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.443629  3849 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:56.445047  8246 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:56.441002  8079 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.447496  8079 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:56.450009  8320 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:56.422329  8357 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:56.457774  8357 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:56.460604  8357 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:28:56.442605  8278 consensus_meta.cc:287] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.006s
I20260709 12:28:56.461391  8278 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:56.463862  8278 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:56.464355  8247 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:56.466704  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 806) took 2457 ms. Trace:
I20260709 12:28:56.467082  4004 rpcz_store.cc:276] 0709 12:28:54.009135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:55.386904 (+1377769us) service_pool.cc:224] Handling call
0709 12:28:55.387152 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:55.954607 (+567455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.466417 (+511810us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b540032c154. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:56.466627 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252326272}
I20260709 12:28:56.468206  3854 pending_rounds.cc:85] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 4
I20260709 12:28:56.468608  3854 pending_rounds.cc:107] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:28:56.468859  3855 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:28:56.468916  3854 raft_consensus.cc:2889] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:56.470316  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:56.471987  3852 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:28:56.441960  8261 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.455132  8280 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:56.455533  4003 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:28:56.483480  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:56.456591  8361 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:56.457013  8222 consensus_meta.cc:287] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.866s	user 0.006s	sys 0.015s
I20260709 12:28:56.454432  8319 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.472711  3855 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:28:56.432245  8124 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:56.495690  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 59986.6us
I20260709 12:28:56.438098  8383 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:56.513499  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:56.514422  3855 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:56.493670  8367 consensus_meta.cc:287] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.008s
I20260709 12:28:56.499980  8124 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:56.513527  8333 consensus_queue.cc:1059] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:28:56.520720  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:56.527604  8328 consensus_queue.cc:237] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.532232  4004 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:28:56.525120  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:56.452298  8348 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.516601  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:56.504662  8383 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:56.549863  8361 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.550801  3852 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 7.
I20260709 12:28:56.550635  8361 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:56.551927  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:56.555946  8361 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:56.557705  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:56.570032  8395 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:56.571518  8348 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:56.579684  3897 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:56.584147  8319 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:56.516433  8261 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.587815  7863 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.588302  4566 raft_consensus.cc:1240] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:56.588789  8261 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:56.590969  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:56.591993  4570 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:56.601189  7843 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:56.603458  8271 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:56.606065  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:56.607911  8384 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:56.628557  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:56.609683  3997 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:56.588581  7863 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.641743  8384 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:56.642429  7863 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:56.643381  8271 raft_consensus.cc:697] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:56.644703  8271 consensus_queue.cc:237] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:56.654417  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:56.659586  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:56.661077  3856 raft_consensus.cc:2410] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:28:56.663265  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:56.664707  4001 raft_consensus.cc:2410] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:28:56.655757  4536 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:56.669481  8380 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.672293  8380 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:56.611330  8274 raft_consensus.cc:3055] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:56.677299  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:56.690665  4570 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:56.692595  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:56.693516  4004 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:56.676157  8280 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:56.686937  3852 raft_consensus.cc:2376] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9. Re-sending same reply.
I20260709 12:28:56.676400  7863 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.699535  3849 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 8: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:56.677726  8274 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:56.704571  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:56.702911  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:56.710361  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:28:56.717841  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 138330us
I20260709 12:28:56.719087  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:56.699260  8280 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:56.722261  8158 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:28:56.723920  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:56.733013  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:56.738416  4571 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:56.694808  4569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "455f8427897049759001979ea81adec1"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:28:56.740664  4569 raft_consensus.cc:606] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:56.741093  4569 raft_consensus.cc:614] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:56.724208  7863 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.748410  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:56.749410  4567 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 14: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:56.752242  3857 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:56.750694  7863 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:56.759241  4000 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:56.763561  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:56.764369  4565 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 11: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:56.765377  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 808) took 1628 ms. Trace:
I20260709 12:28:56.765793  4002 rpcz_store.cc:276] 0709 12:28:55.137026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:55.653117 (+516091us) service_pool.cc:224] Handling call
0709 12:28:55.680878 (+ 27761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:55.732650 (+ 51772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:55.732679 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:55.732719 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:55.732752 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.764987 (+1032235us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b5400128754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:56.765045 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:56.765224 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118605056}
I20260709 12:28:56.767874  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 793) took 3652 ms. Trace:
I20260709 12:28:56.768270  4005 rpcz_store.cc:276] 0709 12:28:53.115671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:53.942496 (+826825us) service_pool.cc:224] Handling call
0709 12:28:55.012248 (+1069752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:55.021893 (+  9645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.767507 (+1745614us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003a5cd0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:56.767697 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2450478976}
I20260709 12:28:56.769874  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 998) took 2392 ms. Trace:
I20260709 12:28:56.770265  3932 rpcz_store.cc:276] 0709 12:28:54.377692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.397383 (+ 19691us) service_pool.cc:224] Handling call
0709 12:28:54.397694 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:54.839563 (+441869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.769391 (+1929828us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b5400367754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:56.769624 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009676672}
I20260709 12:28:56.776388  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 2049) took 1336 ms. Trace:
I20260709 12:28:56.776821  3930 rpcz_store.cc:276] 0709 12:28:55.440233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:55.442465 (+  2232us) service_pool.cc:224] Handling call
0709 12:28:55.445067 (+  2602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:56.357586 (+912519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.776096 (+418510us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b540018cc54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:56.776307 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2096139008}
I20260709 12:28:56.778082  7863 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:56.778743  7863 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.780845  8267 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.788529  3997 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:56.789861  4570 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:28:56.729058  8280 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:28:56.791097  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 68075.7us
I20260709 12:28:56.791550  3850 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:56.794107  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:56.795723  3855 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
W20260709 12:28:56.786338  8437 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.201s	user 0.000s	sys 0.002s
I20260709 12:28:56.797449  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:56.795897  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:56.803073  4571 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:56.812602  4567 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:56.813671  8207 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.814328  8207 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:56.815173  7863 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:56.816642  8207 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:56.817101  7960 raft_consensus.cc:3055] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:28:56.822271  8179 consensus_meta.cc:287] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.005s
I20260709 12:28:56.822499  7960 raft_consensus.cc:740] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:56.823931  8333 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:56.822865  8179 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.824667  8333 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:56.824048  7960 consensus_queue.cc:260] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.825212  8333 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:56.816843  8383 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.826699  4566 raft_consensus.cc:2393] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 13: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:56.828387  8383 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:56.829455  8165 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.830158  8165 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.831502  3923 raft_consensus.cc:1240] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:56.800825  8319 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.834287  8319 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:56.836767  8319 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:56.837170  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 811) took 1374 ms. Trace:
W20260709 12:28:56.838692  8440 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:28:56.837637  4006 rpcz_store.cc:276] 0709 12:28:55.462955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:56.302951 (+839996us) service_pool.cc:224] Handling call
0709 12:28:56.321399 (+ 18448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:56.392129 (+ 70730us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:56.407051 (+ 14922us) log.cc:844] Serialized 14 byte log entry
0709 12:28:56.495553 (+ 88502us) log.cc:844] Serialized 14 byte log entry
0709 12:28:56.495771 (+   218us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:56.526158 (+ 30387us) log.cc:844] Serialized 26 byte log entry
0709 12:28:56.526353 (+   195us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:56.526393 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.526471 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:56.695571 (+169100us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b180036af60. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:28:56.836959 (+141388us) raft_consensus.cc:1685] finished
0709 12:28:56.836982 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:56.837111 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29780,"prepare.queue_time_us":3365,"raft.queue_time_us":33636,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":12232,"spinlock_wait_cycles":24912256,"thread_start_us":62965,"threads_started":1,"wal-append.queue_time_us":76889}
I20260709 12:28:56.843650  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2547) took 1116 ms. Trace:
I20260709 12:28:56.802742  8267 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.847743  8267 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:56.847821  4567 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:56.853998  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.857055  8243 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:56.869724  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:56.869979  3895 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:56.844094  3999 rpcz_store.cc:276] 0709 12:28:55.726984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:56.310651 (+583667us) service_pool.cc:224] Handling call
0709 12:28:56.842795 (+532144us) spinlock_profiling.cc:243] Waited 990 us on lock 0x7b58001b3f98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2eee 000000000036eb39 00007fe056f261e0 00007fe056fef0c4 00007fe056fef131 00007fe056fb0fc0 00007fe056f9b929 00007fe056f9b3d2 00007fe050512bd4
0709 12:28:56.842992 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:56.843335 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:56.843361 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:56.843403 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:56.843440 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.843496 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:56.843595 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2277632}
I20260709 12:28:56.853783  8080 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:28:56.876664  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 68283.2us
W20260709 12:28:56.886133  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 162349us
I20260709 12:28:56.889472  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:56.898097  3822 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:56.901173  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:56.907258  3997 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:56.909003  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:56.909909  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:56.910676  3856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:28:56.910941  4568 raft_consensus.cc:2393] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 11: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:56.911136  8453 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:56.865178  8274 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:56.911290  3856 raft_consensus.cc:606] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:56.913069  3895 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:56.919325  3821 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:56.899602  8320 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:56.923359  4565 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:56.926343  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:56.927579  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:56.920197  8325 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:56.911731  8453 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:56.930012  8274 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:56.922041  8246 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:56.957469  8327 raft_consensus.cc:2764] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:28:56.950930  8215 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:28:56.955627  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 47165.4us
I20260709 12:28:56.957553  8158 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:56.935979  8320 raft_consensus.cc:697] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:56.934983  8453 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:56.961110  8044 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.939450  8325 raft_consensus.cc:697] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:56.967038  4568 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:28:56.959699  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.968218  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.968397  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.969187  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:56.966246  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.976531  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.974730  4568 pending_rounds.cc:85] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 8
I20260709 12:28:56.980705  4568 pending_rounds.cc:107] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:28:56.981055  4568 raft_consensus.cc:2889] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:56.983929  8044 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.984395  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:28:56.984573  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.986344  8044 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:56.965226  8215 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:56.988689  8215 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:56.988791  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.966642  8445 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:56.990056  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.990309  8445 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:56.982345  8158 raft_consensus.cc:697] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:56.991237  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:56.992802  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.992660  8158 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:56.995581  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:57.001573  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:56.982519  8246 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:57.003647  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 176991us
I20260709 12:28:56.992447  8320 consensus_queue.cc:237] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.015352  3927 raft_consensus.cc:2410] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:28:57.024353  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:57.028488  3821 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:57.027256  3895 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:56.974265  8319 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 12:28:57.043972  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 154647us
I20260709 12:28:57.058542  4565 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:28:57.062198  8325 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.064718  8280 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.066159  4571 raft_consensus.cc:2393] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 11: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:28:57.070293  8445 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:57.072211  8215 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:57.074359  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:57.030850  8179 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:57.050026  8333 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:57.058491  8464 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:57.079205  8261 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:57.090834  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 63647.4us
I20260709 12:28:57.091504  3924 raft_consensus.cc:2410] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:28:57.091325  8463 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:28:57.050770  8318 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:28:57.092384  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:57.094166  8312 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:57.079282  8044 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:57.099143  8215 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:57.098483  3969 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:57.098632  3927 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:28:57.058300  8124 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:57.103274  3895 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:57.111284  3928 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 15: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:28:57.118089  4003 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11. Ops: []
W20260709 12:28:57.120673  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:57.121660  8280 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:57.122517  8278 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.123075  8278 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:57.125294  8278 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:57.126045  8311 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:57.129715  8333 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:57.130787  8179 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:57.119074  8044 raft_consensus.cc:697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:57.131867  8318 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.132409  8318 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.132701  8044 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.134752  8318 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:57.134754  3856 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:28:57.114985  8328 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:57.105572  8261 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.125799  8278 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.151367  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.152699  3856 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:28:57.208758  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:57.209458  3850 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:57.140456  8464 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:28:57.142374  8312 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.211127  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:57.211827  3931 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:28:57.212759  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:57.212805  3821 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:57.213392  3931 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:57.213783  8464 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:57.214152  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:57.214246  8464 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.214833  8464 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:57.217191  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:57.224028  8464 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:57.139482  8086 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.226284  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.226249  8086 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.227075  3853 raft_consensus.cc:2368] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11.
I20260709 12:28:57.228356  8086 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:57.229172  8280 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:57.229991  8280 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.234486  8280 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:57.234722  8421 log.cc:927] Time spent T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.938s	user 0.005s	sys 0.000s
I20260709 12:28:57.237133  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 1006) took 1329 ms. Trace:
I20260709 12:28:57.237718  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2529) took 3565 ms. Trace:
I20260709 12:28:57.238072  3969 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:57.238317  3998 rpcz_store.cc:276] 0709 12:28:53.672639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:54.304507 (+631868us) service_pool.cc:224] Handling call
0709 12:28:54.304881 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:55.923597 (+1618716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:57.237450 (+1313853us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540032b754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:57.237662 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3718956928}
I20260709 12:28:57.237640  8464 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:57.241329  7843 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:57.241964  7843 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.242462  7843 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:57.245010  8453 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:57.250254  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.250579  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:57.250948  3856 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:28:57.251353  4570 raft_consensus.cc:2368] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10.
I20260709 12:28:57.251907  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.252300  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:57.252493  3856 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:57.252614  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:57.252954  4573 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:57.253230  4567 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:57.255926  3855 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:28:57.257093  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.258219  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:57.241425  8278 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.259297  3932 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:57.253561  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:57.264227  3926 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:57.142596  8299 raft_consensus.cc:3055] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:28:57.398098  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 294908us
W20260709 12:28:57.400151  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 307855us
I20260709 12:28:57.257736  8165 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:57.398437  4567 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:57.403858  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:57.404870  3855 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:57.405444  4568 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:57.406666  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:57.407747  4565 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 15 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:28:57.212759  8312 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:57.410511  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.412009  4571 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:28:57.421000  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:57.422150  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:57.422013  3923 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:28:57.417968  8165 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:57.427799  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:57.428263  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.428690  3854 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:57.428905  3851 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:57.392773  8086 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.237469  3929 rpcz_store.cc:276] 0709 12:28:55.908174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:55.917341 (+  9167us) service_pool.cc:224] Handling call
0709 12:28:55.918115 (+   774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:56.006587 (+ 88472us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:28:56.007114 (+   527us) log.cc:844] Serialized 14 byte log entry
0709 12:28:56.050841 (+ 43727us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:56.066595 (+ 15754us) log.cc:844] Serialized 26 byte log entry
0709 12:28:56.066777 (+   182us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:56.066824 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:56.288966 (+222142us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b54000d5054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:56.289041 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:56.299601 (+ 10560us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b48002001d8. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe056f00aa1 00007fe056ef7b37 00007fe056ef79ca 00007fe056fef26f 00007fe056feef37 00007fe05700355c 00007fe057003508 00007fe057003488 00007fe057003443 00007fe0570026ec 00007fe055f2ca96
0709 12:28:57.234179 (+934578us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:28:57.236761 (+  2582us) raft_consensus.cc:1685] finished
0709 12:28:57.236791 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:57.236934 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35906,"prepare.queue_time_us":3796,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":1550,"raft.run_cpu_time_us":1790,"raft.run_wall_time_us":334802,"spinlock_wait_cycles":241022336,"thread_start_us":43153,"threads_started":1,"wal-append.queue_time_us":214740}
I20260709 12:28:57.431793  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:57.392869  8299 raft_consensus.cc:740] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:57.410024  8280 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:57.453184  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:57.454231  3855 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:57.456539  4570 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:28:57.472554  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:57.473361  3929 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:57.392884  8463 consensus_queue.cc:1059] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:28:57.451262  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.475140  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:57.475957  3853 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:28:57.430217  8312 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.478790  3848 raft_consensus.cc:2393] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:57.509860  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.418629  8044 consensus_queue.cc:1059] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:28:57.521425  3931 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:57.427817  8165 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.528076  3856 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:57.529691  8124 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:57.483203  8280 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.471539  8327 consensus_queue.cc:1059] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 12:28:57.538137  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 55626.6us
I20260709 12:28:57.531147  8165 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:57.550284  3855 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:28:57.476703  8086 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.588410  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.600838  3856 raft_consensus.cc:2368] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10.
I20260709 12:28:57.509119  8312 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.645829  8044 raft_consensus.cc:3055] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:57.646396  8044 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:57.647413  8044 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:57.648875  8044 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:57.531929  8445 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:28:57.602989  8165 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:57.653384  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 181136us
W20260709 12:28:57.653563  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 47059.7us
I20260709 12:28:57.661059  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.653024  3971 leader_election.cc:400] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10.
I20260709 12:28:57.664446  3971 leader_election.cc:403] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:57.650130  8453 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:57.671691  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:57.603895  7843 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:57.668290  3969 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 1.973s (SENT) [suppressed 17 similar messages]
I20260709 12:28:57.689193  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:57.689515  3822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.004s	sys 0.008s
W20260709 12:28:57.689822  3822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.004s	sys 0.008s
W20260709 12:28:57.690128  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 614412us
W20260709 12:28:57.693090  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 181769us
I20260709 12:28:57.686558  3971 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:57.701781  3856 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:28:57.703378  3971 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:57.664213  8261 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:57.702854  8124 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:57.677644  8278 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:57.716470  8124 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:57.718004  8477 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:57.718163  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:57.714468  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.718950  8384 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:57.719702  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:57.749179  4570 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:57.727371  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2545) took 1179 ms. Trace:
I20260709 12:28:57.750159  4003 rpcz_store.cc:276] 0709 12:28:56.547608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:56.561720 (+ 14112us) service_pool.cc:224] Handling call
0709 12:28:56.602402 (+ 40682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:57.118502 (+516100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:57.727088 (+608586us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b540007e9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:28:57.727299 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185516416}
I20260709 12:28:57.728406  4566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 1054) took 1077 ms. Trace:
I20260709 12:28:57.751974  4566 rpcz_store.cc:276] 0709 12:28:56.651480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:56.651716 (+   236us) service_pool.cc:224] Handling call
0709 12:28:57.728162 (+1076446us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540055d2d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:57.728312 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":385599872}
W20260709 12:28:57.730506  8472 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 12:28:57.731642  8461 log.cc:927] Time spent T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.649s	user 0.013s	sys 0.012s
I20260709 12:28:57.732872  8261 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:57.689949  8328 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10.
I20260709 12:28:57.774554  8086 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:57.654768  8299 consensus_queue.cc:260] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.775394  8299 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:57.669625  8165 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.742445  8477 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:57.760417  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.781823  8477 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:57.781996  3849 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:57.761190  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.762653  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:57.783321  8165 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:57.766629  8312 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:57.767083  8261 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.783914  8165 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.785531  8261 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:57.786051  8480 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:28:57.786686  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:57.786612  8480 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:57.787653  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.788658  8480 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:57.788770  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 52421us
I20260709 12:28:57.789208  8480 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.789611  8312 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.790210  8312 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:57.791898  8477 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.792459  8312 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:57.793097  4573 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:28:57.789644  8480 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:57.794555  8475 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:28:57.796157  8480 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:57.794297  8477 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:57.798275  8380 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:57.799582  8261 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.800228  8261 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.802533  8280 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:57.802727  8261 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:57.805227  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:57.805997  8463 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.806528  8463 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.808756  8463 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:57.809518  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.810405  3855 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:28:57.810739  8278 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.811403  3822 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:57.811354  8278 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.812312  3897 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:57.813720  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:57.814990  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:57.815536  8261 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:57.816125  3897 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:57.816555  4536 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:57.816222  8261 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.818323  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:57.819808  8395 raft_consensus.cc:3055] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:57.820195  4569 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:28:57.820405  8464 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.821012  8464 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.820247  8395 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:57.823339  8464 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:28:57.826548  8448 log.cc:927] Time spent T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.946s	user 0.003s	sys 0.011s
I20260709 12:28:57.822870  8395 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.784453  8165 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.744148  8222 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.851450  3822 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:57.849735  4536 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:57.826762  8278 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:57.742125  8124 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:57.842886  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.843659  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.844357  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.854777  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:57.855087  3853 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:57.855815  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.856099  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.856884  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.857091  3853 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:57.844769  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:57.846248  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:57.853811  3848 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 12: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:57.858160  4567 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:28:57.847710  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:57.858186  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:57.859174  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:57.859508  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:57.834949  3850 consensus_meta.cc:287] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.001s
I20260709 12:28:57.860101  3856 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:28:57.825505  8261 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:57.860510  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.860613  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.858623  4570 raft_consensus.cc:2410] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:28:57.861441  3849 raft_consensus.cc:2393] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:57.862680  3895 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:57.861531  8261 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:57.861042  3850 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:57.862350  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.869695  3856 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:57.858335  3929 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:57.818750  8179 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:57.861938  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:57.837636  7905 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:57.872004  8325 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:57.875052  8325 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:57.875443  8325 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:57.877941  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:57.879284  3855 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
W20260709 12:28:57.893183  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:57.848529  8480 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:57.882699  8473 raft_consensus.cc:3055] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:57.894455  8261 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:57.896880  8473 raft_consensus.cc:740] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:57.897794  3853 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:57.829900  8384 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:28:57.899075  3822 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:57.904172  3855 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:57.903453  3821 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:57.912138  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 94375us
I20260709 12:28:57.908350  3848 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:28:57.897851  8327 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:57.902966  8278 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:57.934460  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:57.911808  8395 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:57.941941  3855 raft_consensus.cc:2410] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:28:57.938227  3821 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:28:57.946686  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 47699.6us
I20260709 12:28:57.911119  8463 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:28:57.898352  8320 consensus_queue.cc:1059] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:28:57.915793  8086 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:57.966622  3822 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:57.941674  8278 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.945721  3895 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:57.895056  8222 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.916173  8484 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:57.925482  8480 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:57.943205  8464 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:28:57.955582  8311 consensus_meta.cc:287] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.829s	user 0.013s	sys 0.002s
I20260709 12:28:57.946058  8225 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.980178  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:57.948766  8390 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:57.925067  8261 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:57.978938  8367 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:57.988281  8278 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:58.021560  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 75904us
W20260709 12:28:58.041501  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 324262us
I20260709 12:28:58.041407  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:58.043893  3850 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:58.041555  3854 raft_consensus.cc:1240] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
W20260709 12:28:58.017948  8478 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:28:58.045558  8271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.301s	user 0.024s	sys 0.015s
I20260709 12:28:58.030853  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.035789  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.021441  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:58.048310  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.050143  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.029827  3853 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:28:58.018193  8480 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.052820  3855 raft_consensus.cc:2410] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:28:58.050735  4003 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:28:58.074334  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.034838  8179 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:58.049813  8271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.024s	sys 0.015s
I20260709 12:28:58.037534  8464 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:58.045796  8315 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:57.947500  8473 consensus_queue.cc:260] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:58.054467  3971 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:28:58.000692  8086 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:58.080161  3857 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:58.096143  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2522) took 1443 ms. Trace:
I20260709 12:28:58.096589  4000 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:58.038244  8311 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:58.077718  3998 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:58.031205  8463 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:28:58.082235  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:58.084483  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:58.096562  3857 rpcz_store.cc:276] 0709 12:28:56.653266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:56.761055 (+107789us) service_pool.cc:224] Handling call
0709 12:28:58.079687 (+1318632us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b5800010298. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056fb0fc0 00007fe056f9b929 00007fe056f9b3d2 00007fe050512bd4
0709 12:28:58.079937 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:58.095824 (+ 15887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:58.096075 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49376000}
W20260709 12:28:58.099251  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 45007.5us
I20260709 12:28:58.099656  3850 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:28:58.100076  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 250819us
I20260709 12:28:58.086496  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:58.072867  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2512) took 1603 ms. Trace:
I20260709 12:28:58.099934  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.075626  8480 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:58.110219  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.110822  4000 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:58.100001  3971 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:58.089633  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:58.081672  8225 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:58.111701  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.115025  3855 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:28:58.049743  8367 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:58.104947  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:58.119253  4002 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:58.121100  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 257714us
I20260709 12:28:58.105464  8312 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:58.117136  3999 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 8.
I20260709 12:28:58.125926  4536 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:58.112452  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:58.122177  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.106110  3852 rpcz_store.cc:276] 0709 12:28:56.469307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:56.713464 (+244157us) service_pool.cc:224] Handling call
0709 12:28:56.862034 (+148570us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b5800010298. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2eee 000000000036eb39 00007fe056f261e0 00007fe056fef0c4 00007fe056fef131 00007fe056fb0fc0 00007fe056f9b929 00007fe056f9b3d2 00007fe050512bd4
0709 12:28:56.862248 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:56.862556 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:28:56.884633 (+ 22077us) log.cc:844] Serialized 14 byte log entry
0709 12:28:56.924529 (+ 39896us) log.cc:844] Serialized 14 byte log entry
0709 12:28:56.975369 (+ 50840us) log.cc:844] Serialized 14 byte log entry
0709 12:28:57.806458 (+831089us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b180028d200. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:28:57.840639 (+ 34181us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b180028d200. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee7455 00007fe051fcf060 00007fe051fe1716 00007fe051ff2287 00007fe051ff2208
0709 12:28:58.072404 (+231765us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:58.072476 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:58.072546 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:58.072634 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:58.072791 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46633,"prepare.queue_time_us":25467,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":133,"raft.queue_time_us":77842,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":5904,"spinlock_wait_cycles":67384832,"thread_start_us":292315,"threads_started":3,"wal-append.queue_time_us":30979,"wal-append.run_cpu_time_us":3214,"wal-append.run_wall_time_us":1111956}
I20260709 12:28:58.115908  3971 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:58.117750  4005 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:28:58.112022  8473 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:58.152125  8488 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:58.151975  8464 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:58.152629  8488 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:58.153067  8488 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:58.153319  8225 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:58.154258  3855 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13. Ops: []
W20260709 12:28:58.158288  8485 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:28:58.122293  8477 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:58.160108  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:58.161226  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:58.162269  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:58.162467  8222 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:58.162684  8358 consensus_queue.cc:1059] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 12:28:58.163308  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:58.163686  4002 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
W20260709 12:28:58.164100  8044 consensus_meta.cc:287] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.004s
I20260709 12:28:58.164418  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:58.166055  8367 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:58.172079  8246 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:58.092602  8179 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:58.124531  8312 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:58.174343  8312 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:58.174654  8179 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:58.175593  8491 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:58.176144  8491 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.176541  8491 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:58.124233  8463 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:58.178248  8463 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:58.180147  3857 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:28:58.180447  8498 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:58.122325  8328 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:28:58.180944  8498 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.181310  8498 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:58.181485  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:58.182732  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:58.183482  3856 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:28:58.185665  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:58.186163  8165 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:58.186236  3853 raft_consensus.cc:2376] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11. Re-sending same reply.
I20260709 12:28:58.115584  8271 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:58.162293  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:58.198478  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:58.162585  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:58.227339  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 75396.9us
W20260709 12:28:58.228927  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:58.231141  3849 raft_consensus.cc:2410] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:28:58.215582  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 249014us
I20260709 12:28:58.234371  3855 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:58.235598  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:28:58.236588  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:58.237205  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:58.233446  3851 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:28:58.236205  3855 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
W20260709 12:28:58.244410  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 128577us
I20260709 12:28:58.235829  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2632) took 1022 ms. Trace:
I20260709 12:28:58.246737  3849 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:58.238222  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:58.250667  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:58.252223  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:58.253152  3849 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:28:58.255968  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:58.180526  8463 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:58.270159  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:58.235445  7905 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:58.271221  3853 raft_consensus.cc:2368] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10.
I20260709 12:28:58.271314  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:58.255728  8358 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:58.149039  8360 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.262s
I20260709 12:28:58.297073  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:58.262228  8348 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.008s	sys 0.035s
I20260709 12:28:58.245316  3928 rpcz_store.cc:276] 0709 12:28:57.212963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:57.236621 (+ 23658us) service_pool.cc:224] Handling call
0709 12:28:57.236946 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:57.262186 (+ 25240us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:57.409475 (+147289us) log.cc:844] Serialized 14 byte log entry
0709 12:28:57.734446 (+324971us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b18003b09e0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:28:57.910977 (+176531us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:57.935110 (+ 24133us) log.cc:844] Serialized 26 byte log entry
0709 12:28:57.935293 (+   183us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:57.935341 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:57.935428 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:58.202277 (+266849us) raft_consensus.cc:1685] finished
0709 12:28:58.235646 (+ 33369us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:58.235775 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24851,"prepare.queue_time_us":147754,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":128274,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":33080,"spinlock_wait_cycles":5804416,"thread_start_us":433412,"threads_started":2,"wal-append.queue_time_us":425434}
I20260709 12:28:58.288719  8463 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.300765  8358 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:58.306704  4001 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:58.299783  8500 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:28:58.307176  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:58.297948  8299 consensus_meta.cc:287] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.001s
W20260709 12:28:58.310201  8492 log.cc:927] Time spent T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:28:58.255553  8325 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:58.310781  8222 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:28:58.311475  8124 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:58.320363  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2623) took 1331 ms. Trace:
I20260709 12:28:58.345034  3932 rpcz_store.cc:276] 0709 12:28:56.988631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:57.031084 (+ 42453us) service_pool.cc:224] Handling call
0709 12:28:57.259128 (+228044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:57.259664 (+   536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:58.320126 (+1060462us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400196ed0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:58.320296 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466854272}
I20260709 12:28:58.330252  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.345645  4573 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
W20260709 12:28:58.340092  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:58.343219  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:58.339150  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:58.347077  3895 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:58.346208  4003 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
W20260709 12:28:58.305428  8348 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.008s	sys 0.036s
W20260709 12:28:58.346526  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 366452us
I20260709 12:28:58.338016  8358 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:58.363159  3997 raft_consensus.cc:2393] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 12: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:28:58.349817  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:58.364441  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:58.365378  4001 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:28:58.367580  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 254701us
I20260709 12:28:58.325657  8278 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:58.370496  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.369432  3969 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:58.350287  8390 raft_consensus.cc:697] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:58.340476  8477 consensus_queue.cc:1059] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:28:58.338716  8463 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:58.360944  8311 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:28:58.387121  3852 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:58.350419  8495 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:58.359531  8445 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:58.385273  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:58.389042  3849 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
W20260709 12:28:58.353386  8476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.003s	sys 0.010s
I20260709 12:28:58.379649  3969 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:58.382359  3856 raft_consensus.cc:1275] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:28:58.335662  8490 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 12:28:58.382432  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 256598us
I20260709 12:28:58.393011  3850 raft_consensus.cc:2368] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10.
I20260709 12:28:58.390091  3856 pending_rounds.cc:85] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 5
I20260709 12:28:58.414703  3856 pending_rounds.cc:107] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:28:58.361701  8222 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:58.368208  8503 consensus_queue.cc:1059] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:28:58.371824  8225 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 12:28:58.415086  4536 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:58.466765  3998 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:58.437379  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.463310  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.465628  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.463069  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2621) took 1475 ms. Trace:
I20260709 12:28:58.399961  3853 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:28:58.472859  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.375608  8328 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:58.693655  3853 pending_rounds.cc:85] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 9
I20260709 12:28:58.462788  3857 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11. Ops: []
W20260709 12:28:58.456423  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:58.415140  3856 raft_consensus.cc:2889] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:58.685325  4001 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:58.540079  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:58.701081  3849 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:58.693320  4006 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:28:58.696170  3999 raft_consensus.cc:2393] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 11: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:58.542104  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:58.492601  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.708461  3853 pending_rounds.cc:107] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:28:58.709690  4569 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:28:58.472553  4002 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:28:58.711879  3853 raft_consensus.cc:2889] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:58.539613  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:58.693480  3924 rpcz_store.cc:276] 0709 12:28:56.988072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:56.992526 (+  4454us) service_pool.cc:224] Handling call
0709 12:28:58.462835 (+1470309us) spinlock_profiling.cc:243] Waited 97.8 ms on lock 0x7b54002364d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:58.462991 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225041152}
I20260709 12:28:58.691756  4005 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
W20260709 12:28:58.494583  8497 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 12:28:58.397424  8476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.003s	sys 0.010s
I20260709 12:28:58.707885  3856 pending_rounds.cc:107] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:28:58.541585  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:58.694011  8261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.011s	sys 0.007s
I20260709 12:28:58.416050  8361 raft_consensus.cc:3055] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:58.494601  7960 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:58.437407  8477 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:58.523357  8484 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:58.475535  8086 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:58.451678  8445 raft_consensus.cc:697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:58.495517  8325 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:58.518023  8505 raft_consensus.cc:3055] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:58.495275  8382 raft_consensus.cc:3055] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:58.821890  3929 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:28:58.829208  4570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.011s	sys 0.008s
W20260709 12:28:58.924120  4570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.012s	sys 0.008s
I20260709 12:28:58.748448  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:58.828991  3856 raft_consensus.cc:2889] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:58.693789  8464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.007s	sys 0.009s
I20260709 12:28:58.830816  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:58.734414  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 347680us
W20260709 12:28:58.763419  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 71402.1us
W20260709 12:28:58.834168  4571 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.018s	sys 0.042s
I20260709 12:28:58.496446  8124 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:58.437728  8320 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:58.498592  8491 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:58.490796  8453 raft_consensus.cc:3055] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:58.883148  3925 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 12:28:58.941423  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:58.498083  8278 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:58.491259  7843 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:28:58.886468  3930 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:58.474403  8390 consensus_queue.cc:237] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:58.642345  8514 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.970268  8514 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:58.973184  8514 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:58.915130  8505 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:58.974900  8505 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:58.942930  8246 raft_consensus.cc:3055] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:58.831897  8358 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:58.942082  8380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.010s	sys 0.020s
I20260709 12:28:58.975975  3930 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:28:58.984253  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1070) took 1271 ms. Trace:
I20260709 12:28:58.984705  4565 rpcz_store.cc:276] 0709 12:28:57.713024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:57.717284 (+  4260us) service_pool.cc:224] Handling call
0709 12:28:57.717644 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:58.109788 (+392144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:58.109819 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:58.110271 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:28:58.390542 (+280271us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:58.390595 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:58.392056 (+  1461us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:58.984031 (+591975us) raft_consensus.cc:1685] finished
0709 12:28:58.984053 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:58.984194 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16835,"raft.queue_time_us":68328,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46,"thread_start_us":610841,"threads_started":2,"wal-append.queue_time_us":781447}
I20260709 12:28:58.986117  8491 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:58.828972  8261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.013s	sys 0.013s
I20260709 12:28:58.987040  8491 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:58.987792  8491 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.988261  8491 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:58.988688  8261 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:58.902647  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:28:58.903972  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:58.744797  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:58.992635  3926 raft_consensus.cc:2410] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:28:58.993515  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:58.923152  8382 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:28:58.994781  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:58.995568  3926 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:28:58.995249  8382 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:58.996471  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:58.996969  8382 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:58.900043  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:58.998795  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:58.999394  3927 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 7.
I20260709 12:28:59.000006  4538 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:59.000514  3927 raft_consensus.cc:1240] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:58.889019  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:58.471469  8463 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:58.941175  8453 raft_consensus.cc:740] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:58.413239  8158 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.420s
I20260709 12:28:59.002213  3923 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:58.687023  8312 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:59.003245  8328 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.002895  8453 consensus_queue.cc:260] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:59.003860  8328 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:59.004350  8453 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:59.005144  8312 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:58.915706  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.925032  3931 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:58.839460  8361 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:28:58.928248  4571 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.018s	sys 0.042s
I20260709 12:28:58.497785  8498 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:58.531183  8480 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:58.522598  8080 raft_consensus.cc:3055] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:59.009258  4002 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 12: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:28:59.009796  8361 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:59.011018  8361 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:59.012063  8480 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:58.960968  8320 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:59.014565  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:59.016510  8320 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:58.534595  8488 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:58.887362  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.022410  3924 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
W20260709 12:28:58.936758  4567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.028s	sys 0.051s
I20260709 12:28:58.956956  4572 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:28:59.023684  4567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.028s	sys 0.051s
W20260709 12:28:58.930457  8464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.007s	sys 0.017s
I20260709 12:28:58.959272  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:58.962105  8511 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.144s
I20260709 12:28:58.963090  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:58.966223  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:58.966833  8445 consensus_queue.cc:237] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:58.936239  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:58.997606  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:59.026093  3931 raft_consensus.cc:2410] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:28:59.048918  4569 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 12:28:58.982224  8380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.010s	sys 0.020s
W20260709 12:28:58.981540  8495 consensus_meta.cc:287] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.000s
I20260709 12:28:59.034847  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:59.074512  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:59.058744  8280 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.013s	sys 0.033s
I20260709 12:28:59.069954  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:59.069954  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:59.070888  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:58.989442  8261 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:58.976420  8505 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:59.074891  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:58.979020  8222 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:58.981166  8358 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:58.978281  8246 raft_consensus.cc:740] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:59.078380  4572 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:28:59.079164  3998 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:28:59.078611  3927 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:28:59.080637  3932 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:28:59.082017  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:59.083688  8498 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:58.981762  8271 consensus_queue.cc:1059] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 12:28:59.031559  8080 raft_consensus.cc:740] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:28:59.084385  8328 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:59.006521  8476 consensus_queue.cc:1059] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:28:59.086793  8511 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:59.177595  8511 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:28:58.982139  8510 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
W20260709 12:28:59.099354  3854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.007s	sys 0.007s
W20260709 12:28:59.180894  3854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.007s	sys 0.007s
W20260709 12:28:59.102005  3969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.009s	sys 0.037s
W20260709 12:28:59.183087  3969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.009s	sys 0.037s
W20260709 12:28:59.183830  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 804213us
I20260709 12:28:59.184747  3969 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:59.067791  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:59.080346  3930 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:28:59.169545  3971 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:59.172380  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.185859  4569 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:59.174669  8080 consensus_queue.cc:260] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:59.175585  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:59.175674  8358 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:59.176399  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:28:59.155726  8504 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.009s	sys 0.000s
I20260709 12:28:59.176869  8476 raft_consensus.cc:3055] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:28:59.077834  8280 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.014s	sys 0.033s
W20260709 12:28:59.099918  8348 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.019s	sys 0.023s
I20260709 12:28:59.174150  8246 consensus_queue.cc:260] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:59.176973  8520 log.cc:927] Time spent T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.092s	user 0.000s	sys 0.002s
I20260709 12:28:59.182083  8511 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:59.155838  8500 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.160085  8495 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:28:59.180958  3897 connection.cc:256] RPC call timeout handler was delayed by -1.3312688349997188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
I20260709 12:28:59.209548  3999 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:28:59.266186  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:59.201417  8504 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.009s	sys 0.000s
W20260709 12:28:59.207353  8395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.011s	sys 0.011s
I20260709 12:28:59.280727  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:59.284595  3930 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
W20260709 12:28:59.231093  8348 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.024s	sys 0.025s
W20260709 12:28:59.265985  4574 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.018s	sys 0.029s
I20260709 12:28:59.256027  8080 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:59.286477  4003 raft_consensus.cc:2410] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:28:59.286943  4574 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.019s	sys 0.029s
I20260709 12:28:59.288178  3927 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:59.206110  8476 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:28:59.205704  8360 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:28:59.296993  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:59.232002  3969 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:28:59.289085  8395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.011s	sys 0.011s
I20260709 12:28:59.307487  8488 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:59.292330  8320 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.292642  8524 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:28:59.309243  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:59.310485  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.199626  8124 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:59.322759  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.355245  3998 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:28:59.208436  8261 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:59.360388  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.360792  4538 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:59.380719  4536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.023s	sys 0.010s
W20260709 12:28:59.387404  3822 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.015s	sys 0.049s
I20260709 12:28:59.267771  8500 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:59.396427  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:28:59.398634  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:28:59.408341  4571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1077) took 1157 ms. Trace:
I20260709 12:28:59.409241  3931 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:28:59.319980  8328 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:59.293141  8464 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:28:59.404160  4536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.024s	sys 0.011s
W20260709 12:28:59.404349  3822 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.015s	sys 0.049s
W20260709 12:28:59.426159  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 996685us
W20260709 12:28:59.426350  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 1.01124e+06us
I20260709 12:28:59.364879  8124 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:59.407217  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 175622us
I20260709 12:28:59.408838  4572 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
W20260709 12:28:59.425159  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:59.444733  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:59.445360  4003 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:59.445868  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:59.446501  3856 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
W20260709 12:28:59.447409  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:59.447803  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:28:59.448968  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.395262  8360 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:28:59.448525  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:59.414000  8520 log.cc:927] Time spent T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:28:59.409036  3895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.020s	sys 0.015s
I20260709 12:28:59.453938  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:59.454360  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.402994  8280 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:28:59.454849  3898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.015s	sys 0.028s
I20260709 12:28:59.455068  3856 raft_consensus.cc:2393] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 10: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:28:59.455744  3895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.021s	sys 0.016s
W20260709 12:28:59.456409  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 691950us
W20260709 12:28:59.457000  3898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.016s	sys 0.028s
I20260709 12:28:59.459086  3822 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:59.456089  3931 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:28:59.461566  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:59.457073  3895 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:28:59.466724  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:59.470700  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:28:59.367518  8320 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:59.468312  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:59.476276  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:28:59.467872  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:59.472718  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:59.469969  4536 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:28:59.470916  4006 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:28:59.474155  4001 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:28:59.476271  3850 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:59.477140  3998 raft_consensus.cc:2393] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 10: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:28:59.479779  4570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.004s	sys 0.035s
W20260709 12:28:59.480232  4570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.004s	sys 0.035s
W20260709 12:28:59.475306  4539 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.004s	sys 0.042s
I20260709 12:28:59.481509  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:59.481750  4539 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.004s	sys 0.042s
W20260709 12:28:59.451200  8432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.021s	sys 0.059s
I20260709 12:28:59.484354  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1174) took 1448 ms. Trace:
I20260709 12:28:59.446219  8124 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:59.491564  3927 raft_consensus.cc:2410] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:28:59.498524  4565 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:59.466729  8488 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.492573  4570 rpcz_store.cc:276] 0709 12:28:58.036223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:58.036327 (+   104us) service_pool.cc:224] Handling call
0709 12:28:58.047356 (+ 11029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:58.047585 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:28:58.287769 (+240184us) log.cc:844] Serialized 14 byte log entry
0709 12:28:59.480566 (+1192797us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:59.482987 (+  2421us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:28:59.483405 (+   418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:59.483499 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:59.483630 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16118,"prepare.queue_time_us":339897,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":3013,"raft.queue_time_us":63928,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":1378868,"threads_started":3,"wal-append.queue_time_us":1000784}
I20260709 12:28:59.467480  8484 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.473798  8278 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:28:59.481066  8165 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.009s	sys 0.028s
I20260709 12:28:59.506543  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:59.513317  3999 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:59.513923  3931 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:28:59.506655  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 45153.6us
I20260709 12:28:59.473682  8158 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:28:59.492142  8432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.024s	sys 0.059s
I20260709 12:28:59.455724  8464 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:59.475075  8280 raft_consensus.cc:697] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:28:59.514870  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 64059.2us
W20260709 12:28:59.541389  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:59.541235  3969 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:59.510651  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.516161  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:28:59.543059  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:59.498112  8299 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:59.496196  8480 consensus_queue.cc:1059] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 12:28:59.518950  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:59.513067  8484 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:59.554596  8185 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.007s	sys 0.027s
W20260709 12:28:59.555044  8185 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.223s	user 0.007s	sys 0.027s
W20260709 12:28:59.513509  8165 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.011s	sys 0.029s
I20260709 12:28:59.561542  3931 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:28:59.573076  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1048) took 1032 ms. Trace:
I20260709 12:28:59.573537  4573 rpcz_store.cc:276] 0709 12:28:58.540195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:58.834857 (+294662us) service_pool.cc:224] Handling call
0709 12:28:58.909317 (+ 74460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:58.923230 (+ 13913us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:28:58.960533 (+ 37303us) log.cc:844] Serialized 14 byte log entry
0709 12:28:59.572726 (+612193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:59.572778 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:28:59.572828 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:59.572892 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:59.573015 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24692,"prepare.queue_time_us":39494,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":445697,"threads_started":1}
I20260709 12:28:59.578799  3925 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:59.510180  8278 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.518137  8158 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.502187  8315 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:28:59.505105  8179 consensus_queue.cc:1048] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 12:28:59.575452  8522 log.cc:927] Time spent T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 12:28:59.589751  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.572366  8360 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.517303  8500 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:59.469215  8476 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:59.576386  8390 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:28:59.595504  8445 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.017s	sys 0.040s
I20260709 12:28:59.512022  8488 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:59.632843  4569 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:28:59.586098  8278 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:59.636852  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 95723.4us
I20260709 12:28:59.648955  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.585840  8496 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.587581  8158 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:59.649770  3931 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 10: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:28:59.630102  8518 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
W20260709 12:28:59.640079  8527 log.cc:927] Time spent T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
W20260709 12:28:59.646136  8445 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.018s	sys 0.040s
W20260709 12:28:59.644237  8517 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.258s	user 0.001s	sys 0.001s
I20260709 12:28:59.638387  7843 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:59.642875  8480 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.664314  8500 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:59.693466  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:59.696573  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1078) took 1445 ms. Trace:
I20260709 12:28:59.689422  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:59.636646  8360 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:59.678653  8390 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.696964  4567 rpcz_store.cc:276] 0709 12:28:58.251669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:58.251807 (+   138us) service_pool.cc:224] Handling call
0709 12:28:58.252098 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:58.270052 (+ 17954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:58.270097 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:58.296684 (+ 26587us) log.cc:844] Serialized 26 byte log entry
0709 12:28:59.024243 (+727559us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:59.024306 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:59.024405 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:59.696342 (+671937us) raft_consensus.cc:1685] finished
0709 12:28:59.696370 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:59.696518 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123007,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":8493,"thread_start_us":673782,"threads_started":1,"wal-append.queue_time_us":831739}
I20260709 12:28:59.687554  8476 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:28:59.698210  8505 consensus_meta.cc:287] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
W20260709 12:28:59.701560  7960 consensus_meta.cc:287] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.817s	user 0.007s	sys 0.005s
I20260709 12:28:59.695951  8500 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.769716  8360 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:59.667670  8496 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:59.699155  8525 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:28:59.717813  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1081) took 1340 ms. Trace:
I20260709 12:28:59.770227  8500 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:59.737331  8390 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:28:59.769317  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 79964.6us
I20260709 12:28:59.776543  4574 rpcz_store.cc:276] 0709 12:28:58.377315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:58.377519 (+   204us) service_pool.cc:224] Handling call
0709 12:28:58.413553 (+ 36034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:58.413809 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:28:59.295264 (+881455us) log.cc:844] Serialized 14 byte log entry
0709 12:28:59.717461 (+422197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:59.717513 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:59.717571 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:59.717640 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:59.717751 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4860,"prepare.queue_time_us":75975,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"thread_start_us":1216227,"threads_started":2}
I20260709 12:28:59.783972  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:59.770681  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:28:59.737726  4003 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:28:59.777308  4568 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:28:59.685472  8480 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:59.694995  8358 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 12:28:59.717036  8534 raft_consensus.cc:3055] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:59.793463  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.763942  7843 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:59.800216  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2559) took 1679 ms. Trace:
W20260709 12:28:59.802467  8542 log.cc:927] Time spent T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 12:28:59.802770  8080 consensus_meta.cc:287] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 12:28:59.827710  8080 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.828217  8080 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:59.832398  8521 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.834054  8086 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:28:59.838644  8484 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:59.833057  8521 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:28:59.840416  4568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42526 (request call id 1073) took 2025 ms (client timeout 1514 ms). Trace:
W20260709 12:28:59.840816  4568 rpcz_store.cc:269] 0709 12:28:57.815289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:57.818001 (+  2712us) service_pool.cc:224] Handling call
0709 12:28:59.840242 (+2022241us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54006f1dd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:59.840353 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4503426432}
I20260709 12:28:59.804083  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:28:59.841988  3850 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:28:59.805510  4000 rpcz_store.cc:276] 0709 12:28:58.121209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:58.121385 (+   176us) service_pool.cc:224] Handling call
0709 12:28:58.123095 (+  1710us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:58.228382 (+105287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:58.228417 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:58.229004 (+   587us) log.cc:844] Serialized 52 byte log entry
0709 12:28:58.691759 (+462755us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:59.260850 (+569091us) log.cc:844] Serialized 14 byte log entry
0709 12:28:59.301834 (+ 40984us) log.cc:844] Serialized 14 byte log entry
0709 12:28:59.308888 (+  7054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:59.309012 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:59.799926 (+490914us) raft_consensus.cc:1685] finished
0709 12:28:59.799956 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:59.800144 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45953,"prepare.queue_time_us":749895,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":2527,"raft.queue_time_us":64755,"raft.run_cpu_time_us":442,"raft.run_wall_time_us":43365,"thread_start_us":853331,"threads_started":2,"wal-append.queue_time_us":957092}
W20260709 12:28:59.790293  8527 log.cc:927] Time spent T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:28:59.844806  8080 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:59.846622  8521 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:59.847878  4536 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:28:59.854391  3848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 2133) took 1692 ms (client timeout 2164 ms). Trace:
W20260709 12:28:59.854918  3848 rpcz_store.cc:269] 0709 12:28:58.161637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:58.164176 (+  2539us) service_pool.cc:224] Handling call
0709 12:28:59.854117 (+1689941us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54002a2bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:28:59.854311 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2957469952}
I20260709 12:28:59.858543  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:28:59.860522  8360 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:59.861014  8360 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.861418  8360 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:59.866801  8086 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:59.868647  8246 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:59.884295  8463 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:28:59.885133  8463 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:28:59.887996  8463 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:59.890779  8541 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:28:59.891499  8360 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:59.683900  8280 consensus_queue.cc:237] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:59.901441  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:28:59.826349  8530 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 12:28:59.795833  8361 consensus_meta.cc:287] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.784s	user 0.012s	sys 0.002s
W20260709 12:28:59.911832  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 64058.6us
I20260709 12:28:59.408879  4571 rpcz_store.cc:276] 0709 12:28:58.250723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:58.250906 (+   183us) service_pool.cc:224] Handling call
0709 12:28:58.272258 (+ 21352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:58.272533 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:28:59.010081 (+737548us) log.cc:844] Serialized 14 byte log entry
0709 12:28:59.408019 (+397938us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:59.408070 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:59.408122 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:59.408182 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:59.408285 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":218913,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":84,"thread_start_us":1109705,"threads_started":2}
I20260709 12:28:59.903843  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.914502  3931 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:28:59.845449  8299 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:28:59.785323  8494 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:59.924667  4537 leader_election.cc:336] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.611s (SENT)
I20260709 12:28:59.925161  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:28:59.927559  8480 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:28:59.930891  8390 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:59.932900  8496 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:28:59.936753  8546 log.cc:927] Time spent T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
W20260709 12:28:59.941001  8491 consensus_meta.cc:287] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.952s	user 0.010s	sys 0.000s
W20260709 12:28:59.948711  8453 consensus_meta.cc:287] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.944s	user 0.009s	sys 0.003s
I20260709 12:28:59.949579  3932 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:28:59.949939  3932 pending_rounds.cc:85] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 8
I20260709 12:28:59.950150  3932 pending_rounds.cc:107] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:28:59.950367  3932 raft_consensus.cc:2889] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:59.902356  8320 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:28:59.962663  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.963492  3932 raft_consensus.cc:2410] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:28:59.969478  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 44844.6us
I20260709 12:28:59.968549  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.972129  3931 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:28:59.972122  3969 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:28:59.796223  8534 raft_consensus.cc:740] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:28:59.973795  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.974045  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.974696  3930 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:28:59.974443  8534 consensus_queue.cc:260] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:59.975222  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:28:59.975947  8534 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:28:59.977766  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:59.978266  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:59.797605  8504 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:59.989564  3848 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:28:59.941474  8491 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:28:59.968132  8299 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:59.994971  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:28:59.995625  3970 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.013s	sys 0.046s
W20260709 12:28:59.995980  3970 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.013s	sys 0.046s
W20260709 12:28:59.993587  4539 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.036s	sys 0.040s
W20260709 12:28:59.996435  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 510280us
W20260709 12:28:59.996634  4539 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.037s	sys 0.040s
W20260709 12:28:59.985829  8395 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.019s	sys 0.024s
I20260709 12:28:59.980037  8514 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:29:00.002971  8395 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.019s	sys 0.024s
I20260709 12:29:00.004205  8395 raft_consensus.cc:3055] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:59.989364  8453 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.000147  8360 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:00.000100  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:00.021553  3930 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:00.004698  8395 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:29:00.023963  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 105920us
I20260709 12:28:59.993597  8361 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:29:00.017094  3970 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:00.024648  4569 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:59.979681  8494 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.030908  8514 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:29:00.034198  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:00.036262  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:00.036024  8278 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.039013  8278 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:00.039234  8124 consensus_meta.cc:287] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.001s
W20260709 12:29:00.039636  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:00.040318  8348 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:29:00.040915  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:00.041520  4566 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:29:00.044199  8382 consensus_meta.cc:287] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.047s	user 0.013s	sys 0.000s
I20260709 12:29:00.045104  8488 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:00.045390  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:00.009061  8328 consensus_meta.cc:287] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.003s
I20260709 12:29:00.048264  8328 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:00.039740  8124 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.051378  8158 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:00.008508  8464 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:00.058437  4566 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:29:00.104629  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:00.107133  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 49661.9us
W20260709 12:29:00.107781  3853 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.032s	sys 0.051s
W20260709 12:29:00.109278  3853 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.032s	sys 0.051s
W20260709 12:29:00.106547  3822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.022s	sys 0.061s
W20260709 12:29:00.113929  3822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.023s	sys 0.061s
W20260709 12:29:00.114784  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 598689us
I20260709 12:29:00.118353  3822 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:00.134140  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:00.134896  3970 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:00.137008  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:00.137324  4537 leader_election.cc:336] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.650s (SENT)
I20260709 12:29:00.136943  4566 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:00.138058  4537 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:00.025206  8453 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.110396  8358 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:29:00.111738  8545 log.cc:927] Time spent T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:29:00.026906  8185 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
W20260709 12:29:00.135156  8530 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:29:00.111677  8536 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:00.139851  3970 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:00.134833  8382 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:29:00.191394  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 54459us
I20260709 12:29:00.209827  3822 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:00.213480  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:00.220126  3823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.044s	sys 0.058s
W20260709 12:29:00.152922  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 125138us
I20260709 12:29:00.220108  4569 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []
W20260709 12:29:00.220355  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 80636.7us
I20260709 12:29:00.223505  3970 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:00.226223  3970 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:00.227809  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:00.228572  3930 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:00.138780  8360 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:29:00.231525  4537 leader_election.cc:336] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.910s (SENT)
W20260709 12:29:00.177505  8165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.018s	sys 0.024s
I20260709 12:29:00.233382  4537 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:00.236888  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:00.236085  3752 catalog_manager.cc:5697] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 6 to 7, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 7 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:00.237803  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:00.238306  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:00.238564  8550 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:29:00.148204  8158 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:00.156239  8453 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:00.300813  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:00.240097  8554 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:29:00.222182  8382 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:00.245855  3923 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 10: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:00.333001  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:00.333231  4569 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:29:00.174008  3821 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.022s	sys 0.042s
I20260709 12:29:00.239082  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:00.335150  3821 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.023s	sys 0.042s
I20260709 12:29:00.335350  3932 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:29:00.146975  8464 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:00.300009  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:00.146837  8514 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:29:00.322664  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 74346.4us
W20260709 12:29:00.339273  4570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.009s	sys 0.018s
I20260709 12:29:00.339587  3969 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:00.341056  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:00.190990  8536 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.139122  8361 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.095s
W20260709 12:29:00.324597  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 93114.5us
W20260709 12:29:00.346310  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 486156us
I20260709 12:29:00.241820  8124 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:00.232509  8504 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:29:00.328382  3896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.008s	sys 0.018s
I20260709 12:29:00.140101  8246 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:29:00.243207  8165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.019s	sys 0.025s
I20260709 12:29:00.331370  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:00.363126  3850 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:00.166321  8395 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:00.366533  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:00.335510  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 838430us
I20260709 12:29:00.335427  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:00.232201  8261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.010s	sys 0.018s
W20260709 12:29:00.383158  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:00.365664  3971 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:00.401041  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 60044.7us
W20260709 12:29:00.413659  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 48095.3us
W20260709 12:29:00.415092  3854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.031s	sys 0.021s
I20260709 12:29:00.415347  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:00.415534  3854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.032s	sys 0.022s
I20260709 12:29:00.416227  3926 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:00.147514  8299 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.346663  8536 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:00.342648  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:00.425160  4568 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:00.425654  3969 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:00.233340  7843 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:00.392432  8328 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:29:00.154474  8500 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:00.339588  4570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.009s	sys 0.018s
W20260709 12:29:00.267230  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 53829.4us
I20260709 12:29:00.248144  8185 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:29:00.349978  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:00.351260  4571 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:29:00.354189  3896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.008s	sys 0.019s
I20260709 12:29:00.330858  8358 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:29:00.442817  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:29:00.443847  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:00.444028  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1184) took 1386 ms. Trace:
W20260709 12:29:00.444530  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:00.330762  8476 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:00.361438  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:00.337390  8382 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:00.230701  8278 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:29:00.391979  8261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.011s	sys 0.018s
I20260709 12:29:00.355517  8360 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:00.356165  8246 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.463197  4567 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:29:00.428591  8524 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:00.299127  8348 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:29:00.472147  8124 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:29:00.475848  8500 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:00.477234  8124 raft_consensus.cc:3055] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:29:00.227873  3823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.045s	sys 0.058s
I20260709 12:29:00.477957  8246 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:00.479439  8564 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.430199  8464 consensus_queue.cc:1059] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:29:00.480379  8464 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:00.480129  8564 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:00.480808  8464 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:00.477695  8124 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:00.481755  8464 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:00.483044  8464 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:00.433704  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:00.346704  4537 leader_election.cc:336] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.916s (SENT)
I20260709 12:29:00.486241  4537 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:00.487277  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 140615us
W20260709 12:29:00.488729  4537 leader_election.cc:336] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 2.050s (SENT)
I20260709 12:29:00.489073  8563 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:00.489171  4537 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:00.436393  8328 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.490129  8328 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:29:00.490656  8551 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
W20260709 12:29:00.491967  8560 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:29:00.437165  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:00.437407  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:00.494273  3930 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:29:00.437915  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:00.495455  3925 raft_consensus.cc:2410] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:29:00.438534  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:00.438899  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:00.484539  8564 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:00.496186  8494 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:00.438566  3897 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:00.482906  8124 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:00.497313  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 58892.7us
I20260709 12:29:00.497471  8124 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:00.456599  8569 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:00.498138  3897 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:00.498307  8569 raft_consensus.cc:697] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:00.499292  3897 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:00.499213  8569 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.500066  8158 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:00.500782  8158 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:00.500852  3923 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:29:00.501579  8158 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:29:00.502127  8158 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:00.502501  8158 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:29:00.439751  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:29:00.505348  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 69198.1us
I20260709 12:29:00.430303  8395 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:00.449111  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:00.507517  4574 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:00.461246  8278 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.510416  8278 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:00.453495  3850 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:00.460433  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:00.516060  4569 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:00.519809  8299 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:00.462163  8361 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:00.522498  8361 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:00.428474  7843 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:00.467681  4568 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
W20260709 12:29:00.470799  8511 consensus_meta.cc:287] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 1.189s	user 0.012s	sys 0.001s
W20260709 12:29:00.429137  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 49593.3us
I20260709 12:29:00.479362  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:00.530791  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:00.531481  3849 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:00.436890  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 210758us
I20260709 12:29:00.532823  3970 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:00.534778  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:00.497020  8524 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.440619  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1130) took 1010 ms. Trace:
I20260709 12:29:00.444423  4573 rpcz_store.cc:276] 0709 12:28:59.055870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:59.582669 (+526799us) service_pool.cc:224] Handling call
0709 12:28:59.620717 (+ 38048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:59.620987 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:28:59.650824 (+ 29837us) log.cc:844] Serialized 14 byte log entry
0709 12:28:59.990260 (+339436us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b18003a6300. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b7723a 00007fe051fe1a2a
0709 12:29:00.440535 (+450275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:00.442112 (+  1577us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:29:00.442194 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:00.442304 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:00.442422 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47267,"prepare.queue_time_us":27888,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":49275,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":11362688,"thread_start_us":400078,"threads_started":1}
I20260709 12:29:00.525151  4536 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:00.525665  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:00.527215  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:00.561113  3856 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:29:00.528317  3897 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:00.561664  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:00.562144  8299 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:00.562546  3822 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:00.562728  8299 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:00.523010  8361 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:00.530970  3857 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:00.486497  3926 raft_consensus.cc:2410] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:29:00.447165  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:00.565348  4536 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:00.546025  4569 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
W20260709 12:29:00.565184  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 76485.3us
W20260709 12:29:00.568246  4537 leader_election.cc:336] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.929s (SENT)
I20260709 12:29:00.568655  4537 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:00.572237  3850 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:29:00.575277  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1192) took 1268 ms. Trace:
I20260709 12:29:00.575657  4567 rpcz_store.cc:276] 0709 12:28:59.306965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:59.709311 (+402346us) service_pool.cc:224] Handling call
0709 12:28:59.709639 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:00.463689 (+754050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:00.575051 (+111362us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b5400488ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:00.575222 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1732309376}
I20260709 12:29:00.496187  8500 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:00.539055  8564 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:29:00.558293  8360 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:00.563946  8565 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:00.610078  8558 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:29:00.643175  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:00.575579  8261 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:29:00.648159  3857 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:00.649719  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:00.557940  7843 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:00.620929  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 52700.9us
I20260709 12:29:00.565056  8358 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:29:00.558499  8464 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.567057  8086 consensus_queue.cc:1059] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:29:00.630857  8564 raft_consensus.cc:697] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:00.573122  3854 rpcz_store.cc:276] 0709 12:28:59.430238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:59.444045 (+ 13807us) service_pool.cc:224] Handling call
0709 12:28:59.468660 (+ 24615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:59.468868 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:28:59.483779 (+ 14911us) log.cc:844] Serialized 14 byte log entry
0709 12:29:00.440279 (+956500us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:00.440331 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:29:00.440385 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:00.440447 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:00.440563 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23724,"prepare.queue_time_us":106858,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2692,"raft.queue_time_us":23822,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":932389,"threads_started":1,"wal-append.queue_time_us":1002191}
I20260709 12:29:00.681054  4536 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:00.563853  8299 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:00.702962  4537 leader_election.cc:336] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 2.141s (SENT)
I20260709 12:29:00.740370  4537 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:00.564661  8511 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:00.728607  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:00.563683  8555 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:29:00.637583  8565 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:29:00.740487  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 59541us
I20260709 12:29:00.650565  8566 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:00.654333  8380 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:00.744917  4537 leader_election.cc:336] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 2.210s (SENT)
I20260709 12:29:00.651948  8261 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.650370  8558 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:00.679661  7960 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:00.707058  3853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.003s	sys 0.018s
I20260709 12:29:00.768355  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2574) took 1324 ms. Trace:
I20260709 12:29:00.746663  8533 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:29:00.768527  3853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.003s	sys 0.018s
I20260709 12:29:00.683398  8358 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:00.646644  8510 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 12:29:00.768887  4002 rpcz_store.cc:276] 0709 12:28:59.443628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:59.454299 (+ 10671us) service_pool.cc:224] Handling call
0709 12:28:59.480953 (+ 26654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:59.969723 (+488770us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:59.990033 (+ 20310us) log.cc:844] Serialized 14 byte log entry
0709 12:29:00.051588 (+ 61555us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b18001c2280. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:29:00.652890 (+601302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:00.652947 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:29:00.652999 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:00.768078 (+115079us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b5400129154. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:00.768144 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:00.768293 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14263,"prepare.queue_time_us":20136,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":47595,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":3020,"spinlock_wait_cycles":1127242752,"thread_start_us":621010,"threads_started":2,"wal-append.queue_time_us":636018}
I20260709 12:29:00.770905  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:00.746789  8464 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.767570  8380 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:00.793227  8358 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:00.812682  8464 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:00.789953  8348 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:00.663189  8328 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:00.748073  8494 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:00.822695  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1135) took 1371 ms. Trace:
W20260709 12:29:00.833303  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:00.766476  8261 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:00.771034  8558 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:00.836220  8577 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:29:00.837265  8574 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 12:29:00.839064  8572 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.203s	user 0.003s	sys 0.000s
I20260709 12:29:00.841408  8328 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:00.830420  4574 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:00.846266  8524 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:00.751725  8565 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:00.852934  8360 raft_consensus.cc:3055] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:29:00.853518  8360 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:00.871085  8360 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:00.749341  8567 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:00.856860  8558 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:00.862529  8491 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:00.864979  8261 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.867486  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:00.867631  4006 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:29:00.868407  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:00.868530  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:00.869843  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:00.886355  4002 raft_consensus.cc:2410] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:29:00.833580  3853 rpcz_store.cc:276] 0709 12:28:59.451159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:59.451282 (+   123us) service_pool.cc:224] Handling call
0709 12:28:59.473339 (+ 22057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:59.473572 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:29:00.111112 (+637540us) log.cc:844] Serialized 14 byte log entry
0709 12:29:00.822333 (+711221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:00.822391 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:29:00.822437 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:00.822506 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:00.822637 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13150,"prepare.queue_time_us":156867,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":8188,"thread_start_us":1258904,"threads_started":2}
I20260709 12:29:00.823575  8533 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:00.873840  8360 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:00.870213  8565 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.897516  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:00.900735  3848 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:29:00.902144  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1182) took 1846 ms. Trace:
I20260709 12:29:00.902697  4565 rpcz_store.cc:276] 0709 12:28:59.055295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:59.506110 (+450815us) service_pool.cc:224] Handling call
0709 12:28:59.537672 (+ 31562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:00.057621 (+519949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:00.057669 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:00.113509 (+ 55840us) log.cc:844] Serialized 26 byte log entry
0709 12:29:00.427214 (+313705us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:00.427246 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:00.427344 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:00.901863 (+474519us) raft_consensus.cc:1685] finished
0709 12:29:00.901913 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:00.902067 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103703,"raft.queue_time_us":242985,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":11227,"thread_start_us":761829,"threads_started":2,"wal-append.queue_time_us":431382}
W20260709 12:29:00.905049  4537 leader_election.cc:336] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 2.220s (SENT)
I20260709 12:29:00.880847  8567 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.910485  8567 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:00.911010  8567 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.911499  8567 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:00.913141  3849 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:00.913897  8504 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:00.913862  8567 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:00.916270  8380 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:00.921964  8564 consensus_queue.cc:237] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:00.793031  7960 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.926849  8533 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.921289  7843 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.933794  4001 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:00.933982  8500 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:00.936919  7843 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:00.938256  8511 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:00.835145  8348 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.868415  8382 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:00.971063  4536 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:00.971926  4570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.023s	sys 0.022s
W20260709 12:29:00.973603  4570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.023s	sys 0.022s
I20260709 12:29:00.979555  4536 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:00.981352  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:00.983557  3849 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:00.989406  3999 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:00.952457  8565 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:00.990669  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 429039us
W20260709 12:29:00.987507  3971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.026s	sys 0.030s
I20260709 12:29:00.913192  8536 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:00.999788  3969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.013s	sys 0.043s
I20260709 12:29:00.979789  8543 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:29:01.007798  3969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.014s	sys 0.043s
W20260709 12:29:01.008445  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 582848us
I20260709 12:29:00.978319  8380 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:01.002171  3971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.026s	sys 0.031s
I20260709 12:29:00.982967  8500 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:29:00.984226  8580 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.987043  8511 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:01.017088  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:01.002417  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:01.024598  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 460347us
I20260709 12:29:01.026113  3821 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:01.029732  3931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.024s	sys 0.006s
W20260709 12:29:01.031169  3931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.025s	sys 0.006s
I20260709 12:29:01.001196  8361 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:01.035550  8278 consensus_meta.cc:287] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.001s
I20260709 12:29:01.034543  8511 raft_consensus.cc:697] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:01.072523  8278 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:01.081828  8246 consensus_meta.cc:287] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.001s
I20260709 12:29:01.032522  8464 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:29:01.082424  8246 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:01.083019  8278 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:01.083551  8464 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:01.015446  8543 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:01.012777  8569 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.015627  8500 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:29:01.039163  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:01.087483  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:01.092952  3849 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: []
I20260709 12:29:01.093685  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:01.094461  3928 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:01.094306  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:01.095160  3926 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:01.082170  8348 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:01.098146  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:01.034075  8555 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:01.100180  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:01.043717  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:01.104393  4006 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:29:01.032395  8158 consensus_meta.cc:287] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.001s
I20260709 12:29:01.025547  3897 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:01.119119  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 93655.2us
I20260709 12:29:01.119882  3897 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:01.030527  8565 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:01.015540  8380 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:01.044724  8524 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:29:01.075737  8453 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:01.024412  8580 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:01.098891  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:01.099334  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 530892us
I20260709 12:29:01.105362  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:01.115121  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:01.144694  3849 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:01.117594  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:01.148283  3924 raft_consensus.cc:2410] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:29:01.088963  8500 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:01.155383  8536 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:01.156085  8589 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:29:01.156306  3856 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:29:01.156649  8589 raft_consensus.cc:697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:01.157548  8589 consensus_queue.cc:237] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:01.159298  3852 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:29:01.160593  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:01.144025  8567 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:01.124436  8555 raft_consensus.cc:697] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:01.162112  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:01.162796  8555 consensus_queue.cc:237] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:01.163281  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:01.163867  3855 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:01.163904  8500 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:01.165256  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:01.089313  8569 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:01.167547  8569 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:01.121677  8565 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.168180  8565 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:01.168362  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:01.169363  3849 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:29:01.170123  3852 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:01.171217  8380 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:01.176250  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:01.089792  8558 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:01.127650  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:01.176505  3926 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:01.130863  3850 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:01.128271  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:01.131852  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1183) took 2076 ms. Trace:
W20260709 12:29:01.131445  8575 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:29:01.040382  3969 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:01.144786  3930 raft_consensus.cc:2410] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:29:01.189858  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 149571us
I20260709 12:29:01.190261  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:01.116995  3857 raft_consensus.cc:1240] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:01.143909  3822 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:01.154852  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:01.153208  8580 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:01.165794  3855 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:01.121635  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:01.193547  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:01.176867  4001 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:01.177718  4570 rpcz_store.cc:276] 0709 12:28:59.055572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:59.508016 (+452444us) service_pool.cc:224] Handling call
0709 12:28:59.517059 (+  9043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:00.435506 (+918447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:00.435540 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:00.453953 (+ 18413us) log.cc:844] Serialized 26 byte log entry
0709 12:29:00.974201 (+520248us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:29:00.974262 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:00.974367 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:01.131656 (+157289us) raft_consensus.cc:1685] finished
0709 12:29:01.131678 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:01.131797 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":199934,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":33826,"thread_start_us":1420549,"threads_started":2,"wal-append.queue_time_us":658413}
I20260709 12:29:01.132285  3848 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:29:01.178965  3970 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:01.028438  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:01.191627  3924 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:01.123945  8382 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:01.194453  3926 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
W20260709 12:29:01.195823  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 170012us
W20260709 12:29:01.196439  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 52607.5us
I20260709 12:29:01.198439  3970 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:01.198522  3822 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:01.204084  3969 leader_election.cc:400] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10.
W20260709 12:29:01.204466  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:01.204672  3822 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:01.204938  3969 leader_election.cc:400] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10.
I20260709 12:29:01.205219  3969 leader_election.cc:403] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:01.143839  8494 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.209077  3822 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:01.216746  4001 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:01.124992  8158 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:01.233037  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:01.248844  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 44018.2us
I20260709 12:29:01.249382  4567 raft_consensus.cc:2368] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13.
I20260709 12:29:01.249826  3969 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:01.209769  8558 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:01.238090  3855 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:01.240283  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:01.203687  8581 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:29:01.206175  8348 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:29:01.247403  4538 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:01.203886  8246 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:01.265516  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:01.236001  3853 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:01.209589  8580 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:29:01.278270  8590 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:29:01.279114  8158 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:01.281116  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 1041) took 1043 ms. Trace:
I20260709 12:29:01.281508  3927 rpcz_store.cc:276] 0709 12:29:00.237574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:00.237704 (+   130us) service_pool.cc:224] Handling call
0709 12:29:00.238122 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:00.238851 (+   729us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:29:00.559096 (+320245us) log.cc:844] Serialized 14 byte log entry
0709 12:29:01.046739 (+487643us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:01.061257 (+ 14518us) log.cc:844] Serialized 26 byte log entry
0709 12:29:01.061456 (+   199us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:29:01.074041 (+ 12585us) log.cc:844] Serialized 14 byte log entry
0709 12:29:01.074301 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:01.074406 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:01.280903 (+206497us) raft_consensus.cc:1685] finished
0709 12:29:01.280924 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:01.281055 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14887,"prepare.queue_time_us":123753,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":86,"raft.queue_time_us":25764,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":18180,"spinlock_wait_cycles":13461376,"thread_start_us":714320,"threads_started":2,"wal-append.queue_time_us":540617}
I20260709 12:29:01.284106  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:01.284755  3927 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:01.291688  8580 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:01.292698  8580 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:01.294669  8581 raft_consensus.cc:697] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:01.296023  7960 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:01.297406  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:01.298629  8361 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:01.299363  8261 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:01.304500  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:01.305135  3849 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:01.268697  8587 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:29:01.307318  8587 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:29:01.307750  8587 raft_consensus.cc:697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:29:01.308682  4537 leader_election.cc:336] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.852s (SENT)
I20260709 12:29:01.309152  4537 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:01.310380  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:01.310967  3852 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:01.298638  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:01.312067  4006 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:29:01.312309  3849 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:01.285641  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:01.313038  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:01.305655  3928 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:01.313745  3926 raft_consensus.cc:2368] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12.
W20260709 12:29:01.315723  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 68421.5us
I20260709 12:29:01.317576  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:01.319327  4567 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: []
I20260709 12:29:01.322763  3971 leader_election.cc:400] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13.
I20260709 12:29:01.323200  3971 leader_election.cc:403] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:29:01.323799  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 279525us
I20260709 12:29:01.219295  8360 consensus_queue.cc:1059] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:29:01.329490  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:01.332808  3855 raft_consensus.cc:2368] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9.
I20260709 12:29:01.258517  8564 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:29:01.325608  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:01.305258  8358 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:01.339705  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:01.342185  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:01.343609  3821 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:01.347784  3932 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:29:01.269004  8576 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:01.224789  8494 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:01.270157  8500 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:01.202618  8511 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:01.431517  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 104590us
I20260709 12:29:01.430262  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:01.433859  3929 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:01.428174  3970 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:01.426383  3895 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:01.387250  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 68175.7us
W20260709 12:29:01.400990  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 85710.2us
I20260709 12:29:01.386837  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:01.396167  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:01.437426  3926 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:01.381652  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:01.356462  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:01.439495  3853 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:01.386765  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:01.430521  3821 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:01.349625  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 99879.4us
I20260709 12:29:01.448643  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:01.450904  3851 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: [7.6-8.7]
I20260709 12:29:01.451861  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:01.453291  3855 raft_consensus.cc:2410] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:29:01.433645  4538 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:01.315985  8569 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:29:01.479833  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 46246.7us
I20260709 12:29:01.462967  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:01.469971  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 161307us
I20260709 12:29:01.479014  3851 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:29:01.483266  3855 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:29:01.441851  3927 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:01.478755  3970 leader_election.cc:400] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12.
I20260709 12:29:01.489158  3970 leader_election.cc:403] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:29:01.490119  3970 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:29:01.374375  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:01.492818  3928 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:01.494089  3851 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:29:01.325734  8510 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:01.503415  3932 raft_consensus.cc:2410] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:29:01.506433  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 386626us
I20260709 12:29:01.506557  8086 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:01.507218  8086 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:01.508859  8586 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:29:01.509291  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 73551.5us
I20260709 12:29:01.509382  8586 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.509931  8586 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:01.510324  3895 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:01.512425  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:01.527565  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:01.531782  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:01.537483  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:01.545686  3850 raft_consensus.cc:2368] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12.
I20260709 12:29:01.502326  7843 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10.
W20260709 12:29:01.553916  4537 leader_election.cc:336] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.769s (SENT)
I20260709 12:29:01.554431  4537 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:01.555253  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 90291.9us
W20260709 12:29:01.555512  4537 leader_election.cc:336] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.898s (SENT)
I20260709 12:29:01.556022  4537 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:01.557524  3998 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: []
W20260709 12:29:01.558543  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 347339us
I20260709 12:29:01.556051  4536 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:01.574424  3853 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:01.435287  7960 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:01.346194  8564 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:01.400729  8534 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.594241  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:01.478338  8360 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:01.582026  4006 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9. Ops: []
I20260709 12:29:01.585112  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:01.591560  3929 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:29:01.600342  3853 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:01.537525  8579 raft_consensus.cc:3060] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:01.435503  8158 consensus_queue.cc:1059] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.146s
I20260709 12:29:01.553140  8328 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:01.552124  8476 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:29:01.634689  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 124378us
I20260709 12:29:01.618433  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:01.621663  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:01.645153  3853 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:29:01.462498  8395 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 12:29:01.624498  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:01.627753  4001 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:01.577018  8510 raft_consensus.cc:697] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:01.631846  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:01.651198  4003 raft_consensus.cc:2393] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 12: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:01.632114  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:01.581893  8524 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:01.646090  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:01.648159  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:01.596302  8584 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:29:01.657310  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 132055us
I20260709 12:29:01.602124  8564 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:01.462739  8588 consensus_queue.cc:1059] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.195s
W20260709 12:29:01.625200  8582 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:29:01.666051  4003 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:01.610697  8500 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:29:01.706998  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:01.718703  8589 consensus_queue.cc:1059] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:29:01.719025  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:01.740015  3853 raft_consensus.cc:2393] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:01.725008  4006 raft_consensus.cc:2393] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:01.726537  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 1043) took 1403 ms. Trace:
I20260709 12:29:01.628659  8614 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:01.734498  4003 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:01.736610  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:01.742476  4001 raft_consensus.cc:2410] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:29:01.736907  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 180951us
I20260709 12:29:01.699167  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:01.751989  4003 raft_consensus.cc:1275] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:29:01.740677  3931 rpcz_store.cc:276] 0709 12:29:00.322711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:00.322888 (+   177us) service_pool.cc:224] Handling call
0709 12:29:00.338816 (+ 15928us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:00.339311 (+   495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:00.339358 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:00.414578 (+ 75220us) log.cc:844] Serialized 26 byte log entry
0709 12:29:01.075638 (+661060us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:01.445124 (+369486us) log.cc:844] Serialized 14 byte log entry
0709 12:29:01.726112 (+280988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:01.726224 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:01.726280 (+    56us) raft_consensus.cc:1685] finished
0709 12:29:01.726298 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:01.726464 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":210574,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":67679,"thread_start_us":1191304,"threads_started":3,"wal-append.queue_time_us":706081}
I20260709 12:29:01.754927  4536 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:01.622356  8534 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:01.698197  8476 raft_consensus.cc:697] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:01.737457  8158 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:01.697763  8609 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:01.818109  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:01.782362  3857 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:29:01.778065  4003 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:29:01.774524  3850 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:29:01.706418  7960 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:29:01.627611  8328 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.629005  8360 raft_consensus.cc:697] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:01.744851  8614 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.792963  8299 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:29:01.720788  8348 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:01.852133  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:01.866469  4567 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:01.868569  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:01.785873  8504 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.850808  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:01.874226  4569 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:29:01.875514  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:01.873364  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:01.880870  3927 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:29:01.883167  4003 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11. Ops: [9.5-10.6]
I20260709 12:29:01.889801  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:01.890837  4573 raft_consensus.cc:2410] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:29:01.851994  8565 consensus_meta.cc:287] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.683s	user 0.008s	sys 0.008s
I20260709 12:29:01.829919  8609 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.797386  8158 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.910204  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:01.920512  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:01.920699  4573 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:01.921402  4568 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:29:01.914883  4569 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
W20260709 12:29:01.902292  8595 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.308s	user 0.001s	sys 0.001s
I20260709 12:29:01.880254  8621 raft_consensus.cc:3055] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:01.894320  8567 raft_consensus.cc:3055] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:29:01.927089  8604 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:29:01.927820  8597 log.cc:927] Time spent T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 12:29:01.968036  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:01.924274  8158 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:01.929904  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:01.920097  8609 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:01.892313  8348 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:01.934926  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:01.937785  4003 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:01.980633  4568 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:01.889976  7960 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:01.882833  8328 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:01.916615  8589 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.901697  8299 raft_consensus.cc:697] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:01.424865  8583 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13.
I20260709 12:29:01.954154  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:01.958694  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 318605us
W20260709 12:29:01.958732  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 322311us
I20260709 12:29:01.793646  8616 consensus_queue.cc:1059] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.137s
I20260709 12:29:02.077991  3895 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:01.928918  8605 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:29:01.893085  8588 raft_consensus.cc:3055] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:29:01.875330  8614 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:01.945753  3852 consensus_meta.cc:287] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.002s
I20260709 12:29:02.089344  3852 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:01.931295  8358 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:01.934358  8621 raft_consensus.cc:740] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:01.991564  4568 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
W20260709 12:29:01.975466  8596 log.cc:927] Time spent T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.399s	user 0.001s	sys 0.000s
I20260709 12:29:01.951809  8494 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:01.937975  8567 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:01.917812  8565 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:01.890277  8504 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:02.053741  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:02.087483  8588 raft_consensus.cc:740] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:01.308534  8587 consensus_queue.cc:237] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:01.295712  8581 consensus_queue.cc:237] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.074350  4001 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:01.952143  8627 consensus_queue.cc:1059] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 12:29:02.076740  4573 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:01.969391  3850 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:29:02.085947  4005 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:02.088145  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 850) took 1058 ms. Trace:
I20260709 12:29:02.157369  3997 rpcz_store.cc:276] 0709 12:29:01.030219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:01.030337 (+   118us) service_pool.cc:224] Handling call
0709 12:29:01.042479 (+ 12142us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:01.042859 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:01.042895 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:01.043396 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:29:01.498919 (+455523us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:01.498963 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:01.499050 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:02.087917 (+588867us) raft_consensus.cc:1685] finished
0709 12:29:02.087937 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:02.088072 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1927,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":422976,"threads_started":1,"wal-append.queue_time_us":690772}
I20260709 12:29:02.105382  4003 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 12:29:02.130744  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 52868.8us
W20260709 12:29:02.102628  8594 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.405s	user 0.000s	sys 0.001s
I20260709 12:29:02.159824  3895 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:02.127960  8555 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.154050  3999 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:01.979645  8476 consensus_queue.cc:237] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.180371  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:02.181243  3997 raft_consensus.cc:2393] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 12: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:01.816219  8576 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 12:29:02.089860  8360 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.167490  3895 leader_election.cc:400] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9.
I20260709 12:29:02.204093  3895 leader_election.cc:403] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:29:02.132650  8633 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:01.980651  8510 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.177583  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:02.179621  3897 connection.cc:256] RPC call timeout handler was delayed by -1.6773637910000616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260709 12:29:02.204936  3897 connection.cc:256] RPC call timeout handler was delayed by -1.6647637910000412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
I20260709 12:29:02.205200  4001 raft_consensus.cc:2410] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:29:02.205294  3897 connection.cc:256] RPC call timeout handler was delayed by -1.6539637910004785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
W20260709 12:29:02.205678  3897 connection.cc:256] RPC call timeout handler was delayed by -1.504563791000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260709 12:29:02.205961  3897 connection.cc:256] RPC call timeout handler was delayed by -1.4181637910000973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
W20260709 12:29:02.206336  3897 connection.cc:256] RPC call timeout handler was delayed by -1.2156637910002246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
W20260709 12:29:02.201846  3821 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.017s	sys 0.043s
W20260709 12:29:02.208578  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 57434.1us
I20260709 12:29:02.161829  8534 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:02.086061  8589 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.148097  8395 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 12:29:02.208861  3821 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.018s	sys 0.043s
W20260709 12:29:02.232158  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 801702us
I20260709 12:29:02.169512  8632 raft_consensus.cc:2804] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:29:02.213541  8608 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 12:29:02.220485  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 53132.5us
I20260709 12:29:02.241371  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:02.162603  8616 raft_consensus.cc:3055] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:02.202497  4565 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:02.210297  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:02.209645  4573 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:29:02.236003  4568 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:29:02.237103  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.246165  4001 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:29:02.233796  3821 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:02.245369  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.247205  3999 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:02.172178  8555 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.223634  8627 raft_consensus.cc:3055] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:02.224047  8603 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:02.232594  8617 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 8. Current term is 9.
W20260709 12:29:02.264003  4537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.000s	sys 0.011s
W20260709 12:29:02.298835  4537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.000s	sys 0.012s
W20260709 12:29:02.301450  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 745904us
W20260709 12:29:02.277819  3856 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.008s	sys 0.005s
W20260709 12:29:02.305646  3856 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.008s	sys 0.005s
I20260709 12:29:02.253445  8627 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:02.224234  8634 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:02.169414  7960 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.167569  8299 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.299005  8348 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:02.238452  8633 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.287225  8588 consensus_queue.cc:260] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:02.291323  8565 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:02.291590  8613 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 12:29:02.293066  8589 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:02.295753  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:02.377327  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:02.377898  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 82264.2us
I20260709 12:29:02.377988  4001 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:02.379097  3822 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:02.296097  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:02.277375  3971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.002s	sys 0.010s
W20260709 12:29:02.381036  3971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.003s	sys 0.011s
W20260709 12:29:02.265360  8382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.000s	sys 0.011s
I20260709 12:29:02.176344  8621 consensus_queue.cc:260] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:02.288692  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:02.242556  8616 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:02.303169  8603 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:02.285423  8643 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:29:02.306674  8395 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:02.312291  8534 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:02.381263  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:02.380193  3822 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:02.381361  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 681393us
I20260709 12:29:02.410781  4568 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:29:02.388177  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2662) took 1252 ms. Trace:
I20260709 12:29:02.411549  3929 rpcz_store.cc:276] 0709 12:29:01.135292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:01.600660 (+465368us) service_pool.cc:224] Handling call
0709 12:29:01.601007 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:01.601279 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:29:02.300694 (+699415us) log.cc:844] Serialized 14 byte log entry
0709 12:29:02.387604 (+ 86910us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:02.387799 (+   195us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:29:02.387894 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:02.387986 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:02.388118 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":717153,"prepare.queue_time_us":781077,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"thread_start_us":67986,"threads_started":1}
W20260709 12:29:02.379842  8605 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:29:02.399510  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 88751us
I20260709 12:29:02.382136  8641 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:29:02.420958  4537 leader_election.cc:336] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.829s (SENT)
I20260709 12:29:02.421559  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:02.404201  3999 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:29:02.404933  8652 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:29:02.423847  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:02.424347  8504 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:02.424831  3929 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 9: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:29:02.384572  8382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.000s	sys 0.014s
I20260709 12:29:02.415216  3897 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:02.402510  8565 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:02.372200  8634 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:02.440514  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1145) took 1628 ms. Trace:
I20260709 12:29:02.427804  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:02.413308  8534 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.417042  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 2093) took 1324 ms. Trace:
I20260709 12:29:02.387707  8632 raft_consensus.cc:697] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:29:02.431221  8635 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:29:02.442540  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:02.409556  8621 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:02.432899  8543 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:02.434218  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.434746  8524 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:02.463861  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:02.464986  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:02.434904  8382 raft_consensus.cc:3055] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:29:02.435397  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:02.435858  8650 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:29:02.436066  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.473253  4005 raft_consensus.cc:2410] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:29:02.437597  8600 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:29:02.438043  8619 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:29:02.438488  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.474884  4001 raft_consensus.cc:2410] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:29:02.440878  3854 rpcz_store.cc:276] 0709 12:29:00.811772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:00.812883 (+  1111us) service_pool.cc:224] Handling call
0709 12:29:00.813260 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:00.822578 (+  9318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:00.822609 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:00.829773 (+  7164us) log.cc:844] Serialized 26 byte log entry
0709 12:29:01.249761 (+419988us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:01.249801 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:01.249866 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:02.440334 (+1190468us) raft_consensus.cc:1685] finished
0709 12:29:02.440350 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:02.440464 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8969,"raft.queue_time_us":48348,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":353268,"threads_started":1,"wal-append.queue_time_us":1485385}
I20260709 12:29:02.439342  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2656) took 1337 ms. Trace:
I20260709 12:29:02.431263  8494 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:02.431917  8644 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:02.443063  3925 rpcz_store.cc:276] 0709 12:29:01.092439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:01.092539 (+   100us) service_pool.cc:224] Handling call
0709 12:29:01.101371 (+  8832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:01.118629 (+ 17258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:01.118658 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:01.125494 (+  6836us) log.cc:844] Serialized 26 byte log entry
0709 12:29:01.438915 (+313421us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:29:02.300065 (+861150us) log.cc:844] Serialized 14 byte log entry
0709 12:29:02.416594 (+116529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:02.416708 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:02.416769 (+    61us) raft_consensus.cc:1685] finished
0709 12:29:02.416788 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:02.416954 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":872000,"prepare.queue_time_us":871120,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":32739,"raft.queue_time_us":98447,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":39562,"thread_start_us":415478,"threads_started":2,"wal-append.queue_time_us":586287}
I20260709 12:29:02.451968  8534 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:02.415328  8589 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:29:02.467617  4003 raft_consensus.cc:2376] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15. Re-sending same reply.
I20260709 12:29:02.475430  3927 rpcz_store.cc:276] 0709 12:29:01.101738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:01.593788 (+492050us) service_pool.cc:224] Handling call
0709 12:29:01.633234 (+ 39446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:01.881284 (+248050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:02.439121 (+557837us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54003061d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:02.439287 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551739776}
I20260709 12:29:02.454532  4537 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:02.422421  8395 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.451952  8652 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:02.452704  8565 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.431247  8620 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.458776  8491 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:29:02.466559  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.495668  3997 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
W20260709 12:29:02.486452  8558 consensus_meta.cc:287] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.215s	user 0.012s	sys 0.000s
I20260709 12:29:02.456739  8504 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:02.472054  8524 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.405088  8616 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.507550  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 2090) took 1416 ms. Trace:
I20260709 12:29:02.510991  8633 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:02.511278  8616 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:02.515910  8567 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.517119  8567 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:02.518252  8618 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.518992  8618 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.522182  8640 consensus_queue.cc:1059] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:29:02.523170  8598 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.243s	user 0.001s	sys 0.001s
I20260709 12:29:02.525039  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1196) took 1514 ms. Trace:
I20260709 12:29:02.508033  3923 rpcz_store.cc:276] 0709 12:29:01.091362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:01.091485 (+   123us) service_pool.cc:224] Handling call
0709 12:29:01.091820 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:01.100111 (+  8291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:01.100144 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:01.122446 (+ 22302us) log.cc:844] Serialized 26 byte log entry
0709 12:29:01.515788 (+393342us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b18000f5f80. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:29:01.735158 (+219370us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:29:01.735198 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:01.735266 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:02.498883 (+763617us) raft_consensus.cc:1685] finished
0709 12:29:02.498913 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:02.507444 (+  8531us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7920,"raft.queue_time_us":25111,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":3287,"spinlock_wait_cycles":16526720,"thread_start_us":219126,"threads_started":1,"wal-append.queue_time_us":864525}
I20260709 12:29:02.525384  4574 rpcz_store.cc:276] 0709 12:29:01.010964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:01.011134 (+   170us) service_pool.cc:224] Handling call
0709 12:29:01.011565 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:01.012061 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:01.012105 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:01.015847 (+  3742us) log.cc:844] Serialized 26 byte log entry
0709 12:29:01.241739 (+225892us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:29:01.241800 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:01.241910 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:02.524815 (+1282905us) raft_consensus.cc:1685] finished
0709 12:29:02.524836 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:02.524971 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":570,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":6153,"thread_start_us":198377,"threads_started":1,"wal-append.queue_time_us":1121260}
W20260709 12:29:02.525842  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:02.470224  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:02.484189  4537 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:02.395617  8649 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 12:29:02.537415  8642 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:29:02.475724  8617 consensus_queue.cc:1059] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:29:02.485069  8623 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:02.477069  8641 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:02.467363  8382 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:02.542052  8654 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:29:02.542805  8556 raft_consensus.cc:3055] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:29:02.543032  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 58942.4us
I20260709 12:29:02.543272  8556 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:02.543831  4537 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:02.544107  8556 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.544987  4537 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:02.545446  8358 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.546126  8358 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:02.546327  8382 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.543289  8348 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.547346  8382 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:02.547432  8348 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.548599  8358 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:02.549558  8348 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:02.465297  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:02.551708  4537 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:02.465914  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 85754.4us
I20260709 12:29:02.493376  8565 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:02.501869  8620 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:02.549292  8634 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:02.491288  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 840) took 1841 ms. Trace:
I20260709 12:29:02.490967  8652 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.556859  3822 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:02.561123  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:02.483844  8494 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.497798  8643 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:02.500118  8558 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:02.439925  8627 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:02.564085  3998 rpcz_store.cc:276] 0709 12:29:00.649763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:00.650886 (+  1123us) service_pool.cc:224] Handling call
0709 12:29:00.651256 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:01.557991 (+906735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:02.491072 (+933081us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b540036e054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:02.491232 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2083773824}
W20260709 12:29:02.526423  8564 consensus_meta.cc:287] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.786s	user 0.012s	sys 0.001s
I20260709 12:29:02.579259  3822 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:02.526182  8555 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:02.526057  8618 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:02.565069  8609 consensus_meta.cc:287] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.001s
I20260709 12:29:02.497776  8651 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 12:29:02.565125  8536 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:02.614490  4574 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:02.562654  8566 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:02.562505  8380 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:02.563496  8511 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:02.599016  4537 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:02.602643  3849 raft_consensus.cc:2410] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:29:02.568619  8510 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:02.568585  8652 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:02.604816  4004 raft_consensus.cc:3055] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:02.576332  8624 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:02.606089  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.550998  8632 consensus_queue.cc:237] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:02.610273  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:02.616199  8536 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:02.597940  8606 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:02.612577  8609 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:02.601918  8564 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:02.614418  8653 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:29:02.614490  4001 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:29:02.614984  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:02.577742  8643 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.480134  8600 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.617797  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.619807  3998 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:29:02.665100  4005 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
W20260709 12:29:02.630371  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 62397.6us
I20260709 12:29:02.630999  4004 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:02.633687  4000 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 8.
I20260709 12:29:02.666378  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.608311  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:02.666778  4000 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
W20260709 12:29:02.634078  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 400320us
I20260709 12:29:02.666747  3897 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:02.668433  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:02.634577  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.618537  8558 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:29:02.635984  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.694947  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.695328  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.695714  4005 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:02.638842  3822 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:02.696743  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 57949.1us
I20260709 12:29:02.696871  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:02.635455  8566 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:29:02.655500  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2550) took 1498 ms. Trace:
I20260709 12:29:02.702294  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.702023  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:02.662432  4571 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
W20260709 12:29:02.629421  4537 leader_election.cc:336] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.989s (SENT)
I20260709 12:29:02.665428  3998 pending_rounds.cc:85] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 10
I20260709 12:29:02.704419  3998 pending_rounds.cc:107] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:29:02.704758  3998 raft_consensus.cc:2889] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:02.646008  8536 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:02.646270  8606 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.711009  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:02.611320  4566 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:29:02.696106  4000 raft_consensus.cc:2393] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 16: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:02.706279  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:02.704197  4537 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:02.707536  3997 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:02.712683  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:02.702989  4002 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:02.713331  3852 raft_consensus.cc:2376] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9. Re-sending same reply.
W20260709 12:29:02.708254  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:02.710312  3822 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:02.709721  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:02.715426  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 86042.9us
I20260709 12:29:02.715794  4005 raft_consensus.cc:2393] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 9: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:02.637274  8640 consensus_queue.cc:1059] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:29:02.716996  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:02.665424  8643 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:02.708235  4004 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.719980  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:02.721096  4001 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:02.722631  8464 consensus_queue.cc:1059] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:29:02.722978  8663 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.723984  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:02.702103  3856 rpcz_store.cc:276] 0709 12:29:01.157406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:01.157520 (+   114us) service_pool.cc:224] Handling call
0709 12:29:01.157803 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:01.550340 (+392537us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:29:02.306196 (+755856us) log.cc:844] Serialized 14 byte log entry
0709 12:29:02.484611 (+178415us) log.cc:844] Serialized 14 byte log entry
0709 12:29:02.486892 (+  2281us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:02.559608 (+ 72716us) log.cc:844] Serialized 26 byte log entry
0709 12:29:02.559752 (+   144us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:29:02.559788 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:02.560018 (+   230us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:02.648817 (+ 88799us) raft_consensus.cc:1685] finished
0709 12:29:02.648848 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:02.655431 (+  6583us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14766,"prepare.queue_time_us":191711,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":66975,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":149,"thread_start_us":1141887,"threads_started":3,"wal-append.queue_time_us":255031}
I20260709 12:29:02.725565  4005 raft_consensus.cc:1240] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:29:02.669899  8603 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:02.726181  4004 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:02.726926  3854 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:29:02.703498  8641 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:02.726960  3930 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 6.
I20260709 12:29:02.728940  3999 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:29:02.729241  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:02.717849  8395 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:02.719031  8558 raft_consensus.cc:697] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:29:02.720438  8586 consensus_meta.cc:287] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.210s	user 0.011s	sys 0.000s
I20260709 12:29:02.707105  8555 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:02.753407  4537 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:02.736979  8579 consensus_meta.cc:287] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.088s	user 0.008s	sys 0.000s
I20260709 12:29:02.772991  8579 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12.
I20260709 12:29:02.773780  4006 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:02.777388  8566 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:29:02.734457  3924 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:29:02.744742  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:02.767192  3856 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:29:02.787488  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:02.724264  8261 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:02.714541  8606 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:02.777850  8566 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:02.737627  8494 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:02.714322  8654 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 12:29:02.791030  8665 log.cc:927] Time spent T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:29:02.790499  8558 consensus_queue.cc:237] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:02.525215  8655 consensus_queue.cc:1175] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34711da9380944d2969a2bc3e203db3d" responder_term: 12 status { last_received { term: 12 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:29:02.743203  8564 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:02.797797  8566 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:29:02.742206  8524 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:02.732483  8671 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:02.746183  8666 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.798790  3999 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:29:02.731393  8657 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.174s
W20260709 12:29:02.771157  8158 consensus_meta.cc:287] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.781s	user 0.011s	sys 0.000s
I20260709 12:29:02.788208  3930 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:02.778079  8586 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:02.826361  8662 log.cc:927] Time spent T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:29:02.811666  4001 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:02.731484  8667 consensus_queue.cc:1059] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.192s
I20260709 12:29:02.817209  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:02.853915  3999 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:02.817938  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:02.818284  8622 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:02.813189  8671 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.862134  8671 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:02.866029  8672 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:02.866696  8086 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:02.866611  8672 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.825582  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:02.826457  3856 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:02.804808  4003 pending_rounds.cc:85] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 7
I20260709 12:29:02.832875  8621 raft_consensus.cc:3055] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:02.837180  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36516 (request call id 2565) took 1005 ms. Trace:
I20260709 12:29:02.840929  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1200) took 1609 ms. Trace:
I20260709 12:29:02.880336  4006 rpcz_store.cc:276] 0709 12:29:01.831636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:01.831782 (+   146us) service_pool.cc:224] Handling call
0709 12:29:02.837027 (+1005245us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54000f87d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:02.837124 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2062641536}
I20260709 12:29:02.843474  3821 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:02.821774  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:02.847530  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:02.911791  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:02.912743  4571 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:29:02.869084  8672 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:02.812681  8620 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:02.853389  8632 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.858814  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:02.926204  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:02.927366  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 68662.9us
I20260709 12:29:02.809300  4004 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 12:29:02.874189  4003 pending_rounds.cc:107] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:29:02.929145  4003 raft_consensus.cc:2889] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:02.880256  8621 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:02.930863  4004 pending_rounds.cc:85] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 11
I20260709 12:29:02.931170  4004 pending_rounds.cc:107] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 12:29:02.931484  4004 raft_consensus.cc:2889] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:29:02.874779  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:02.878295  3999 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:02.853961  8158 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:02.897312  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:02.880493  4565 rpcz_store.cc:276] 0709 12:29:01.231857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:01.232020 (+   163us) service_pool.cc:224] Handling call
0709 12:29:01.232425 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:02.245354 (+1012929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:02.839802 (+594448us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b54005ddca0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f4edc0 00007fe051fdaa02 00007fe051fd6dd6 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:29:02.840701 (+   899us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b54005dd9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:02.840869 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2242736384}
I20260709 12:29:02.753212  8663 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:02.914305  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:02.917098  3926 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:02.936736  3928 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:29:02.917909  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:02.869151  8556 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:02.940621  8673 log.cc:927] Time spent T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:29:02.941641  8663 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:02.943493  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:02.935958  8361 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:29:02.944672  8679 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:02.945183  8679 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.945518  8679 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:02.946949  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:02.948027  3852 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:29:02.948145  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:02.949303  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:02.956988  8644 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:02.962010  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:02.963127  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:02.964254  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:29:02.964426  8614 consensus_meta.cc:287] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.863s	user 0.008s	sys 0.000s
I20260709 12:29:02.964862  8614 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.965214  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:02.935510  4536 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:02.968456  8566 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:02.920830  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:02.919869  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:02.857468  8622 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.870316  8667 raft_consensus.cc:3055] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:02.920053  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2671) took 1659 ms. Trace:
I20260709 12:29:03.003595  3925 rpcz_store.cc:276] 0709 12:29:01.250440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:02.482188 (+1231748us) service_pool.cc:224] Handling call
0709 12:29:02.493148 (+ 10960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:02.501826 (+  8678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:02.501873 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:02.501943 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:02.501996 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:02.909691 (+407695us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b54002e1b54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:02.909740 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:02.909858 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13497088}
I20260709 12:29:02.912554  8648 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.935874  4571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "455f8427897049759001979ea81adec1"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:42442
W20260709 12:29:02.971418  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:02.972203  8491 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:29:02.972600  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:02.975658  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2668) took 1794 ms. Trace:
W20260709 12:29:02.919391  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 76034.3us
I20260709 12:29:03.017171  3821 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:02.973544  8644 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:02.869213  8565 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:02.998932  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 78295.7us
I20260709 12:29:02.999109  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:03.007635  8614 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:03.010401  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 294563us
I20260709 12:29:02.927464  8261 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.925102  8609 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:02.844401  8666 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.020236  3928 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:02.927291  7960 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:03.015899  3931 rpcz_store.cc:276] 0709 12:29:01.181093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:01.825416 (+644323us) service_pool.cc:224] Handling call
0709 12:29:01.869539 (+ 44123us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:29:01.938729 (+ 69190us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:29:02.569908 (+631179us) log.cc:844] Serialized 14 byte log entry
0709 12:29:02.710706 (+140798us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:29:02.721209 (+ 10503us) log.cc:844] Serialized 52 byte log entry
0709 12:29:02.721377 (+   168us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:29:02.721622 (+   245us) log.cc:844] Serialized 14 byte log entry
0709 12:29:02.805452 (+ 83830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:02.805571 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:02.975393 (+169822us) raft_consensus.cc:1685] finished
0709 12:29:02.975420 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:02.975583 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":465836,"prepare.queue_time_us":479169,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":11292,"raft.queue_time_us":277865,"raft.run_cpu_time_us":448,"raft.run_wall_time_us":29437,"thread_start_us":427289,"threads_started":3,"wal-append.queue_time_us":192224}
I20260709 12:29:03.080741  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:03.031818  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:03.003639  8622 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:02.997447  8382 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.014546  8640 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:03.107896  8640 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:03.108408  8640 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:03.083479  8641 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 12:29:03.114856  8630 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.980s	user 0.003s	sys 0.003s
I20260709 12:29:03.003261  8580 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:03.075017  8328 consensus_meta.cc:287] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.984s	user 0.011s	sys 0.000s
I20260709 12:29:03.115684  8580 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.115979  8328 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.067873  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:03.034565  3999 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:29:03.121578  3926 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:03.070502  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:03.122143  8382 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.122898  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 2141) took 1674 ms. Trace:
I20260709 12:29:03.123297  3849 rpcz_store.cc:276] 0709 12:29:01.448244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:01.448394 (+   150us) service_pool.cc:224] Handling call
0709 12:29:03.122695 (+1674301us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000ee054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:03.122837 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2651901184}
I20260709 12:29:03.124612  8382 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:03.070912  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:29:03.126276  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 55465.8us
I20260709 12:29:03.126947  3822 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:03.128568  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:03.129972  3848 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11. Ops: []
W20260709 12:29:03.133219  8567 consensus_meta.cc:287] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.616s	user 0.006s	sys 0.005s
I20260709 12:29:03.002817  8667 raft_consensus.cc:740] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:03.072494  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:03.151793  4005 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:02.930447  8632 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:02.937233  8624 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.127s
I20260709 12:29:03.081434  3925 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:03.153870  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:03.154469  3925 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:29:02.974222  8511 consensus_queue.cc:1059] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.092s
I20260709 12:29:02.972240  8536 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.056784  8558 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:29:03.069978  8534 consensus_meta.cc:287] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.000s
W20260709 12:29:03.089803  8678 log.cc:927] Time spent T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:29:03.094962  8566 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:03.094687  8659 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 12:29:03.103515  8623 consensus_meta.cc:287] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.001s
I20260709 12:29:03.026672  8648 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.194561  8648 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:03.133630  8628 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:29:03.134354  8555 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:03.194671  8556 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:03.135399  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:03.196146  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 60815.8us
I20260709 12:29:03.196950  3822 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:03.197255  8246 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:29:03.138603  8380 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:03.198168  3822 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:03.198464  8380 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:03.199255  8657 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:29:03.199949  8657 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:03.200626  8641 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:03.139721  8348 consensus_queue.cc:1059] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:29:03.202060  3822 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:03.202373  8348 consensus_queue.cc:1243] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer f3cab225ecb7488386a1a19239498cfe log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:29:03.202857  8555 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:03.139598  8679 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.101135  8606 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.205694  3854 raft_consensus.cc:1240] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:03.142263  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:03.142343  3998 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:29:03.143092  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:03.211061  4004 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:29:03.144961  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2151) took 1631 ms. Trace:
I20260709 12:29:03.070547  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:03.212612  3822 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:03.152909  3857 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:29:03.170966  3924 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:03.139591  8453 raft_consensus.cc:3055] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:03.211882  3853 rpcz_store.cc:276] 0709 12:29:01.513288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:01.744432 (+231144us) service_pool.cc:224] Handling call
0709 12:29:01.784715 (+ 40283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:02.170631 (+385916us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:29:02.200412 (+ 29781us) log.cc:844] Serialized 14 byte log entry
0709 12:29:02.437983 (+237571us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b18003020e0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe051b7f4bc 00007fe04eecd48b 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b7723a
0709 12:29:02.626046 (+188063us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:02.638145 (+ 12099us) log.cc:844] Serialized 26 byte log entry
0709 12:29:02.638295 (+   150us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:29:02.638334 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:03.144670 (+506336us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b540027ae54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:03.144721 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:03.144763 (+    42us) raft_consensus.cc:1685] finished
0709 12:29:03.144775 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:03.144908 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4855,"prepare.queue_time_us":30467,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":159478,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":29369,"spinlock_wait_cycles":883480192,"thread_start_us":223285,"threads_started":2,"wal-append.queue_time_us":132063}
I20260709 12:29:03.149448  8633 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:03.086614  8261 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.190268  4568 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:03.192273  8593 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:29:03.195230  8628 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:03.202929  8348 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:03.141104  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:03.203533  8382 raft_consensus.cc:3055] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:03.212770  4006 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:03.236709  4568 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:03.149009  3926 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:03.171096  8586 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:03.220629  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 204990us
I20260709 12:29:03.091562  7960 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.218863  8623 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:03.232340  8564 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:29:03.232839  3752 catalog_manager.cc:5697] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 1 to 3, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 3 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:03.238121  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:03.245469  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:03.244184  3856 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:29:03.228041  8616 consensus_meta.cc:287] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.716s	user 0.007s	sys 0.003s
I20260709 12:29:03.219102  8453 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:03.231093  8158 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:03.246245  3926 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:29:03.249341  4006 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:03.181780  8534 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.180981  8670 consensus_queue.cc:1059] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:29:03.234154  8628 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:03.190119  8510 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:29:03.289397  8453 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.268498  8524 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:03.242447  8348 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.322570  8671 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.322774  8524 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:03.323464  8524 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:03.323662  3932 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:03.324108  8348 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:03.324744  8671 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:03.291049  8464 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:03.293334  4569 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:03.294931  8580 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:03.298913  8627 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:03.326620  8534 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:03.327252  8453 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:03.327670  3929 raft_consensus.cc:2393] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 12: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:03.234777  8667 consensus_queue.cc:260] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.330299  8667 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:03.326575  8464 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:03.331046  8464 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:03.250653  8558 consensus_queue.cc:1059] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:29:03.332360  8666 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:03.301714  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:03.305058  4571 raft_consensus.cc:606] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:03.333263  3931 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:03.333287  4571 raft_consensus.cc:614] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:03.229154  8633 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.339951  8633 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:03.233870  8622 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.346940  3851 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 14. Ops: []
I20260709 12:29:03.347313  8640 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.348097  8622 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:03.350131  3928 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:03.351387  3931 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:03.306041  7960 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:03.311743  8261 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:29:03.312896  8565 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:03.319787  8632 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:03.234997  8382 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:29:03.355122  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:03.354270  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:03.271772  8328 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:03.368089  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:03.370249  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:03.376256  4570 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: []
I20260709 12:29:03.362588  3925 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 7.
W20260709 12:29:03.360288  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:03.384843  3932 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:29:03.362821  8555 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:03.389773  8670 raft_consensus.cc:3055] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:29:03.390264  8670 raft_consensus.cc:740] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:29:03.394208  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 120692us
I20260709 12:29:03.397027  8543 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:29:03.399101  8543 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:03.402415  8536 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:03.402889  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 1055) took 1195 ms. Trace:
I20260709 12:29:03.403357  3923 rpcz_store.cc:276] 0709 12:29:02.207506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:02.560482 (+352976us) service_pool.cc:224] Handling call
0709 12:29:02.560907 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:02.561256 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:29:02.561575 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 12:29:03.142973 (+581398us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b18004b3580. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b7723a 00007fe051fe1a2a
0709 12:29:03.402548 (+259575us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:03.402605 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:29:03.402652 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:03.402718 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:03.402833 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":152,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":7612,"raft.queue_time_us":106,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":2385280,"thread_start_us":259057,"threads_started":1}
I20260709 12:29:03.406464  8464 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.406176  8670 consensus_queue.cc:260] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.408756  8464 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:03.408823  8670 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:03.419186  3969 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:03.420096  8580 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:03.421274  3969 leader_election.cc:400] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12.
I20260709 12:29:03.422206  8348 consensus_queue.cc:1059] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:29:03.427515  8682 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 12:29:03.376466  8524 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.431388  8524 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:03.447404  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:03.449316  3969 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:03.450784  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:03.454941  3923 raft_consensus.cc:2368] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12.
I20260709 12:29:03.459761  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:03.461253  3929 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:29:03.457809  8652 consensus_meta.cc:287] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.816s	user 0.009s	sys 0.003s
I20260709 12:29:03.469743  3969 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:03.471321  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:03.457949  8587 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.017s	sys 0.013s
I20260709 12:29:03.456110  8580 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:03.456295  8627 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.451501  8328 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:03.481849  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:03.489279  3969 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:03.506585  3929 raft_consensus.cc:3055] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:29:03.513271  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:03.555833  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 66638.1us
I20260709 12:29:03.495213  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:03.556908  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 382666us
I20260709 12:29:03.557101  4572 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:03.512578  3752 catalog_manager.cc:5697] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 5 to 7, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 7 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:03.555187  3929 raft_consensus.cc:740] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:03.466683  8382 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:03.528101  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:03.477062  8587 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.066s	user 0.017s	sys 0.013s
W20260709 12:29:03.560667  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:03.562414  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 336787us
I20260709 12:29:03.558693  3969 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:03.519876  8691 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:29:03.529294  8689 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.411s	user 0.000s	sys 0.001s
I20260709 12:29:03.558578  3929 consensus_queue.cc:260] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.480526  8581 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:03.480813  8580 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:03.482266  8647 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:03.570202  3929 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:03.527439  8588 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:03.566725  4538 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:03.490995  8576 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:29:03.573807  3822 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:03.494359  8667 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.557946  8620 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:03.496974  8600 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:03.485473  8627 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.481694  8652 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.587105  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:03.583423  8643 consensus_meta.cc:287] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.853s	user 0.011s	sys 0.000s
I20260709 12:29:03.593210  8667 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.589761  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:03.599365  4566 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:29:03.600569  4571 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:29:03.624761  3822 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:03.600732  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:03.581849  8580 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:03.606174  8699 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:29:03.608508  8640 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:03.582691  8628 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.594463  8555 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:03.485317  8328 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:03.632542  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 237028us
I20260709 12:29:03.633203  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:03.571784  8698 consensus_queue.cc:1059] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:29:03.622133  8453 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:03.622701  8694 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:03.590910  8380 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.626173  3822 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:03.645489  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:03.626899  8600 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:03.675493  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:03.677503  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 51643us
I20260709 12:29:03.678139  3851 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:29:03.678503  3822 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:03.679589  3822 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:03.712105  4574 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 6. Current term is 7. Ops: []
I20260709 12:29:03.635869  8555 raft_consensus.cc:697] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:29:03.630249  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 71654.8us
W20260709 12:29:03.596727  8634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.019s	sys 0.006s
I20260709 12:29:03.620329  4537 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:03.689113  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:03.640118  8698 consensus_queue.cc:1243] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:29:03.596582  8579 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:03.636548  3927 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:29:03.638172  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:03.728818  3855 raft_consensus.cc:2393] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:03.636142  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:03.599090  8581 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:29:03.581137  8587 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:29:03.729562  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:03.730540  8380 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:03.572240  8696 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:29:03.626387  3895 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:03.732483  8620 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.732678  8579 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.733068  8620 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:03.732508  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 106203us
I20260709 12:29:03.734920  8579 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:03.735528  8640 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:29:03.736073  8640 raft_consensus.cc:697] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:03.736943  8640 consensus_queue.cc:237] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.652909  8453 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.739768  8453 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:03.739957  8581 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.628870  8666 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:03.630832  8686 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:29:03.711304  8464 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:03.742126  8666 raft_consensus.cc:697] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:29:03.742867  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 122656us
I20260709 12:29:03.743299  8620 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:03.744122  4537 leader_election.cc:400] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12.
I20260709 12:29:03.742964  8666 consensus_queue.cc:237] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.744462  4537 leader_election.cc:403] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:29:03.726524  3849 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
I20260709 12:29:03.745623  8690 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:29:03.746210  8690 raft_consensus.cc:697] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:03.746330  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:03.725294  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:03.747260  3999 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 10: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:03.744242  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:03.748278  4004 raft_consensus.cc:2393] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:03.740463  8581 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.748636  8494 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12.
I20260709 12:29:03.747090  8690 consensus_queue.cc:237] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.751262  8667 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:03.741618  8361 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.752926  8652 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:03.753325  8581 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:03.751618  3897 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:03.726372  8634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.019s	sys 0.006s
I20260709 12:29:03.754456  8361 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.757452  8361 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:03.761224  8628 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:03.717845  8565 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:03.762737  8565 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:03.763942  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:03.763782  8565 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.764787  4004 raft_consensus.cc:2368] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12.
I20260709 12:29:03.762755  3897 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:03.767028  8652 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:29:03.767688  8652 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:03.767490  8555 consensus_queue.cc:237] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.768877  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:03.771121  8328 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:03.717918  8641 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:03.771854  3997 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:03.771905  8641 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:03.772562  8641 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:03.773514  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:03.627431  8643 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:03.774437  3997 raft_consensus.cc:2393] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 12: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:03.778743  4536 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:03.781320  4536 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:03.635655  3929 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:29:03.775704  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:03.785145  8524 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:29:03.788153  3997 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:03.628084  4572 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:03.785717  8701 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:03.785566  4004 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:03.797029  8261 raft_consensus.cc:2764] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:29:03.802351  8643 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:03.802767  8679 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:03.803519  7960 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:03.804072  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:03.804716  4006 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:03.805531  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:03.807246  4572 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:29:03.809614  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:03.811265  3997 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:03.771925  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:03.812260  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:03.789726  3929 pending_rounds.cc:85] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 8
I20260709 12:29:03.812861  3929 pending_rounds.cc:107] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:29:03.813159  3929 raft_consensus.cc:2889] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:03.813438  3971 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:03.811471  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:03.791885  4001 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:29:03.818708  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 47444us
I20260709 12:29:03.819633  3897 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:03.822626  4567 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:29:03.823004  3997 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:03.823125  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:03.823858  4001 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:29:03.827204  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:03.833827  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:03.835165  4571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86e92801c3904600b054e99343413645"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:29:03.835947  4571 raft_consensus.cc:606] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:03.836416  4571 raft_consensus.cc:614] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:03.839579  4568 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:29:03.806723  8628 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.797340  8634 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.841251  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:03.843432  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:03.847290  3997 raft_consensus.cc:2368] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13.
I20260709 12:29:03.847672  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:03.848248  4006 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:03.822218  8328 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:03.852218  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:03.852596  3997 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:03.853082  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:03.857533  4001 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:03.830159  8588 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:03.828547  8652 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:03.815500  8494 consensus_queue.cc:1059] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:29:03.828217  8361 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:29:03.839661  7960 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:29:03.911413  3853 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:03.873988  8453 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:03.851720  8628 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:03.859838  3857 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:29:03.879253  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:03.887310  8588 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:03.876976  8652 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:03.864673  3897 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:03.862003  8634 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:03.945917  8607 log.cc:927] Time spent T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 1.484s	user 0.009s	sys 0.000s
I20260709 12:29:03.951822  8644 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.989566  8669 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.995616  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1073) took 1203 ms. Trace:
I20260709 12:29:03.996258  4569 rpcz_store.cc:276] 0709 12:29:02.791968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:02.792411 (+   443us) service_pool.cc:224] Handling call
0709 12:29:02.792795 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:03.326246 (+533451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:03.995313 (+669067us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54006a3954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:03.995539 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150663424}
W20260709 12:29:03.990765  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 126186us
I20260709 12:29:03.991228  8671 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:04.011368  4006 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:04.012773  3897 leader_election.cc:400] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12.
I20260709 12:29:04.013226  3897 leader_election.cc:403] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:03.936546  8647 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.024849  4568 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:29:04.021837  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:04.027406  4569 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:04.028182  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:04.027477  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.029971  3856 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:03.958536  8667 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.032289  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:04.042845  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:03.993566  8627 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:04.036692  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:03.993402  8652 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:04.040729  3897 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:04.057662  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:04.058349  3853 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:04.058576  3848 raft_consensus.cc:1240] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:04.024214  8603 raft_consensus.cc:3055] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:04.053206  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.019848  8617 raft_consensus.cc:3055] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:04.056027  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:04.033771  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:04.058418  3932 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 12: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:04.066970  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:04.075699  3925 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:04.068622  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:04.072283  3897 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:04.077059  4567 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:04.023258  8615 consensus_queue.cc:1059] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:29:04.069028  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:04.045145  8158 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12.
I20260709 12:29:04.083168  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:04.071492  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:04.081377  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:04.085705  4569 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:04.086030  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:04.087779  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.088536  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:04.089598  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:04.091193  3897 leader_election.cc:400] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13.
I20260709 12:29:04.093024  3895 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:04.019351  8644 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.024585  8669 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:04.112191  3851 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 12: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:04.118170  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:04.119041  4568 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:04.036854  8681 consensus_queue.cc:1059] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:29:04.122903  4569 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:29:04.144294  4569 raft_consensus.cc:1240] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: []
I20260709 12:29:04.145942  4569 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:29:04.067703  8603 raft_consensus.cc:740] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:04.054177  8640 consensus_queue.cc:1059] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:29:04.074174  8617 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:04.153756  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:29:04.154245  3971 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.4:41095 timed out after 1.600s (SENT) [suppressed 44 similar messages]
I20260709 12:29:04.165457  3932 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:04.031466  8647 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.094851  8633 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:04.054368  8667 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.163676  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.176362  3857 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:04.168042  4568 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:04.100224  8534 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:04.174304  3853 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:04.182400  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.184698  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.186314  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:04.167785  8702 log.cc:927] Time spent T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:29:04.168411  8158 raft_consensus.cc:2764] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 12:29:04.189296  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 97120.2us
I20260709 12:29:04.140828  8615 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:29:04.194916  3931 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:29:04.192695  3897 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:29:04.191852  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 98905.2us
I20260709 12:29:04.175581  8633 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:04.233450  8633 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:04.238920  8647 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:04.196491  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.202708  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:04.204574  3848 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:04.208359  8615 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:29:04.208662  8694 raft_consensus.cc:3055] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:29:04.186998  8534 raft_consensus.cc:697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:04.204943  8628 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:04.168251  8588 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:04.213841  8453 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:29:04.216198  8711 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:29:04.221576  8580 consensus_meta.cc:287] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.000s
I20260709 12:29:04.222724  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:04.193497  8640 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:04.208477  8707 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:29:04.231102  8667 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:04.241204  3857 raft_consensus.cc:2393] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:04.243369  4567 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:04.246305  3925 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
W20260709 12:29:04.247558  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 45012us
I20260709 12:29:04.395742  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:04.396862  3970 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:04.229279  3895 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:04.398433  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 169245us
I20260709 12:29:04.254130  8621 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.256770  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1104) took 1169 ms. Trace:
I20260709 12:29:04.222071  8603 consensus_queue.cc:260] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:04.262105  8606 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:04.267452  8685 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 1.173s	user 0.000s	sys 0.015s
W20260709 12:29:04.268908  8684 log.cc:927] Time spent T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 1.045s	user 0.009s	sys 0.002s
I20260709 12:29:04.270761  8476 raft_consensus.cc:3055] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:04.274700  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2672) took 3023 ms. Trace:
I20260709 12:29:04.427901  3927 rpcz_store.cc:276] 0709 12:29:01.250797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:02.483301 (+1232504us) service_pool.cc:224] Handling call
0709 12:29:02.495313 (+ 12012us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:03.738520 (+1243207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:04.274305 (+535785us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002e2f54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:04.274614 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2624066944}
W20260709 12:29:04.277804  8677 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 1.202s	user 0.000s	sys 0.013s
I20260709 12:29:04.278908  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1058) took 2462 ms. Trace:
I20260709 12:29:04.434720  4570 rpcz_store.cc:276] 0709 12:29:01.816908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:01.817186 (+   278us) service_pool.cc:224] Handling call
0709 12:29:01.851496 (+ 34310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:03.377995 (+1526499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:04.278543 (+900548us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54006f1dd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:04.278794 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3504312576}
I20260709 12:29:04.286144  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.287453  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:04.301239  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.301667  3854 raft_consensus.cc:3055] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:29:04.301761  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.436926  3853 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 9.
I20260709 12:29:04.384248  8615 raft_consensus.cc:697] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:04.392159  8348 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.340724  8617 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.345866  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:04.348557  8382 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:04.353178  7960 consensus_queue.cc:1059] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:29:04.354319  8712 log.cc:927] Time spent T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.160s	user 0.003s	sys 0.000s
I20260709 12:29:04.487131  3822 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:04.354635  8261 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:29:04.357369  8708 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 12:29:04.377705  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 120295us
I20260709 12:29:04.379993  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:04.380436  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 2101) took 1465 ms. Trace:
I20260709 12:29:04.495932  3928 rpcz_store.cc:276] 0709 12:29:02.915085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:03.077002 (+161917us) service_pool.cc:224] Handling call
0709 12:29:03.077281 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:03.350537 (+273256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:04.380189 (+1029652us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54003066d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:04.380376 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627088256}
W20260709 12:29:04.381172  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 226958us
W20260709 12:29:04.388856  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 88680.1us
I20260709 12:29:04.427717  8476 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:04.400586  4565 rpcz_store.cc:276] 0709 12:29:03.087630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:03.087917 (+   287us) service_pool.cc:224] Handling call
0709 12:29:03.088365 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:03.269223 (+180858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:03.269262 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:03.289922 (+ 20660us) log.cc:844] Serialized 26 byte log entry
0709 12:29:03.451511 (+161589us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:03.451557 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:04.256299 (+804742us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54004bbed4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:04.256372 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:04.256437 (+    65us) raft_consensus.cc:1685] finished
0709 12:29:04.256457 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:04.256711 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112698,"raft.queue_time_us":22375,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":81205,"spinlock_wait_cycles":368533248,"thread_start_us":161198,"threads_started":1,"wal-append.queue_time_us":189161}
W20260709 12:29:04.259848  8683 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 1.154s	user 0.013s	sys 0.010s
I20260709 12:29:04.398864  3970 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:04.400331  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:04.508428  4002 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:29:04.509034  4574 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:04.380055  8634 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:04.424054  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:04.381021  8723 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:04.438149  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.510069  3853 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:04.304698  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.241873  8641 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:04.429668  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.427155  3897 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:04.441097  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:04.441401  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:04.436578  3854 raft_consensus.cc:740] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:04.516290  4569 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:29:04.333230  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.504597  8534 consensus_queue.cc:237] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:04.388075  8511 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:04.518641  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1074) took 1683 ms. Trace:
I20260709 12:29:04.518908  8511 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.519024  4573 rpcz_store.cc:276] 0709 12:29:02.835396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:02.836307 (+   911us) service_pool.cc:224] Handling call
0709 12:29:02.836643 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:02.836968 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:02.836994 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:02.837469 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:29:02.919831 (+ 82362us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:29:02.919874 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:02.919942 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:04.259248 (+1339306us) spinlock_profiling.cc:243] Waited 41.2 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:04.518359 (+259111us) raft_consensus.cc:1685] finished
0709 12:29:04.518377 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:04.518571 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1086,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":94731520,"thread_start_us":81972,"threads_started":1,"wal-append.queue_time_us":185384}
W20260709 12:29:04.448333  8718 log.cc:927] Time spent T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 12:29:04.451399  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.452087  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:04.528576  4566 raft_consensus.cc:2410] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:29:04.455946  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.529286  3851 raft_consensus.cc:2393] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:04.457399  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2594) took 1657 ms. Trace:
I20260709 12:29:04.413618  8651 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:04.400102  8640 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:04.463748  8621 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:04.465418  3753 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51802 (request call id 335) took 16645 ms (client timeout 15000 ms). Trace:
I20260709 12:29:04.467003  8696 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:04.471150  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 183831us
I20260709 12:29:04.401015  8361 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.416078  8632 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:04.414397  8576 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:04.554538  8361 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.555395  8576 consensus_queue.cc:1059] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:29:04.476907  3849 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:04.522055  8669 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:04.444473  8453 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.392732  8580 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:04.500486  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:04.368468  8694 raft_consensus.cc:740] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:04.571820  8580 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:04.571702  8694 consensus_queue.cc:260] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.572804  8694 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:04.554390  8681 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:04.574184  3999 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:29:04.512924  3969 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:04.429118  8667 consensus_queue.cc:1059] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:29:04.480835  8603 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:04.553424  8696 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.514322  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.515286  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.475675  8644 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:04.478807  8491 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:04.488332  8565 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.516019  3857 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
W20260709 12:29:04.523756  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 124938us
I20260709 12:29:04.529798  4003 rpcz_store.cc:276] 0709 12:29:02.800561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:02.800847 (+   286us) service_pool.cc:224] Handling call
0709 12:29:02.804573 (+  3726us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:02.929699 (+125126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:02.929733 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:02.930169 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 12:29:03.021476 (+ 91307us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:29:03.021528 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:03.021655 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:04.268234 (+1246579us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:04.457098 (+188864us) raft_consensus.cc:1685] finished
0709 12:29:04.457122 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:04.457338 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8477440,"thread_start_us":90995,"threads_started":1,"wal-append.queue_time_us":241488}
I20260709 12:29:04.534355  3821 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:04.587589  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 53304.8us
I20260709 12:29:04.588357  3821 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:04.521035  8511 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:04.585678  3752 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.064s	sys 0.089s
I20260709 12:29:04.537160  3851 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
I20260709 12:29:04.527324  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:04.547710  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 120615us
I20260709 12:29:04.590795  3998 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
W20260709 12:29:04.592362  3752 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.064s	sys 0.089s
I20260709 12:29:04.503800  8649 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:29:04.495270  8278 consensus_queue.cc:1059] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:29:04.482239  4570 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:04.493742  3822 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:04.529567  8634 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.540014  8360 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:29:04.505545  8609 consensus_queue.cc:1059] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:29:04.564932  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:04.566011  8361 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:04.522248  8246 consensus_queue.cc:1059] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:29:04.545285  8617 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:04.581461  3855 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 15: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:29:04.588616  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 75774.3us
I20260709 12:29:04.624126  3969 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:04.498131  8558 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:04.592115  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:04.481194  8348 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.584517  8453 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.558420  8628 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.648741  8628 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.563046  8632 raft_consensus.cc:697] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:04.650730  8558 raft_consensus.cc:697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:04.650961  8632 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.651700  8558 consensus_queue.cc:237] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.553184  8690 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:29:04.626070  8361 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:04.655490  8246 raft_consensus.cc:3055] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:04.655908  8246 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:04.656896  4000 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:29:04.656694  8246 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:04.657840  8246 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:04.658910  8633 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:04.651715  8641 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:04.660995  8633 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:04.661594  8633 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:29:04.558866  8652 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:04.625072  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 131439us
W20260709 12:29:04.540885  3753 rpcz_store.cc:269] 0709 12:28:47.819590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.823179 (+  3589us) service_pool.cc:224] Handling call
0709 12:29:04.465129 (+16641950us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:55.547656 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:55.552644 (+  4988us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:55.552687 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:28:55.552708 (+    21us) tablet.cc:662] Decoding operations
0709 12:28:55.706000 (+153292us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:55.706074 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:55.706102 (+    28us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:28:55.708036 (+  1934us) tablet.cc:701] Row locks acquired
0709 12:28:55.708056 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:28:55.708201 (+   145us) write_op.cc:270] Start()
0709 12:28:55.708325 (+   124us) write_op.cc:276] Timestamp: P: 1783600135708159 usec, L: 0
0709 12:28:55.708347 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:28:55.709080 (+   733us) log.cc:844] Serialized 9365 byte log entry
0709 12:28:56.008787 (+299707us) op_driver.cc:464] REPLICATION: finished
0709 12:28:56.486056 (+477269us) write_op.cc:301] APPLY: starting
0709 12:28:56.512564 (+ 26508us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:57.234924 (+722360us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:57.235065 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:58.579498 (+1344433us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:58.581603 (+  2105us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 12:28:58.581704 (+   101us) write_op.cc:312] APPLY: finished
0709 12:28:58.582579 (+   875us) log.cc:844] Serialized 212 byte log entry
0709 12:28:59.575199 (+992620us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:59.966024 (+390825us) write_op.cc:454] Released schema lock
0709 12:28:59.987330 (+ 21306us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:00.042262 (+ 54932us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:00.042295 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":77265,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":401171,"apply.run_cpu_time_us":139755,"apply.run_wall_time_us":3594396,"cfile_cache_hit":94,"cfile_cache_hit_bytes":98136,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6215,"cfile_init":2,"lbm_read_time_us":93726,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":10,"num_ops":24,"prepare.queue_time_us":108596,"prepare.run_cpu_time_us":13735,"prepare.run_wall_time_us":274384,"raft.queue_time_us":166097,"raft.run_cpu_time_us":14181,"raft.run_wall_time_us":397247,"replication_time_us":283691,"thread_start_us":1509954,"threads_started":5,"wal-append.queue_time_us":1238416,"wal-append.run_cpu_time_us":14635,"wal-append.run_wall_time_us":2431909}]]}
I20260709 12:29:04.635883  3932 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:04.685387  3822 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:04.648023  8453 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:04.645812  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 53780.9us
I20260709 12:29:04.688532  3897 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:04.689061  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:04.664403  8348 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:04.665128  8609 consensus_queue.cc:1243] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer f3cab225ecb7488386a1a19239498cfe log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:29:04.665993  8671 consensus_meta.cc:287] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.000s
W20260709 12:29:04.666484  8720 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 12:29:04.556564  8615 consensus_queue.cc:237] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:04.606820  8360 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:04.673211  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.674252  3849 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:04.676041  3855 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:04.618609  8555 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:29:04.593118  8580 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:29:04.631040  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:04.612931  8681 raft_consensus.cc:697] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:04.593130  8565 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:04.699553  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:04.700519  8246 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:04.701588  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:04.742789  3927 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:04.703284  3931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:29:04.745273  3931 raft_consensus.cc:606] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:04.704188  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:04.626950  8666 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:04.708271  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:04.669756  8606 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:04.712137  3923 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:29:04.755084  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:04.756517  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:04.757427  3923 raft_consensus.cc:2393] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 12: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:04.656688  8382 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:04.668896  8628 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:04.612761  8634 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.715104  3926 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:29:04.708318  8671 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:04.611635  8576 raft_consensus.cc:3055] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:29:04.587179  8476 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.718261  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:04.740417  8348 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:04.779594  4537 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:04.785259  3855 raft_consensus.cc:1275] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:29:04.723183  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:04.723664  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:04.727311  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 96368.8us
I20260709 12:29:04.787978  3849 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:29:04.730890  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:04.739393  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:04.706599  8651 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:29:04.702378  3928 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:29:04.746327  3925 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:04.749751  4566 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:04.724535  8360 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:04.789479  3924 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:04.787247  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:04.798615  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:04.799100  4003 raft_consensus.cc:1275] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:29:04.782945  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:04.802255  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:04.803668  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 72891us
I20260709 12:29:04.805675  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:04.805572  3929 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:04.806341  4003 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:04.808353  3895 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:04.811759  3927 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:29:04.810755  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:04.826514  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:04.827406  3998 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:29:04.796247  8651 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:04.877663  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 67009.7us
I20260709 12:29:04.878756  3897 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:04.779209  8576 raft_consensus.cc:740] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:04.881260  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:04.795292  8348 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:04.885800  3849 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:29:04.883286  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 296401us
W20260709 12:29:04.882217  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 63961.5us
I20260709 12:29:04.799285  8524 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:04.779377  8643 consensus_queue.cc:1059] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
W20260709 12:29:04.804813  8494 consensus_queue.cc:1175] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "073f84fcc295417f9bcc1eea29d2bb58" responder_term: 14 status { last_received { term: 14 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 14 index: 13 } }
I20260709 12:29:04.888127  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:04.809827  3895 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:04.899762  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:04.920626  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 373823us
I20260709 12:29:04.959414  3971 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:04.889178  3929 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:04.805799  8382 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:04.940054  3931 raft_consensus.cc:1275] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 12:29:04.966133  3931 pending_rounds.cc:85] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 5
I20260709 12:29:04.966468  3931 pending_rounds.cc:107] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:29:04.966768  3931 raft_consensus.cc:2889] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:04.968129  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:04.969197  4003 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:04.969558  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:04.972615  3931 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:04.852679  8246 raft_consensus.cc:697] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:04.973134  3931 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:04.978408  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:04.979983  3925 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:29:04.887667  8640 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:04.887465  8651 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:04.888973  8348 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:04.805678  8491 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260709 12:29:04.804800  8606 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:04.967826  8667 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:05.015224  8627 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:05.026532  8627 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.026921  8627 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:05.028440  8606 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.879097  8476 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:05.031733  8361 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.032266  8361 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:05.034253  8730 log.cc:927] Time spent T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:29:04.994571  3931 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:04.954553  8734 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:05.035526  3931 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:04.986084  8524 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.042348  8524 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:29:05.046403  8732 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.248s	user 0.000s	sys 0.000s
I20260709 12:29:05.049069  8246 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.056102  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2687) took 1023 ms. Trace:
I20260709 12:29:05.056631  3929 rpcz_store.cc:276] 0709 12:29:04.032263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:04.033491 (+  1228us) service_pool.cc:224] Handling call
0709 12:29:05.055871 (+1022380us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54000e8dd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:05.056021 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679112960}
W20260709 12:29:05.058957  8721 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.566s	user 0.002s	sys 0.000s
I20260709 12:29:05.064579  8576 consensus_queue.cc:260] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.067142  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2587) took 1298 ms. Trace:
I20260709 12:29:05.067502  3999 rpcz_store.cc:276] 0709 12:29:03.768476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:03.770143 (+  1667us) service_pool.cc:224] Handling call
0709 12:29:03.770514 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:04.574655 (+804141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:05.066863 (+492208us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b54003787d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:05.067079 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1847583488}
I20260709 12:29:05.068101  8737 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:05.071834  8696 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:05.065112  8361 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:05.072798  8361 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:29:05.073293  8361 raft_consensus.cc:697] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:05.074580  8576 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:29:05.076468  8722 raft_consensus.cc:3055] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:05.077069  8722 raft_consensus.cc:740] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:29:05.080053  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:05.080189  8627 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:05.074250  8361 consensus_queue.cc:237] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:04.998677  8453 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:05.035929  8640 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:29:04.887259  8681 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:05.098865  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 413527us
I20260709 12:29:05.036666  8698 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:29:05.095562  3853 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.032s	sys 0.022s
I20260709 12:29:05.124876  3931 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:29:05.131196  3931 pending_rounds.cc:85] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 7
I20260709 12:29:05.131630  3931 pending_rounds.cc:107] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 12.8
W20260709 12:29:05.132718  3853 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.033s	sys 0.022s
I20260709 12:29:05.132011  3931 raft_consensus.cc:2889] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:05.112656  8722 consensus_queue.cc:260] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.129148  3822 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:05.135494  8722 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:05.135807  8628 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:29:05.137321  8628 consensus_queue.cc:1059] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:05.138523  8641 raft_consensus.cc:3055] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:05.138902  8641 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:29:05.142799  8733 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 12:29:05.113240  8627 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:05.146049  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:05.148813  4566 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:29:05.154186  8652 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:05.163537  8609 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.202189  8565 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:05.168892  8464 consensus_queue.cc:1059] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 12:29:05.249099  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 370458us
I20260709 12:29:05.204723  8609 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:05.247196  8617 consensus_meta.cc:287] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.005s
W20260709 12:29:05.260016  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 450250us
W20260709 12:29:05.268534  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:05.274695  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 315336us
I20260709 12:29:05.283404  3971 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:05.288923  3930 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:05.265256  3895 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:05.308228  3971 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:05.268414  8694 consensus_meta.cc:287] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.695s	user 0.014s	sys 0.000s
W20260709 12:29:05.310761  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:05.309541  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 44415.8us
I20260709 12:29:05.331918  3971 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:05.335659  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 447595us
I20260709 12:29:05.335773  3895 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:05.324220  8588 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:05.288255  8652 consensus_queue.cc:1048] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:29:05.308571  8745 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:05.322765  8696 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:05.324612  8617 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:29:05.333212  8360 consensus_meta.cc:287] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.003s
I20260709 12:29:05.328593  8494 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.288549  8524 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.328787  8261 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:05.396926  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2688) took 1359 ms. Trace:
I20260709 12:29:05.322274  8576 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:29:05.400959  3926 rpcz_store.cc:276] 0709 12:29:04.037999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:04.038164 (+   165us) service_pool.cc:224] Handling call
0709 12:29:04.038569 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:04.774360 (+735791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:05.396595 (+622235us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54003061d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:05.396852 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555330432}
I20260709 12:29:05.389907  8086 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:29:05.367573  8491 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:29:05.397854  8603 consensus_meta.cc:287] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.823s	user 0.010s	sys 0.002s
I20260709 12:29:05.385411  8694 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:05.334651  8627 consensus_queue.cc:1059] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
W20260709 12:29:05.472222  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:05.437223  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 269655us
I20260709 12:29:05.421586  8555 raft_consensus.cc:3055] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:29:05.530792  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 195093us
I20260709 12:29:05.541687  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:05.321511  8382 raft_consensus.cc:697] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:05.408725  8494 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.417989  8632 consensus_queue.cc:1048] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:29:05.399358  8360 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:05.581655  4570 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:05.401986  8696 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.504568  8511 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:05.439221  8491 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.418694  8261 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.399130  8617 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:05.586663  3896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.023s	sys 0.023s
W20260709 12:29:05.617923  3896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.024s	sys 0.023s
I20260709 12:29:05.532873  8555 raft_consensus.cc:740] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:05.567516  8627 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:29:05.431885  8694 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:05.601775  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 60138.3us
I20260709 12:29:05.582132  8759 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:05.667542  8722 consensus_meta.cc:287] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.002s
I20260709 12:29:05.667085  8759 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:05.668610  8752 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:29:05.638455  8621 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:05.605645  8745 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:05.547844  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:05.682310  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:05.682683  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:05.688793  3929 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:05.688983  3931 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:05.581350  7843 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:05.605237  8725 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:05.643285  3928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:29:05.681572  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:05.696285  3928 raft_consensus.cc:606] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:05.696681  3928 raft_consensus.cc:614] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:05.644097  3852 raft_consensus.cc:3055] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:29:05.645722  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 313853us
I20260709 12:29:05.697043  3852 raft_consensus.cc:740] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:05.696786  3923 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:05.648838  8694 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:05.650892  8617 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:05.651597  8750 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 12:29:05.651696  8494 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:05.709092  4537 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:05.709303  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 1070) took 1013 ms. Trace:
I20260709 12:29:05.652460  8382 consensus_queue.cc:237] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:05.709807  3932 rpcz_store.cc:276] 0709 12:29:04.695550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:04.697234 (+  1684us) service_pool.cc:224] Handling call
0709 12:29:04.697628 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:04.709518 (+ 11890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:04.709579 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:04.710174 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 12:29:05.175574 (+465400us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:05.175613 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:05.175682 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:05.709031 (+533349us) raft_consensus.cc:1685] finished
0709 12:29:05.709070 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:05.709229 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13141,"raft.queue_time_us":10684,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6526,"spinlock_wait_cycles":1691904,"thread_start_us":464296,"threads_started":1,"wal-append.queue_time_us":623096}
I20260709 12:29:05.654835  8261 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:05.712638  8261 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:05.713001  8261 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:05.713357  8261 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:05.659458  8348 consensus_meta.cc:287] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
W20260709 12:29:05.659783  8743 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.411s	user 0.000s	sys 0.001s
I20260709 12:29:05.660996  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2605) took 1161 ms. Trace:
I20260709 12:29:05.697796  3852 consensus_queue.cc:260] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:05.664497  8737 consensus_meta.cc:287] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 12:29:05.665037  8609 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:05.666339  8524 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:05.672686  8696 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:05.639434  8739 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 12:29:05.607542  8756 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:05.674284  8555 consensus_queue.cc:260] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.676117  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:05.676276  8651 consensus_meta.cc:287] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.641s	user 0.008s	sys 0.002s
I20260709 12:29:05.604882  8511 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:05.618685  8361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.005s	sys 0.006s
W20260709 12:29:05.694820  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:05.697621  3929 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:05.607278  8086 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:29:05.701773  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:05.742182  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:05.742434  3927 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:29:05.742832  4566 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:05.641757  8627 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.696039  8725 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.708135  8694 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:05.722002  4537 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:05.725024  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:05.726120  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:05.718174  4004 rpcz_store.cc:276] 0709 12:29:04.499754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:04.500938 (+  1184us) service_pool.cc:224] Handling call
0709 12:29:04.501266 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:29:04.501643 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:29:04.953838 (+452195us) log.cc:844] Serialized 14 byte log entry
0709 12:29:05.552019 (+598181us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:29:05.562492 (+ 10473us) log.cc:844] Serialized 52 byte log entry
0709 12:29:05.562641 (+   149us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:29:05.573727 (+ 11086us) log.cc:844] Serialized 14 byte log entry
0709 12:29:05.574936 (+  1209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:05.575137 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:05.660778 (+ 85641us) raft_consensus.cc:1685] finished
0709 12:29:05.660799 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:05.660939 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":607,"prepare.queue_time_us":648577,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":193635,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":26254,"spinlock_wait_cycles":457472,"thread_start_us":928227,"threads_started":2,"wal-append.queue_time_us":661338}
I20260709 12:29:05.729034  3852 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:05.698719  8644 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.737625  3926 raft_consensus.cc:2393] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 11: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:05.738919  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:05.736722  8758 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:05.743970  3971 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:05.758141  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:05.695259  8621 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.698967  8745 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:05.730732  8737 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:29:05.738024  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 397091us
W20260709 12:29:05.740918  8361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.006s	sys 0.006s
I20260709 12:29:05.723771  8348 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:05.748698  8627 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:05.763521  4537 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:05.763998  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:05.764526  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:05.766366  4569 raft_consensus.cc:1217] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Deduplicated request from leader. Original: 7.8->[8.9-8.9]   Dedup: 8.9->[]
I20260709 12:29:05.783113  4569 raft_consensus.cc:1240] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:29:05.745045  8651 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.747098  8770 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.745373  8609 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:05.769721  3971 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:05.755633  8555 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:05.754680  8764 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:05.784304  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:05.751130  8725 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:05.786451  3970 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:05.782922  4570 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:29:05.768748  8775 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:05.792027  8361 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:29:05.755995  8694 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:05.802685  8769 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:29:05.788825  8772 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:05.765905  8756 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:05.768846  8696 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.819182  4571 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:05.827159  8360 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:05.827350  3925 raft_consensus.cc:1240] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:29:05.832013  8756 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.834847  8756 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:05.841387  8756 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:05.844125  8727 log.cc:927] Time spent T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 1.257s	user 0.010s	sys 0.006s
I20260709 12:29:05.844789  8748 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:05.845160  8617 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.845737  8617 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.823570  8770 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.847978  8617 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:05.828001  8494 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:05.852217  8494 raft_consensus.cc:697] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:05.853353  8494 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.853991  8158 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.854622  8158 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:05.857486  8158 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:05.858999  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:05.819594  8737 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 12:29:05.826005  8774 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:29:05.828830  8771 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:29:05.831151  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 153175us
I20260709 12:29:05.862535  8771 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:05.863094  8771 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.863759  8491 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:05.863520  8771 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:05.865667  8771 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:05.759860  8644 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.832535  3852 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:29:05.845525  8748 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.866300  8771 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:05.869572  8626 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:29:05.870582  8771 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:05.872768  8771 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:05.865864  8641 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.874703  8679 consensus_queue.cc:1059] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:05.875005  8491 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.875504  8491 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.877498  8491 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:05.868400  8644 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:05.878249  8641 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:05.878520  8759 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:05.879770  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:05.880098  8634 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:05.882406  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:05.883224  4568 raft_consensus.cc:2410] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:29:05.868763  4566 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:29:05.885567  8748 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:05.823320  8609 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.886482  8669 raft_consensus.cc:3055] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:05.887006  8669 raft_consensus.cc:740] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:05.888074  8669 consensus_queue.cc:260] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:05.888793  8609 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:05.889348  8669 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:05.894871  3854 consensus_queue.cc:260] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:05.896106  8751 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.565s	user 0.013s	sys 0.013s
I20260709 12:29:05.896514  3854 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:05.900769  4570 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:29:05.905037  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1191) took 1288 ms. Trace:
W20260709 12:29:05.906595  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:05.865715  3822 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:05.909734  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:05.905540  3851 rpcz_store.cc:276] 0709 12:29:04.616847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:04.617051 (+   204us) service_pool.cc:224] Handling call
0709 12:29:04.617455 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:04.669348 (+ 51893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:04.669381 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:04.686130 (+ 16749us) log.cc:844] Serialized 26 byte log entry
0709 12:29:05.088486 (+402356us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:05.088525 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:05.523770 (+435245us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b5400018bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:05.523844 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:05.895449 (+371605us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:05.904773 (+  9324us) raft_consensus.cc:1685] finished
0709 12:29:05.904804 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:05.904965 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":221,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5113,"spinlock_wait_cycles":200115584,"thread_start_us":347468,"threads_started":1,"wal-append.queue_time_us":533408}
I20260709 12:29:05.912801  8348 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:05.921033  3854 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:29:05.921578  3854 pending_rounds.cc:85] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 7
I20260709 12:29:05.921924  3854 pending_rounds.cc:107] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:29:05.922290  3854 raft_consensus.cc:2889] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:29:05.926065  8504 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 12:29:05.927294  8773 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:29:05.939400  8745 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:05.941423  8651 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:05.950790  8694 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:05.954943  8511 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:05.926160  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2164) took 1625 ms. Trace:
I20260709 12:29:05.956305  3854 rpcz_store.cc:276] 0709 12:29:04.301107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:04.301234 (+   127us) service_pool.cc:224] Handling call
0709 12:29:04.301551 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:05.894495 (+1592944us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540010e3a0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f5506f 00007fe051fcdf60 00007fe051fcf7de 00007fe051fd9b49 00007fe051fda416 00007fe051fd6d8f 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62
0709 12:29:05.925784 (+ 31289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:05.926048 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307213568}
I20260709 12:29:05.825220  8775 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.962580  8775 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:05.824877  8764 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.972762  8764 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:05.897029  8696 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.980221  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1165) took 3045 ms. Trace:
I20260709 12:29:05.980662  3852 rpcz_store.cc:276] 0709 12:29:02.934671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:02.948875 (+ 14204us) service_pool.cc:224] Handling call
0709 12:29:02.949180 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:05.644006 (+2694826us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b54001b0420. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f4edc0 00007fe051fd91c0 00007fe051fda231 00007fe051fd6d8f 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c
0709 12:29:05.869363 (+225357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:05.979870 (+110507us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54002ee854. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:05.980131 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4042221568}
I20260709 12:29:05.763401  8758 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:05.991741  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:05.988055  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:05.988771  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:05.989109  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:05.994475  4570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:29:05.994828  4568 raft_consensus.cc:2393] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 11: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:29:05.990578  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 80831.9us
I20260709 12:29:05.992409  3853 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
W20260709 12:29:05.998253  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 234804us
I20260709 12:29:06.006567  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:06.007380  3856 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
W20260709 12:29:06.028848  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:06.050794  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:06.051505  3926 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:06.051357  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:06.050850  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:06.052544  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:06.052544  3927 raft_consensus.cc:2393] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 11: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:06.053087  3929 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:06.057178  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:05.902289  8759 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:06.059610  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 57846.7us
I20260709 12:29:06.083630  4537 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:06.085675  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:05.992551  8534 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.999033  8696 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:06.092604  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:05.991941  8643 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:06.096717  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:06.097617  3854 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:05.997846  8694 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.001286  8511 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.110049  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 869) took 2465 ms. Trace:
W20260709 12:29:06.111081  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:06.110612  4000 rpcz_store.cc:276] 0709 12:29:03.644500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:03.646940 (+  2440us) service_pool.cc:224] Handling call
0709 12:29:03.711970 (+ 65030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:04.657354 (+945384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:06.109690 (+1452336us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b540036e554. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:06.109956 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2172245760}
I20260709 12:29:06.112213  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54068 (request call id 1075) took 1411 ms. Trace:
I20260709 12:29:06.112775  3930 rpcz_store.cc:276] 0709 12:29:04.701185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:04.701314 (+   129us) service_pool.cc:224] Handling call
0709 12:29:06.111973 (+1410659us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54000efbd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:06.112134 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251924864}
I20260709 12:29:06.120347  8609 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.121120  8609 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:06.123169  8754 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.407s	user 0.004s	sys 0.000s
I20260709 12:29:06.087504  8644 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:05.998689  8698 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
W20260709 12:29:06.132969  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:06.101271  8643 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:06.089510  8759 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:06.170190  8647 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.170881  8647 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:06.173578  8647 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:06.174512  7843 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:06.133584  8609 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:06.186415  8696 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:06.187072  8696 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:06.187565  8696 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:06.190254  8261 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.193298  8261 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:06.195431  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:06.132206  8278 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:06.210865  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:06.211071  8278 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:06.212059  8603 raft_consensus.cc:3055] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:06.212628  8603 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:06.155122  8643 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:06.217391  8756 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:06.103348  8617 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:29:06.132920  8644 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:06.226564  8644 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:06.229809  8617 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.230590  8617 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.231282  8758 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:06.108821  8694 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.232919  8632 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.233630  8632 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:06.237952  8759 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:06.112608  8511 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.213733  8603 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:06.241186  8511 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:06.105291  8534 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.241783  4572 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:06.239123  8632 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:06.253295  8770 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:06.275018  3897 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:06.271698  4574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.018s	sys 0.068s
W20260709 12:29:06.278304  4574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.018s	sys 0.068s
W20260709 12:29:06.274151  8588 consensus_meta.cc:287] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.881s	user 0.013s	sys 0.000s
I20260709 12:29:06.213867  8278 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:06.246201  8603 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:06.296082  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:06.298460  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:06.299871  3857 raft_consensus.cc:2410] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:29:06.275542  8756 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:06.302569  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:06.304423  3855 raft_consensus.cc:2393] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:29:06.289417  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 503034us
I20260709 12:29:06.306035  3970 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:06.307693  4573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.033s	sys 0.100s
I20260709 12:29:06.280922  8759 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.312265  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:06.315104  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:06.318091  3848 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:06.320746  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:06.289844  8588 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:06.281212  8632 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:06.321693  3857 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:29:06.308027  4573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.033s	sys 0.100s
W20260709 12:29:06.325573  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 246570us
I20260709 12:29:06.332796  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:06.333506  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:06.337314  4537 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:06.338325  4004 raft_consensus.cc:2410] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:29:06.313138  8278 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.344449  3998 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:29:06.344856  8784 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:06.345392  8784 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:06.345942  8784 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:06.340018  8382 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:29:06.347783  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:06.348409  4000 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:06.349203  8621 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:06.350138  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:06.350927  3999 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 14: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:06.351593  8771 raft_consensus.cc:3055] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:06.352075  8771 raft_consensus.cc:740] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:06.352929  8771 consensus_queue.cc:260] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.320968  8759 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.313910  8494 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:06.356060  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:06.337464  8555 consensus_meta.cc:287] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 12:29:06.386214  8278 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.340456  8647 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:06.402478  8534 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:06.403807  8627 consensus_meta.cc:287] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.001s
W20260709 12:29:06.405315  8725 consensus_meta.cc:287] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
I20260709 12:29:06.309307  8756 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:06.408674  8775 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.356158  8694 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:06.383484  8617 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:06.356295  8632 raft_consensus.cc:697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:06.329625  8785 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:06.439502  8771 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:06.461383  8759 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:06.311076  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:06.551976  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:06.522750  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:06.577934  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:06.524142  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:06.542074  3998 raft_consensus.cc:1240] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:29:06.552892  4001 raft_consensus.cc:1217] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Deduplicated request from leader. Original: 5.6->[6.7-8.8]   Dedup: 6.7->[8.8-8.8]
W20260709 12:29:06.561601  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 465939us
I20260709 12:29:06.532935  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:06.551230  3932 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:29:06.564410  4565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.013s	sys 0.015s
I20260709 12:29:06.587010  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:06.566280  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:06.541154  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:06.474898  8775 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:06.550860  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:06.516510  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:06.568001  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:06.514923  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:06.506595  3850 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
W20260709 12:29:06.584632  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:06.535653  3997 raft_consensus.cc:1275] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:29:06.476238  8784 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.595674  8737 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:06.551913  4005 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: [9.5-11.7]
I20260709 12:29:06.527390  3969 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:06.539166  3848 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:29:06.650103  4001 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 8. Current term is 9. Ops: [6.7-8.8]
W20260709 12:29:06.666545  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:06.642629  3857 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:06.634299  4000 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
W20260709 12:29:06.668651  4565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.013s	sys 0.022s
I20260709 12:29:06.646066  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:06.428714  8647 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:06.635160  8758 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.687397  3999 raft_consensus.cc:2393] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 12: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:06.688067  3854 raft_consensus.cc:2410] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:29:06.689091  8617 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.690825  8633 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:06.693179  8534 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:06.693656  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:06.690850  3927 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:06.700923  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:06.702431  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:06.702476  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:06.703197  4005 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:06.703439  4000 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:06.693574  3930 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:06.704703  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:06.441607  8725 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:06.715405  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:06.716210  8360 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.716961  8647 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:06.716770  8758 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.716969  8360 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.718391  8633 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.718870  4573 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:06.719954  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:06.720816  3999 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:29:06.724063  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 197173us
I20260709 12:29:06.725279  4003 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:06.727887  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:06.729156  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:06.729365  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:06.724557  8348 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:29:06.392352  8494 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.732753  8494 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:06.726411  3849 raft_consensus.cc:2410] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:29:06.726783  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:06.735520  3997 raft_consensus.cc:2376] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15. Re-sending same reply.
I20260709 12:29:06.736240  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:06.737426  3932 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:06.738711  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:06.741983  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:06.721529  8633 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:06.729681  4003 raft_consensus.cc:2376] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14. Re-sending same reply.
I20260709 12:29:06.743623  8632 consensus_queue.cc:237] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:06.711665  4002 raft_consensus.cc:2468] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:06.748600  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:06.736747  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:06.726229  8745 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:06.748842  4570 raft_consensus.cc:606] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:06.756239  8555 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:06.756991  8555 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.759397  8555 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:06.438951  8627 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:06.751463  3998 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:06.761956  4000 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 14: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:06.766996  8278 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:06.767335  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 58000.3us
I20260709 12:29:06.770231  8534 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:06.766245  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:06.770259  8491 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:29:06.779484  4005 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:29:06.769613  4537 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:06.709748  8737 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.794265  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:06.795404  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:06.795877  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:06.796159  8633 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.792160  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:06.796240  3930 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:06.798494  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 72581.8us
I20260709 12:29:06.788127  8671 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:29:06.799887  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 76351.9us
I20260709 12:29:06.803975  3997 raft_consensus.cc:2410] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:29:06.796923  8633 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.805681  3927 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
W20260709 12:29:06.792474  8795 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:29:06.813328  3998 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:29:06.819183  8771 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:06.819831  8756 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:06.821637  8725 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:06.821916  8723 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.822445  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1126) took 1055 ms. Trace:
I20260709 12:29:06.823002  8723 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.822939  4565 rpcz_store.cc:276] 0709 12:29:05.766978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.767098 (+   120us) service_pool.cc:224] Handling call
0709 12:29:05.767359 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:05.776407 (+  9048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:05.776454 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:05.814827 (+ 38373us) log.cc:844] Serialized 26 byte log entry
0709 12:29:06.717806 (+902979us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:29:06.717901 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:06.718021 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:06.822216 (+104195us) raft_consensus.cc:1685] finished
0709 12:29:06.822241 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:06.822366 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1530,"raft.queue_time_us":60105,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":794261,"threads_started":1,"wal-append.queue_time_us":800937}
I20260709 12:29:06.824983  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:06.813483  8696 consensus_meta.cc:287] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.625s	user 0.017s	sys 0.000s
I20260709 12:29:06.802578  8671 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:06.772898  8617 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.830637  3924 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:06.833752  4567 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:29:06.832728  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:06.837502  3932 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:29:06.839690  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:06.838842  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 69476.7us
I20260709 12:29:06.840946  4003 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:06.841881  8278 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:06.842710  8278 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.846657  8278 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:06.849161  8797 raft_consensus.cc:993] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:06.819979  8771 raft_consensus.cc:697] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:06.851121  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:06.852978  3971 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:06.854398  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 80965.2us
I20260709 12:29:06.850862  8797 raft_consensus.cc:1081] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:06.859625  8745 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:06.862929  4004 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:29:06.864609  8491 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:06.865097  4536 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:06.865195  8491 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:06.863513  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1228) took 1049 ms. Trace:
I20260709 12:29:06.865991  3998 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:06.852499  8534 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:06.835994  8696 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.873143  3927 raft_consensus.cc:2410] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:29:06.867429  8491 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:06.876871  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:06.877540  3928 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:06.879885  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:06.880612  4005 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:06.885965  8690 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:06.886514  8690 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:06.887894  8696 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:06.886946  8690 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:06.896984  4573 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:06.866214  4574 rpcz_store.cc:276] 0709 12:29:05.725573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:05.727502 (+  1929us) service_pool.cc:224] Handling call
0709 12:29:05.727798 (+   296us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:29:05.728098 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:05.728136 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:29:05.732850 (+  4714us) log.cc:844] Serialized 52 byte log entry
0709 12:29:06.278795 (+545945us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:29:06.664794 (+385999us) log.cc:844] Serialized 14 byte log entry
0709 12:29:06.747035 (+ 82241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:06.755661 (+  8626us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:06.763901 (+  8240us) raft_consensus.cc:1685] finished
0709 12:29:06.763918 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:06.775404 (+ 11486us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82854,"prepare.queue_time_us":71814,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":24,"raft.queue_time_us":17018,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":11852,"thread_start_us":887516,"threads_started":2,"wal-append.queue_time_us":670147}
I20260709 12:29:06.897975  3924 raft_consensus.cc:2393] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:06.878649  8617 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:06.905992  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:06.904799  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:06.874099  8797 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:29:06.909691  4004 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: []
I20260709 12:29:06.919275  3928 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:06.911872  8534 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.920888  8758 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:06.938802  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:06.923658  8737 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:06.951064  3928 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:29:06.963795  3927 raft_consensus.cc:2393] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 12: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:06.976454  3997 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:29:06.922670  8756 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:29:06.977950  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:06.978482  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:06.985690  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:06.980806  8278 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:06.987859  8476 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:29:06.988114  8278 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:06.985378  8606 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:06.990022  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:06.990533  8606 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:06.970533  8534 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:06.993471  8633 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:06.993649  4571 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:06.993762  8606 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:06.994815  8811 log.cc:927] Time spent T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 12:29:06.996001  8669 consensus_meta.cc:287] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.106s	user 0.006s	sys 0.013s
I20260709 12:29:06.997074  4536 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:06.999317  3930 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:06.941004  8771 consensus_queue.cc:237] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:07.003171  8649 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:07.003233  8756 consensus_queue.cc:1243] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer f3cab225ecb7488386a1a19239498cfe log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:29:07.003412  4567 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:07.006342  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.006974  4003 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:07.008503  3924 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13. Ops: [11.10-12.11]
W20260709 12:29:06.999532  8813 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.125s	user 0.001s	sys 0.001s
I20260709 12:29:07.013201  8799 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:07.013911  8799 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:07.017828  8799 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:07.018872  8278 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.019320  8723 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:07.020177  8603 consensus_meta.cc:287] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.718s	user 0.013s	sys 0.002s
I20260709 12:29:07.021777  4000 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:29:07.022045  8756 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:07.022946  8576 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:07.022811  8756 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.023571  8576 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:07.016695  8643 consensus_meta.cc:287] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.802s	user 0.014s	sys 0.004s
I20260709 12:29:07.025259  8756 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.025575  8606 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:07.015924  8644 consensus_meta.cc:287] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.789s	user 0.004s	sys 0.013s
I20260709 12:29:07.005427  8649 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.025204  8643 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.031929  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.032481  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:07.036072  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:07.026299  3929 raft_consensus.cc:2410] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:29:07.032902  4536 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:07.052388  3998 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:07.053747  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.049078  3971 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:07.064195  4005 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:07.065272  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.065965  4005 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
W20260709 12:29:07.068992  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 146750us
I20260709 12:29:07.027745  8643 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.026260  8644 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.072113  3998 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:07.068118  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.027722  8649 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.080756  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.025827  8576 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.084161  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.080302  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.086985  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:07.087440  3928 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:07.065500  8745 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:07.088595  3923 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:29:07.033324  8647 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:07.069694  8756 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:07.026203  8606 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:07.088052  8524 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:07.097680  3851 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: []
I20260709 12:29:07.099015  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.098505  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:07.099689  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.102543  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:07.085246  8797 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:07.098297  3931 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:29:07.106252  3924 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:29:07.106230  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:07.109606  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 76886.8us
I20260709 12:29:07.110059  3854 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:07.111418  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.105813  4537 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:07.117477  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.118707  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:07.118853  3932 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:29:07.116688  4002 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:07.123442  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.101613  8756 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:07.065369  8758 consensus_queue.cc:1059] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:29:07.127303  3997 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 8. Current term is 9. Ops: []
I20260709 12:29:07.107230  8524 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:07.134227  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.135180  3853 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:29:07.135672  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:07.136085  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.134295  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.137624  3850 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:29:07.134423  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.138917  3855 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:07.139288  3850 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:07.140977  3850 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:07.142306  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:29:07.142594  8524 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:07.142907  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.144301  3998 raft_consensus.cc:2368] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14.
I20260709 12:29:07.148075  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.148501  4536 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:07.145565  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.150121  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:07.150396  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.148108  4005 raft_consensus.cc:1275] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:29:07.151371  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:07.152527  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:07.141266  3855 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:29:07.155329  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:07.162217  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:07.161302  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 78231.1us
I20260709 12:29:07.161443  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.167018  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.128934  8756 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:07.168381  3924 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:07.169986  4537 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:07.170601  8534 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:07.173489  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:07.095396  8745 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:07.159801  4571 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:29:07.180811  4005 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: []
W20260709 12:29:07.184538  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 50841.8us
I20260709 12:29:07.189031  4537 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:07.183544  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.193125  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:07.192988  4005 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:29:07.193053  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:07.199878  3857 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:07.199854  3931 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:29:07.202745  3851 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:07.206799  3997 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:29:07.194175  8696 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:07.150067  8797 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.214841  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:07.212698  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:29:07.214780  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:07.218014  8491 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.219659  8737 raft_consensus.cc:3055] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:07.191156  3853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:40038
I20260709 12:29:07.222664  3855 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:07.222836  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.223836  8821 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:07.199615  8476 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:07.236374  8649 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:07.236759  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.201678  8261 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:29:07.246445  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.246479  3928 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:07.249907  8628 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:07.250474  8647 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:07.250654  8628 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.251507  8644 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:07.233812  8737 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:07.254441  8476 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:07.254973  8737 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.255506  8476 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.256620  8737 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:07.239886  8696 raft_consensus.cc:697] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:07.257999  8696 consensus_queue.cc:237] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.258608  8628 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.263340  8491 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:07.263936  8797 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:07.264339  4566 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 11: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:07.264935  8821 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.267052  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.267513  8821 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.268537  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:07.270839  4566 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:07.274284  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.274787  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.248690  4567 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
W20260709 12:29:07.278002  3999 consensus_meta.cc:287] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.557s	user 0.013s	sys 0.000s
I20260709 12:29:07.278496  3999 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:07.279286  4003 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:07.275501  3855 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:07.287601  3969 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:07.292303  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:07.292706  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.273648  3821 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:07.293218  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.301911  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.295184  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.295847  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.297322  3853 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:29:07.302124  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 55489.8us
I20260709 12:29:07.306912  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.306923  3853 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:07.275794  8261 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:07.285063  8606 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:07.315246  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:07.315347  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 74028.6us
I20260709 12:29:07.316061  4000 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:29:07.320394  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.324249  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.318344  4565 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:29:07.337098  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.333092  3897 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:07.334913  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:07.337735  3997 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:07.312740  8261 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:07.340054  4004 raft_consensus.cc:2368] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14.
I20260709 12:29:07.337327  3969 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:07.340880  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:07.341420  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.301198  8524 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.348814  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:07.350816  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:07.351719  8694 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:07.316066  8821 consensus_queue.cc:1048] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:29:07.352607  4571 raft_consensus.cc:2410] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:29:07.354403  8632 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:07.356030  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.358548  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:07.359212  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.356006  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.358111  8632 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:07.361109  8741 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:29:07.361276  8632 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:07.361536  3855 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:07.367213  4000 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:07.342535  8649 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.352226  8694 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:29:07.373663  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 100157us
I20260709 12:29:07.374413  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.388763  8649 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.390882  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:07.392805  8681 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:07.393311  8681 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:07.393317  8524 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:07.393777  8681 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:07.395768  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.396996  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.398455  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:07.399137  3855 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:07.366407  8647 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:07.397608  3997 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:29:07.402539  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:07.404022  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 1231) took 1126 ms. Trace:
I20260709 12:29:07.404413  4573 rpcz_store.cc:276] 0709 12:29:06.278031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.577314 (+299283us) service_pool.cc:224] Handling call
0709 12:29:07.403883 (+826569us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b540048c954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:07.403971 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110912768}
I20260709 12:29:07.405568  8628 consensus_queue.cc:1059] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:29:07.406251  8784 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:07.406857  8784 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:07.407259  8649 raft_consensus.cc:3055] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:07.407349  8784 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.407778  8649 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:07.409281  8649 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:07.410694  8649 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:07.411655  8745 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:07.413120  8784 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:07.415349  8810 log.cc:927] Time spent T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.596s	user 0.004s	sys 0.000s
I20260709 12:29:07.417959  8756 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.419301  3999 raft_consensus.cc:2368] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 12. Current term is 13.
I20260709 12:29:07.420388  8756 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.370903  8741 raft_consensus.cc:697] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:07.421324  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.427420  8741 consensus_queue.cc:237] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:07.429136  8627 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:07.403911  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:07.432529  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 56552us
I20260709 12:29:07.422192  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.435223  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.426244  3821 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:07.471984  4000 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
W20260709 12:29:07.436246  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:07.478829  3856 raft_consensus.cc:2410] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:29:07.479393  3852 raft_consensus.cc:2393] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 17: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:07.481827  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:07.481563  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 55510.5us
I20260709 12:29:07.479902  3853 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.436096  4566 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:07.508045  3851 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:07.508415  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:07.519130  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:07.432760  8694 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:07.540999  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:07.545598  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:07.543184  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.546514  3932 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:07.550504  3851 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:07.553159  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:07.507786  8606 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:07.553287  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:07.508991  8771 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:07.555323  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:07.548581  8690 consensus_meta.cc:287] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.651s	user 0.002s	sys 0.010s
I20260709 12:29:07.516703  8756 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:07.425055  8799 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.566735  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.570205  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:07.565322  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:07.577152  3932 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:29:07.577168  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:07.579295  3927 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
W20260709 12:29:07.565407  8823 log.cc:927] Time spent T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:29:07.588151  3851 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:29:07.513664  8681 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.570742  8534 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:07.561947  8834 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:07.594086  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:07.596009  3999 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:07.590902  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.557507  8628 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:29:07.622843  3855 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:29:07.569766  8261 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.583251  8690 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.604619  8756 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.724206  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:07.725023  3927 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:07.666431  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:29:07.688275  8832 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.123s	user 0.003s	sys 0.006s
W20260709 12:29:07.688377  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 73797.8us
I20260709 12:29:07.607702  8627 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:07.689544  8278 consensus_queue.cc:1059] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:29:07.739387  8278 raft_consensus.cc:3055] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:07.739761  8278 raft_consensus.cc:740] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:07.740715  8278 consensus_queue.cc:260] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:07.741024  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:07.693197  8834 raft_consensus.cc:697] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:07.742633  8834 consensus_queue.cc:237] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:07.694697  8643 consensus_queue.cc:1059] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:29:07.744905  8261 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:07.746472  8643 raft_consensus.cc:3055] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:29:07.746879  8643 raft_consensus.cc:740] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:07.747788  8643 consensus_queue.cc:260] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.748740  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:07.749084  8643 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:07.695612  3821 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:07.750349  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 55041.1us
I20260709 12:29:07.753299  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.753523  8628 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:07.753983  8628 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:07.754048  8669 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:07.754403  8628 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:07.754873  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:07.755522  4005 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:07.754684  8669 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:07.756250  8649 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:07.757266  8821 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:29:07.757695  8669 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:07.758463  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.759436  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:07.760694  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:07.761021  3999 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:29:07.761741  8511 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:07.762184  8511 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:07.762529  8511 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:07.762423  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:07.766393  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:07.699422  3849 raft_consensus.cc:1240] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:07.767611  8278 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:07.702126  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:07.753348  3821 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:07.592428  8633 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:29:07.703365  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 317636us
I20260709 12:29:07.770816  8822 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:29:07.771055  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:07.771338  8822 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:07.770889  8633 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.771759  8822 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:07.718286  3853 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.773618  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.719007  8799 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:07.662189  8360 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.583735  8771 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:07.726110  3932 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:29:07.729594  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:07.731101  8671 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:07.731526  8690 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:07.732599  8627 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:07.734148  4004 raft_consensus.cc:2410] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:29:07.736337  8756 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.625305  8534 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.738271  8632 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.732008  3970 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:07.767160  3924 raft_consensus.cc:2393] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 11: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:07.777019  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:07.773195  3822 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:07.796041  4568 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:07.797955  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:07.808137  3927 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:07.807799  3997 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:07.819242  3923 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:07.821339  3930 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 13: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:29:07.841568  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 109649us
I20260709 12:29:07.842537  3970 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:07.844658  8792 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:07.844792  3970 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:07.845461  8792 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:07.845742  8647 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:07.846427  8792 raft_consensus.cc:3055] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:07.846941  8792 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:29:07.853717  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 80604.8us
I20260709 12:29:07.854702  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:07.854921  8760 raft_consensus.cc:3055] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:07.855326  8760 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:07.856053  8681 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.857205  8792 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.867233  8792 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:07.804247  8649 consensus_queue.cc:1048] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:29:07.859349  8771 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:07.870110  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 2123) took 1135 ms. Trace:
I20260709 12:29:07.870558  3929 rpcz_store.cc:276] 0709 12:29:06.735159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.738088 (+  2929us) service_pool.cc:224] Handling call
0709 12:29:07.869852 (+1131764us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54002e3454. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:07.870024 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645124864}
I20260709 12:29:07.872104  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2613) took 1348 ms. Trace:
I20260709 12:29:07.872500  4001 rpcz_store.cc:276] 0709 12:29:06.523826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.551751 (+ 27925us) service_pool.cc:224] Handling call
0709 12:29:06.552228 (+   477us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:29:06.695710 (+143482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:07.871777 (+1176067us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b5400001ca0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051f4edc0 00007fe051fdaa02 00007fe051fd6dd6 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:29:07.872013 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87692672}
I20260709 12:29:07.875289  8534 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.877382  8632 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:07.846266  8628 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:07.883819  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2620) took 1356 ms. Trace:
I20260709 12:29:07.883996  8628 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:07.884255  4002 rpcz_store.cc:276] 0709 12:29:06.527376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:06.748307 (+220931us) service_pool.cc:224] Handling call
0709 12:29:07.883580 (+1135273us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400128254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:07.883723 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":844717312}
I20260709 12:29:07.886801  8694 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.888005  4570 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:07.889159  8694 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:07.890341  4003 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:29:07.890833  4003 pending_rounds.cc:85] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 10
I20260709 12:29:07.891130  4003 pending_rounds.cc:107] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:29:07.891463  4003 raft_consensus.cc:2889] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:29:07.892362  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:07.892969  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:07.896263  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:07.898703  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:07.899293  3931 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:07.898890  3971 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:07.904407  3932 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:29:07.907428  4005 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
W20260709 12:29:07.920185  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 75457.5us
I20260709 12:29:07.845947  8756 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:07.925982  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:07.892378  8627 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:07.902486  8737 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:07.926131  3970 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:07.930291  3924 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 12:29:07.906550  8690 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:29:07.856282  8760 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:07.935669  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.911512  8360 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:07.930791  3895 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:07.951511  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.933171  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:07.951825  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:07.928385  3929 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:07.953871  3853 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:07.929112  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:07.933765  8825 log.cc:927] Time spent T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.582s	user 0.000s	sys 0.003s
I20260709 12:29:07.960934  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:07.906313  8723 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:29:07.930621  8628 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:07.929600  8643 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:29:07.912192  8771 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:29:07.968519  3971 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:07.912015  8632 consensus_queue.cc:1059] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:29:07.929360  8649 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 12:29:08.003423  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 148849us
I20260709 12:29:08.003883  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:08.007694  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 54412.9us
I20260709 12:29:07.962469  8760 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:08.008893  3849 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:29:07.964737  8633 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:08.013095  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 103010us
I20260709 12:29:08.018000  8770 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:08.018126  8603 raft_consensus.cc:3055] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:29:08.018285  8632 consensus_queue.cc:1059] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:29:08.018858  8534 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:29:08.019107  8671 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:29:08.019418  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 46576.1us
I20260709 12:29:08.015733  8511 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.028209  3850 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:29:07.971396  8628 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:07.970623  8799 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:07.952615  8737 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.020563  8756 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:08.055779  4538 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:08.038686  8603 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:08.045547  8632 consensus_queue.cc:1243] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:29:08.047619  8628 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:08.068744  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:08.081714  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:08.083019  3857 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:08.066485  8476 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:08.052525  8799 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:08.097371  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 200382us
W20260709 12:29:08.098663  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 59019.6us
I20260709 12:29:08.101436  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:08.107812  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:08.120729  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:08.172636  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 58098.1us
I20260709 12:29:08.173687  3931 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:08.096379  8756 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:29:08.177914  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 160540us
I20260709 12:29:08.178807  3853 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
W20260709 12:29:08.180013  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 68474.6us
I20260709 12:29:08.181913  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2189) took 1078 ms. Trace:
I20260709 12:29:08.074893  8534 consensus_queue.cc:1059] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:29:08.195487  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:08.196431  3855 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:29:08.150501  8806 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 1.331s	user 0.008s	sys 0.003s
I20260709 12:29:08.184445  3848 rpcz_store.cc:276] 0709 12:29:07.092547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:07.093686 (+  1139us) service_pool.cc:224] Handling call
0709 12:29:07.093997 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:07.094358 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:07.094386 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:07.120674 (+ 26288us) log.cc:844] Serialized 26 byte log entry
0709 12:29:07.296798 (+176124us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:07.323372 (+ 26574us) log.cc:844] Serialized 14 byte log entry
0709 12:29:07.325600 (+  2228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:07.325679 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:07.897356 (+571677us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:08.112989 (+215633us) raft_consensus.cc:1685] finished
0709 12:29:08.170990 (+ 58001us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:08.171176 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1964,"prepare.queue_time_us":26304,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":44312,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":11922,"spinlock_wait_cycles":14700800,"thread_start_us":126247,"threads_started":1,"wal-append.queue_time_us":174309}
I20260709 12:29:08.211334  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:08.212109  3853 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:08.185055  8534 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:29:08.226155  8851 log.cc:927] Time spent T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:29:08.230420  3857 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:08.231343  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.234525  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:08.235173  3931 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:08.247133  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.249922  3928 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:29:08.251664  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:08.221622  8534 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:08.208127  8696 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:29:08.257500  3931 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
W20260709 12:29:08.259583  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 75218.8us
I20260709 12:29:08.262223  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2606) took 1076 ms. Trace:
I20260709 12:29:08.262606  3852 rpcz_store.cc:276] 0709 12:29:07.183089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:07.561060 (+377971us) service_pool.cc:224] Handling call
0709 12:29:07.592097 (+ 31037us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:07.694708 (+102611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:07.694833 (+   125us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:07.696711 (+  1878us) log.cc:844] Serialized 26 byte log entry
0709 12:29:07.796127 (+ 99416us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:29:07.796163 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:07.796232 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:08.259187 (+462955us) raft_consensus.cc:1685] finished
0709 12:29:08.259206 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:08.259334 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74542,"raft.queue_time_us":76700,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":106,"thread_start_us":98679,"threads_started":1,"wal-append.queue_time_us":313111}
I20260709 12:29:08.264664  3852 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:29:08.264963  3852 pending_rounds.cc:85] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 6
I20260709 12:29:08.265206  3852 pending_rounds.cc:107] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:29:08.265426  3852 raft_consensus.cc:2889] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:29:08.266196  3854 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 2191) took 1166 ms (client timeout 1544 ms). Trace:
W20260709 12:29:08.266613  3854 rpcz_store.cc:269] 0709 12:29:07.099813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:07.111129 (+ 11316us) service_pool.cc:224] Handling call
0709 12:29:08.258442 (+1147313us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b540001ad28. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057db45f4 00007fe056f9d227 00007fe056f9cab8 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6
0709 12:29:08.266110 (+  7668us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6242176}
I20260709 12:29:08.267371  3895 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:08.268383  3895 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:08.269510  3895 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:08.270183  8868 raft_consensus.cc:2764] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:29:08.270867  8868 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:08.271991  8534 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.273379  8534 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:08.204089  8633 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:29:08.276731  8756 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.276489  3895 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:08.281333  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 207428us
I20260709 12:29:08.282042  8853 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:08.282526  8853 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:08.282909  8853 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:08.283963  3822 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:08.286039  8856 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:08.286443  8856 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:08.286818  8856 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:08.287493  3895 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:08.278339  8852 log.cc:927] Time spent T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:29:08.278669  8633 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:08.298424  8633 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:08.298947  8633 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:08.300288  8737 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:08.301388  8647 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:08.255687  8511 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:08.308619  8799 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:08.309718  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:08.311652  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 343454us
W20260709 12:29:08.312327  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:08.313139  8555 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:08.313419  3970 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:08.313647  8555 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.314388  3895 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:08.315495  8360 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:29:08.315847  8555 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:08.249742  8476 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:08.317080  8476 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.319763  8476 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:08.320519  3895 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:08.308709  8681 raft_consensus.cc:3055] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:29:08.321204  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 59788.2us
I20260709 12:29:08.324173  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.329344  3855 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:08.339056  3852 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 15: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:08.339174  3895 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:08.340096  3929 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:08.340643  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:08.333940  4536 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:08.201635  8603 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.341789  8855 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:08.293529  8853 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.345288  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.347582  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:08.338686  8627 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:29:08.345541  8822 consensus_meta.cc:287] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.572s	user 0.013s	sys 0.000s
I20260709 12:29:08.330772  8681 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:08.355665  4536 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:08.344627  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.358810  3970 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:08.422892  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 64157.3us
I20260709 12:29:08.423669  3970 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:08.345556  8737 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:08.365949  8647 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:29:08.401557  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 62103.1us
I20260709 12:29:08.397994  8868 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:29:08.390987  3897 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:08.392001  8555 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:08.394549  8681 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.392817  8822 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.363835  8861 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:29:08.392155  8603 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:29:08.431010  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 75381.8us
I20260709 12:29:08.485167  8861 raft_consensus.cc:697] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:08.485468  4536 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:08.486166  8861 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.487277  4536 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:08.372799  8627 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:08.488637  8863 consensus_queue.cc:1059] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:29:08.489034  8627 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:08.343096  8628 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.466483  3822 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:08.466818  8793 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 12:29:08.467803  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.467931  8784 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:08.597031  8784 raft_consensus.cc:697] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:08.598117  8784 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.600781  8849 raft_consensus.cc:2764] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
W20260709 12:29:08.467834  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 76945.9us
I20260709 12:29:08.602898  3897 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:08.471565  8822 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:08.473510  8853 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:08.604117  8723 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:08.604378  8853 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:08.604698  8723 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.425132  8737 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:08.605715  8737 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:29:08.606878  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:08.607312  8723 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:08.607936  8723 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:08.608433  8723 raft_consensus.cc:697] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:08.474159  8855 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:08.475894  8633 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.609819  8855 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:08.610330  8855 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:08.426767  8760 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:29:08.482527  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 58936us
W20260709 12:29:08.482755  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 49928.6us
I20260709 12:29:08.625531  3969 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:08.483310  8770 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:08.604933  8853 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.484347  8647 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:29:08.484479  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 54136.2us
I20260709 12:29:08.579298  8745 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:08.579238  8511 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:08.581988  8856 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.584025  3821 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:08.584311  8628 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:08.584709  8476 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:08.586654  8799 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:29:08.587493  8681 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:29:08.578903  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 112524us
I20260709 12:29:08.587688  8649 raft_consensus.cc:3055] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:08.586211  8873 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:08.609319  8723 consensus_queue.cc:237] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:08.603741  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:08.630095  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:08.631501  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:08.483767  8360 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:29:08.650080  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:08.650290  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:08.651237  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:08.652009  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:08.679425  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:08.680485  3929 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 13: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:29:08.661269  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 77327.5us
I20260709 12:29:08.659538  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:08.662523  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:08.663396  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:08.611485  8868 raft_consensus.cc:697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:08.664113  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:08.593871  8627 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.644798  8793 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:29:08.671680  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 68877.7us
I20260709 12:29:08.674197  3999 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:29:08.681643  3998 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:08.704820  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:08.705298  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:08.661767  8791 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:08.707082  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:08.664726  8555 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:29:08.689076  3821 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:08.707790  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:08.714494  3932 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:29:08.709600  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:08.710242  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:08.715898  3998 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:29:08.717517  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 50213.9us
I20260709 12:29:08.677171  8760 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:08.721710  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:08.722482  3928 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:29:08.723088  4004 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:08.671149  8649 raft_consensus.cc:740] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:08.690029  8476 raft_consensus.cc:697] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:08.717036  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:08.726192  4538 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:08.697429  8770 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:08.662240  8511 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.728525  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:08.700114  8799 raft_consensus.cc:697] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:08.706809  8632 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:08.689347  8771 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:08.708439  8756 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:08.732626  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:08.662092  8745 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.732800  8555 raft_consensus.cc:697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:08.739749  8745 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:08.739665  8555 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.743144  8856 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:08.744867  8627 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:08.746569  8853 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:08.724562  8628 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:08.751138  8868 consensus_queue.cc:237] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.754305  8649 consensus_queue.cc:260] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.755565  8649 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:08.755941  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:08.698823  8873 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.758577  8606 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:08.759801  8690 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:08.759869  3895 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:08.760335  8690 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:08.760759  8690 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:08.736841  8633 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:08.762290  8799 consensus_queue.cc:237] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.762900  8628 raft_consensus.cc:697] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:08.762740  8756 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.763863  8628 consensus_queue.cc:237] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.765182  8647 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.728897  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:08.712106  8822 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:29:08.779191  3927 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:29:08.774307  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 52579.1us
I20260709 12:29:08.775198  8883 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:08.775555  3754 catalog_manager.cc:5697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 6 to 7, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 7 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:08.776985  3895 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:08.777493  8627 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:08.785848  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.787403  3970 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:08.787901  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:08.788671  3927 raft_consensus.cc:2410] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:29:08.781904  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:08.735491  8770 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.790709  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.791236  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.791986  8770 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:08.792157  8886 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:08.792701  8886 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.793601  8793 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:08.789851  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:08.795845  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.796805  3855 raft_consensus.cc:2393] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:08.798501  3851 pending_rounds.cc:85] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 7
I20260709 12:29:08.798885  3851 pending_rounds.cc:107] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:29:08.799116  3851 raft_consensus.cc:2889] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:08.799582  3970 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:08.800294  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:08.800832  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:08.801401  3931 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:08.803216  3927 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 15: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:08.806226  3855 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 12:29:08.807960  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:08.810938  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:08.811910  3855 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:08.813961  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:08.814683  3855 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:08.819375  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 93259.2us
I20260709 12:29:08.827406  3931 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:08.721078  8791 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.831120  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.799137  8745 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 12:29:08.839455  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 120771us
I20260709 12:29:08.839031  3754 catalog_manager.cc:5697] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 3 to 5, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 5 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:08.839079  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.729993  8760 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.846179  3856 raft_consensus.cc:2368] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12.
I20260709 12:29:08.846719  3925 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:29:08.849587  3930 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:29:08.844933  4538 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:08.799106  8261 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:29:08.854982  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 78072.7us
I20260709 12:29:08.818575  8741 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:08.854269  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:08.857271  8861 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:08.861373  8555 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:29:08.758491  8476 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.831724  8883 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.863096  8555 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:29:08.863687  8555 consensus_queue.cc:1243] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:29:08.863773  3822 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:08.859386  4000 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:08.860213  4538 leader_election.cc:400] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14.
I20260709 12:29:08.865511  4538 leader_election.cc:403] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:29:08.843219  8633 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:08.769197  8771 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.861516  8885 consensus_queue.cc:1059] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:29:08.866284  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:08.871987  3997 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:08.876354  4538 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:08.876870  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:08.871168  8822 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:08.879194  8737 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:08.847611  8756 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:08.852118  8632 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:08.837064  8793 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:29:08.883584  4005 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:08.884629  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:08.834280  8606 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:08.864660  8883 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:08.892378  3822 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:08.890854  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 72977.3us
I20260709 12:29:08.910956  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:08.912858  4001 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:08.875707  8627 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:08.925709  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.883862  8873 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:08.886018  8555 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:29:08.929768  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 88470.8us
I20260709 12:29:08.900257  3821 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:08.885943  8476 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14.
I20260709 12:29:08.933645  3895 leader_election.cc:400] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12.
I20260709 12:29:08.934060  3895 leader_election.cc:403] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:08.935070  8888 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:08.935300  8681 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:29:08.935869  8888 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:08.936636  8888 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:08.937119  8888 raft_consensus.cc:697] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:08.890775  8822 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:08.891592  8793 consensus_queue.cc:1243] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:29:08.941913  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.942492  3855 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:08.890301  8696 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:29:08.955423  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 63117.7us
I20260709 12:29:08.873656  8261 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.951184  8822 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:08.961591  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:08.912030  8737 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:08.939164  8555 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:08.967684  8555 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:08.969664  8632 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:29:08.972678  3754 catalog_manager.cc:5697] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:08.974504  8647 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:08.975538  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 77596.8us
I20260709 12:29:08.925114  8741 raft_consensus.cc:3055] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:29:08.977530  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 112929us
I20260709 12:29:08.980062  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:08.980798  4006 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:08.980841  3895 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:08.964932  8822 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:08.965649  8606 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:08.990618  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:08.986600  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:08.988509  3998 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:08.995065  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:08.995882  3998 raft_consensus.cc:2376] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16. Re-sending same reply.
I20260709 12:29:09.001026  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:08.991263  4003 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:29:09.001824  4565 raft_consensus.cc:3055] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:09.002290  4565 raft_consensus.cc:740] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:09.005286  3822 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:08.940925  8278 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:08.950901  8886 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:09.007782  4538 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:09.007839  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:08.923269  8756 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:29:09.010113  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:09.012501  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:09.016619  4004 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 12:29:08.962589  8633 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:29:09.017024  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:08.950465  8853 consensus_queue.cc:1059] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:29:09.023882  3897 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:08.985544  8741 raft_consensus.cc:740] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:09.028235  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:09.029984  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:08.975071  8647 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:09.015408  4565 consensus_queue.cc:260] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:09.022811  3754 catalog_manager.cc:5697] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 6 to 7, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 7 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:09.030761  8632 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:09.011633  8627 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:09.038491  4565 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:09.044442  3897 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:09.014257  8511 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:09.015249  8799 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:09.057384  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:09.044486  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:09.045423  4003 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:29:09.045610  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:09.015612  8534 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:09.046471  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:09.047098  8669 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:09.047773  8647 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:09.048628  8853 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:09.043545  8671 raft_consensus.cc:3055] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:09.050590  8891 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:09.037322  8896 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:09.052697  8261 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
W20260709 12:29:09.054713  3752 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39516 (request call id 223) took 64384 ms (client timeout 15000 ms). Trace:
W20260709 12:29:09.054940  8887 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:29:09.060346  3998 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:08.991178  8855 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:09.063288  3822 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:09.006577  8603 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:29:09.031250  8771 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:09.295722  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:09.296401  4004 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:09.273037  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 265316us
I20260709 12:29:09.044559  8696 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:09.300021  8696 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:09.300458  8696 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:09.072731  3754 catalog_manager.cc:5697] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 5 to 6, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 6 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:09.244086  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 165818us
I20260709 12:29:09.064668  8278 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:09.064471  8669 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:09.069800  8627 raft_consensus.cc:697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:09.077683  8671 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:09.243114  8756 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:09.323053  3932 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:08.991932  8888 consensus_queue.cc:237] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:09.329705  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:09.330416  3853 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:09.321920  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:09.071681  8799 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:09.281469  8632 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:09.078342  8534 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:09.372622  8855 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:09.378803  8760 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:09.334916  8756 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:09.380868  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 317635us
I20260709 12:29:09.313308  8791 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:09.382715  8555 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:09.370289  8868 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:09.364238  8647 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:09.363186  8649 consensus_meta.cc:287] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.001s
I20260709 12:29:09.387600  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:09.317271  8669 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:09.322678  4002 pending_rounds.cc:85] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 5
I20260709 12:29:09.394801  3850 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:29:09.435093  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:09.396169  3754 catalog_manager.cc:5697] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 6 to 8, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 8 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:09.412649  4006 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:09.409279  3998 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:09.381669  8671 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:09.414402  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:09.415066  8893 log.cc:927] Time spent T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:29:09.415452  8534 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:09.290347  8741 consensus_queue.cc:260] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:09.416126  8278 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:09.410486  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:09.447767  3822 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:09.447306  3754 catalog_manager.cc:5697] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 3 to 4, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 4 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:09.449110  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:09.432441  3931 pending_rounds.cc:85] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 6
I20260709 12:29:09.449862  3931 pending_rounds.cc:107] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:29:09.450228  3931 raft_consensus.cc:2889] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:09.436024  4002 pending_rounds.cc:107] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 10.6
W20260709 12:29:09.403600  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 80415.9us
W20260709 12:29:09.440528  8690 consensus_meta.cc:287] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.675s	user 0.007s	sys 0.005s
I20260709 12:29:09.453106  4002 raft_consensus.cc:2889] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:09.430536  8873 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:09.458402  8891 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:09.458355  8690 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:09.459501  4538 leader_election.cc:400] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 12. Current term is 13.
I20260709 12:29:09.463889  8627 consensus_queue.cc:237] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:09.273569  3752 rpcz_store.cc:269] 0709 12:28:04.585330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:04.594788 (+  9458us) service_pool.cc:224] Handling call
0709 12:29:08.969721 (+64374933us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:04.792512 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:05.155166 (+362654us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:05.167744 (+ 12578us) write_op.cc:435] Acquired schema lock
0709 12:29:05.169349 (+  1605us) tablet.cc:662] Decoding operations
0709 12:29:05.316443 (+147094us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:05.367205 (+ 50762us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:05.375514 (+  8309us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:29:05.575368 (+199854us) tablet.cc:701] Row locks acquired
0709 12:29:05.605794 (+ 30426us) write_op.cc:260] PREPARE: finished
0709 12:29:05.675090 (+ 69296us) write_op.cc:270] Start()
0709 12:29:05.675259 (+   169us) write_op.cc:276] Timestamp: P: 1783600145624406 usec, L: 0
0709 12:29:05.675283 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:29:05.676026 (+   743us) log.cc:844] Serialized 1280 byte log entry
0709 12:29:06.463113 (+787087us) op_driver.cc:464] REPLICATION: finished
0709 12:29:06.843386 (+380273us) write_op.cc:301] APPLY: starting
0709 12:29:06.844458 (+  1072us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:06.996617 (+152159us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b180031e340. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe051b7f4bc 00007fe04eecd48b 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe055a0def0 00007fe055a0e489 00007fe055a1071a
0709 12:29:07.224492 (+227875us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b180031e340. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe051d16129 00007fe051d18af7 00007fe051d19fb0 00007fe055a2e1bb 00007fe055a2e532 00007fe055a75b93 00007fe055922de3 00007fe0559226ab 00007fe055923e77
0709 12:29:07.267405 (+ 42913us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:07.267456 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:07.269389 (+  1933us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:07.269665 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:29:07.269729 (+    64us) write_op.cc:312] APPLY: finished
0709 12:29:07.324355 (+ 54626us) log.cc:844] Serialized 41 byte log entry
0709 12:29:07.343836 (+ 19481us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:07.351718 (+  7882us) write_op.cc:454] Released schema lock
0709 12:29:07.351787 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:07.367844 (+ 16057us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:07.370015 (+  2171us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4324475,"reported_tablets":26,"spinlock_wait_cycles":9088,"child_traces":[["op",{"apply.queue_time_us":378881,"apply.run_cpu_time_us":12429,"apply.run_wall_time_us":509559,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16655,"num_ops":3,"prepare.queue_time_us":731915,"prepare.run_cpu_time_us":13472,"prepare.run_wall_time_us":1180720,"raft.queue_time_us":258246,"raft.run_cpu_time_us":11228,"raft.run_wall_time_us":534147,"replication_time_us":787637,"spinlock_wait_cycles":34897536,"thread_start_us":1463288,"threads_started":4,"wal-append.queue_time_us":525939,"wal-append.run_cpu_time_us":39814,"wal-append.run_wall_time_us":2193746}]]}
I20260709 12:29:09.469780  8649 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:29:09.470531  8879 log.cc:927] Time spent T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.732s	user 0.002s	sys 0.004s
I20260709 12:29:09.472126  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:09.483603  3927 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:09.473989  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:09.477404  4565 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:09.441764  8910 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:09.445621  8791 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:29:09.435786  8647 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:09.494776  8690 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:09.496819  3754 catalog_manager.cc:5697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 3 to 7, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 7 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:09.433529  8868 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:09.482749  8649 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:29:09.495273  8903 log.cc:927] Time spent T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:29:09.543490  3927 raft_consensus.cc:1240] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:09.482893  8873 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:09.525806  8891 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:29:09.546520  8873 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:09.546726  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:09.547219  8891 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:09.495719  8910 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:09.548156  8891 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:09.548549  8647 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:09.548669  8891 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:09.549438  8910 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:09.550921  8756 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:09.545640  8669 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:09.536351  8649 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:29:09.556028  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 96660.5us
I20260709 12:29:09.557240  8669 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:09.549630  8891 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:09.558841  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:09.559017  8861 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:09.559628  8511 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:09.561339  4004 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:09.554530  3754 catalog_manager.cc:5697] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:09.539525  8633 consensus_meta.cc:287] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.009s
I20260709 12:29:09.567312  8633 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12.
I20260709 12:29:09.568523  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:09.569425  3927 raft_consensus.cc:2410] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 12:29:09.570188  8902 log.cc:927] Time spent T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 12:29:09.570299  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:09.571616  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:09.572659  8868 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:09.573757  3754 catalog_manager.cc:5697] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 4 to 6, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 6 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
W20260709 12:29:09.576778  3897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.010s	sys 0.010s
W20260709 12:29:09.577193  3897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.011s	sys 0.010s
I20260709 12:29:09.579638  4566 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:09.583220  4574 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:09.584738  8799 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:09.585836  8555 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:09.586714  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 540295us
W20260709 12:29:09.567786  8889 log.cc:927] Time spent T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.734s	user 0.001s	sys 0.002s
I20260709 12:29:09.591691  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:09.597537  4566 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:09.590817  3897 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:09.600340  8863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.014s	sys 0.014s
I20260709 12:29:09.611821  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:09.613098  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:09.616932  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:09.619450  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:09.620147  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:09.620741  4005 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:09.576078  3754 catalog_manager.cc:5697] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 7 to 9, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 9 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:29:09.589787  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 115931us
W20260709 12:29:09.609961  8863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.014s	sys 0.015s
I20260709 12:29:09.625941  3999 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 12. Current term is 13. Ops: []
W20260709 12:29:09.624398  3822 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.700s (SENT) [suppressed 20 similar messages]
I20260709 12:29:09.627168  3754 catalog_manager.cc:5697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 3 to 5, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 5 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:09.621502  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:09.632542  3897 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:09.633783  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:09.634809  4005 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:09.635162  3897 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:09.636965  3897 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:09.638988  3999 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:29:09.643841  8669 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:09.644457  8669 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:09.644955  8669 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:09.651587  3854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.001s	sys 0.029s
W20260709 12:29:09.651950  3854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.001s	sys 0.029s
I20260709 12:29:09.627501  8911 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:29:09.627784  8868 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:29:09.668090  3754 catalog_manager.cc:5697] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 2 to 5, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 5 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:09.628558  8278 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:29:09.687286  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 62908.5us
I20260709 12:29:09.694062  3927 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:09.697657  4005 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:09.647089  8918 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:09.715705  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:09.706125  8914 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:09.709599  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:09.715611  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:09.717869  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:09.728384  3970 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:09.727113  8822 consensus_meta.cc:287] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.005s
I20260709 12:29:09.729871  3970 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:09.734947  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:09.742650  3927 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:09.735534  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:09.716282  8918 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:09.746171  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:09.740118  3930 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:09.749512  3970 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:09.774894  3970 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:09.730532  8791 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:09.750801  8918 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:09.753140  8756 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:09.744438  8822 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:09.744656  8696 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:09.788983  8892 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:29:09.793684  8920 log.cc:927] Time spent T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:29:09.794795  8898 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:09.795817  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:09.796001  8880 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 1.062s	user 0.015s	sys 0.000s
I20260709 12:29:09.796645  3926 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 13: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:29:09.800310  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:09.781067  8770 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:09.783308  8278 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:09.793418  8924 consensus_queue.cc:1059] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:29:09.793432  8892 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:09.821695  8649 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:09.788154  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:09.827394  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 44161.7us
I20260709 12:29:09.835387  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:09.837391  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:09.838186  4565 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:09.840794  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:09.841015  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:09.853399  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:09.854612  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:09.855515  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:09.840297  8671 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:09.829506  8892 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:09.892922  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:09.890236  4569 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:09.893532  4573 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:09.893447  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:09.894646  4006 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:09.895689  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:09.890646  4572 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:09.897346  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:09.898005  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:09.830587  8868 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:09.899684  3897 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:09.901219  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:09.903717  4571 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:09.906955  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:09.906994  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:09.911331  4565 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
W20260709 12:29:09.913224  8925 log.cc:927] Time spent T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:29:09.914390  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:09.916574  3897 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:09.924062  4569 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:09.930451  4573 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:09.854071  8756 consensus_queue.cc:1059] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:29:09.907076  8633 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:09.907007  8914 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:09.964224  4006 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:09.965641  3998 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:29:09.920917  8360 raft_consensus.cc:3055] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:09.983863  4573 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:09.969151  8649 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:09.973165  8756 raft_consensus.cc:3055] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:09.907864  8868 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:09.973959  4568 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:29:09.931469  8911 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:29:09.980057  8935 log.cc:927] Time spent T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:29:09.982488  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:09.985684  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:09.981714  8741 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:09.966951  8633 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:09.999877  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:09.965919  8914 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:09.983151  8360 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:10.011799  8360 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:10.013199  8360 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:29:10.016716  8938 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:29:10.005765  8633 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:09.987973  8756 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:10.025079  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:10.031824  8633 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.009923  8914 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:10.039048  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:10.050746  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:10.035629  8822 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.036682  8696 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:10.039002  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:10.052484  3997 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2629) took 1429 ms (client timeout 1863 ms). Trace:
W20260709 12:29:10.053023  3997 rpcz_store.cc:269] 0709 12:29:08.622839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.627465 (+  4626us) service_pool.cc:224] Handling call
0709 12:29:10.052284 (+1424819us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540021b1d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:10.052414 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450278272}
I20260709 12:29:10.050959  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:10.056871  3857 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:10.034920  8868 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:10.033046  8918 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.061142  8771 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.065023  8633 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.065565  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:10.065659  4005 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:29:10.068475  4572 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:10.068475  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:10.069461  4003 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:10.071339  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:10.068379  8901 log.cc:927] Time spent T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.658s	user 0.003s	sys 0.000s
I20260709 12:29:10.074702  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:10.077795  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:10.078637  3928 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 14: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:10.080188  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:10.080610  3998 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:10.081647  3997 raft_consensus.cc:2393] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:10.087487  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:10.088268  3998 raft_consensus.cc:2410] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:29:10.069407  8771 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:10.090272  4003 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:10.090713  8898 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.090847  8771 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:10.091172  8898 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.096690  4572 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:10.073920  8669 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:10.065663  8892 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:10.103606  8899 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.795s	user 0.002s	sys 0.000s
I20260709 12:29:10.107142  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2634) took 1482 ms. Trace:
I20260709 12:29:10.108758  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:10.111744  8628 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.114360  3857 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:10.145612  4001 rpcz_store.cc:276] 0709 12:29:08.624582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.627917 (+  3335us) service_pool.cc:224] Handling call
0709 12:29:10.106933 (+1479016us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54002bd754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:10.107083 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532652416}
I20260709 12:29:10.117668  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:10.117715  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:10.120720  8821 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:10.121838  8923 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:29:10.128120  4003 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: []
W20260709 12:29:10.135023  3971 connection.cc:256] RPC call timeout handler was delayed by -1.1752385849995335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 12:29:10.147996  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.135448  8741 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:10.136801  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:10.137411  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:10.137715  4565 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:10.138134  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:10.147918  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:10.149796  4573 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:10.138852  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:10.143235  3855 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:10.144806  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:10.149199  3971 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:10.151733  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:10.152760  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:10.156368  4568 raft_consensus.cc:2393] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 13: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:10.158761  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:10.160533  3931 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:29:10.161494  3923 raft_consensus.cc:2393] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 10: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:10.162555  3850 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:10.164084  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:10.164608  3849 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:29:10.167256  3971 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:10.163617  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:10.171046  3925 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:29:10.172031  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:10.173950  3928 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:29:10.170646  3926 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:10.179235  3923 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:29:10.180904  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:10.085608  8756 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:10.184073  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:10.187136  4003 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:10.155788  8868 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:10.155110  8771 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.160377  8883 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:10.197472  8883 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:10.198172  8868 raft_consensus.cc:697] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:10.199170  8868 consensus_queue.cc:237] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.198675  8883 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.203531  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:10.204895  3822 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:10.206935  8821 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:29:10.208127  8821 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:10.208477  8821 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.208809  8821 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:10.175506  8894 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:10.210913  3928 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:29:10.211417  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:10.189814  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:10.188946  3850 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:29:10.163419  8741 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.171706  8745 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:10.159889  8633 consensus_queue.cc:1059] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:29:10.208701  4538 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:10.226420  3848 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:29:10.213539  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:10.217173  4566 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:29:10.197300  8771 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.224933  3849 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:29:10.160265  8628 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.231994  8799 consensus_queue.cc:1059] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:10.229718  8923 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:10.232754  8741 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.233179  8628 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.228416  3822 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:10.233361  8911 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:10.234035  8628 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:10.234290  3852 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:10.229964  8861 consensus_queue.cc:1059] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:29:10.235447  8628 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:29:10.235817  8861 raft_consensus.cc:3055] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:10.236231  8861 raft_consensus.cc:740] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:10.237090  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:10.237949  8771 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.238278  8681 raft_consensus.cc:3055] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:10.237936  8628 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:29:10.238839  8681 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:10.239234  8856 raft_consensus.cc:3055] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:10.239624  8856 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:10.240017  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:10.240422  8856 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:10.240988  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:10.240041  8681 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.241423  8856 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:10.241670  3923 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:10.242085  8681 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:10.242750  8628 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:10.246295  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:10.246841  4566 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
I20260709 12:29:10.247334  8873 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:10.248415  3822 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:10.248683  8873 consensus_queue.cc:1059] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:29:10.249166  8628 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:10.249379  8873 consensus_queue.cc:1243] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer 4eedd844c09d456ca0b3614490dd1dbb log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:29:10.249620  8628 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.250075  8628 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:10.252529  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2737) took 1451 ms. Trace:
I20260709 12:29:10.252875  3932 rpcz_store.cc:276] 0709 12:29:08.800776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.804221 (+  3445us) service_pool.cc:224] Handling call
0709 12:29:08.844803 (+ 40582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:09.323557 (+478754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:10.252267 (+928710us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b540031bfd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:10.252442 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1099340032}
I20260709 12:29:10.255086  8918 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.237056  8861 consensus_queue.cc:260] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.258915  3970 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:10.267951  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:10.263345  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:10.268941  4570 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:29:10.273015  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:10.274008  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.274856  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:10.275501  3930 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:29:10.279143  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 70522.8us
I20260709 12:29:10.280071  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:10.267140  8669 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:10.287298  4005 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 12:29:10.269084  8690 raft_consensus.cc:3055] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:29:10.292276  4000 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2639) took 1660 ms (client timeout 1700 ms). Trace:
W20260709 12:29:10.294726  4000 rpcz_store.cc:269] 0709 12:29:08.632364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:08.675885 (+ 43521us) service_pool.cc:224] Handling call
0709 12:29:10.292061 (+1616176us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400376254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:10.292203 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330283264}
W20260709 12:29:10.296998  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 165990us
I20260709 12:29:10.279598  8647 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:10.284611  8799 raft_consensus.cc:3055] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:10.310623  8799 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:10.311635  8799 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.312891  8799 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:10.315867  4005 raft_consensus.cc:1275] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 12:29:10.284790  8784 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:10.294445  8690 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:10.317349  8916 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:10.317806  8916 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:10.318256  8916 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:10.317998  8690 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.319451  8690 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:10.283799  8918 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:29:10.316013  8921 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.692s	user 0.002s	sys 0.000s
I20260709 12:29:10.300422  8647 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.351789  8647 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:10.266131  8628 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.301003  8861 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:10.356446  3930 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:10.306814  8892 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.355319  8669 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:10.373811  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:10.376798  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 188791us
I20260709 12:29:10.353274  8918 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.380672  3971 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:10.382244  8918 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.386510  3928 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: []
W20260709 12:29:10.376191  8849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.600s	user 0.017s	sys 0.072s
W20260709 12:29:10.384263  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 95939.3us
I20260709 12:29:10.386853  3971 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:10.388139  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 141380us
W20260709 12:29:10.404507  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.387602  8771 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:29:10.376906  8669 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:10.406764  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:10.394170  8849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.629s	user 0.017s	sys 0.073s
I20260709 12:29:10.420944  3971 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:10.423774  3971 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:10.388840  8885 consensus_queue.cc:1059] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:29:10.427359  4537 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:10.388669  8914 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.429515  8849 raft_consensus.cc:3055] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:10.433462  8896 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.436795  4570 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:29:10.426911  3971 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:10.406826  8954 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:29:10.451234  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 59328.9us
I20260709 12:29:10.437670  8894 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:29:10.453295  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 60343us
W20260709 12:29:10.450196  8950 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:29:10.456374  3971 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:10.457476  4537 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:10.440208  8771 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:10.446071  8849 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:10.472461  4537 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:10.472771  4538 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:10.455598  8955 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:10.451049  8923 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:29:10.451368  8896 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.467347  8278 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:10.456910  8745 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:29:10.471663  8885 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:29:10.475356  8890 log.cc:927] Time spent T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 1.613s	user 0.004s	sys 0.017s
W20260709 12:29:10.478062  8862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.698s	user 0.018s	sys 0.013s
I20260709 12:29:10.475656  8628 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.499404  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:10.500110  4574 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:29:10.491616  8862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.717s	user 0.018s	sys 0.014s
W20260709 12:29:10.510185  8953 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:29:10.514772  8628 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.515317  8628 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:10.515918  8916 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.517444  8628 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:10.504837  8784 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:10.518860  8784 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:10.519390  8784 raft_consensus.cc:697] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:10.520390  8784 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.506106  8849 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.501332  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:10.521778  4005 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:10.485697  8907 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:10.522684  8907 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:10.523262  8799 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:10.524804  8907 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:10.526351  8914 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.526643  8681 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.527215  8681 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.527457  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:10.530683  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:10.476519  8957 consensus_queue.cc:1059] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:29:10.492836  8868 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:10.534559  4574 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:10.490806  8969 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:10.536389  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:10.538094  4003 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:10.533206  4538 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:10.536780  3822 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:10.540625  8896 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.542243  8669 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:10.543061  8821 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:10.499819  8964 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:29:10.485970  8278 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:10.562810  4000 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:29:10.566247  8690 consensus_queue.cc:1059] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:29:10.567476  8896 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.568190  8896 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.499097  8970 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:29:10.573501  8971 raft_consensus.cc:2764] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:29:10.575374  8821 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:10.576088  8756 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:10.576754  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:10.579202  8278 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:10.545236  8868 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.578379  8896 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.583524  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:10.583577  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:10.585220  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:10.585924  4569 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:10.581635  8868 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.587400  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:10.589387  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:10.602197  4573 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:29:10.609313  8956 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.171s	user 0.003s	sys 0.000s
I20260709 12:29:10.557466  8891 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:29:10.613517  8891 raft_consensus.cc:697] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:10.614576  3924 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:29:10.615293  3926 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:29:10.614744  8891 consensus_queue.cc:237] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.615758  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:10.616315  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:10.616461  3932 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:10.616935  3931 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:29:10.617709  3923 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:29:10.618991  3925 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:10.619323  4570 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:29:10.595160  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:10.597507  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:10.598107  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:10.622615  8649 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:10.598193  3969 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:10.601112  8968 log.cc:927] Time spent T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:29:10.612897  3929 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:10.625792  4573 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:10.614626  3930 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:29:10.649118  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.645128  3971 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:10.655568  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 57485.6us
I20260709 12:29:10.654438  8862 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:10.658438  8862 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:10.659271  8647 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.657017  3969 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:10.701365  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 44468.6us
I20260709 12:29:10.675964  8862 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:10.661550  8791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.019s	sys 0.024s
W20260709 12:29:10.705219  8791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.019s	sys 0.025s
I20260709 12:29:10.672803  8910 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.631440  8849 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:10.715663  3897 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:10.627374  8894 raft_consensus.cc:3055] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:10.626320  8916 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:10.735532  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:10.742983  3851 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:10.735788  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:10.719503  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:10.728082  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:10.709630  8910 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:10.748339  3852 raft_consensus.cc:2410] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:29:10.748780  3897 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:10.750722  3897 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:10.713670  8793 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:10.752008  3969 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:10.751412  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 293393us
I20260709 12:29:10.711179  8954 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:10.736703  8894 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:10.713510  8770 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:10.741140  8822 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.748593  8868 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:10.751061  8911 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:10.750010  8972 raft_consensus.cc:3055] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:29:10.768551  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 296141us
W20260709 12:29:10.783973  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.755231  8918 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:10.777365  8770 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:10.869375  4537 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:10.762933  8771 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:10.766404  8916 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:29:10.782445  8647 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.774237  8793 raft_consensus.cc:697] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:10.871460  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:10.750916  8896 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 12:29:10.886616  4568 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:10.871013  8966 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:29:10.892010  8910 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:10.894934  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:10.774812  8696 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 12:29:10.898138  3851 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:10.762804  4536 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:10.898288  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 147654us
I20260709 12:29:10.901710  3897 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:10.901918  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:10.902122  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:10.903275  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:10.910557  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:10.911391  3923 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:10.913219  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:10.902539  3927 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:10.915356  3998 raft_consensus.cc:2410] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 12:29:10.915609  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 153666us
I20260709 12:29:10.926955  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:10.927692  3923 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:10.869902  8972 raft_consensus.cc:740] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:10.881770  8770 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:10.931262  4537 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:10.933734  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:10.934334  3929 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:10.783587  8822 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.892925  8918 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:29:10.964143  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 60929.9us
I20260709 12:29:10.965113  3897 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:10.942991  8894 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:10.926818  8971 raft_consensus.cc:2764] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:29:10.983178  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:10.948102  8966 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:10.928977  8690 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:29:10.947798  8681 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:10.998874  3929 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:10.929322  8970 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:29:10.940340  8861 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:29:10.947471  8969 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:29:10.999987  8966 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:11.014544  8894 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:29:11.048089  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 273053us
W20260709 12:29:11.061260  8945 log.cc:927] Time spent T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.526s	user 0.001s	sys 0.000s
W20260709 12:29:11.066075  8958 log.cc:927] Time spent T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.529s	user 0.006s	sys 0.012s
I20260709 12:29:11.070024  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2651) took 1402 ms. Trace:
I20260709 12:29:11.070544  4002 rpcz_store.cc:276] 0709 12:29:09.667473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:09.847594 (+180121us) service_pool.cc:224] Handling call
0709 12:29:09.847935 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:29:09.848270 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:09.848300 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:29:09.848879 (+   579us) log.cc:844] Serialized 52 byte log entry
0709 12:29:09.922292 (+ 73413us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:09.969554 (+ 47262us) log.cc:844] Serialized 14 byte log entry
0709 12:29:09.978452 (+  8898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:09.978529 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:10.247728 (+269199us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b1800455140. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeb82a6 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1
0709 12:29:10.248549 (+   821us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b1800455140. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:29:10.535050 (+286501us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b1800455140. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:29:11.060453 (+525403us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:11.069723 (+  9270us) raft_consensus.cc:1685] finished
0709 12:29:11.069754 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:11.069942 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17949,"prepare.queue_time_us":64759,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":15187,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":2827,"spinlock_wait_cycles":56093824,"thread_start_us":72091,"threads_started":1,"wal-append.queue_time_us":139903}
I20260709 12:29:11.077186  3969 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:11.080070  8986 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:11.107532  4566 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:11.125608  8892 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:11.126380  8892 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.128795  8892 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:11.135988  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2647) took 1050 ms. Trace:
I20260709 12:29:11.136432  3997 rpcz_store.cc:276] 0709 12:29:10.088841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:10.088984 (+   143us) service_pool.cc:224] Handling call
0709 12:29:10.292775 (+203791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:10.293246 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:10.293286 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:10.293839 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 12:29:10.405732 (+111893us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:29:10.405760 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:10.405804 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:11.065206 (+659402us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:11.067203 (+  1997us) raft_consensus.cc:1685] finished
0709 12:29:11.067230 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:11.135808 (+ 68578us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400376250. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:11.135922 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3641,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4403,"spinlock_wait_cycles":450513920,"thread_start_us":97148,"threads_started":1,"wal-append.queue_time_us":170849}
I20260709 12:29:11.137591  8760 consensus_queue.cc:1059] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:29:11.145138  8898 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:11.148746  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:11.153028  8741 raft_consensus.cc:3055] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:11.153525  8741 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:11.156646  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:11.154631  8741 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.157485  4571 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:11.158236  8741 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:11.161324  8756 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:11.176923  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:11.178254  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:11.165277  3971 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:11.208071  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 43762.6us
W20260709 12:29:11.191213  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 124943us
I20260709 12:29:11.213675  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:11.214547  3928 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:29:11.051867  8883 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:11.224126  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:11.208710  8979 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 12:29:11.044345  8966 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:11.244046  4003 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:11.228472  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:11.006764  8972 consensus_queue.cc:260] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.226380  8771 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:11.212177  8898 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:11.186515  8756 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.040643  8967 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.456s
W20260709 12:29:11.223327  8977 log.cc:927] Time spent T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.382s	user 0.001s	sys 0.000s
I20260709 12:29:11.216813  8962 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:29:11.239238  8976 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 12:29:11.228000  8883 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:11.186674  8681 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:11.166671  8978 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:11.186806  8918 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:11.245640  8955 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:11.033707  8793 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.254813  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:11.270916  4004 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:11.256778  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:11.330734  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:11.331321  4004 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:29:11.258790  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 48232.6us
I20260709 12:29:11.331861  4568 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:11.254400  4001 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:29:11.262283  3970 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:11.333024  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 70843.1us
I20260709 12:29:11.270583  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:11.338717  4003 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:29:11.332991  3971 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:11.329646  3928 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:11.298838  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:11.305261  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:11.345252  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:11.253326  8914 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.007s	sys 0.013s
I20260709 12:29:11.325065  8918 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.322711  8955 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:11.277453  3923 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:11.347213  4004 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
W20260709 12:29:11.346910  8914 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.007s	sys 0.013s
I20260709 12:29:11.348618  8955 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:11.320466  8883 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:11.348620  8918 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:11.296482  8898 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.350147  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:11.350879  3923 raft_consensus.cc:2393] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 13: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:11.351482  8898 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:11.258684  3998 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:29:11.304190  8756 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:11.344673  4000 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:11.345711  4571 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:29:11.357945  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:11.359051  4001 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:29:11.359800  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:11.360972  8969 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:11.328778  8822 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:11.263687  8892 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:11.366492  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:11.359599  3971 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:11.379484  3853 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:29:11.380585  3969 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:11.341401  8885 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:11.381553  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:11.324610  8982 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 12:29:11.343859  8647 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:11.299741  8972 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:11.317404  8987 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:11.286324  8771 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:11.386458  3852 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:11.386746  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:11.388615  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 56280.4us
W20260709 12:29:11.367558  8980 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.342s	user 0.001s	sys 0.000s
I20260709 12:29:11.367237  8962 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:11.417729  4571 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:29:11.383483  8992 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:11.383446  8923 raft_consensus.cc:3055] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:29:11.423107  8985 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
I20260709 12:29:11.426476  3969 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:11.437245  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:11.421060  8979 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.004s
I20260709 12:29:11.417163  8771 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:11.421397  8647 raft_consensus.cc:697] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:11.447561  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:11.383579  8892 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.418766  8988 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:11.423828  8923 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:29:11.509160  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 53159.5us
W20260709 12:29:11.520238  4536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.004s	sys 0.017s
I20260709 12:29:11.426887  8962 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:11.515906  8966 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:11.517783  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 70306us
I20260709 12:29:11.608816  3822 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:11.443730  8955 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:29:11.506398  3821 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.003s	sys 0.014s
I20260709 12:29:11.443243  8741 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:29:11.614993  3821 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.005s	sys 0.015s
W20260709 12:29:11.521529  8980 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:29:11.559577  8669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.006s	sys 0.006s
I20260709 12:29:11.568853  8962 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:11.570472  9001 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:29:11.571116  8992 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:11.574190  8792 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:11.574337  8998 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:29:11.575145  8892 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:11.580061  8745 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:11.581605  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:11.636976  4574 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:29:11.583935  8898 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:11.583961  9000 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:29:11.586385  8647 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:11.595391  8770 consensus_meta.cc:287] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.648s	user 0.005s	sys 0.003s
W20260709 12:29:11.519917  8984 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 12:29:11.615387  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 860990us
W20260709 12:29:11.520758  4536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.004s	sys 0.017s
I20260709 12:29:11.621356  8924 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 12:29:11.601630  8849 consensus_meta.cc:287] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.860s	user 0.004s	sys 0.003s
W20260709 12:29:11.567298  8979 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:29:11.528663  8910 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:11.563688  8988 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:11.418650  8987 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.630954  4568 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 16. Current term is 17. Ops: []
W20260709 12:29:11.624537  8669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.006s	sys 0.006s
I20260709 12:29:11.624234  8967 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:11.617216  3822 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:11.677316  8891 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:11.635164  8792 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:11.671842  3851 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.025s	sys 0.050s
I20260709 12:29:11.624868  8883 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.671207  3971 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:11.679065  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 161159us
W20260709 12:29:11.680240  3897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.052s	sys 0.075s
I20260709 12:29:11.678220  8910 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:11.689743  3851 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.025s	sys 0.050s
W20260709 12:29:11.695420  3897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.052s	sys 0.079s
I20260709 12:29:11.696324  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2659) took 1161 ms. Trace:
W20260709 12:29:11.696403  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 731331us
I20260709 12:29:11.697646  3897 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:11.693126  4574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:29:11.635581  8992 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:11.643694  8745 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:11.665095  8898 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:11.668682  8770 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.704782  4574 raft_consensus.cc:606] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:11.679620  8649 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 12:29:11.702980  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:11.717088  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:11.679890  8988 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:11.739213  3897 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:11.708916  8892 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:11.706349  8991 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:11.744185  8914 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:11.751317  8792 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:11.754980  8987 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:11.701301  8910 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:11.633605  8923 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:11.760732  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:11.783897  3999 raft_consensus.cc:1240] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:11.761821  4574 raft_consensus.cc:614] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:11.750551  8966 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:11.776258  3897 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:11.779021  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:11.680399  8821 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:29:11.680565  8862 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 12:29:11.785605  3854 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:11.682791  8907 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 12:29:11.697103  4005 rpcz_store.cc:276] 0709 12:29:10.535041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:10.537018 (+  1977us) service_pool.cc:224] Handling call
0709 12:29:10.559745 (+ 22727us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:29:10.585418 (+ 25673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:10.585447 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:29:10.586373 (+   926us) log.cc:844] Serialized 78 byte log entry
0709 12:29:10.718460 (+132087us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:29:10.754137 (+ 35677us) log.cc:844] Serialized 14 byte log entry
0709 12:29:10.763431 (+  9294us) log.cc:844] Serialized 14 byte log entry
0709 12:29:11.033445 (+270014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:11.033567 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:11.119603 (+ 86036us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b180042f880. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea522 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:29:11.226401 (+106798us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b180042f880. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:29:11.691784 (+465383us) raft_consensus.cc:1685] finished
0709 12:29:11.696096 (+  4312us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:11.696246 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8903,"prepare.queue_time_us":601941,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":12784,"raft.queue_time_us":22154,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":67809,"spinlock_wait_cycles":113882880,"thread_start_us":393075,"threads_started":2,"wal-append.queue_time_us":289619}
I20260709 12:29:11.704577  9008 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:11.717842  8669 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:29:11.690518  8891 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.772763  8892 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:11.774544  8681 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:11.738085  8997 consensus_queue.cc:1048] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:29:11.793756  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:11.775223  8989 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:11.777949  8360 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:11.780974  8791 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:11.774788  8995 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:29:11.793743  8967 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:11.827896  8681 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:11.846302  8885 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:11.821682  8914 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:11.844992  8360 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:11.856098  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:11.835063  8918 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:11.847508  8791 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.782176  8991 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.914384  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:11.914939  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:11.915081  3925 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:11.915529  3927 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:11.859750  8891 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:11.862027  8957 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:11.862246  8868 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:11.862908  8770 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:11.862826  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:11.825426  8892 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:11.872834  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:11.874392  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:11.828061  9006 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:11.874840  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:11.879411  4573 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:29:11.880777  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:11.885710  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:11.946079  4569 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:11.844158  8760 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:11.889020  8990 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:11.867408  8967 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:11.896183  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:11.875438  8681 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:11.898893  8992 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:11.901662  8898 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:11.902424  8987 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:11.873499  8885 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:11.817623  9008 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:11.866472  8989 raft_consensus.cc:697] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:11.912350  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:11.986726  3930 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:29:11.914245  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:11.987613  3931 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:11.858633  8745 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:11.917789  3855 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:11.929014  8954 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:11.931805  4568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:29:11.933544  8883 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:12.006712  4568 raft_consensus.cc:606] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:11.943143  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 266104us
I20260709 12:29:11.981056  8885 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:11.929951  8918 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.016307  9004 consensus_queue.cc:1059] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:29:11.999931  3999 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:29:11.941496  8868 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.962667  8760 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:11.941138  8957 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.949811  8914 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:12.033027  8822 raft_consensus.cc:3055] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:12.006981  3854 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:11.997217  8756 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:29:12.006669  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 389532us
I20260709 12:29:12.021237  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:12.036873  3822 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:12.000619  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:11.983139  8987 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.019102  3821 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:11.990199  8995 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.033540  8822 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:11.981469  8791 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:12.058513  3821 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:12.061172  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:12.061846  3929 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:12.046022  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:12.037628  8793 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:12.047389  8918 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:12.047889  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:12.050122  8647 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:12.050025  8822 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.052570  8856 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:29:12.053089  8894 consensus_meta.cc:287] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 1.003s	user 0.005s	sys 0.005s
I20260709 12:29:12.041954  8891 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:12.057353  8278 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:12.036193  8360 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:12.064368  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:12.153272  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:12.057041  8955 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:12.000988  8973 consensus_queue.cc:1059] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:29:12.097226  4572 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:12.048785  8995 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:12.140286  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 76697.6us
I20260709 12:29:12.025985  8792 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:12.065523  8771 consensus_meta.cc:287] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
I20260709 12:29:12.034216  9016 consensus_queue.cc:1059] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:29:12.056994  8988 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.186739  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:12.187386  3929 raft_consensus.cc:2376] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11. Re-sending same reply.
I20260709 12:29:12.151854  4006 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:29:12.153625  3997 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:12.188036  4006 pending_rounds.cc:85] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 11
I20260709 12:29:12.033421  8914 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:11.966678  8990 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.159729  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:12.079288  8987 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:12.081228  8868 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:12.106130  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 47697.1us
I20260709 12:29:12.000257  8954 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:12.179529  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 178704us
I20260709 12:29:12.139227  8647 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:12.042517  8756 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:12.164196  3970 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:29:12.197371  8741 consensus_meta.cc:287] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.003s
I20260709 12:29:12.142714  8862 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:29:12.184175  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 260360us
I20260709 12:29:11.960893  9006 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:12.228754  3928 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 13: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:12.139935  8997 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:12.188344  4006 pending_rounds.cc:107] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:29:12.230691  4006 raft_consensus.cc:2889] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:12.149616  8891 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:12.231676  8891 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:12.232597  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:12.063066  9019 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.146s
I20260709 12:29:12.182905  8955 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:12.152525  8278 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:12.163678  8649 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:12.177158  8991 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:11.998006  8989 consensus_queue.cc:237] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:12.085960  8793 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:12.213563  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 49496.9us
I20260709 12:29:12.183589  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:12.206856  3821 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:12.189644  8822 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:12.147590  8896 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:29:12.236511  8741 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:12.283682  4537 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:12.285713  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 78994.8us
I20260709 12:29:12.224481  9027 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:12.251428  8278 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:12.231531  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:12.306814  3854 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:12.307922  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:12.199195  3925 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:29:12.245738  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:12.242190  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 178898us
I20260709 12:29:12.213001  8647 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:12.186131  8792 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:12.261085  8990 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:12.185976  8771 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.266316  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:12.325311  3931 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:12.265417  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:12.325806  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:12.267776  3930 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:12.267779  3970 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:12.269598  4571 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:29:12.273203  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:12.325315  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:12.227357  3969 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:12.299799  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:12.299991  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:12.258173  8999 raft_consensus.cc:3055] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:12.309268  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:12.289178  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:12.256351  8967 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:12.277690  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:12.328383  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 101167us
I20260709 12:29:12.342743  4568 raft_consensus.cc:2393] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 17: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:12.334502  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:12.327347  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 59660.2us
I20260709 12:29:12.341799  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:12.354575  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:12.356068  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:12.363263  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:12.368602  3927 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:29:12.369307  3927 pending_rounds.cc:85] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 9
I20260709 12:29:12.370018  3927 pending_rounds.cc:107] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:29:12.371096  3927 raft_consensus.cc:2889] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:12.381095  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:12.344995  3969 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:12.318049  9027 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:12.401257  3851 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:12.401484  3855 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:12.405845  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:12.406368  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:12.408021  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:12.408792  3855 raft_consensus.cc:2376] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14. Re-sending same reply.
I20260709 12:29:12.408938  4005 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:12.257939  8649 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:12.436018  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 214192us
I20260709 12:29:12.414104  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:12.341167  9025 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:12.346038  9018 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:12.393451  9035 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.485577  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:12.409734  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:12.333760  8999 raft_consensus.cc:740] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:12.258430  8997 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:12.393697  9015 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260709 12:29:12.380756  8978 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.380426  8990 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:12.336167  9026 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:12.500710  3931 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
I20260709 12:29:12.505461  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:12.542273  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:12.542994  3931 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:12.543977  3925 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:29:12.507402  3926 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:12.403304  8992 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:12.278034  8991 consensus_queue.cc:1059] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.115s
I20260709 12:29:12.409132  8760 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:12.564517  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:12.521584  3855 raft_consensus.cc:2376] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13. Re-sending same reply.
I20260709 12:29:12.325121  8868 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.169s
I20260709 12:29:12.408238  9027 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:12.508009  9025 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:12.408092  9008 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:12.543836  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:12.401944  8360 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:12.545238  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:12.593816  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:12.588331  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:12.595136  3855 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:12.596143  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:12.597635  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:12.588995  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 241819us
I20260709 12:29:12.562786  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:12.565287  3931 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:12.600288  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:12.604106  3850 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:29:12.605376  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 79402.5us
I20260709 12:29:12.601846  3855 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:29:12.606309  3822 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:12.614044  3926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:29:12.541167  8990 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:12.614778  3926 raft_consensus.cc:606] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:12.615206  3926 raft_consensus.cc:614] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:12.543494  8741 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.594409  9025 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:12.645745  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:12.529675  9035 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.618813  8990 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:12.680160  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:12.632387  9044 raft_consensus.cc:3055] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:12.634649  9016 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:12.731108  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 79224.6us
I20260709 12:29:12.548609  8978 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.651867  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:12.647709  9008 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.687016  8991 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:29:12.759958  3849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.009s	sys 0.025s
W20260709 12:29:12.764798  3849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.009s	sys 0.025s
I20260709 12:29:12.689917  8792 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:12.688010  8360 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:12.689289  8793 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:12.731477  9044 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:12.635617  8988 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:12.648885  9042 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:12.862655  9042 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:12.870396  8988 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.872772  8988 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:12.772730  9031 log.cc:927] Time spent T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.471s	user 0.001s	sys 0.000s
I20260709 12:29:12.634655  8741 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:12.770265  8892 consensus_meta.cc:287] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.002s
I20260709 12:29:12.764513  8991 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:12.925927  9022 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.328s
W20260709 12:29:12.882746  9020 log.cc:927] Time spent T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 12:29:12.763307  8995 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:12.929741  4568 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 16. Current term is 17. Ops: []
W20260709 12:29:12.937094  9028 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 12:29:12.763370  8978 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:12.770202  9008 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.955663  9061 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:12.938817  8892 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.956286  9061 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.956787  9035 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:12.957131  4003 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 12: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:12.957396  9046 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:29:12.957994  9053 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.958499  9053 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.959321  8892 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:12.960680  9053 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:12.961597  9037 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.452s	user 0.001s	sys 0.000s
W20260709 12:29:12.926872  9052 log.cc:927] Time spent T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260709 12:29:12.927354  9021 log.cc:927] Time spent T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.376s	user 0.000s	sys 0.001s
I20260709 12:29:12.966192  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1258) took 1289 ms. Trace:
I20260709 12:29:12.966708  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:12.967756  3924 raft_consensus.cc:2393] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:12.837918  8868 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.970971  8868 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.972093  8862 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:12.972527  8862 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:29:12.973390  8885 consensus_meta.cc:287] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.958s	user 0.007s	sys 0.003s
I20260709 12:29:12.855284  8793 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:12.966596  3848 rpcz_store.cc:276] 0709 12:29:11.676346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:11.676832 (+   486us) service_pool.cc:224] Handling call
0709 12:29:11.677159 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:11.894295 (+217136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:11.894335 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:11.936312 (+ 41977us) log.cc:844] Serialized 26 byte log entry
0709 12:29:12.203281 (+266969us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:29:12.203320 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:12.203391 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:12.965949 (+762558us) raft_consensus.cc:1685] finished
0709 12:29:12.965973 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:12.966122 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3912,"raft.queue_time_us":24956,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":5907,"thread_start_us":474249,"threads_started":2,"wal-append.queue_time_us":385760}
W20260709 12:29:12.950913  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 306238us
I20260709 12:29:12.927850  9006 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:12.974534  9061 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:12.975594  8741 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:12.976159  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2666) took 1139 ms. Trace:
I20260709 12:29:12.757532  9016 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.804240  9041 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:12.998063  4570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.020s	sys 0.045s
I20260709 12:29:12.903597  8771 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:12.938264  8991 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:12.841431  8360 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:12.973662  8868 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:12.927067  8954 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:13.014285  4005 rpcz_store.cc:276] 0709 12:29:11.836727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:11.838283 (+  1556us) service_pool.cc:224] Handling call
0709 12:29:11.866929 (+ 28646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:12.409446 (+542517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:12.975935 (+566489us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b5400023354. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:12.976097 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246028544}
I20260709 12:29:12.978138  9046 raft_consensus.cc:697] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:13.000599  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:13.018481  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.021399  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:12.991248  8649 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.029695  9041 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.067225  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:13.050765  8681 consensus_meta.cc:287] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 1.082s	user 0.011s	sys 0.001s
I20260709 12:29:13.068612  9041 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.068842  4002 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:13.069247  3850 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 11: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:13.068933  8681 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.021142  8741 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:13.071239  8681 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.047391  9032 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.068398  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.072046  9032 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.022925  9025 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:13.047187  9036 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.469s	user 0.001s	sys 0.000s
I20260709 12:29:13.074976  3851 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:13.046516  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:13.077003  4005 raft_consensus.cc:2410] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:29:13.080806  3927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.009s	sys 0.009s
W20260709 12:29:13.081236  3927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.009s	sys 0.009s
I20260709 12:29:13.075065  9046 consensus_queue.cc:237] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.082726  8972 raft_consensus.cc:3055] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:13.083164  8972 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:29:13.027758  8891 consensus_meta.cc:287] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.795s	user 0.008s	sys 0.004s
I20260709 12:29:13.083988  8972 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:13.023540  4570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.021s	sys 0.045s
W20260709 12:29:13.091665  4538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.000s	sys 0.013s
W20260709 12:29:13.092022  4538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.000s	sys 0.013s
I20260709 12:29:13.087433  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1259) took 1410 ms. Trace:
W20260709 12:29:13.092499  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 781891us
I20260709 12:29:13.092527  3849 rpcz_store.cc:276] 0709 12:29:11.676671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:11.677900 (+  1229us) service_pool.cc:224] Handling call
0709 12:29:11.682779 (+  4879us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:29:11.933001 (+250222us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:29:11.934527 (+  1526us) log.cc:844] Serialized 14 byte log entry
0709 12:29:12.766169 (+831642us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:29:12.824724 (+ 58555us) log.cc:844] Serialized 78 byte log entry
0709 12:29:12.824923 (+   199us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:29:13.085778 (+260855us) log.cc:844] Serialized 14 byte log entry
0709 12:29:13.086286 (+   508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:13.086379 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:13.086433 (+    54us) raft_consensus.cc:1685] finished
0709 12:29:13.086451 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:13.087377 (+   926us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30030,"prepare.queue_time_us":151027,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":204358,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":33350,"thread_start_us":1323272,"threads_started":4,"wal-append.queue_time_us":290472}
I20260709 12:29:13.096356  8997 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.098785  8914 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.100879  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36516 (request call id 2668) took 1260 ms. Trace:
I20260709 12:29:13.101325  4003 rpcz_store.cc:276] 0709 12:29:11.841218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:11.846962 (+  5744us) service_pool.cc:224] Handling call
0709 12:29:13.100644 (+1253682us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540036e054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:13.100800 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2325758336}
W20260709 12:29:13.050601  8910 consensus_meta.cc:287] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.256s	user 0.012s	sys 0.000s
I20260709 12:29:13.109069  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.115940  3848 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:13.041713  8923 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:13.118099  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1257) took 1442 ms. Trace:
W20260709 12:29:13.087558  8955 consensus_meta.cc:287] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.828s	user 0.011s	sys 0.001s
I20260709 12:29:13.075065  9008 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.056368  9016 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.047719  8957 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.130702  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:13.075024  9025 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:13.127846  3852 rpcz_store.cc:276] 0709 12:29:11.675954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:11.676115 (+   161us) service_pool.cc:224] Handling call
0709 12:29:11.676443 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:11.702608 (+ 26165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:11.702674 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:11.719192 (+ 16518us) log.cc:844] Serialized 26 byte log entry
0709 12:29:12.057552 (+338360us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b1800419d40. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:29:12.149382 (+ 91830us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:29:12.149424 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:13.117784 (+968360us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b5400054bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:13.117839 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:13.117904 (+    65us) raft_consensus.cc:1685] finished
0709 12:29:13.117918 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:13.118039 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13435,"raft.queue_time_us":78609,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":4611,"spinlock_wait_cycles":50126080,"thread_start_us":91636,"threads_started":1,"wal-append.queue_time_us":485998}
I20260709 12:29:12.991206  8885 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.041209  8360 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.140154  9032 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.084663  8891 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.018971  8793 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.071328  8741 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.144884  8988 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.147696  4536 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:13.141849  8972 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:29:13.169844  9030 consensus_queue.cc:1175] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4eedd844c09d456ca0b3614490dd1dbb" responder_term: 11 status { last_received { term: 10 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:29:13.173914  9003 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.174467  9003 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.031591  9044 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.186282  8966 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:13.186663  9044 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:13.186750  8966 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:13.187184  8966 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:13.190941  8885 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:13.192801  8822 consensus_meta.cc:287] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.909s	user 0.012s	sys 0.000s
I20260709 12:29:13.140955  8760 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:13.193677  8760 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.195135  9042 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:13.195283  8278 consensus_meta.cc:287] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.862s	user 0.009s	sys 0.000s
I20260709 12:29:13.176635  9003 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.202039  3857 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:13.124580  8910 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.132316  8962 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:29:13.142421  8955 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.198539  9034 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:13.228104  3856 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:13.235692  8955 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.238265  8793 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:13.243057  8991 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.245391  8991 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.251180  8910 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.257265  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2665) took 2514 ms. Trace:
I20260709 12:29:13.257364  8741 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.258085  9034 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:13.257784  4006 rpcz_store.cc:276] 0709 12:29:10.743137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:10.743258 (+   121us) service_pool.cc:224] Handling call
0709 12:29:10.743541 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:12.231241 (+1487700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:13.256935 (+1025694us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400128c54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:13.257152 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3238003072}
I20260709 12:29:13.258745  9034 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:13.195731  8278 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.262919  8756 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:13.263625  8278 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.264482  3853 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 12. Current term is 13. Ops: []
W20260709 12:29:13.265822  4537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.981s	user 0.018s	sys 0.008s
W20260709 12:29:13.266264  4537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.019s	sys 0.008s
W20260709 12:29:13.266793  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 983136us
I20260709 12:29:13.267055  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.269438  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:13.244900  9027 consensus_meta.cc:287] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.000s
I20260709 12:29:13.279831  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.281520  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.261040  8862 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.290110  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.292377  3850 raft_consensus.cc:2393] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:13.330754  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.331679  4568 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:13.334524  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.335179  3852 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:29:13.223591  8990 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.273958  8891 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.342955  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.347496  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:13.334167  8647 consensus_meta.cc:287] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.992s	user 0.008s	sys 0.004s
I20260709 12:29:13.348219  4537 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:13.348206  4566 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:13.312044  8756 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.358482  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:13.337040  8962 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.345141  8862 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:13.289532  9027 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.339949  8978 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:13.379550  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:13.380172  4566 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:13.376292  4537 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:13.427359  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:13.428254  3852 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:29:13.432325  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 56137us
W20260709 12:29:13.433589  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 302966us
I20260709 12:29:13.435119  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2646) took 1137 ms. Trace:
I20260709 12:29:13.378373  8957 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:13.354209  9038 consensus_queue.cc:1059] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:29:13.442018  3821 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:13.357728  8647 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.471230  9081 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:13.471611  8647 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:13.471837  9081 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.472961  4565 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:13.447621  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:13.376874  8962 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.474857  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.367177  8756 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.475664  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.453131  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.476720  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:13.480185  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.384217  8978 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.481289  3854 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:13.482097  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:13.482260  9044 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:13.483057  8756 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.483199  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.484341  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:13.484473  9071 log.cc:927] Time spent T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:29:13.484887  4569 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:13.447651  9066 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:13.488137  9066 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 17 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:13.489125  9066 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.493871  8962 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.453655  8957 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:13.501443  8957 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:29:13.501994  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:13.506055  9027 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:13.507743  9070 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.347s	user 0.005s	sys 0.003s
I20260709 12:29:13.510673  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:13.452689  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:13.518841  3849 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:13.448277  3856 rpcz_store.cc:276] 0709 12:29:12.297540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:12.299511 (+  1971us) service_pool.cc:224] Handling call
0709 12:29:13.434849 (+1135338us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b5400019fd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:13.435040 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068716416}
I20260709 12:29:13.455133  9080 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:29:13.448504  3972 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.019s	sys 0.010s
W20260709 12:29:13.523155  3972 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.019s	sys 0.011s
W20260709 12:29:13.457034  9076 log.cc:927] Time spent T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:29:13.459900  9038 raft_consensus.cc:3055] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:13.462213  9035 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.463027  9077 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.466493  8972 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:13.466699  8990 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.469331  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:13.510854  3854 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2651) took 1211 ms (client timeout 1531 ms). Trace:
I20260709 12:29:13.511902  3852 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:13.515931  8978 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.446802  8966 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.522145  3821 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:13.509647  4566 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:13.538184  9080 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.539170  9038 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:13.479887  9081 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.540710  8999 consensus_queue.cc:260] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.543998  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 1132) took 1354 ms. Trace:
I20260709 12:29:13.565685  3929 rpcz_store.cc:276] 0709 12:29:12.190239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:12.190545 (+   306us) service_pool.cc:224] Handling call
0709 12:29:12.213828 (+ 23283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:12.216972 (+  3144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:12.217003 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:12.217565 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 12:29:13.049774 (+832209us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b1800281140. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:29:13.442121 (+392347us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:29:13.442177 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:13.443907 (+  1730us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:13.486277 (+ 42370us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b48002001d8. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe056f00aa1 00007fe056ef7b37 00007fe056ef79ca 00007fe056fef26f 00007fe056feef37 00007fe05700355c 00007fe057003508 00007fe057003488 00007fe057003443 00007fe0570026ec 00007fe055f2ca96
0709 12:29:13.543758 (+ 57481us) raft_consensus.cc:1685] finished
0709 12:29:13.543781 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:13.543918 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1470,"raft.queue_time_us":1777,"raft.run_cpu_time_us":4400,"raft.run_wall_time_us":1258112,"spinlock_wait_cycles":31245440,"thread_start_us":392099,"threads_started":1,"wal-append.queue_time_us":1309787}
I20260709 12:29:13.544435  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:13.499814  9034 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.546332  4569 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:13.547680  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2763) took 1151 ms. Trace:
W20260709 12:29:13.558910  3854 rpcz_store.cc:269] 0709 12:29:12.299143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:12.307599 (+  8456us) service_pool.cc:224] Handling call
0709 12:29:13.510697 (+1203098us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b54002ef254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:13.510796 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2043906816}
W20260709 12:29:13.558892  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 328012us
I20260709 12:29:13.570429  8987 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.568866  3927 rpcz_store.cc:276] 0709 12:29:12.397708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:12.397984 (+   276us) service_pool.cc:224] Handling call
0709 12:29:12.398982 (+   998us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:12.400503 (+  1521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:12.400536 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:12.401058 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:29:13.085974 (+684916us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:13.546887 (+460913us) log.cc:844] Serialized 14 byte log entry
0709 12:29:13.547270 (+   383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:13.547367 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:13.547424 (+    57us) raft_consensus.cc:1685] finished
0709 12:29:13.547442 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:13.547602 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3723,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":96313,"thread_start_us":1095292,"threads_started":2,"wal-append.queue_time_us":650732}
I20260709 12:29:13.570926  8987 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.572944  8987 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.573280  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:13.569440  9034 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.569304  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.575570  3895 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:13.578439  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.575632  3821 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:13.576457  8862 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:13.578629  8978 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:13.584683  8978 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.586238  9038 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.586745  8978 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:13.589098  3821 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:13.591236  4568 raft_consensus.cc:2393] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 15: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:29:13.591998  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 47653.6us
I20260709 12:29:13.596051  3895 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:13.546661  9035 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.598500  3895 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:13.578651  8990 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:13.600310  8278 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:13.560017  8972 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.581471  8999 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:13.604903  8278 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:13.610663  8278 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:13.603286  3895 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:13.594799  9019 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:13.615123  4569 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:29:13.615895  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1131) took 1758 ms. Trace:
W20260709 12:29:13.617733  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 178492us
I20260709 12:29:13.622350  4566 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:29:13.560129  9077 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.599511  8918 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:13.603554  8997 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:13.597204  8862 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:13.605713  9038 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:13.636767  3930 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:29:13.636770  3849 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:29:13.638135  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:13.614861  8990 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:13.619064  9019 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:13.629175  8278 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.624861  8669 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:13.609031  8987 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:13.594549  8923 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:29:13.634757  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:13.634805  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:13.635087  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:13.638602  3927 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:29:13.644639  3928 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:29:13.621941  9056 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:13.640244  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:13.621681  3895 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:13.630110  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:13.642290  4565 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:13.616351  4570 rpcz_store.cc:276] 0709 12:29:11.857596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:11.863445 (+  5849us) service_pool.cc:224] Handling call
0709 12:29:11.866021 (+  2576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:11.866267 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:29:12.140080 (+273813us) log.cc:844] Serialized 14 byte log entry
0709 12:29:13.613841 (+1473761us) log.cc:844] Serialized 14 byte log entry
0709 12:29:13.614390 (+   549us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:13.614473 (+    83us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:13.615652 (+  1179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:13.615723 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:13.615835 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59897,"prepare.queue_time_us":353456,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":77062,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":28842,"thread_start_us":1661219,"threads_started":3,"wal-append.queue_time_us":922249}
I20260709 12:29:13.638862  3929 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 15: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:13.628366  8969 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:13.641606  8997 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:13.643895  9019 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:13.661643  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:13.646703  8987 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:13.652663  8918 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:13.668654  3822 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:13.670096  8278 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.667587  8856 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:13.674886  8856 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:13.675269  8856 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:13.683058  9088 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:29:13.685962  9080 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.686180  8966 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.685552  8856 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.686606  9080 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:13.655158  8969 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.646872  8957 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.688282  8856 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.689240  8957 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:13.650983  9056 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.691303  8972 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.666252  8987 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:13.702522  8997 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.664204  8822 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.689138  8969 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.713069  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:13.728942  4567 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:29:13.732503  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.733218  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:13.734081  3855 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:13.734236  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.734301  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.734917  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.735471  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.735558  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:13.736783  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.738171  8862 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:13.737977  8990 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.738662  8862 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.740660  8862 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:13.741700  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:13.755785  3821 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:13.756521  9082 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:13.756944  9082 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:13.757323  9082 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:13.760072  8862 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:13.760610  8862 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.710439  8896 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.706466  8669 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:29:13.687186  9080 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.730815  8822 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.744807  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.671624  9017 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:13.730259  8856 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:13.746975  9019 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.747351  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.749830  9068 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:29:13.751319  8910 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:29:13.752152  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:13.762044  3821 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:13.790464  3926 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:13.791090  8910 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:13.791286  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1266) took 1517 ms. Trace:
I20260709 12:29:13.791713  3853 rpcz_store.cc:276] 0709 12:29:12.274206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:12.274388 (+   182us) service_pool.cc:224] Handling call
0709 12:29:12.274772 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:13.264899 (+990127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:13.791075 (+526176us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54000550d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:13.791225 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275645312}
I20260709 12:29:13.779538  4567 raft_consensus.cc:2368] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 15. Current term is 16.
I20260709 12:29:13.786106  8278 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:13.786338  8862 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.787878  8856 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:13.824204  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:13.789165  9019 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.789759  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.798496  8910 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:13.800007  3822 leader_election.cc:400] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 15. Current term is 16.
I20260709 12:29:13.833966  3822 leader_election.cc:403] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:13.800410  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2670) took 1256 ms. Trace:
W20260709 12:29:13.822602  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 345265us
W20260709 12:29:13.837051  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 384404us
I20260709 12:29:13.827461  3856 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:13.830533  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.838354  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.831669  3854 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:13.832904  8987 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.838701  3850 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:29:13.835294  4000 rpcz_store.cc:276] 0709 12:29:12.543996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:12.545820 (+  1824us) service_pool.cc:224] Handling call
0709 12:29:12.591675 (+ 45855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:12.591974 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:29:13.093402 (+501428us) log.cc:844] Serialized 14 byte log entry
0709 12:29:13.380102 (+286700us) log.cc:844] Serialized 14 byte log entry
0709 12:29:13.799942 (+419840us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b18003468a0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04ee64c0a 00007fe0585a4219 00007fe04eeeca40 00007fe04eee74e4 00007fe04eee7455 00007fe051fcf060 00007fe051fe1716 00007fe051ff2287 00007fe051ff2208
0709 12:29:13.800085 (+   143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:13.800133 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:29:13.800191 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:13.800255 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:13.800356 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79659,"prepare.queue_time_us":464330,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":434308,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":17303,"spinlock_wait_cycles":109617920,"thread_start_us":729100,"threads_started":2,"wal-append.queue_time_us":481209}
I20260709 12:29:13.779075  9017 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:13.842168  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:13.846850  3854 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:29:13.845031  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 192390us
I20260709 12:29:13.838874  3926 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:13.855068  3854 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:13.853793  3821 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:13.858860  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 58993.2us
I20260709 12:29:13.861405  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:13.874425  3850 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 13: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:13.847004  8991 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:13.858850  9017 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:13.846060  8918 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:13.794186  8896 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.860468  9075 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:13.838037  8756 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:29:13.845598  8910 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.906785  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.912071  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.912686  4570 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:13.913492  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.914470  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.915477  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:13.877465  9032 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:29:13.917104  3851 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
W20260709 12:29:13.917718  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:13.920157  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:13.924120  4569 raft_consensus.cc:2410] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:29:13.904379  8898 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.901363  9075 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:13.924474  4567 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:29:13.923686  9042 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:13.898049  8745 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:13.939944  4570 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:13.905021  9081 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 15. Current term is 16.
I20260709 12:29:13.917356  9063 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:13.891310  8991 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:13.899995  8918 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:13.985826  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 132107us
I20260709 12:29:13.935487  8770 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:13.933521  9075 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:13.899659  8856 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.012506  9101 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:13.986204  9063 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.019310  9101 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:13.993258  9096 log.cc:927] Time spent T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:29:13.952731  9042 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:13.997329  8647 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:14.026878  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.027621  3930 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:13.944567  8745 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.004174  8896 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:13.934358  8898 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:13.994302  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.020963  9063 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:14.023319  9101 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:14.016168  8989 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:14.024056  8822 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:13.997380  8770 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:14.042203  9042 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:14.052242  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.042762  8745 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:14.058372  8987 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:14.043080  9082 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:14.061805  8918 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:14.062173  8898 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:14.062565  9082 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:14.062879  8910 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:14.030829  8647 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.068360  8647 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:14.048899  8770 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:14.037344  9080 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:14.038997  8989 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.072804  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:14.073530  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 200198us
I20260709 12:29:14.080289  3895 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:14.083272  9111 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:14.083743  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:14.084390  3928 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:14.096582  3928 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:14.097293  8995 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:14.083783  9111 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:14.139628  9111 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:14.125330  8862 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:14.166564  8862 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:14.167903  9004 raft_consensus.cc:993] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
W20260709 12:29:14.191280  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 111069us
I20260709 12:29:14.194787  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.197429  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.198202  3925 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:14.201766  3821 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:14.200695  3895 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:14.207527  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:14.208480  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:14.208824  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 371113us
I20260709 12:29:14.211658  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:14.214141  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.215143  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:14.209687  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 294896us
I20260709 12:29:14.216714  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.217248  3930 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:14.201185  8989 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:14.207938  8999 raft_consensus.cc:1081] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:14.223764  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.220465  3969 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:14.351333  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:14.351724  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:14.352805  3928 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 12: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:14.353499  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.208192  8891 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:29:14.366465  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.369656  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:14.221362  8745 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:14.222121  8770 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:14.218926  8894 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:14.314059  8647 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:14.221046  8992 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:14.208619  9075 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:14.349727  8898 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:14.410909  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:14.411419  9119 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:14.414223  3930 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:14.421169  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.421952  3932 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 7.
I20260709 12:29:14.425552  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.415078  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.433421  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:14.217244  3925 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:14.405833  9118 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:14.434355  3932 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 16: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:14.408972  8891 raft_consensus.cc:697] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:14.437199  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.433133  3821 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:14.437791  3923 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
W20260709 12:29:14.437670  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 217306us
I20260709 12:29:14.439594  3925 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:29:14.408751  8770 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.441920  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:14.445791  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:14.446184  3855 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 15: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:14.447080  8770 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:14.423689  8898 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.417440  8647 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:14.451928  8647 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:14.396502  8745 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:14.454042  8745 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:14.424508  8992 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:14.455180  8992 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:14.441509  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:14.424363  9017 consensus_meta.cc:287] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.000s
I20260709 12:29:14.457638  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:14.458094  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:14.460201  3971 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:14.442189  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:14.444015  3931 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:29:14.462234  3852 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:14.442251  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:14.463167  3853 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:14.473815  9017 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.474808  3931 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:14.480482  3856 raft_consensus.cc:2368] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12.
I20260709 12:29:14.476914  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:14.477428  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:14.413220  8894 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.485735  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:14.449715  8898 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:14.479905  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:14.503523  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:14.506955  4002 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:14.487648  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:14.490595  3895 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:14.489578  3971 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:14.491596  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.500643  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:14.510563  3855 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:14.496660  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:14.494036  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.512732  3931 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 13: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:14.510365  3927 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:14.487046  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:14.511708  4006 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:14.467605  9119 raft_consensus.cc:697] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:14.533639  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:14.515986  3971 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:14.536088  3971 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:14.524410  3895 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:14.526840  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:14.517966  4002 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:29:14.518849  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:14.529341  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:14.529764  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.543067  3853 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:14.543566  3925 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 15: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:14.543045  4006 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:14.544584  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:14.463379  9117 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:29:14.530071  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:14.540704  3999 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:14.547616  3855 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:29:14.530877  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.545428  3925 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 13: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:14.530071  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.539525  3895 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:14.553536  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.554683  3931 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:29:14.555377  3930 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:14.548879  3932 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:14.474339  9112 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:14.569584  4001 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:14.479650  8856 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:14.479753  8792 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:14.557029  3855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:40038
I20260709 12:29:14.623150  3855 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:14.623766  3855 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:14.541549  3971 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:14.567407  8745 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:29:14.499442  9027 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:14.623513  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:14.631212  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:14.566694  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:14.649335  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:14.746693  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:14.666508  4006 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:14.573927  3923 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:29:14.744807  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.769007  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:14.456661  9118 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.532469  9113 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:14.804450  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:14.551017  8669 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:14.826973  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.833231  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:14.849424  3930 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:14.477870  8891 consensus_queue.cc:237] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:14.570793  9080 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:14.513902  8770 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:14.743005  3970 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:14.870885  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 127987us
I20260709 12:29:14.513432  9116 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:14.568802  8999 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:14.554080  8898 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:14.570336  9063 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:29:14.741936  9111 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:14.623001  8856 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:14.744243  9117 raft_consensus.cc:697] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:14.526253  8954 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:14.570348  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:14.735836  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 170686us
I20260709 12:29:14.886627  9042 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:14.531666  8995 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:14.872244  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:14.820111  9075 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:14.821934  8792 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:14.885185  3855 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.902900  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2643) took 2600 ms. Trace:
I20260709 12:29:14.772768  9112 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.786505  9027 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.926446  3930 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:29:14.905742  9017 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:14.863903  8978 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:29:14.928308  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 56154.5us
I20260709 12:29:14.943995  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:14.897830  8647 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:14.821365  3853 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:14.933933  3849 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:14.936728  3855 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:14.905563  8770 raft_consensus.cc:697] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:14.926620  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:14.968395  8770 consensus_queue.cc:237] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.969455  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:14.971577  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:14.932814  8792 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:14.982370  8792 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:14.922467  8856 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:14.930297  8791 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:14.952593  8760 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:14.932958  3857 rpcz_store.cc:276] 0709 12:29:12.289511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:12.290191 (+   680us) service_pool.cc:224] Handling call
0709 12:29:12.328346 (+ 38155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:13.202576 (+874230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:14.889115 (+1686539us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b54002a30d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:14.889345 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2008732928}
I20260709 12:29:14.970063  8918 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:14.972240  9080 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:29:14.974692  8669 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:14.975248  9075 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:14.945457  3970 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:15.006726  3997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.016s	sys 0.092s
W20260709 12:29:15.007639  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 446326us
I20260709 12:29:14.931011  9063 raft_consensus.cc:697] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:14.932514  8995 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.996538  3852 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:29:14.929790  9042 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.905491  8999 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:15.007884  3997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.016s	sys 0.092s
I20260709 12:29:14.999046  8924 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:29:15.027971  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 486480us
I20260709 12:29:14.991397  8992 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:15.003355  8669 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:15.024899  8760 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:29:15.011881  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 66513.1us
I20260709 12:29:14.991238  8978 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.063349  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:15.064481  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 493461us
I20260709 12:29:15.068182  3970 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:15.073273  3855 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:29:15.065095  8669 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:15.077207  9118 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:15.077847  9118 consensus_queue.cc:1059] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:15.078071  9111 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:15.078755  9118 consensus_queue.cc:1059] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:29:15.079416  9118 consensus_queue.cc:1243] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer 4eedd844c09d456ca0b3614490dd1dbb log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:29:15.080562  9125 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:29:15.083742  8990 raft_consensus.cc:3055] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:15.084015  8999 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:29:15.084168  8990 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:15.084678  8999 consensus_queue.cc:1059] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:29:15.085391  9124 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:29:15.085129  8990 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:15.087097  9112 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:15.087483  8990 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:15.088851  9063 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:14.901906  9116 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:15.107805  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:15.107064  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:15.109511  3930 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:15.113412  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.113735  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.072042  8898 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:29:15.114123  4572 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:29:15.108556  3931 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
W20260709 12:29:15.119238  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 51159.6us
I20260709 12:29:15.121318  3970 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:15.127156  3970 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:15.039837  8924 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:15.099877  8894 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:15.131546  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:14.916301  9119 consensus_queue.cc:237] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:15.040788  9117 consensus_queue.cc:237] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.133922  4567 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:15.132562  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.135270  8898 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:15.135030  3970 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:15.144387  3970 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:15.137950  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 213429us
I20260709 12:29:15.131577  9075 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:29:15.108966  8669 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.157836  3930 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:15.128523  9132 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:15.159346  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:15.163542  8760 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:15.163964  9111 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:15.164393  8898 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:15.164510  9111 raft_consensus.cc:697] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:15.164642  8924 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:15.164876  8898 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:15.165688  8898 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:15.165429  9111 consensus_queue.cc:237] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:15.165460  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.170126  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:15.170892  3930 raft_consensus.cc:2393] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 18: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:15.171264  8669 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:15.173063  8995 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:15.180116  3970 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:15.181190  8745 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:15.181564  8745 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:15.181936  8745 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:15.184291  9056 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:15.184317  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.184980  9056 raft_consensus.cc:3055] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:15.185384  9056 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:15.156702  9075 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:15.186048  8741 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:15.186404  9075 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:29:15.186551  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.187394  4567 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:15.188973  8999 consensus_queue.cc:1059] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:29:15.190095  8999 raft_consensus.cc:3055] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:15.190469  8999 raft_consensus.cc:740] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:15.191250  8999 consensus_queue.cc:260] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.191550  9077 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:15.189666  3971 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:15.192376  8647 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:15.192931  8741 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:15.193307  8741 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:15.193760  8741 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:29:15.195029  3851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2672) took 1461 ms (client timeout 1687 ms). Trace:
W20260709 12:29:15.195608  3851 rpcz_store.cc:269] 0709 12:29:13.733120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:13.734693 (+  1573us) service_pool.cc:224] Handling call
0709 12:29:15.194815 (+1460122us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54001e6754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:15.194952 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417424128}
I20260709 12:29:15.199108  9116 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:15.199937  9042 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:15.192348  8999 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:15.138319  9115 consensus_queue.cc:1059] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:29:15.201215  9115 raft_consensus.cc:3055] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:15.201552  9115 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:15.202720  8978 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:15.204620  9027 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:15.220196  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:15.220911  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:15.154317  8894 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:15.218969  3971 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:15.162432  4536 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:15.226341  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 64098.5us
I20260709 12:29:15.227396  4536 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:15.217415  9133 log.cc:927] Time spent T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:29:15.241840  3971 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:15.258051  8997 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:15.258255  4536 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:15.264437  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.261107  9077 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:29:15.262106  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.300470  4003 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 16: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:15.262560  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.264400  4005 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:29:15.274559  4538 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.625s (SENT) [suppressed 14 similar messages]
I20260709 12:29:15.282325  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.290784  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:15.224504  8792 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.293001  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:15.264696  8966 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:15.295189  8856 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.257107  8898 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.288504  4001 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:15.299180  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:15.302596  3997 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 14: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:15.304702  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.264732  8978 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:29:15.265612  9027 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:15.307330  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:15.318617  4005 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:15.302274  9038 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:15.317162  8966 raft_consensus.cc:697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:15.291687  8894 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:15.321398  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.316349  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.348284  8898 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:15.348526  4566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1144) took 1436 ms. Trace:
I20260709 12:29:15.348979  8745 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.348927  4566 rpcz_store.cc:276] 0709 12:29:13.911997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:13.912855 (+   858us) service_pool.cc:224] Handling call
0709 12:29:14.013122 (+100267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:14.021492 (+  8370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:14.021527 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:14.025725 (+  4198us) log.cc:844] Serialized 26 byte log entry
0709 12:29:14.433753 (+408028us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:14.433801 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:14.433893 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:14.453967 (+ 20074us) raft_consensus.cc:1685] finished
0709 12:29:14.454002 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:15.348271 (+894269us) spinlock_profiling.cc:243] Waited 99.9 ms on lock 0x7b540048c950. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:15.348466 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7902,"raft.queue_time_us":9690,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":229858048,"thread_start_us":179590,"threads_started":1,"wal-append.queue_time_us":415708}
I20260709 12:29:15.365530  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:15.364451  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:15.365346  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:15.375128  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:15.400662  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:15.402288  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:15.404136  3932 raft_consensus.cc:2393] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:15.314445  8978 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:15.442509  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:15.301458  8997 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:15.440783  3931 raft_consensus.cc:2393] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:15.318464  9027 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:15.440830  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:15.437810  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:15.440981  9068 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:15.445575  8745 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:15.265305  9056 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.342375  8894 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:15.492784  3856 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
W20260709 12:29:15.474027  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 485204us
I20260709 12:29:15.437940  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:15.422700  9042 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:15.495090  9042 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.356279  9038 raft_consensus.cc:697] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:15.498148  9035 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:15.498392  8862 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:15.498682  9038 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.497572  9042 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:15.452633  8978 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:15.301832  9115 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:15.529855  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2682) took 1042 ms. Trace:
W20260709 12:29:15.536955  3850 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.016s	sys 0.025s
W20260709 12:29:15.537462  3850 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.016s	sys 0.025s
I20260709 12:29:15.537230  3848 rpcz_store.cc:276] 0709 12:29:14.487103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.502484 (+ 15381us) service_pool.cc:224] Handling call
0709 12:29:14.502813 (+   329us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:29:14.503255 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:14.503285 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:29:14.503984 (+   699us) log.cc:844] Serialized 78 byte log entry
0709 12:29:15.030023 (+526039us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:29:15.030082 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:15.030229 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:15.529495 (+499266us) raft_consensus.cc:1685] finished
0709 12:29:15.529530 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:15.529765 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16446,"raft.queue_time_us":12227,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":8581,"thread_start_us":287238,"threads_started":1,"wal-append.queue_time_us":573940}
I20260709 12:29:15.542498  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.506253  3932 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:15.474030  9027 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:15.535774  4005 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:15.567605  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.568333  4005 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:15.488250  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:15.355958  8741 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.582521  8278 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:15.583104  8278 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:15.507102  8894 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:15.583602  8278 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:15.584549  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 96369.3us
W20260709 12:29:15.553841  8770 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.025s	sys 0.038s
W20260709 12:29:15.600720  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 326203us
I20260709 12:29:15.604111  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.607420  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2679) took 1126 ms. Trace:
W20260709 12:29:15.608449  4537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.019s	sys 0.014s
W20260709 12:29:15.608825  4537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.019s	sys 0.014s
W20260709 12:29:15.604480  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:15.610056  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:15.611850  4006 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:15.569077  9056 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:15.510131  8896 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 12:29:15.566016  8647 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:15.566892  9077 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:15.486707  9068 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:15.536087  9035 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 12:29:15.563063  8990 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:29:15.614394  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:15.671767  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:15.724359  4568 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.007s	sys 0.027s
I20260709 12:29:15.634410  4537 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:15.689079  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:15.725994  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 111703us
I20260709 12:29:15.672739  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.727102  4005 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:15.728353  4003 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 14: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:29:15.603227  8770 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.026s	sys 0.038s
I20260709 12:29:15.640285  3822 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:15.613636  8954 consensus_meta.cc:287] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.001s
W20260709 12:29:15.684408  9128 log.cc:927] Time spent T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:29:15.727161  3969 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:29:15.724808  4568 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.007s	sys 0.027s
W20260709 12:29:15.723941  4571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.021s	sys 0.011s
I20260709 12:29:15.606758  9115 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:29:15.684307  9114 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 1.381s	user 0.000s	sys 0.013s
I20260709 12:29:15.761874  3969 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:15.658615  8991 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:15.690577  9130 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:15.615013  8756 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:15.691047  9134 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:15.762410  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 122218us
W20260709 12:29:15.760954  4571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.021s	sys 0.012s
I20260709 12:29:15.684110  9136 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:15.690845  9131 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:15.732870  9081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.012s	sys 0.014s
I20260709 12:29:15.608050  3850 rpcz_store.cc:276] 0709 12:29:14.481359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.481478 (+   119us) service_pool.cc:224] Handling call
0709 12:29:14.481873 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:29:14.498946 (+ 17073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:14.498992 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:29:14.499783 (+   791us) log.cc:844] Serialized 52 byte log entry
0709 12:29:14.998552 (+498769us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:15.563000 (+564448us) log.cc:844] Serialized 14 byte log entry
0709 12:29:15.563518 (+   518us) log.cc:844] Serialized 14 byte log entry
0709 12:29:15.606981 (+ 43463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:15.607089 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:15.607149 (+    60us) raft_consensus.cc:1685] finished
0709 12:29:15.607178 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:15.607344 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59560,"prepare.queue_time_us":773434,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":87,"raft.queue_time_us":26096,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":24537,"thread_start_us":1011601,"threads_started":2,"wal-append.queue_time_us":674073}
I20260709 12:29:15.773703  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.785753  4005 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
W20260709 12:29:15.758545  9111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.009s	sys 0.026s
I20260709 12:29:15.730028  9116 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:15.793406  4571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1196) took 2435 ms. Trace:
I20260709 12:29:15.692193  8792 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:15.771111  8856 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:15.656083  3932 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:15.770228  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.766644  9017 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:15.787379  3923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:29:15.799998  3923 raft_consensus.cc:606] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:15.730743  9077 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.771961  9119 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:15.773921  8770 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:15.729089  8647 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:15.811151  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.812336  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.813010  4003 raft_consensus.cc:2368] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 15. Current term is 16.
W20260709 12:29:15.797807  8999 consensus_meta.cc:287] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 12:29:15.789461  9003 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:29:15.812999  9075 consensus_meta.cc:287] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.001s
I20260709 12:29:15.768105  8954 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:29:15.785166  9081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.012s	sys 0.015s
W20260709 12:29:15.793313  9111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.010s	sys 0.027s
I20260709 12:29:15.800387  3923 raft_consensus.cc:614] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:15.787698  3897 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:15.775843  9138 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:15.824396  3999 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:15.794185  4571 rpcz_store.cc:276] 0709 12:29:13.351586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:13.351817 (+   231us) service_pool.cc:224] Handling call
0709 12:29:13.354030 (+  2213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:13.354306 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:29:13.378144 (+ 23838us) log.cc:844] Serialized 14 byte log entry
0709 12:29:15.153635 (+1775491us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b180041f080. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b7723a 00007fe051fe1a2a
0709 12:29:15.786719 (+633084us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:15.786773 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:29:15.786830 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:15.786897 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:15.786996 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9167,"prepare.queue_time_us":23661,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":40187,"spinlock_wait_cycles":7291264,"thread_start_us":623662,"threads_started":1,"wal-append.queue_time_us":2302944}
I20260709 12:29:15.612876  8966 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.803865  9119 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:15.785398  9136 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.820865  3850 raft_consensus.cc:1240] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:15.800595  8997 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:15.801692  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:15.837332  4005 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:15.826488  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:15.809087  8741 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:15.827710  3897 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:15.776746  9130 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:15.820204  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:15.789804  9131 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:15.777591  8891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.014s	sys 0.010s
I20260709 12:29:15.783774  9134 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.853457  3897 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:15.829542  8990 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:15.886761  3854 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:15.817932  9075 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.829980  9119 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:15.827539  9077 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:15.898098  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:15.896930  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:15.886996  9151 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:29:15.900280  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:15.900735  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.902841  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:15.822836  9003 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:15.905862  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 127105us
W20260709 12:29:15.906883  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:15.907083  3999 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:15.902915  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:15.907493  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2785) took 2105 ms. Trace:
W20260709 12:29:15.901207  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 349816us
I20260709 12:29:15.908439  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.910250  4005 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:15.911051  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.912050  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:15.887576  8997 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:15.829564  9138 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.907871  3924 rpcz_store.cc:276] 0709 12:29:13.793767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:13.794119 (+   352us) service_pool.cc:224] Handling call
0709 12:29:13.794445 (+   326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:29:13.794780 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:13.794806 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:29:13.822299 (+ 27493us) log.cc:844] Serialized 52 byte log entry
0709 12:29:14.027357 (+205058us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:14.036539 (+  9182us) log.cc:844] Serialized 14 byte log entry
0709 12:29:14.052101 (+ 15562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:14.052169 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:15.503556 (+1451387us) spinlock_profiling.cc:243] Waited 96.1 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:15.894735 (+391179us) raft_consensus.cc:1685] finished
0709 12:29:15.898465 (+  3730us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:15.898622 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5062,"prepare.queue_time_us":9255,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":5352,"raft.queue_time_us":23953,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":31320,"spinlock_wait_cycles":221015424,"thread_start_us":151439,"threads_started":1,"wal-append.queue_time_us":277150}
W20260709 12:29:15.914196  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 279906us
I20260709 12:29:15.895498  8990 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:15.920760  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:15.934314  4537 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:15.934626  4005 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 16: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:15.912976  8278 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:15.935429  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:15.936235  4005 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 12: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:15.938473  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.938642  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:15.938969  8923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.001s	sys 0.016s
I20260709 12:29:15.938918  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:15.939459  8923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.001s	sys 0.016s
I20260709 12:29:15.912916  8999 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:15.942094  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:15.911321  9146 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:15.942163  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.947115  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:15.896692  9143 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:29:15.951936  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.953274  8278 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:15.960039  4567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:29:15.960902  4567 raft_consensus.cc:606] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:15.961513  9160 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:29:15.950255  9077 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:15.962515  9077 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:15.962877  9077 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:15.966056  9111 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:29:15.966492  9155 log.cc:927] Time spent T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:29:15.954368  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.969076  4537 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:15.969415  4567 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:15.970494  4537 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:15.972491  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.960284  9068 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:15.966415  8647 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:15.913324  9038 consensus_queue.cc:1059] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:29:15.974308  4005 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:15.978169  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.979192  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:15.979830  4567 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:15.979759  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:15.980378  4565 raft_consensus.cc:3055] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:15.980669  4565 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:15.981324  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.981396  4565 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:15.982295  4573 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:15.982712  4565 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:15.984236  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.985332  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.987104  4005 raft_consensus.cc:1240] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:15.987648  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:15.988092  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:29:15.992192  4567 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:15.994690  4565 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:15.995101  4005 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:29:15.989977  9147 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:16.000078  9167 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:16.000149  9174 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:29:16.000974  9167 consensus_queue.cc:1059] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:16.002307  9174 consensus_queue.cc:1059] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:29:16.002948  9174 consensus_queue.cc:1243] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer 4eedd844c09d456ca0b3614490dd1dbb log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:29:15.975814  8990 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:15.944764  9035 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:29:16.014416  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:15.991171  9113 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.008s	sys 0.016s
I20260709 12:29:15.998162  9146 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:15.955084  9081 consensus_queue.cc:1059] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:29:16.033970  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:16.032615  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.018883  3897 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:16.004056  9134 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:16.008030  9168 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:29:16.081275  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 62488.7us
W20260709 12:29:16.051301  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:16.038702  9113 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.009s	sys 0.017s
I20260709 12:29:16.061615  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:16.047426  9158 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:29:16.111891  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 50361.3us
W20260709 12:29:16.048342  9139 log.cc:927] Time spent T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:29:16.033346  9038 raft_consensus.cc:3055] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:29:16.046887  9165 log.cc:927] Time spent T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:29:16.047964  9157 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:29:16.115130  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:16.125180  3822 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:16.127103  9081 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:29:16.127585  9081 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:16.127899  9119 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:16.128959  4005 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:16.082517  8856 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:16.018872  8990 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:16.129420  8923 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:29:16.046299  9161 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:29:16.116600  9068 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:29:16.121040  8894 consensus_meta.cc:287] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.003s
I20260709 12:29:16.130988  9068 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:16.131170  8894 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.131925  9068 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.133423  8894 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:16.128468  9081 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.135070  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:16.109583  9153 raft_consensus.cc:3055] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:16.106752  9168 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:16.138305  8891 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.148162  4569 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:16.129444  8856 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:16.117296  9038 raft_consensus.cc:740] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:16.164242  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:16.143010  8923 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:29:16.167119  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.141232  9153 raft_consensus.cc:740] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:16.055756  9146 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.148859  9175 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:29:16.180991  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:16.144105  9168 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:16.151600  9075 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:16.155001  8856 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:16.196053  4565 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:29:16.153894  8924 consensus_queue.cc:1059] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:29:16.196899  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:16.153956  8910 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:29:16.151985  8891 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.194720  8997 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:16.192430  9131 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:16.182312  9174 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:29:16.192765  8923 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:16.195367  9136 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:16.207419  8978 consensus_meta.cc:287] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.002s
I20260709 12:29:16.197237  9138 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:16.201067  9178 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:29:16.210626  9166 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:29:16.243858  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:16.246596  3857 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 12: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:16.216741  8924 raft_consensus.cc:3055] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:16.251363  8924 raft_consensus.cc:740] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:16.252234  8924 consensus_queue.cc:260] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:16.253609  8924 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:16.258464  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1298) took 1076 ms. Trace:
W20260709 12:29:16.259090  9172 log.cc:927] Time spent T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:29:16.258898  4574 rpcz_store.cc:276] 0709 12:29:15.182153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.182329 (+   176us) service_pool.cc:224] Handling call
0709 12:29:15.182760 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:15.587731 (+404971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:15.587780 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:15.590922 (+  3142us) log.cc:844] Serialized 26 byte log entry
0709 12:29:15.919800 (+328878us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:29:15.919836 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:15.919901 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:16.258256 (+338355us) raft_consensus.cc:1685] finished
0709 12:29:16.258275 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:16.258401 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6603,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":64,"thread_start_us":732728,"threads_started":2,"wal-append.queue_time_us":399222}
W20260709 12:29:16.250967  9027 consensus_meta.cc:287] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.662s	user 0.006s	sys 0.004s
I20260709 12:29:16.261193  9027 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.200542  9038 consensus_queue.cc:260] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.263046  9038 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:16.263366  9027 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:16.263597  8891 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:16.238610  9143 raft_consensus.cc:3055] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:29:16.258495  9180 log.cc:927] Time spent T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:29:16.213730  9153 consensus_queue.cc:260] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.216522  8923 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:16.288975  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 316880us
I20260709 12:29:16.290359  4537 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:16.280895  9143 raft_consensus.cc:740] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:29:16.292420  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 111505us
I20260709 12:29:16.294389  3897 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:16.296056  3969 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:16.285198  9119 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:16.298743  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:16.298936  3969 leader_election.cc:400] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12.
I20260709 12:29:16.305579  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2685) took 1022 ms. Trace:
I20260709 12:29:16.299866  8910 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.299862  8756 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:16.325102  9186 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:16.294100  9153 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:16.302407  9178 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:29:16.326201  9143 consensus_queue.cc:260] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:16.247092  8978 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.346843  4537 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:16.337044  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:16.293450  9056 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:16.339533  4002 rpcz_store.cc:276] 0709 12:29:15.282878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.965649 (+682771us) service_pool.cc:224] Handling call
0709 12:29:15.965995 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:15.966380 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:15.966412 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:15.966832 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 12:29:16.039570 (+ 72738us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:29:16.039643 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:16.039756 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:16.305443 (+265687us) raft_consensus.cc:1685] finished
0709 12:29:16.305456 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:16.305537 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1019,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":13571,"thread_start_us":72391,"threads_started":1,"wal-append.queue_time_us":196715}
I20260709 12:29:16.356128  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:16.307022  8896 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:16.343750  8910 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.351920  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:16.362411  3857 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:16.362950  9195 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:16.363221  4537 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:16.352799  8978 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:16.353453  9188 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:16.353955  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:16.335625  9174 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:16.356880  4002 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:16.366451  8978 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:16.367449  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:16.368039  4002 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:16.368799  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:16.369771  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:16.372411  4537 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:16.343500  9146 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:16.374187  3897 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:16.375108  4002 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 16: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:16.338553  9077 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.379200  3857 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:16.380312  3897 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:16.361943  9143 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:16.382632  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:16.382084  4002 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:16.387130  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:16.388845  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:16.391045  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:16.391438  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 746510us
I20260709 12:29:16.391793  4002 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:16.395102  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:16.395709  3929 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:16.377202  9138 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:16.376646  9174 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:29:16.398705  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:16.397457  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2688) took 1113 ms. Trace:
I20260709 12:29:16.400559  4001 rpcz_store.cc:276] 0709 12:29:15.283880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.310727 (+ 26847us) service_pool.cc:224] Handling call
0709 12:29:16.388654 (+1077927us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b58001b3f98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056f9d0a0 00007fe056f9c984 00007fe0505176d4 00007fe050517662
0709 12:29:16.397399 (+  8745us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9348864}
I20260709 12:29:16.392906  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:16.402606  3930 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14. Ops: [12.10-13.11]
I20260709 12:29:16.403883  3897 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:16.386502  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.406098  4537 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:16.408387  4002 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:29:16.413241  8990 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:16.414933  9038 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:16.386029  9146 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:16.415544  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:16.443583  4001 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:16.416023  8997 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:16.382369  9178 raft_consensus.cc:2764] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:29:16.397696  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:16.429924  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:16.379680  9181 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:29:16.449045  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:16.450278  3857 raft_consensus.cc:2393] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 15: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:16.451418  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:16.371325  8896 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.446686  3850 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:16.436466  3897 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:16.357412  9186 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.458817  4002 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:16.400162  8923 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:16.468076  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:16.452535  9171 log.cc:927] Time spent T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.411s	user 0.003s	sys 0.000s
I20260709 12:29:16.470901  9177 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:16.443295  9146 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:16.397646  9134 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:29:16.480850  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:16.481683  3848 raft_consensus.cc:2393] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 12: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:16.445695  9081 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.447317  8990 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:16.442921  9038 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:16.484186  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:16.488628  4001 raft_consensus.cc:2410] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:29:16.463991  9174 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:16.471446  9177 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:16.494887  4571 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: [13.11-14.12]
I20260709 12:29:16.482530  9146 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:16.498344  4574 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 12:29:16.505594  9189 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:29:16.514086  9199 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:29:16.515275  4001 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:29:16.498921  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:16.466231  9113 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:29:16.527590  9186 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:16.471575  9178 consensus_queue.cc:1059] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:29:16.487310  8896 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:16.498808  9173 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:29:16.489544  9038 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:16.492430  9196 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:16.519711  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:16.522745  9115 consensus_meta.cc:287] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.753s	user 0.010s	sys 0.002s
I20260709 12:29:16.522642  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2682) took 1241 ms. Trace:
W20260709 12:29:16.542130  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.499599  9177 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:16.542753  4006 rpcz_store.cc:276] 0709 12:29:15.281740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.281963 (+   223us) service_pool.cc:224] Handling call
0709 12:29:16.522469 (+1240506us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b540032ffd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:16.522583 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713123200}
I20260709 12:29:16.544466  4006 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 12:29:16.545061  9179 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
W20260709 12:29:16.545351  9147 consensus_meta.cc:287] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.001s
I20260709 12:29:16.545774  9147 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:16.523695  9168 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.489635  9081 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.546983  4573 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:16.547847  9081 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:16.536566  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:16.549504  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:16.550889  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:16.537207  4536 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:16.551771  3932 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:29:16.552251  4004 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
W20260709 12:29:16.534874  9162 log.cc:927] Time spent T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.574s	user 0.001s	sys 0.001s
I20260709 12:29:16.529309  9077 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:16.553772  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 96337.2us
I20260709 12:29:16.554761  3850 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:29:16.559514  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:16.534118  8973 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 12:29:16.554958  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 157351us
I20260709 12:29:16.529384  9173 raft_consensus.cc:3055] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:16.563169  9173 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:16.563848  8856 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.564237  9173 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.533068  8910 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:16.565608  3849 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:16.536065  9188 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:16.539233  9174 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:29:16.566360  9188 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.567256  9174 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:16.568491  9188 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:16.570199  9174 raft_consensus.cc:3055] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:16.570632  9174 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:16.571280  8856 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:16.571576  9174 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.573403  9174 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:16.561549  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:16.548480  9168 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:16.575026  3932 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 8.
I20260709 12:29:16.575932  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:16.590410  4574 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:16.536187  9101 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:16.591462  9101 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.593683  9101 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:16.578496  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:16.581085  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:16.594570  3923 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:16.538877  8990 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:29:16.598953  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:16.577095  9147 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:29:16.600400  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:16.603812  4574 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:16.606302  9147 raft_consensus.cc:697] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:16.607266  9147 consensus_queue.cc:237] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.571439  9038 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.612402  9038 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:16.614530  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:16.615154  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:16.615837  3850 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:16.602165  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:16.602943  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:16.588121  9146 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.625391  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:16.627562  9177 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:16.638093  8966 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.002s	sys 0.006s
W20260709 12:29:16.639024  8966 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.002s	sys 0.006s
I20260709 12:29:16.986908  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:16.990757  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:16.991520  3929 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 14: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:16.992882  9174 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:16.993724  9174 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:16.997078  9174 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:17.013833  9003 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:17.021730  9174 raft_consensus.cc:3055] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:17.022589  9174 raft_consensus.cc:740] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:17.024600  9174 consensus_queue.cc:260] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:17.026716  9174 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:29:17.040196  9150 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 1.090s	user 0.002s	sys 0.002s
I20260709 12:29:17.048311  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2262) took 2607 ms. Trace:
I20260709 12:29:17.048895  3854 rpcz_store.cc:276] 0709 12:29:14.440271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.441959 (+  1688us) service_pool.cc:224] Handling call
0709 12:29:14.479719 (+ 37760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:15.887232 (+1407513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:17.047630 (+1160398us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54002ed954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:17.048061 (+   431us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3235386752}
I20260709 12:29:17.049736  8999 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:17.050530  8999 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:17.056793  9118 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:17.057709  9118 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:17.058372  9101 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:17.059186  9101 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.056619  8669 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.061803  9101 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:17.060540  9118 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:17.061408  8669 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:17.065310  8669 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:17.077802  8999 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:17.082996  3999 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 959) took 2548 ms (client timeout 1713 ms). Trace:
W20260709 12:29:17.083585  3999 rpcz_store.cc:269] 0709 12:29:14.534419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.576084 (+ 41665us) service_pool.cc:224] Handling call
0709 12:29:17.082473 (+2506389us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000c4c54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:17.082679 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2481548544}
I20260709 12:29:17.087625  9209 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:17.088521  9209 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.091176  9209 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:17.091691  9209 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:17.085590  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:17.111214  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 1155) took 1172 ms. Trace:
I20260709 12:29:17.109964  9209 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.111691  4569 rpcz_store.cc:276] 0709 12:29:15.938870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.951638 (+ 12768us) service_pool.cc:224] Handling call
0709 12:29:17.110753 (+1159115us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54004880d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:17.110941 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449446656}
I20260709 12:29:17.116295  9209 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:17.116979  8999 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:17.121894  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.122861  8647 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.123728  8647 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.126165  8647 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:17.142683  9177 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:17.149763  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:17.158241  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:17.159227  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:17.166905  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.169396  4569 raft_consensus.cc:1240] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: []
I20260709 12:29:17.169344  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:17.170285  4574 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:17.171767  9200 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.172472  9200 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.178900  9200 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:17.180776  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:17.181555  4567 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:17.181835  9130 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:17.185374  8647 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:17.191043  4572 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:29:17.191282  8647 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.197547  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:17.206580  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:17.208473  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:17.208861  9170 log.cc:927] Time spent T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 1.247s	user 0.003s	sys 0.000s
I20260709 12:29:17.211282  4569 raft_consensus.cc:2368] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12.
I20260709 12:29:17.209168  4574 raft_consensus.cc:2410] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:29:17.208750  9111 raft_consensus.cc:3055] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:17.218560  9111 raft_consensus.cc:740] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:17.220573  9111 consensus_queue.cc:260] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.216604  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:17.224118  9210 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.224968  9210 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.225322  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:17.226706  3928 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:17.216971  8647 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:17.229204  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:17.228615  4568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1291) took 2115 ms. Trace:
I20260709 12:29:17.237286  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:17.239346  4569 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:29:17.243211  4572 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:17.247315  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:17.255651  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:17.256584  3928 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:17.233596  4568 rpcz_store.cc:276] 0709 12:29:15.112554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.112715 (+   161us) service_pool.cc:224] Handling call
0709 12:29:15.113183 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:15.113661 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:29:15.767812 (+654151us) log.cc:844] Serialized 14 byte log entry
0709 12:29:15.904599 (+136787us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:15.905052 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:29:15.905208 (+   156us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:15.905239 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:15.905306 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:17.207931 (+1302625us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:17.227731 (+ 19800us) raft_consensus.cc:1685] finished
0709 12:29:17.227897 (+   166us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:17.228116 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":91950,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":76948,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":8162,"spinlock_wait_cycles":13031680,"thread_start_us":742779,"threads_started":2,"wal-append.queue_time_us":162957}
I20260709 12:29:17.259157  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:17.260452  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:17.261490  4568 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:17.265057  4567 raft_consensus.cc:2468] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
W20260709 12:29:17.254792  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 115064us
I20260709 12:29:17.282447  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:17.284780  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:17.291414  4569 raft_consensus.cc:2368] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 15. Current term is 16.
I20260709 12:29:17.290879  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:17.296221  9174 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:17.296343  4570 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
W20260709 12:29:17.296783  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.297178  9174 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.300496  9174 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:17.275660  9111 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:17.308475  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2683) took 1758 ms. Trace:
I20260709 12:29:17.310391  4005 rpcz_store.cc:276] 0709 12:29:15.543878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:16.007256 (+463378us) service_pool.cc:224] Handling call
0709 12:29:16.015343 (+  8087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:16.129351 (+114008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:17.301500 (+1172149us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540032c654. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:17.301832 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260878208}
W20260709 12:29:17.313297  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.314512  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:17.324021  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:17.324644  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:17.327265  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:17.329125  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:17.331454  4569 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:29:17.332024  3848 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:29:17.333009  9210 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:17.336779  3852 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:29:17.338208  4570 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:17.342196  9063 consensus_queue.cc:1059] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:29:17.346227  4569 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:17.347958  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:17.343743  9063 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:29:17.353000  9003 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:29:17.355207  9210 raft_consensus.cc:3055] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:29:17.358897  8992 raft_consensus.cc:3055] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:17.359007  3969 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:17.359411  8992 raft_consensus.cc:740] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:17.360801  8992 consensus_queue.cc:260] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.374219  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:17.376371  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:17.377190  3931 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:17.379021  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:17.379730  3931 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:17.356776  4536 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:17.381732  8992 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:17.382915  9056 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:29:17.383360  9147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.007s	sys 0.011s
I20260709 12:29:17.383378  9056 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:29:17.383903  9147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.007s	sys 0.011s
I20260709 12:29:17.385205  4567 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: []
I20260709 12:29:17.385246  9056 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:17.363049  3971 leader_election.cc:400] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12.
I20260709 12:29:17.365585  3930 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:29:17.367769  3932 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:29:17.370994  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:17.361634  8898 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:17.393631  9146 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:17.398319  4574 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:29:17.400704  3971 leader_election.cc:403] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:29:17.400394  3929 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:17.355753  9210 raft_consensus.cc:740] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:17.430601  8898 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:17.442741  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:17.451088  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2691) took 1675 ms. Trace:
I20260709 12:29:17.451689  4000 rpcz_store.cc:276] 0709 12:29:15.775167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:16.039498 (+264331us) service_pool.cc:224] Handling call
0709 12:29:16.039860 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:16.040203 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:29:16.116126 (+ 75923us) log.cc:844] Serialized 14 byte log entry
0709 12:29:17.435881 (+1319755us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b18004c1140. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe051b7f4bc 00007fe04eecd48b 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b7723a
0709 12:29:17.450295 (+ 14414us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:17.450433 (+   138us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:29:17.450534 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:17.450647 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:17.450881 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8370,"prepare.queue_time_us":74163,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":4539,"raft.queue_time_us":11708,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":156,"spinlock_wait_cycles":9215872,"thread_start_us":30213,"threads_started":1,"wal-append.queue_time_us":90342,"wal-append.run_cpu_time_us":3584,"wal-append.run_wall_time_us":1177635}
I20260709 12:29:17.462574  3852 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:29:17.472728  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 109953us
I20260709 12:29:17.475090  8647 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:17.475876  8647 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.478132  9196 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:29:17.489147  3971 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:17.495754  9027 raft_consensus.cc:2804] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:17.498232  9027 raft_consensus.cc:697] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:17.499501  9027 consensus_queue.cc:237] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.500691  8647 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:17.504132  3822 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:17.505303  8278 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:29:17.505802  3822 leader_election.cc:400] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 15. Current term is 16.
I20260709 12:29:17.521994  3822 leader_election.cc:403] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:29:17.523042  9154 raft_consensus.cc:3060] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:29:17.512110  4004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2686) took 2228 ms (client timeout 2009 ms). Trace:
W20260709 12:29:17.527346  4004 rpcz_store.cc:269] 0709 12:29:15.283197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.317662 (+ 34465us) service_pool.cc:224] Handling call
0709 12:29:17.511621 (+2193959us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540021a2d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:17.511841 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2781586816}
W20260709 12:29:17.508750  9127 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 2.207s	user 0.005s	sys 0.000s
W20260709 12:29:17.533589  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 931351us
I20260709 12:29:17.536882  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:17.537931  4574 raft_consensus.cc:2410] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:29:17.538457  8995 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:17.538968  8995 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:17.539410  8995 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:17.543262  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:17.543468  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:17.544245  4566 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:17.545022  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:17.545235  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:17.545504  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:17.545966  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2683) took 2263 ms. Trace:
I20260709 12:29:17.546522  4570 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:29:17.546430  3997 rpcz_store.cc:276] 0709 12:29:15.282230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:15.319619 (+ 37389us) service_pool.cc:224] Handling call
0709 12:29:17.544192 (+2224573us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b58001b3f98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056f9d0a0 00007fe056f9c984 00007fe0505176d4 00007fe050517662
0709 12:29:17.545905 (+  1713us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5143936}
I20260709 12:29:17.547797  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:17.548134  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:17.548727  9146 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:17.549402  3999 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:17.549657  9146 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.550294  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:17.551255  4000 raft_consensus.cc:2410] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:29:17.549062  4005 raft_consensus.cc:2393] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:17.546132  4568 raft_consensus.cc:2393] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:17.553141  9146 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:17.506408  9131 raft_consensus.cc:3055] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:17.554322  9131 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:17.555764  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2709) took 1015 ms. Trace:
I20260709 12:29:17.556200  4001 rpcz_store.cc:276] 0709 12:29:16.539984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:16.547891 (+  7907us) service_pool.cc:224] Handling call
0709 12:29:16.548172 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:16.548493 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:16.548532 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:16.549019 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:29:16.624816 (+ 75797us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:29:16.624858 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:16.624925 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:17.555270 (+930345us) raft_consensus.cc:1685] finished
0709 12:29:17.555320 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:17.555561 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3388,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":1332,"thread_start_us":73800,"threads_started":1,"wal-append.queue_time_us":100089}
I20260709 12:29:17.557545  9131 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.560904  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:17.507391  8822 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:17.548203  4574 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:29:17.561597  4004 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:17.580199  3854 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: []
I20260709 12:29:17.581805  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:17.583807  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:17.567871  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 78866.7us
W20260709 12:29:17.571053  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.570873  4571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1162) took 1018 ms. Trace:
W20260709 12:29:17.563131  3923 consensus_meta.cc:287] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.968s	user 0.016s	sys 0.000s
I20260709 12:29:17.578186  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42178 (request call id 1158) took 1195 ms. Trace:
I20260709 12:29:17.581123  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:17.600463  4571 rpcz_store.cc:276] 0709 12:29:16.552733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:16.553006 (+   273us) service_pool.cc:224] Handling call
0709 12:29:16.553295 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:17.381146 (+827851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:17.381215 (+    69us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:17.381281 (+    66us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:17.381330 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:17.570441 (+189111us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b54004f01d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:17.570489 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:17.570683 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1902572800}
I20260709 12:29:17.582653  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:17.585353  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:17.559363  9131 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:17.605978  3971 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:17.566480  8822 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:17.611330  8822 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:17.593163  8995 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.611845  3853 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:29:17.568637  9100 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:17.613304  9100 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.613837  8995 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:17.603111  4573 rpcz_store.cc:276] 0709 12:29:16.382261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:16.382401 (+   140us) service_pool.cc:224] Handling call
0709 12:29:17.577826 (+1195425us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54004cbdd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:17.578007 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369947392}
I20260709 12:29:17.570338  9210 consensus_queue.cc:260] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.615865  9100 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:17.616997  9210 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:17.606040  9177 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:17.618041  8745 consensus_queue.cc:1059] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:29:17.617956  9177 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.618264  9075 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:29:17.619258  8745 raft_consensus.cc:3055] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:29:17.619714  8745 raft_consensus.cc:740] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:17.617957  3969 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:17.620553  9177 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:17.620831  8745 consensus_queue.cc:260] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.621619  8647 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:17.622561  8647 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:17.622906  3971 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:17.623095  8647 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:17.624017  3851 raft_consensus.cc:2376] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11. Re-sending same reply.
I20260709 12:29:17.624191  8647 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.624857  3971 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:17.625308  8760 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:29:17.569582  9161 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 1.236s	user 0.003s	sys 0.000s
I20260709 12:29:17.625765  8741 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:29:17.570870  9118 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.626837  9118 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:17.617009  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.629240  9118 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:17.629933  9115 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:17.569108  9174 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:17.632238  9174 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:17.607738  3923 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:17.589489  8898 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12.
I20260709 12:29:17.655663  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:17.660145  3999 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:17.642279  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:17.663442  8745 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:17.666811  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:17.661600  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:17.673259  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.677343  3923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54068 (request call id 1166) took 1091 ms. Trace:
I20260709 12:29:17.657997  9075 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.677819  3923 rpcz_store.cc:276] 0709 12:29:16.580543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:16.580714 (+   171us) service_pool.cc:224] Handling call
0709 12:29:17.665736 (+1085022us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:17.683197  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:17.684114  3930 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
W20260709 12:29:17.690217  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:17.692320  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.702210  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:17.703902  9138 raft_consensus.cc:993] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:29:17.704592  9138 raft_consensus.cc:1081] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:29:17.709164  3969 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:17.716193  4572 raft_consensus.cc:2410] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:29:17.671277  9115 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:29:17.719626  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 193007us
I20260709 12:29:17.725121  9068 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:29:17.725688  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe560 after lost signal to thread 2679
I20260709 12:29:17.725159  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:17.757956  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:17.727108  8760 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:29:17.780489  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:17.786871  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.765437  9115 raft_consensus.cc:697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:17.725994  9068 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:17.720351  9075 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:17.790982  3895 leader_election.cc:336] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Timed out: RequestConsensusVote RPC to 127.2.157.1:32843 timed out after 1.687s (SENT)
I20260709 12:29:17.795315  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:17.789763  9154 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 15. Current term is 16.
W20260709 12:29:17.806665  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.815472  3924 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:29:17.822086  3821 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:17.819618  9190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.362s	user 0.010s	sys 0.034s
I20260709 12:29:17.799345  9218 consensus_queue.cc:1059] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:29:17.852134  8924 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:17.853005  8924 consensus_queue.cc:1059] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:17.854300  9215 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.854955  9215 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.855814  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 1152) took 3032 ms. Trace:
I20260709 12:29:17.856755  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 1153) took 2970 ms. Trace:
W20260709 12:29:17.857090  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 75738.7us
W20260709 12:29:17.858305  9144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.846s	user 0.020s	sys 0.007s
W20260709 12:29:17.846726  9190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.497s	user 0.011s	sys 0.034s
W20260709 12:29:17.868403  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 44751.4us
I20260709 12:29:17.826339  9174 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:17.847368  9117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.786s	user 0.013s	sys 0.017s
I20260709 12:29:17.875254  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:17.872408  3897 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:17.858752  9144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.907s	user 0.020s	sys 0.007s
I20260709 12:29:17.876240  3857 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
W20260709 12:29:17.879253  9117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.915s	user 0.014s	sys 0.018s
I20260709 12:29:17.856249  3927 rpcz_store.cc:276] 0709 12:29:14.823732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.823884 (+   152us) service_pool.cc:224] Handling call
0709 12:29:14.824216 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:14.890343 (+ 66127us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:29:15.226154 (+335811us) log.cc:844] Serialized 14 byte log entry
0709 12:29:15.684532 (+458378us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:15.684613 (+    81us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:29:15.684709 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:17.826379 (+2141670us) spinlock_profiling.cc:243] Waited 65.8 ms on lock 0x7b54000d4b54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:17.845219 (+ 18840us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:17.855587 (+ 10368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35326,"prepare.queue_time_us":673774,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":2664,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":34744,"spinlock_wait_cycles":151374720,"thread_start_us":763155,"threads_started":2,"wal-append.queue_time_us":456450,"wal-append.run_cpu_time_us":3182,"wal-append.run_wall_time_us":1509898}
W20260709 12:29:17.888236  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 169829us
W20260709 12:29:17.889613  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 81285.6us
I20260709 12:29:17.869012  9215 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:17.857182  3926 rpcz_store.cc:276] 0709 12:29:14.886539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.891293 (+  4754us) service_pool.cc:224] Handling call
0709 12:29:14.920381 (+ 29088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:15.039206 (+118825us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:29:15.538288 (+499082us) log.cc:844] Serialized 14 byte log entry
0709 12:29:15.953042 (+414754us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:15.953092 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:15.953156 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:17.352344 (+1399188us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b180025f600. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:29:17.856322 (+503978us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54002bd254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:17.856375 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:17.856589 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":177,"prepare.queue_time_us":575595,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":49,"raft.queue_time_us":37401,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":17110,"spinlock_wait_cycles":276396160,"thread_start_us":881183,"threads_started":3,"wal-append.queue_time_us":436524}
I20260709 12:29:17.891081  3821 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:17.894429  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 169303us
I20260709 12:29:17.895327  4536 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:17.873098  9056 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.924481  3897 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:17.894174  9146 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:29:17.925165  3850 consensus_meta.cc:287] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.189s	user 0.016s	sys 0.000s
I20260709 12:29:17.934883  3850 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
W20260709 12:29:17.935308  9221 log.cc:927] Time spent T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:29:17.935727  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 2280) took 1321 ms. Trace:
I20260709 12:29:17.936219  3850 rpcz_store.cc:276] 0709 12:29:16.614778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:16.614909 (+   131us) service_pool.cc:224] Handling call
0709 12:29:17.935602 (+1320693us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:29:17.939960  8822 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:17.942711  9217 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:29:17.942900  9215 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.943017  4567 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:29:17.931921  9146 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:17.943776  9075 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:17.942778  9220 log.cc:927] Time spent T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:29:17.969167  9215 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:17.969172  9146 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:17.994076  8978 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:18.006888  9225 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:29:18.009474  9223 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:29:18.031988  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:18.036021  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 110946us
W20260709 12:29:18.056854  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:18.073153  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:17.996428  9174 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:17.968859  9230 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:18.074663  9229 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.074812  9230 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:18.074903  9232 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:17.926061  9115 consensus_queue.cc:237] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:18.075301  9229 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.075635  9232 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.077500  9229 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:18.063123  3897 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:18.067788  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 176638us
W20260709 12:29:18.070418  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.085278  4004 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:18.081810  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 2274) took 1562 ms. Trace:
I20260709 12:29:18.132871  3998 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:18.079023  4572 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: []
W20260709 12:29:18.078821  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.156442  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:18.063521  9144 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.142104  3969 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:18.196547  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 241418us
I20260709 12:29:18.141180  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.190141  3849 rpcz_store.cc:276] 0709 12:29:16.519176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:16.519306 (+   130us) service_pool.cc:224] Handling call
0709 12:29:18.081498 (+1562192us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b5400377654. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:18.081641 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60723456}
I20260709 12:29:18.068869  9111 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:18.082015  9035 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.078176  9138 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:18.203460  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.077833  9232 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:18.145923  9226 log.cc:927] Time spent T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.189s	user 0.004s	sys 0.004s
W20260709 12:29:18.215924  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.146252  3821 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:18.078549  8918 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:18.133155  9219 log.cc:927] Time spent T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.214s	user 0.004s	sys 0.011s
I20260709 12:29:18.087605  9174 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:18.079560  9134 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:18.206439  8745 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:18.146534  9235 raft_consensus.cc:3055] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:18.079579  9154 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.141s
W20260709 12:29:18.202137  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 111347us
I20260709 12:29:18.147797  9056 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:18.150580  8822 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:18.146893  9214 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.299s	user 0.009s	sys 0.000s
I20260709 12:29:18.203331  9229 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:29:18.150621  9146 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.206004  9068 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:18.206534  9111 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:18.225816  3857 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:18.270689  3897 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:18.248091  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.077986  8978 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:18.274814  9131 consensus_meta.cc:287] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.000s
I20260709 12:29:18.273711  8918 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:18.275453  9131 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:18.276096  9131 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.270947  9239 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:18.277192  8918 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:18.219904  9138 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.280294  9138 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:18.115866  9230 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:18.287652  9230 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:29:18.290081  9217 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:29:18.291895  4538 leader_election.cc:336] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.591s (SENT)
I20260709 12:29:18.293920  9236 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.294765  9236 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:18.296984  9236 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:18.302307  9131 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:18.273335  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 127167us
I20260709 12:29:18.303421  3821 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:18.304278  9173 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:18.304773  3821 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:18.275463  8978 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:18.225425  9063 consensus_queue.cc:1059] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 12:29:18.310745  9063 raft_consensus.cc:3055] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:18.310905  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.311221  9063 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:18.311590  4004 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:29:18.312649  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:18.312325  9063 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:18.311739  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.220781  9134 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:18.302455  8894 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:18.316356  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.225826  9215 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:18.315598  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:18.315153  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:18.221642  9235 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:18.315979  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:18.314725  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.305764  3821 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:18.221319  9035 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.313805  9230 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:18.334698  8894 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:18.336577  9112 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:18.333076  4003 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:29:18.314328  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.313699  9063 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:18.221118  9174 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:29:18.340476  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 117449us
I20260709 12:29:18.269233  9229 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:18.317039  9111 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:18.332492  9134 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:18.355322  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:18.355870  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:18.221786  9075 consensus_queue.cc:1059] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 12:29:18.385123  4570 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:18.356570  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:18.357239  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:18.358037  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:18.358901  4005 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:18.359813  8894 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:18.360599  9035 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:18.388352  4537 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:18.388592  9035 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:18.347144  9230 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:18.389235  9230 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:18.363332  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:18.364957  9187 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.366496  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:18.366601  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.385907  3997 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:18.348114  9131 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:18.371022  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:18.372428  4538 leader_election.cc:336] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.625s (SENT)
I20260709 12:29:18.372798  9146 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:18.391739  4001 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 9.
W20260709 12:29:18.395383  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 125151us
I20260709 12:29:18.394107  4006 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:18.399686  9215 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:29:18.402776  4538 leader_election.cc:336] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.638s (SENT)
W20260709 12:29:18.404024  4538 leader_election.cc:336] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.713s (SENT)
I20260709 12:29:18.404390  3997 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:18.376190  3970 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:18.380358  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.380285  8918 consensus_queue.cc:1059] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:29:18.383163  9229 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:18.332926  8745 raft_consensus.cc:697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:18.349097  9112 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:29:18.386551  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 80910.6us
I20260709 12:29:18.387648  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.388686  9239 raft_consensus.cc:2764] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:29:18.390396  4000 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:18.345715  3999 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:18.389935  4569 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:18.367560  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.223404  9144 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:18.406226  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 262577us
I20260709 12:29:18.457410  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.388988  9035 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:18.421773  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 944) took 3928 ms. Trace:
I20260709 12:29:18.459956  4005 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:29:18.464449  4574 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:29:18.461550  3851 raft_consensus.cc:1275] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:29:18.393985  9131 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:18.431291  3969 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:18.434266  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 46027us
I20260709 12:29:18.435050  9235 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.442296  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.463410  3998 rpcz_store.cc:276] 0709 12:29:14.493220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.495635 (+  2415us) service_pool.cc:224] Handling call
0709 12:29:14.503987 (+  8352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:18.201998 (+3698011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:18.421469 (+219471us) spinlock_profiling.cc:243] Waited 3.49 s on lock 0x7b5400128754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:18.421687 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8034202368}
I20260709 12:29:18.422863  9146 raft_consensus.cc:3055] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:29:18.491770  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 424261us
I20260709 12:29:18.495898  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.498756  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:18.502542  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.503273  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:18.501255  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 70082.9us
I20260709 12:29:18.443970  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:18.511754  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:18.513433  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 69559us
I20260709 12:29:18.513674  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.504527  4001 raft_consensus.cc:2376] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15. Re-sending same reply.
I20260709 12:29:18.458967  9112 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:18.515246  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.516358  3857 raft_consensus.cc:2410] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:29:18.511426  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:18.519523  4005 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:18.471810  9035 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:18.499593  9131 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:18.527848  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.393553  9187 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:18.529592  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.529014  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:18.502002  9027 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.538795  3853 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:18.542352  3856 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
W20260709 12:29:18.545584  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 169667us
I20260709 12:29:18.546931  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:18.538242  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.547174  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:18.541508  3997 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:18.543485  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.546434  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.548714  4006 raft_consensus.cc:2376] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14. Re-sending same reply.
I20260709 12:29:18.548882  3998 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:18.549614  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.550755  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.550449  9230 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.500278  9146 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:18.552718  9230 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:18.552388  9146 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:18.515303  8992 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:18.511281  9210 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:18.541950  3851 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:18.526265  8898 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:18.566183  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.573951  3997 raft_consensus.cc:2376] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11. Re-sending same reply.
I20260709 12:29:18.574993  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.576490  3997 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:29:18.577435  9173 consensus_queue.cc:1059] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:18.570806  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.577831  3997 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:29:18.587919  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:18.588423  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 48884.7us
W20260709 12:29:18.581993  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 55027us
W20260709 12:29:18.585487  3786 debug-util.cc:398] Leaking SignalData structure 0x7b080034a620 after lost signal to thread 3789
I20260709 12:29:18.543689  3999 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:18.558701  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:18.559648  9146 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:18.559829  3998 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:18.561972  9110 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:29:18.562093  9111 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:18.534150  9239 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:29:18.553795  9075 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:29:18.563115  8745 consensus_queue.cc:237] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:18.564350  4565 raft_consensus.cc:2410] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:29:18.566237  9027 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:18.668846  3970 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:18.566845  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:18.669831  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08002f5e60 after lost signal to thread 3881
I20260709 12:29:18.572872  9210 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:18.551514  4006 raft_consensus.cc:2410] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:29:18.581633  9235 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:18.578543  9173 raft_consensus.cc:3055] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:29:18.643069  4000 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:18.642118  9132 raft_consensus.cc:3055] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:18.586056  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.587183  4536 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:18.655403  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 100532us
W20260709 12:29:18.654307  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.656440  4002 raft_consensus.cc:2376] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12. Re-sending same reply.
I20260709 12:29:17.746217  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:29:18.662071  3852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.018s	sys 0.016s
W20260709 12:29:18.680233  3852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.018s	sys 0.016s
I20260709 12:29:18.657195  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:18.662432  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.669947  4001 raft_consensus.cc:2368] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 15. Current term is 16.
W20260709 12:29:18.571333  4538 leader_election.cc:336] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.903s (SENT)
I20260709 12:29:18.585286  9187 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:18.675197  3849 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: []
W20260709 12:29:18.675383  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08002eae80 after lost signal to thread 3956
I20260709 12:29:18.657893  8918 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.656545  9144 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:18.688107  4000 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:18.688656  3853 raft_consensus.cc:2368] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14.
W20260709 12:29:18.676990  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 89856.1us
W20260709 12:29:18.694768  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08003ac240 after lost signal to thread 4030
W20260709 12:29:18.695384  3786 debug-util.cc:398] Leaking SignalData structure 0x7b080000ffa0 after lost signal to thread 4031
I20260709 12:29:18.697574  4004 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:18.674844  9210 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:18.707197  3997 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:29:18.677639  9132 raft_consensus.cc:740] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:18.715309  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.679278  9173 raft_consensus.cc:740] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:18.724972  4002 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:29:18.726729  3851 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:18.697310  9236 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:18.709980  3997 pending_rounds.cc:85] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 9
W20260709 12:29:18.719803  4565 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 1301) took 2100 ms (client timeout 1920 ms). Trace:
W20260709 12:29:18.732586  4565 rpcz_store.cc:269] 0709 12:29:16.602214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:16.602735 (+   521us) service_pool.cc:224] Handling call
0709 12:29:18.696345 (+2093610us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b540052c454. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:18.702542 (+  6197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4398059392}
W20260709 12:29:18.714222  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5de0 after lost signal to thread 4598
I20260709 12:29:18.707347  9187 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.743757  3857 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: []
W20260709 12:29:18.764189  3786 debug-util.cc:398] Leaking SignalData structure 0x7b08003886e0 after lost signal to thread 4599
I20260709 12:29:18.698920  8918 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:18.731992  3997 pending_rounds.cc:107] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:29:18.772692  3997 raft_consensus.cc:2889] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:18.769217  9187 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:18.784170  9187 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:18.786309  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.786592  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.787123  3853 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:18.787930  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.788424  3850 raft_consensus.cc:1240] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 12:29:18.789040  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.789507  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.790388  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.790952  9248 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:18.791462  9111 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:18.802618  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:18.793638  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 286566us
W20260709 12:29:18.808588  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:18.813182  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 47719.2us
W20260709 12:29:18.816027  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 157976us
W20260709 12:29:18.816735  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 245457us
I20260709 12:29:18.819681  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:18.820636  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:18.821502  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 164399us
I20260709 12:29:18.822417  3897 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:18.821236  3853 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:18.823789  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.821897  3969 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:18.816905  3930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 1173) took 1010 ms. Trace:
I20260709 12:29:18.792549  9173 consensus_queue.cc:260] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.835966  3930 rpcz_store.cc:276] 0709 12:29:17.806872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:17.807063 (+   191us) service_pool.cc:224] Handling call
0709 12:29:17.842839 (+ 35776us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:29:17.864126 (+ 21287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:17.864206 (+    80us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:29:17.891592 (+ 27386us) log.cc:844] Serialized 52 byte log entry
0709 12:29:18.197812 (+306220us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:29:18.673383 (+475571us) log.cc:844] Serialized 14 byte log entry
0709 12:29:18.816409 (+143026us) log.cc:844] Serialized 14 byte log entry
0709 12:29:18.816611 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:18.816685 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:18.816723 (+    38us) raft_consensus.cc:1685] finished
0709 12:29:18.816735 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:18.816849 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":613843,"raft.queue_time_us":135505,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":11782,"thread_start_us":856793,"threads_started":3,"wal-append.queue_time_us":468063}
I20260709 12:29:18.819252  9248 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:18.881130  3857 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:29:18.883093  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.844784  9209 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:18.817401  9075 consensus_queue.cc:1048] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:29:18.890269  8278 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.883759  3853 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:18.869867  9168 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:18.832063  8647 consensus_queue.cc:1059] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:29:18.863636  9144 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:18.860911  8894 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:29:18.879266  8992 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.900410  3850 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:18.893007  8278 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.915169  3970 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:18.888989  9209 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:18.920015  9209 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:18.920807  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.921476  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.922187  3848 raft_consensus.cc:2368] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14.
I20260709 12:29:18.922919  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.927083  9201 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:18.927605  9201 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.929596  9201 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:18.825587  9132 consensus_queue.cc:260] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.919199  9144 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.919904  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.946936  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.931541  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.918437  9229 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.895845  9138 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:18.879992  9035 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:18.945986  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:18.946682  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.917987  8278 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:18.948046  3850 raft_consensus.cc:2393] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:18.898686  9168 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:18.911943  9063 consensus_meta.cc:287] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.561s	user 0.001s	sys 0.010s
I20260709 12:29:18.964568  3849 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
W20260709 12:29:18.969223  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 61872.1us
I20260709 12:29:18.970098  9038 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:18.974849  9247 log.cc:927] Time spent T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:29:18.995198  4005 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:18.975036  9131 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.930884  9266 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:18.892683  9134 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.971648  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.991310  3853 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:18.960005  8647 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:19.011272  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:19.016714  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:19.026723  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:18.943610  8992 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:18.983095  9168 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:18.992813  8745 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:19.032210  9266 raft_consensus.cc:697] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:19.034577  9266 consensus_queue.cc:237] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.032164  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:18.988499  8741 raft_consensus.cc:3055] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:18.990638  9027 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:18.993491  9132 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:19.037320  4538 leader_election.cc:336] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 2.034s (SENT)
I20260709 12:29:19.054862  4538 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:19.055739  3970 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:19.056352  4569 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: []
W20260709 12:29:19.058773  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:19.061509  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 239150us
I20260709 12:29:19.062924  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:19.072719  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:19.078034  9056 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:19.078719  9056 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.078995  3970 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:19.081027  9056 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:29:19.082266  9144 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:19.085439  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.086133  3930 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:19.086264  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:19.088001  3926 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:19.085448  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:19.089222  3850 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:19.011649  9138 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.072947  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:19.086050  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:19.088658  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:18.844066  3750 catalog_manager.cc:5697] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 4 to 7, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 7 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:19.094802  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:19.094828  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:19.090795  3854 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:19.008162  9038 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:19.069633  9250 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:29:19.090534  4565 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:19.054626  8741 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:19.103719  3927 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:29:19.101759  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 88215.4us
I20260709 12:29:19.101497  3930 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:29:19.106345  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.105500  9056 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.074913  9258 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:29:19.099229  9262 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:29:19.104346  3930 pending_rounds.cc:85] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 11
I20260709 12:29:19.125833  3930 pending_rounds.cc:107] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:29:19.126161  3930 raft_consensus.cc:2889] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:29:19.094069  3822 connection.cc:256] RPC call timeout handler was delayed by -1.0583354549999058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
I20260709 12:29:19.115343  3932 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 9. Current term is 10. Ops: []
I20260709 12:29:19.070165  9003 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:19.109968  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:19.118364  9117 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:29:19.118957  9134 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:19.119397  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 82101.7us
I20260709 12:29:19.119963  3929 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14. Ops: []
W20260709 12:29:19.093112  9112 consensus_meta.cc:287] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.546s	user 0.005s	sys 0.006s
I20260709 12:29:19.120832  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.121675  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:19.124384  4572 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:19.126658  3822 connection.cc:256] RPC call timeout handler was delayed by -1.0312900969997827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260709 12:29:19.089143  8918 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:19.159451  9209 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:19.044752  9248 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:19.165047  8741 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:19.166137  8741 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:19.114539  8745 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:19.138005  4571 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:19.145074  9027 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:19.134449  9201 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:29:19.145534  9267 log.cc:927] Time spent T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:29:19.195246  9131 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:19.147233  9229 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:19.150548  9038 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:19.178435  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:19.158082  8898 consensus_meta.cc:287] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.007s
I20260709 12:29:19.036749  8647 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:19.176754  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.188107  8992 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:19.188431  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:19.207978  3932 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 14: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:19.189535  9138 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:19.189980  9263 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.060s	user 0.001s	sys 0.001s
I20260709 12:29:19.189476  9035 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:19.161813  9209 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:19.192780  3822 leader_election.cc:336] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.603s (SENT)
I20260709 12:29:19.194124  3931 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
W20260709 12:29:19.155730  9174 consensus_meta.cc:287] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.000s
I20260709 12:29:19.128391  9115 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:19.200058  8898 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:19.202418  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:19.202692  4565 raft_consensus.cc:1240] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:29:19.202980  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:19.260188  3929 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:29:19.203052  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.260468  3930 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:29:19.206422  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.207578  3926 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:19.229243  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.229528  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.261554  3999 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:19.261759  4001 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:19.240906  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.243031  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.262645  3998 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:19.177542  9112 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.243789  9174 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.245662  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:19.264034  4573 raft_consensus.cc:2393] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:19.174331  9258 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:19.265630  9146 consensus_meta.cc:287] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.000s
I20260709 12:29:19.266811  9258 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:19.267227  8278 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:19.211731  9201 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.249171  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:19.268922  3931 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 12: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:19.270102  9111 consensus_queue.cc:1059] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:29:19.270620  9201 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:19.129940  9056 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:19.250233  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 106875us
I20260709 12:29:19.251868  8647 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:19.253280  4572 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
W20260709 12:29:19.254529  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.292120  4002 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:19.243188  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:19.203722  4571 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:19.272557  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:19.273850  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:19.294050  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.249662  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:19.288975  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:19.285281  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:19.286484  8278 consensus_queue.cc:1059] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:19.288982  9110 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:19.289767  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:19.300222  3857 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:19.290292  9146 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.290333  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:19.274346  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:19.272990  9210 consensus_meta.cc:287] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.001s
I20260709 12:29:19.307217  4003 raft_consensus.cc:2410] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 15 because replica has last-logged OpId of term: 14 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 12:29:19.305725  3923 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:19.301338  3853 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:19.313130  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:19.313865  4573 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:19.314066  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:19.314467  8278 raft_consensus.cc:3055] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:29:19.314937  8278 raft_consensus.cc:740] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:19.315063  3855 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:19.316015  9131 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.315758  8278 consensus_queue.cc:260] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.316496  9131 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:19.316905  8278 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:19.317435  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:19.318457  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.318814  9131 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:19.318994  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:19.320096  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 127350us
I20260709 12:29:19.320477  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:19.320797  3822 leader_election.cc:336] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.616s (SENT)
I20260709 12:29:19.321247  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:19.322180  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:19.326753  3754 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51798 (request call id 320) took 50421 ms (client timeout 15000 ms). Trace:
I20260709 12:29:19.330273  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.330152  3750 catalog_manager.cc:5697] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 9 to 10, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 10 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:19.331066  3998 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:19.332252  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.332502  8278 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:19.334187  3856 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:19.335131  9063 raft_consensus.cc:3055] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:19.335534  9063 raft_consensus.cc:740] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:19.336432  9063 consensus_queue.cc:260] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.338634  9063 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:19.315762  3897 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:19.340883  9229 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:19.341336  9229 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:19.340997  9146 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.341740  9229 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:19.342888  9248 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.343380  9248 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.271997  9235 raft_consensus.cc:3055] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:19.359728  9235 raft_consensus.cc:740] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:19.360914  9235 consensus_queue.cc:260] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.358119  9210 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:19.206565  9027 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:19.379115  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:19.339972  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:19.372735  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 75741us
I20260709 12:29:19.380184  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:19.372875  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:19.374914  3923 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:19.321650  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:19.381668  3849 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:19.319342  9131 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.385739  3970 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:19.332921  3750 catalog_manager.cc:5697] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:19.401333  3851 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:29:19.397703  9111 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:19.403380  3970 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:19.422297  9210 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:19.422465  9173 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:29:19.423074  9210 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:19.423638  9210 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:19.423472  3970 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:19.425007  9115 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:19.405225  9146 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:19.426440  9056 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:19.407917  9168 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.409111  9209 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:19.410889  9187 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:19.411818  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:19.413513  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:19.414784  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:19.418011  8898 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:19.418908  9174 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:19.420658  3857 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:19.412055  9131 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.424682  9210 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.404484  8741 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:19.303722  9201 consensus_queue.cc:1059] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.123s
I20260709 12:29:19.435118  3854 raft_consensus.cc:2393] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:29:19.439692  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.440773  3897 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:29:19.327155  3754 rpcz_store.cc:269] 0709 12:28:28.905696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:28.906224 (+   528us) service_pool.cc:224] Handling call
0709 12:29:19.326527 (+50420303us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:10.308527 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:10.309381 (+   854us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:10.309450 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:29:10.309479 (+    29us) tablet.cc:662] Decoding operations
0709 12:29:10.310859 (+  1380us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:10.310957 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:10.310981 (+    24us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:29:10.379327 (+ 68346us) tablet.cc:701] Row locks acquired
0709 12:29:10.388784 (+  9457us) write_op.cc:260] PREPARE: finished
0709 12:29:10.410382 (+ 21598us) write_op.cc:270] Start()
0709 12:29:10.440129 (+ 29747us) write_op.cc:276] Timestamp: P: 1783600150402920 usec, L: 0
0709 12:29:10.440156 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:29:10.484918 (+ 44762us) log.cc:844] Serialized 5071 byte log entry
0709 12:29:11.319843 (+834925us) op_driver.cc:464] REPLICATION: finished
0709 12:29:11.667341 (+347498us) write_op.cc:301] APPLY: starting
0709 12:29:11.673124 (+  5783us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:11.863436 (+190312us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:11.863546 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:13.059216 (+1195670us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:13.059672 (+   456us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:29:13.059748 (+    76us) write_op.cc:312] APPLY: finished
0709 12:29:13.060232 (+   484us) log.cc:844] Serialized 121 byte log entry
0709 12:29:13.447403 (+387171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:13.455760 (+  8357us) write_op.cc:454] Released schema lock
0709 12:29:13.455821 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:13.458597 (+  2776us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:13.458630 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1526175,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":313686,"apply.run_cpu_time_us":49755,"apply.run_wall_time_us":1818155,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58415,"num_ops":13,"prepare.queue_time_us":457251,"prepare.run_cpu_time_us":7829,"prepare.run_wall_time_us":204034,"raft.queue_time_us":511358,"raft.run_cpu_time_us":20598,"raft.run_wall_time_us":326401,"replication_time_us":840652,"thread_start_us":1107568,"threads_started":5,"wal-append.queue_time_us":574443,"wal-append.run_cpu_time_us":13010,"wal-append.run_wall_time_us":2420723}]]}
I20260709 12:29:19.450240  9248 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:19.451630  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:19.452466  3848 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 17: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:19.455909  3855 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:29:19.434326  9187 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:19.442297  4536 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:19.456992  3930 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:19.439143  9235 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:19.441681  9266 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:19.458453  3926 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
W20260709 12:29:19.468250  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:19.480183  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.499899  3929 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:19.460737  9248 consensus_queue.cc:1059] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:29:19.459573  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:19.493788  3897 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:19.463799  9035 raft_consensus.cc:3055] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:29:19.502533  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 181773us
I20260709 12:29:19.502592  9035 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:19.501863  3850 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:19.500525  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:19.505595  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.459060  3970 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:19.472769  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.507556  3849 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:19.516232  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:19.510699  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:19.437783  9209 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.520275  3897 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:19.516969  3852 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:19.483139  9215 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:19.466243  9027 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:19.468400  9187 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:19.458638  9270 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:19.465139  9131 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:19.525594  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 76888.3us
I20260709 12:29:19.533099  9174 consensus_queue.cc:1059] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:19.523036  3897 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:19.534500  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:19.535501  9209 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:19.526623  3895 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:19.535933  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:19.536693  9131 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:19.537119  9131 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:19.537506  9131 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:19.459911  3750 catalog_manager.cc:5697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 5 to 9, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 9 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:19.520285  9266 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:19.508612  9201 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:19.522208  8918 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:19.545853  9268 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:19.556098  9268 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:19.556468  9268 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:19.556787  3822 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:19.517824  9278 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:19.550086  9248 consensus_queue.cc:1059] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:29:19.558928  9248 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:19.560233  3897 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:19.465198  9168 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:19.566888  3822 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:19.569955  3850 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:19.583662  9259 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:19.570058  3852 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:19.571866  3970 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:19.572046  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:19.574071  8278 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:19.593866  8278 raft_consensus.cc:697] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:29:19.552021  9281 log.cc:927] Time spent T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.144s	user 0.000s	sys 0.004s
I20260709 12:29:19.550257  9144 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:29:19.584628  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.560441  9132 raft_consensus.cc:3055] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:19.550299  9270 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:19.552318  8918 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:19.585799  3822 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:19.559334  9248 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:19.550601  9266 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:19.572415  9110 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:19.597026  9229 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.550837  9201 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:19.607221  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 44719.6us
I20260709 12:29:19.612100  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2718) took 1241 ms. Trace:
W20260709 12:29:19.639176  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.639107  4003 rpcz_store.cc:276] 0709 12:29:18.370588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:18.547335 (+176747us) service_pool.cc:224] Handling call
0709 12:29:19.611864 (+1064529us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54000230d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:19.611999 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1490069376}
I20260709 12:29:19.607733  8278 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.605712  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:19.605501  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:19.628249  3849 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:19.648504  4568 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:29:19.650535  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 141408us
I20260709 12:29:19.653493  3895 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:19.657321  9293 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:19.656548  3895 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:19.659783  3895 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:19.660516  9296 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:19.623286  9110 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:19.680714  9110 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:19.681303  9258 raft_consensus.cc:3055] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:19.627566  8918 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:19.685165  9131 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:19.623248  9132 raft_consensus.cc:740] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:19.664018  9201 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:19.664222  9112 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:19.636404  9266 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:19.550282  3750 catalog_manager.cc:5697] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:19.671190  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:19.675505  3822 leader_election.cc:336] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.929s (SENT)
W20260709 12:29:19.679913  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.606556  9278 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:29:19.681749  9258 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:19.687325  9229 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:19.611408  9144 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:19.598709  9035 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.644385  9290 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:19.627401  9270 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:19.691649  3969 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:19.694190  4536 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:19.746483  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 54935us
W20260709 12:29:19.746831  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 52727us
I20260709 12:29:19.691713  9271 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:29:19.700493  9110 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:19.707129  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 47420.1us
I20260709 12:29:19.750360  3895 leader_election.cc:400] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14.
I20260709 12:29:19.708487  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.711270  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.751407  3998 raft_consensus.cc:2410] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:29:19.711808  8992 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:19.713075  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.713454  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:19.713577  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.714077  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.713605  9132 consensus_queue.cc:260] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.714975  4001 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:29:19.754035  3997 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:19.720973  3822 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:19.755105  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:19.730538  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:19.732054  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 154380us
I20260709 12:29:19.742170  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.746295  9278 raft_consensus.cc:697] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:19.760244  4000 raft_consensus.cc:2410] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:29:19.723145  8918 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.730394  9144 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:19.753577  3969 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:19.761664  3821 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:19.764951  3895 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:19.725710  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 159221us
I20260709 12:29:19.751693  4005 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 14: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:19.753242  4002 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:19.766430  4537 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:19.769939  3895 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:19.775218  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:19.777823  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:19.780627  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:19.783524  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.781466  4568 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 8.
I20260709 12:29:19.787971  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:19.788472  3999 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:29:19.789598  3895 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:19.794310  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:19.795289  9131 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:19.795475  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:19.795679  8918 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:19.724529  9187 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.796371  4565 raft_consensus.cc:2410] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:29:19.797401  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:19.797870  9187 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:19.756769  9027 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:19.798149  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.798748  4003 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:19.798831  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:19.799721  4573 raft_consensus.cc:2368] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:19.802151  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.802786  9298 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:19.752799  9056 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:19.798149  4570 raft_consensus.cc:2368] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14.
W20260709 12:29:19.806378  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 44947.2us
I20260709 12:29:19.752931  9290 raft_consensus.cc:697] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:19.808836  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.809628  4005 raft_consensus.cc:2410] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:29:19.810875  9278 consensus_queue.cc:237] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.766089  9144 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:19.767918  9229 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:19.767719  9063 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:19.814239  9258 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:19.820389  4006 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:19.829306  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:19.803290  9298 raft_consensus.cc:697] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:19.798717  9027 raft_consensus.cc:697] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:19.833496  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:19.763037  8741 consensus_queue.cc:1059] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:29:19.807245  9131 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:29:19.816720  9187 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:29:19.822481  9261 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:19.753108  9248 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:19.837514  8978 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:19.874019  8978 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:19.887044  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 125483us
I20260709 12:29:19.893348  8278 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:19.895968  4005 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:29:19.896373  3923 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:19.897420  3931 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:29:19.897897  3931 pending_rounds.cc:85] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 9
I20260709 12:29:19.898234  3931 pending_rounds.cc:107] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:29:19.898638  3931 raft_consensus.cc:2889] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:19.898784  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:19.899675  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.900063  3929 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:19.898129  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:19.901212  3925 raft_consensus.cc:2393] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:19.901746  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.902014  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.902618  3924 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:19.903365  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:19.897536  3930 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:19.905171  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.906428  3923 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:19.907580  3929 raft_consensus.cc:1240] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 9. Current term is 10. Ops: []
I20260709 12:29:19.908077  8278 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:19.908654  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:19.909265  3929 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:29:19.906487  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:19.916968  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 169357us
I20260709 12:29:19.918035  4536 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:19.907608  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:19.921463  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 140940us
I20260709 12:29:19.921872  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.884573  8745 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.877609  9268 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.922749  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.887542  8978 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:19.913324  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.922205  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:19.887221  9248 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:19.908679  8278 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:19.924777  4006 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:19.947005  3931 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:19.924296  3923 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:19.955099  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:19.961652  3930 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:19.957098  3897 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:29:19.976271  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 300795us
I20260709 12:29:19.957041  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:19.981160  3928 raft_consensus.cc:2368] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15.
I20260709 12:29:19.984758  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:19.986025  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:19.987030  8278 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:19.990063  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:19.990600  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.990896  4004 raft_consensus.cc:2410] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:29:19.991214  3998 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
W20260709 12:29:19.991708  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 202216us
I20260709 12:29:19.991777  3931 raft_consensus.cc:3060] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:19.972275  3929 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:19.995607  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:19.996565  4570 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:19.996975  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:19.997980  3929 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:19.997623  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.998370  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.005177  4006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:51898
I20260709 12:29:20.005543  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.005617  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.005967  4006 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:20.006352  4001 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:20.006609  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.007268  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.006690  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.006358  4006 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:20.012837  3930 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:29:20.018814  3895 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:20.022528  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:20.022894  4000 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 16: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:20.023144  4570 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:20.023314  4573 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:29:19.976114  9056 raft_consensus.cc:697] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:20.023734  4573 pending_rounds.cc:85] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 9
I20260709 12:29:20.024085  4573 pending_rounds.cc:107] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:29:20.024333  4573 raft_consensus.cc:2889] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:20.025563  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.024464  9056 consensus_queue.cc:237] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.026693  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.027468  4001 raft_consensus.cc:2410] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:29:20.028177  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.023739  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:20.029521  3822 leader_election.cc:336] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 2.005s (SENT)
I20260709 12:29:20.037127  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:19.954497  8745 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:20.046015  9300 log.cc:927] Time spent T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:29:20.047408  8745 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:20.048152  4001 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:19.980664  9110 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:20.050136  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:20.040117  3822 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:20.052414  3822 leader_election.cc:336] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 2.009s (SENT)
I20260709 12:29:19.989806  9146 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:20.054615  9146 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.055011  9146 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:20.058259  9035 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:20.057466  3750 catalog_manager.cc:5697] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 4 to 7, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 7 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.058578  9110 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:20.059566  3750 catalog_manager.cc:5697] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 7 to 11, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 11 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:20.062083  9294 log.cc:927] Time spent T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:29:19.911168  9027 consensus_queue.cc:237] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.068948  9144 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.070128  3927 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 16: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:20.075582  9270 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.078040  9270 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:20.041841  9303 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:20.080355  9261 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:20.080775  9261 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:20.082507  3822 leader_election.cc:336] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 1.945s (SENT)
I20260709 12:29:20.037371  9167 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:29:19.966328  9187 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:29:20.044266  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:20.044502  9301 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 12:29:20.102479  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.085456  4002 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
W20260709 12:29:20.085628  3822 leader_election.cc:336] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 2.221s (SENT)
I20260709 12:29:20.049868  4003 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:20.043009  4005 raft_consensus.cc:2410] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:29:20.088662  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:20.089586  3929 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:20.121681  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:19.910836  9290 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.124045  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.124754  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:20.125339  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:20.125973  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:20.122313  4001 raft_consensus.cc:2376] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15. Re-sending same reply.
I20260709 12:29:19.913623  9298 consensus_queue.cc:237] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.134303  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:20.138171  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 145226us
I20260709 12:29:20.061194  3750 catalog_manager.cc:5697] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 6 to 9, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 9 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:20.139851  4006 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.133613  3998 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:20.142400  3926 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:20.143479  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.151587  4003 raft_consensus.cc:2393] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 14: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:20.144932  4574 raft_consensus.cc:2393] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 12: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:20.077418  9266 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.156190  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.156539  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.157282  4005 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:20.157536  3998 raft_consensus.cc:2410] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:29:20.146396  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.150206  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.147313  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.160384  4002 raft_consensus.cc:2393] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:29:20.159441  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 237219us
I20260709 12:29:20.189205  4537 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:20.180456  3931 raft_consensus.cc:2468] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:20.160085  4000 raft_consensus.cc:2376] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11. Re-sending same reply.
I20260709 12:29:20.195325  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:20.196130  3853 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:29:20.197535  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 48075.3us
I20260709 12:29:20.198462  3895 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:20.209460  4006 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:20.212301  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.146154  9268 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:20.159756  4001 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:29:20.187913  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 188845us
I20260709 12:29:20.188236  3998 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:29:20.154479  9305 raft_consensus.cc:2804] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:20.182973  3897 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:20.216295  3925 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:20.159106  9312 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:20.230381  4537 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:20.226438  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 43554.5us
I20260709 12:29:20.235632  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.194095  9311 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.141721  8978 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.186136  4570 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
W20260709 12:29:20.238291  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:20.257637  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.248524  4537 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:20.210263  9303 raft_consensus.cc:2764] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 12:29:20.238684  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 153072us
W20260709 12:29:20.262101  3822 leader_election.cc:336] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 2.522s (SENT)
W20260709 12:29:20.262271  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 280853us
I20260709 12:29:20.265189  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:20.217561  9110 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:20.265780  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:20.266125  9110 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.266561  4574 raft_consensus.cc:3055] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:29:20.265815  4565 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:20.267006  4574 raft_consensus.cc:740] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:20.268311  9110 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:20.268059  4574 consensus_queue.cc:260] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.231292  9215 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:20.231825  9270 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:29:20.269734  9270 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.238224  9144 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:20.269285  4574 raft_consensus.cc:3060] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:20.272665  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.272836  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.283568  4000 raft_consensus.cc:2376] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11. Re-sending same reply.
I20260709 12:29:20.256246  3895 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:20.245543  9311 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.243403  9167 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:20.237843  3750 catalog_manager.cc:5697] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 6 to 9, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 9 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.243525  9271 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.280474  3924 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:20.273113  3971 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:20.285220  3895 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:20.285641  4001 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:20.288230  4005 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:20.289489  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:20.285960  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:20.301049  9144 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:29:20.301972  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.302071  3897 leader_election.cc:400] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:20.302498  3897 leader_election.cc:403] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:29:20.303182  8992 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:20.303406  3897 leader_election.cc:400] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14.
I20260709 12:29:20.303730  3897 leader_election.cc:403] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:29:20.304281  8992 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14.
I20260709 12:29:20.304957  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:20.304880  8992 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:20.306515  9187 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:20.247978  9305 raft_consensus.cc:697] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:20.259493  9201 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:29:20.308864  4538 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.310997  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.315307  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.311623  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:20.316190  4570 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:20.270241  9270 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:20.317157  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.319375  4006 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:20.310603  3895 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:20.321300  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:20.318596  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 70136us
I20260709 12:29:20.323488  9261 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.324467  3926 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:20.322419  9268 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:20.327834  9268 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:20.328290  9268 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:20.295397  9303 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:20.323307  3895 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:20.326557  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:20.327490  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.334372  9110 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:20.314805  8992 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:29:20.337535  4005 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:20.335103  9299 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:20.334757  3750 catalog_manager.cc:5697] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 2 to 8, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 8 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.342742  3750 catalog_manager.cc:5697] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.344301  8992 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:20.335632  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:20.346048  8992 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:20.346746  8992 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:20.347218  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:20.347939  3856 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:20.349709  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:20.351097  4570 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:20.351648  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:20.352221  3856 raft_consensus.cc:2376] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17. Re-sending same reply.
W20260709 12:29:20.353544  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.355259  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:20.355931  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.356448  4001 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:20.357180  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.357461  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.357777  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.358249  3856 raft_consensus.cc:2368] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14.
I20260709 12:29:20.358804  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.358541  9305 consensus_queue.cc:237] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.359186  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.359724  3998 raft_consensus.cc:2376] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12. Re-sending same reply.
I20260709 12:29:20.358188  4001 raft_consensus.cc:2368] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15.
I20260709 12:29:20.360234  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:20.358186  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.361503  3999 raft_consensus.cc:2376] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15. Re-sending same reply.
I20260709 12:29:20.353372  3897 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:20.363157  9248 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:20.363655  9248 raft_consensus.cc:697] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:20.364460  9248 consensus_queue.cc:237] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.365310  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:20.366011  3856 raft_consensus.cc:2368] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:20.366274  9324 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:20.366709  9324 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.367044  9324 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:20.367617  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:20.370321  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.370525  9132 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:20.371297  4537 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:20.374720  9317 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:20.375695  9311 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:20.285137  9306 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:29:20.376343  3856 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:29:20.309268  9167 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.378613  4005 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:20.379236  9167 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:20.309118  9271 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.314419  9063 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:20.381556  9063 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:20.381937  3849 raft_consensus.cc:1240] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:20.381982  9063 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:20.382647  9271 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:20.308354  9187 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:20.383450  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:20.384065  3849 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:20.383867  9187 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.383687  3750 catalog_manager.cc:5697] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 5 to 8, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 8 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.326049  9144 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.386277  9144 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.388185  9144 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:20.388824  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:20.319317  9201 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.389420  3854 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:20.389490  9201 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:20.391379  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:20.391925  3850 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:20.392418  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:20.393153  3854 raft_consensus.cc:2410] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:29:20.394845  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:20.395190  4006 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:20.393791  3853 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:29:20.396847  3857 raft_consensus.cc:1240] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 9. Current term is 10. Ops: []
I20260709 12:29:20.396888  3849 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:20.397400  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:20.398034  3969 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:20.405311  9271 raft_consensus.cc:2804] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:29:20.405807  9271 raft_consensus.cc:697] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:20.406718  9271 consensus_queue.cc:237] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.407914  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:20.408540  4574 raft_consensus.cc:2468] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:29:20.408501  3849 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:29:20.409612  9268 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.411367  8978 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:20.403151  9261 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:20.432011  4536 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:20.404042  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.413983  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:20.416525  3850 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:20.417614  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:20.440442  3932 raft_consensus.cc:2393] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 10: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:20.440547  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.411829  9268 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:20.365646  9146 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.432358  9259 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:20.447216  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:20.447837  3932 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:20.447885  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.448675  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.448892  4005 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:20.449275  4001 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:29:20.420634  3750 catalog_manager.cc:5697] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 5 to 7, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 7 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.460817  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.442456  9056 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:29:20.465435  3895 leader_election.cc:400] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14.
I20260709 12:29:20.469803  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.470413  4001 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:20.472805  3931 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:29:20.474620  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:20.457521  9270 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.477619  3932 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:20.478205  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:20.478854  4574 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:29:20.479532  3927 raft_consensus.cc:1240] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17. Ops: []
W20260709 12:29:20.473902  4538 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.3:33709 timed out after 2.022s (SENT) [suppressed 58 similar messages]
I20260709 12:29:20.466909  9056 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:20.492380  9056 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:20.485661  4001 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:20.491581  3897 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:20.495333  9268 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:20.495464  3897 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:20.495864  9268 raft_consensus.cc:697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:20.496372  3926 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:29:20.496876  9268 consensus_queue.cc:237] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.499276  9303 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:20.499801  9303 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:29:20.500324  9326 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:29:20.500761  9303 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.501538  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:20.501950  9270 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:20.502321  4574 raft_consensus.cc:2393] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:20.438653  9112 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:29:20.505479  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.463517  9259 raft_consensus.cc:697] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:29:20.508436  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.505276  3897 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:20.511324  4537 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:20.465754  3895 leader_election.cc:403] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:29:20.508085  9319 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.282s	user 0.003s	sys 0.000s
W20260709 12:29:20.507969  9332 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.186s	user 0.002s	sys 0.001s
W20260709 12:29:20.517031  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 51715.9us
I20260709 12:29:20.482869  8978 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:29:20.519816  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:20.514791  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.515524  9144 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:20.521905  9261 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:20.523015  3895 leader_election.cc:400] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:20.523432  9273 consensus_queue.cc:1059] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:20.517350  9270 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14.
I20260709 12:29:20.526373  3970 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:20.526477  9324 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.528376  3897 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:20.530401  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:20.538519  4538 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:20.516613  9309 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:20.543190  4574 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:20.544342  4538 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:20.549642  9305 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:29:20.552008  4004 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
I20260709 12:29:20.551801  9173 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.555405  9173 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.557478  9173 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:20.551600  9168 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:20.553486  9309 raft_consensus.cc:697] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:20.559506  9309 consensus_queue.cc:237] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.520371  8745 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:29:20.562992  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:20.550117  9273 raft_consensus.cc:3055] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:20.563614  3926 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:20.563961  9273 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:20.564152  9259 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.565027  4537 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:20.564924  9273 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.565922  9168 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:20.565948  9311 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:29:20.566464  9168 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.538172  9320 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:29:20.566850  9168 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:20.567477  9320 raft_consensus.cc:3055] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:20.567826  9320 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:20.568622  9320 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.575075  4574 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 9.
I20260709 12:29:20.576321  3897 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:20.516319  9210 consensus_queue.cc:1059] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
W20260709 12:29:20.600477  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 47377.1us
I20260709 12:29:20.569705  9248 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:20.541396  9144 raft_consensus.cc:697] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:20.550272  8741 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:20.607012  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:20.609784  3895 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:20.614086  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 145879us
W20260709 12:29:20.610800  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 167299us
I20260709 12:29:20.615051  3822 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:20.619544  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:20.620191  3926 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:20.621052  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:20.624368  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:20.625770  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 51515.1us
I20260709 12:29:20.626719  4538 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:20.605818  9248 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.632843  9248 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:29:20.633141  9331 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:29:20.607684  9311 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:29:20.634199  9311 raft_consensus.cc:697] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:20.635138  9311 consensus_queue.cc:237] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.638134  9289 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.638916  9289 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.641434  9324 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:20.643693  3822 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:20.606035  9146 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:20.645593  9299 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:20.645057  3822 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:20.646607  9201 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.647562  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:20.649516  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:20.650141  3924 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:20.649981  9314 consensus_queue.cc:1059] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:29:20.651329  4572 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:20.665580  3924 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:20.667258  4537 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:20.621447  9310 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:20.686698  3970 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:20.687808  9271 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:29:20.689237  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 74236.6us
I20260709 12:29:20.604892  9270 consensus_queue.cc:1059] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:29:20.627514  9273 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:29:20.696334  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 69723.7us
I20260709 12:29:20.697433  4538 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:20.693694  8741 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:20.694494  9271 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.654147  8745 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:29:20.704690  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 57186.6us
I20260709 12:29:20.685767  9305 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:20.692135  9324 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:20.699016  9111 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:20.695300  9315 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:20.712745  9112 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:29:20.739292  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.708259  9271 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:20.733137  8278 raft_consensus.cc:3055] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:20.763873  8278 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:20.718384  9201 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:20.713169  9317 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:29:20.757834  9278 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.002s	sys 0.010s
I20260709 12:29:20.726562  9345 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:20.786998  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 100422us
W20260709 12:29:20.792846  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 95529.1us
I20260709 12:29:20.795069  4538 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:20.789657  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.797909  3970 leader_election.cc:400] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15.
I20260709 12:29:20.798398  3970 leader_election.cc:403] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:29:20.800495  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 86637.7us
I20260709 12:29:20.801680  3822 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:20.727108  9306 consensus_queue.cc:1059] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:29:20.728663  9210 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:29:20.761804  9324 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:29:20.792768  9278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.002s	sys 0.010s
I20260709 12:29:20.824062  3970 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:20.821794  9173 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:20.832930  4538 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:29:20.839712  9334 log.cc:927] Time spent T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:29:20.841014  9258 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:20.846088  9168 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.847239  9324 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.848311  9168 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:20.849987  9352 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:29:20.850538  3970 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:20.852684  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.852885  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.836048  8745 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:20.854187  9346 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:29:20.854561  8745 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:20.855216  8745 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:20.855620  9346 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:29:20.855922  3997 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 7. Current term is 8. Ops: []
I20260709 12:29:20.856993  9290 raft_consensus.cc:3055] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:20.856801  9063 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.857357  9290 raft_consensus.cc:740] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:20.858219  9290 consensus_queue.cc:260] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.858990  9063 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:20.859473  9290 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:20.835294  9056 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.864127  9056 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:20.727901  9144 consensus_queue.cc:237] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:20.869227  9266 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:20.870404  9289 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:20.878114  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 45245.1us
W20260709 12:29:20.878587  9340 log.cc:927] Time spent T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:29:20.879016  4538 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:20.880453  9337 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 12:29:20.882223  9321 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:20.882819  9321 raft_consensus.cc:697] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:20.886246  9321 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.837638  9344 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:20.884445  9215 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:20.815958  9345 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.911338  3928 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: [12.10-14.11]
W20260709 12:29:20.885125  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 83528.9us
I20260709 12:29:20.912885  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.915552  3926 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:20.916424  3924 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:20.894948  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:20.894958  3927 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: []
I20260709 12:29:20.917693  4000 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:29:20.921119  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.924477  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:20.937309  3932 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:29:20.943325  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:20.944178  3857 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:20.891131  9258 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:29:20.968115  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:20.969110  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:20.969671  4570 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:20.964514  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:20.972886  3928 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:20.973750  4574 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 8. Current term is 9. Ops: []
I20260709 12:29:20.965222  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:20.974411  3932 raft_consensus.cc:2393] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 10: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:20.976122  4565 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:20.977483  4538 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:20.981069  4570 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
W20260709 12:29:20.982802  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 70546.1us
I20260709 12:29:20.898962  9111 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:20.855638  8745 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:20.985970  3929 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:29:20.987438  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:20.957444  9112 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.889832  9248 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:20.891975  9345 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:21.006956  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:20.961169  9346 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:29:21.027489  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:21.028417  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:21.029002  3857 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:21.042798  4537 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:21.042843  4574 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:29:20.982587  9258 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.022495  9321 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:21.024122  9111 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:21.047581  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:21.012415  9112 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.021584  9345 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 12:29:21.068778  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 91356.8us
I20260709 12:29:21.072253  4538 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:21.038503  9063 consensus_queue.cc:1059] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:29:21.074879  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 386008us
I20260709 12:29:21.083752  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:21.084390  4001 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:29:21.085546  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 102031us
I20260709 12:29:21.086614  3822 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:21.023789  9346 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:21.075436  8745 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:21.099135  9356 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:21.102622  9266 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.103132  9266 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:21.032334  9351 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:29:21.087600  8978 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:21.106420  8978 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:21.050230  9261 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:29:21.106863  8978 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:21.107980  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:21.108549  3998 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:21.109457  9365 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:21.110082  9063 consensus_queue.cc:1243] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:29:21.111277  9273 raft_consensus.cc:3055] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:21.111622  9273 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:29:21.111835  9333 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.790s	user 0.003s	sys 0.000s
I20260709 12:29:21.105813  3929 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:21.112459  9273 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.113639  9273 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:29:21.114007  9350 log.cc:927] Time spent T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:29:21.114248  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:21.115190  3822 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:21.116277  9298 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:21.117249  9354 raft_consensus.cc:3055] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:29:21.117797  9345 consensus_queue.cc:1059] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:29:21.122753  3998 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:21.125000  3857 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:21.125267  3848 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
W20260709 12:29:21.127370  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:21.128458  4003 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:21.146595  3999 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:21.128628  3928 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:21.106750  9266 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:21.160847  3999 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:29:21.135664  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 155943us
I20260709 12:29:21.065871  9167 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:29:21.140280  4001 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:21.171792  4574 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:29:21.119417  9248 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:21.178162  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:21.127107  9356 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:21.179987  3971 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:21.184430  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 69332.3us
I20260709 12:29:21.133522  9354 raft_consensus.cc:740] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:29:21.190385  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:21.197295  9356 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:21.189059  9318 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.931s	user 0.012s	sys 0.000s
I20260709 12:29:21.230988  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:21.202373  9168 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:21.233870  9168 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.235518  9173 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:21.236096  9168 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:21.202389  9345 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:21.205390  9346 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:21.238750  9258 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:21.238855  9112 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:21.130752  9365 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:21.193953  8745 consensus_queue.cc:1059] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:29:21.194734  9298 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:29:21.244431  9345 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:29:21.275362  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 89533.5us
I20260709 12:29:21.277483  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:21.271433  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 150578us
W20260709 12:29:21.285261  9271 consensus_meta.cc:287] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
I20260709 12:29:21.286078  9271 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.247105  9346 consensus_queue.cc:1059] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:29:21.291950  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2318) took 1427 ms. Trace:
I20260709 12:29:21.292543  9278 raft_consensus.cc:3055] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:29:21.288137  9339 log.cc:927] Time spent T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.579s	user 0.000s	sys 0.002s
I20260709 12:29:21.285508  9361 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:21.292374  3851 rpcz_store.cc:276] 0709 12:29:19.864258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:19.864373 (+   115us) service_pool.cc:224] Handling call
0709 12:29:19.864801 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:19.919423 (+ 54622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:19.919470 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:19.920126 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 12:29:20.007785 (+ 87659us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:29:20.007855 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:20.007954 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:21.010234 (+1002280us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:21.291655 (+281421us) raft_consensus.cc:1685] finished
0709 12:29:21.291680 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:21.291868 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29483,"raft.queue_time_us":92004,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":24924,"spinlock_wait_cycles":119746944,"thread_start_us":131552,"threads_started":2,"wal-append.queue_time_us":234116}
W20260709 12:29:21.289749  9371 log.cc:927] Time spent T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:29:21.295629  4006 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 13: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:21.296185  9361 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:21.297048  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:21.297838  9361 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:21.298321  9361 raft_consensus.cc:697] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:21.299190  9361 consensus_queue.cc:237] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:21.298326  3822 leader_election.cc:400] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15.
I20260709 12:29:21.293084  9278 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:21.303889  9345 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.306977  9365 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:21.293274  8978 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.302594  9352 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15.
W20260709 12:29:21.314610  4004 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51898 (request call id 1001) took 1322 ms (client timeout 1504 ms). Trace:
W20260709 12:29:21.315016  4004 rpcz_store.cc:269] 0709 12:29:19.992009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:19.997404 (+  5395us) service_pool.cc:224] Handling call
0709 12:29:21.314443 (+1317039us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b540021b1d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:21.314552 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1272301312}
I20260709 12:29:21.318572  9278 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.319996  9132 raft_consensus.cc:3055] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:21.320320  9278 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:21.329974  9354 consensus_queue.cc:260] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.331362  9354 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:29:21.331482  3822 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:21.332296  9349 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:21.332695  9349 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:21.333033  9349 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:21.333441  4574 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:21.320451  9132 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:21.343087  9132 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.344424  9132 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:21.348798  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:21.349107  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:21.350391  4572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1338) took 1086 ms. Trace:
I20260709 12:29:21.350886  4572 rpcz_store.cc:276] 0709 12:29:20.264048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:20.264176 (+   128us) service_pool.cc:224] Handling call
0709 12:29:20.264476 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:20.651788 (+387312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:21.350105 (+698317us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b540052c454. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:21.350298 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889100672}
I20260709 12:29:21.355221  3848 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:29:21.356400  9320 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:21.358711  3849 raft_consensus.cc:3060] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:21.336807  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:21.341241  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 984) took 1465 ms. Trace:
I20260709 12:29:21.360033  3997 rpcz_store.cc:276] 0709 12:29:19.875683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:19.875841 (+   158us) service_pool.cc:224] Handling call
0709 12:29:19.882227 (+  6386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:20.856477 (+974250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:21.340975 (+484498us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b540006d454. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:21.341172 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2238741760}
I20260709 12:29:21.361042  9347 raft_consensus.cc:3055] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:21.361457  9347 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:21.341964  9268 raft_consensus.cc:3055] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:21.349490  3857 raft_consensus.cc:2368] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 15. Current term is 16.
I20260709 12:29:21.362085  9268 raft_consensus.cc:740] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:21.362301  9347 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:21.339448  4565 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:29:21.362886  9304 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:21.365942  3857 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:29:21.368927  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:21.369069  9365 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.369544  9365 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.370229  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:21.371312  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:21.371666  9365 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:21.372161  9365 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.372591  9365 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.374337  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:21.374691  3854 raft_consensus.cc:1275] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:29:21.375001  9027 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:29:21.375918  9257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.011s	sys 0.010s
W20260709 12:29:21.376371  9257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.011s	sys 0.010s
W20260709 12:29:21.359726  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:21.363226  9268 consensus_queue.cc:260] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.380686  9268 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:21.381341  4536 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:21.388005  4536 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:21.382642  3997 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:29:21.388119  9215 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:21.389200  9215 raft_consensus.cc:697] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:21.390094  9215 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.390687  4570 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:29:21.382316  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:21.391785  9324 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:29:21.392405  9324 raft_consensus.cc:697] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:21.394280  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:21.394999  4002 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
I20260709 12:29:21.397926  3997 raft_consensus.cc:1275] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:29:21.405193  4001 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:29:21.406641  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:21.407105  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:21.407449  4002 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:21.410701  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:21.412448  4004 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:29:21.412472  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:21.413650  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:21.413765  4006 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:21.414430  3926 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 13: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:21.415599  3854 raft_consensus.cc:1240] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:21.417654  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:21.418195  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 81412.5us
I20260709 12:29:21.418377  3854 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:21.419981  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:21.420043  3856 raft_consensus.cc:1275] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:29:21.422170  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:21.423422  3969 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:21.309530  9271 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:21.415838  4574 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:21.434546  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:21.435612  3897 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:21.438265  3822 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:21.440285  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:21.440863  4568 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:21.442173  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:21.442770  3852 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:29:21.443637  3895 leader_election.cc:400] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 15. Current term is 16.
I20260709 12:29:21.443975  3895 leader_election.cc:403] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:29:21.445398  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:21.446298  3822 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:21.449301  3853 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:21.450912  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:21.363672  9347 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:21.454490  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:21.441324  3849 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:21.378310  9365 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:21.468040  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 74126.4us
I20260709 12:29:21.465974  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:21.458256  9146 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 15. Current term is 16.
W20260709 12:29:21.493557  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:21.499794  9367 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:21.501194  3848 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:21.449254  9298 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:29:21.512254  4003 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:29:21.466552  9112 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:21.506103  3852 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:21.508283  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:21.477460  9167 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.510571  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:21.477869  9259 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:21.449384  9131 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:29:21.509102  3999 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:29:21.455206  9290 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
W20260709 12:29:21.525789  9382 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:29:21.478992  9248 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:29:21.471056  3897 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:21.552229  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 81546.1us
I20260709 12:29:21.528764  4003 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:29:21.553298  3897 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:21.521826  8278 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:21.482944  3969 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:21.479229  9346 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:29:21.546411  4538 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:21.527187  4002 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:21.412449  9324 consensus_queue.cc:237] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.568454  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:21.573025  3931 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:29:21.572952  3822 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:21.583798  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:21.549945  9259 raft_consensus.cc:697] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:21.588254  3928 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:29:21.591938  3926 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:29:21.592370  4002 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:29:21.565989  9310 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:21.575263  9353 raft_consensus.cc:2804] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:21.600975  3925 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:21.544191  9167 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.604759  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:21.601064  9368 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:29:21.555200  9356 consensus_queue.cc:1048] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:29:21.612387  9311 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:29:21.575855  9187 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:29:21.603446  9310 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:21.583093  9365 consensus_queue.cc:1048] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:29:21.571470  9270 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:29:21.618968  9259 consensus_queue.cc:237] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:21.592175  9201 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:21.598100  9144 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:29:21.626185  9355 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:21.555986  9305 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:29:21.587790  9112 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:21.616750  9349 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.583658  9314 consensus_queue.cc:1059] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 12:29:21.631191  9384 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:29:21.628872  9173 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:21.643095  9310 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:21.654958  8978 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:21.666746  9389 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.643436  9313 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:29:21.675334  9305 consensus_queue.cc:1243] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:29:21.672966  9355 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:21.689683  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:21.646019  9321 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:29:21.684734  9314 consensus_queue.cc:1243] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:29:21.668186  9360 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
W20260709 12:29:21.875051  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 182756us
I20260709 12:29:21.674139  9201 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:21.889864  9386 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 12:29:21.841531  9355 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:21.900342  9173 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:21.901505  9173 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.902541  9309 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:21.903769  9173 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:29:21.905257  8278 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:29:21.906778  9320 consensus_meta.cc:287] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 12:29:21.907495  4570 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
W20260709 12:29:21.891433  9383 log.cc:927] Time spent T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:29:21.920548  9349 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:21.749280  9353 raft_consensus.cc:697] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:21.922060  9353 consensus_queue.cc:237] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:21.914182  9132 consensus_meta.cc:287] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.001s
I20260709 12:29:21.873481  9168 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 12:29:21.917078  9354 consensus_meta.cc:287] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.585s	user 0.003s	sys 0.006s
I20260709 12:29:21.918256  9167 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:21.885826  9268 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:21.841694  9389 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.919257  9201 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:21.928977  3857 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:21.935895  4005 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:29:21.937484  4005 pending_rounds.cc:85] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 8
I20260709 12:29:21.938845  4005 pending_rounds.cc:107] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:29:21.939149  4005 raft_consensus.cc:2889] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:21.945047  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:21.956377  8278 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:21.957120  8278 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:21.959555  8278 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:21.970043  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 82306.9us
I20260709 12:29:21.975723  3928 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:21.936879  9268 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.970391  9131 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.936671  9356 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:21.980500  3929 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:29:21.982455  3926 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:21.978195  9248 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.973734  9399 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:21.985046  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:21.987495  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:21.978969  8278 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.976627  9368 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.988291  3925 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:21.988420  8278 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.978004  9187 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:21.980944  9167 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:21.994402  9324 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:21.996775  9324 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.992116  9399 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:22.000831  9187 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.005844  8278 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:22.009650  9324 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:21.982628  9131 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:22.003366  9167 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.013413  9310 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:21.991022  9248 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:21.986092  9356 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.006843  9187 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:21.993669  9368 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.029470  9389 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:22.031226  9131 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:22.032752  9347 consensus_meta.cc:287] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.000s
I20260709 12:29:22.034185  9248 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:22.035661  9356 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:22.036644  9355 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:22.038327  9278 consensus_meta.cc:287] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.717s	user 0.012s	sys 0.001s
I20260709 12:29:22.039844  9310 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:22.041965  9268 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:22.042042  9355 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:22.042568  9167 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:22.043849  9368 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:22.045747  3851 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
W20260709 12:29:22.054368  9393 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.133s	user 0.002s	sys 0.000s
I20260709 12:29:22.058583  9268 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:22.059194  9268 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:22.060742  9399 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:22.062412  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:22.062592  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:22.063230  3926 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:22.064074  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:22.065495  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:22.066023  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:22.066720  3929 raft_consensus.cc:2393] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 13: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:22.066233  3926 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 17: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:22.071257  3930 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:29:22.061311  9268 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:22.123762  9352 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:22.123967  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1010) took 1204 ms. Trace:
I20260709 12:29:22.124436  4000 rpcz_store.cc:276] 0709 12:29:20.919187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:20.919305 (+   118us) service_pool.cc:224] Handling call
0709 12:29:20.937506 (+ 18201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:21.276283 (+338777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:21.276324 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:21.302980 (+ 26656us) log.cc:844] Serialized 26 byte log entry
0709 12:29:21.457959 (+154979us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:21.504181 (+ 46222us) log.cc:844] Serialized 14 byte log entry
0709 12:29:22.123317 (+619136us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b1800184de0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04ee64c0a 00007fe0585a4219 00007fe04eeeca40 00007fe04eee74e4 00007fe04eee7455 00007fe051fcf060 00007fe051fe1716 00007fe051ff2287 00007fe051ff2208
0709 12:29:22.123525 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:22.123625 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:22.123664 (+    39us) raft_consensus.cc:1685] finished
0709 12:29:22.123768 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:22.123912 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26746,"prepare.queue_time_us":48547,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":769785,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":158,"spinlock_wait_cycles":9095552,"thread_start_us":417481,"threads_started":2,"wal-append.queue_time_us":186759}
W20260709 12:29:22.126621  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 643709us
I20260709 12:29:22.130810  3857 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:22.138612  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:22.138685  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:22.140507  3926 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:22.139544  3930 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:22.148097  3857 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:22.163691  9132 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:22.158792  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:22.168390  3855 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:29:22.171022  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:22.180425  3930 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:29:22.196254  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:22.197552  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:22.181257  9266 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:29:22.202777  9368 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:22.205252  9368 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:22.205575  9368 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:22.202585  9324 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 12:29:22.211818  9377 log.cc:927] Time spent T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.763s	user 0.004s	sys 0.012s
I20260709 12:29:22.213322  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 2252) took 1105 ms. Trace:
I20260709 12:29:22.213690  3932 rpcz_store.cc:276] 0709 12:29:21.107592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:21.117995 (+ 10403us) service_pool.cc:224] Handling call
0709 12:29:21.118294 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:21.118621 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:21.118651 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:21.119090 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:29:21.313450 (+194360us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:21.313478 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:21.313525 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:22.211252 (+897727us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:22.212991 (+  1739us) raft_consensus.cc:1685] finished
0709 12:29:22.213012 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:22.213241 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":140,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":18072832,"thread_start_us":193962,"threads_started":1,"wal-append.queue_time_us":328910}
I20260709 12:29:22.201169  9035 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:22.215679  9035 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:22.216027  9035 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:22.170596  8992 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.194811  9132 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:22.217761  9402 log.cc:927] Time spent T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:29:22.233240  8992 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:22.233469  9368 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.203783  9167 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:22.201684  9268 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:22.246315  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.233992  9309 consensus_queue.cc:1243] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:29:22.246491  3971 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:22.251438  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.226846  9132 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:22.203364  9261 consensus_queue.cc:1048] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:29:22.254495  3897 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:22.262221  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.260561  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:22.268496  4570 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:22.270521  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:22.271145  3926 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:22.272624  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.275066  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:22.275772  4570 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 11.
I20260709 12:29:22.279100  9248 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:29:22.279412  8992 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:22.279762  9248 raft_consensus.cc:697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:22.280037  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.281170  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:22.279196  3849 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:29:22.282323  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:22.241743  9167 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:22.240316  9063 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:22.280820  9248 consensus_queue.cc:237] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.287719  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:22.293867  4572 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:22.289099  4565 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:22.249605  9268 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:22.290788  3930 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:22.292814  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:22.297030  4536 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:22.311167  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 64739.1us
I20260709 12:29:22.314934  4001 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:22.281760  9349 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.291057  9167 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:22.320344  9367 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:22.320758  9367 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:22.321099  9367 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:22.322374  9278 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.322865  9278 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:22.324921  9278 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:22.298813  9289 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:29:22.328851  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:22.289759  9131 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.341187  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:22.342837  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:22.343402  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:22.330083  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:22.286517  9112 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.330549  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:22.337787  4538 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:22.325287  9035 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.344218  3999 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 18.
I20260709 12:29:22.348392  4570 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 13: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:22.346830  4006 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:29:22.349651  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:22.350237  4006 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:22.354079  3930 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:29:22.313123  9268 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:22.358702  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:22.359557  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:22.311075  9320 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:22.286789  9298 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:29:22.371739  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:22.291812  9317 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:29:22.367141  4572 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:29:22.342533  9399 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.372769  4567 raft_consensus.cc:2393] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 12: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:22.352169  9408 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.314093  9389 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:29:22.297605  9063 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.352762  9354 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:22.352945  9278 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.365002  3999 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:22.378275  4565 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:22.389395  4006 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:22.342679  9349 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:22.396711  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:22.399930  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:22.410756  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:22.411855  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:22.400009  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:22.412321  9412 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.412861  9412 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.375721  9324 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:29:22.351665  9187 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:29:22.413152  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:22.351666  9131 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.372263  9410 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:22.355922  9112 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:22.391026  3997 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
I20260709 12:29:22.417402  3897 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:29:22.416741  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 61340.4us
I20260709 12:29:22.384343  9347 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:22.426931  3999 raft_consensus.cc:2410] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:29:22.378093  9173 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 12:29:22.428036  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 93770.5us
I20260709 12:29:22.431529  3999 pending_rounds.cc:85] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 8
I20260709 12:29:22.435210  3999 pending_rounds.cc:107] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:29:22.434304  4567 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:29:22.434377  3822 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:22.429670  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:22.436030  3997 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:22.435653  3999 raft_consensus.cc:2889] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:22.438575  4570 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:22.439177  3997 pending_rounds.cc:85] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 10
I20260709 12:29:22.440115  3997 pending_rounds.cc:107] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:29:22.440375  3997 raft_consensus.cc:2889] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:22.436744  3897 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:29:22.442921  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 122608us
I20260709 12:29:22.444938  3821 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:22.394933  9399 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:22.461375  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:22.427630  9411 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:22.466321  3821 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:22.467223  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:22.444412  9144 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:22.414330  9278 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:22.458236  9290 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:22.422528  9270 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:29:22.397107  9408 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:22.514326  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 55574.8us
I20260709 12:29:22.516075  3897 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:22.520581  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 43866.9us
I20260709 12:29:22.463181  9353 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:22.422676  9409 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:29:22.465682  9257 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:22.442265  9347 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.532949  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:22.535751  3929 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:22.474920  9144 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:22.537081  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 70862.1us
I20260709 12:29:22.474700  9289 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:22.515326  9261 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:29:22.546744  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 188209us
I20260709 12:29:22.565083  3929 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:22.568126  9132 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.528750  9259 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:22.525967  9421 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:22.548017  9261 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:22.474066  9298 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:29:22.585091  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:22.544453  9416 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:22.589367  4006 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:22.591461  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:22.543780  9406 log.cc:927] Time spent T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:29:22.542992  9144 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:22.579704  9187 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:22.605245  9173 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:22.614230  9173 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:22.638438  9173 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:29:22.622682  9414 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 12:29:22.623543  9417 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 12:29:22.644263  9391 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:29:22.624480  9415 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:29:22.646087  9422 consensus_queue.cc:1059] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:29:22.605355  9261 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:22.634959  9427 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.650265  9427 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:22.632097  9418 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:29:22.654078  9349 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:22.605538  9421 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.657869  9399 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:22.659201  9412 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:22.635366  9144 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:22.475615  9411 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.623879  9396 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.667610  9396 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.613868  9400 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:29:22.599002  9259 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:22.604544  9353 raft_consensus.cc:697] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:22.580605  9365 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 12:29:22.670265  9187 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:22.744415  9259 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:22.751755  9112 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:22.767323  9187 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:22.738196  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 190547us
I20260709 12:29:22.603552  9416 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:22.545459  9257 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.783809  3821 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:22.792061  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:22.790831  3821 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:22.788213  9416 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:22.789434  9131 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:22.795749  9112 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:22.794724  9421 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:22.789283  9144 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:22.799153  9433 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:29:22.824896  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 279924us
I20260709 12:29:22.807761  9411 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:22.810871  9427 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:22.815650  9112 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:22.833017  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.834332  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.827198  9433 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.835373  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.835906  9063 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:22.836380  9433 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:22.789577  9367 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.838032  9432 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:22.838171  4002 raft_consensus.cc:2368] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:22.838502  9367 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:22.841281  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:22.842140  9167 consensus_meta.cc:287] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.003s
I20260709 12:29:22.842681  9167 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.844341  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:22.844923  9167 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:22.845420  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:22.846050  4568 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:22.847580  4536 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:22.848644  9427 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:22.849107  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:22.849196  4536 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:22.850307  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2758) took 1421 ms. Trace:
I20260709 12:29:22.850689  3855 rpcz_store.cc:276] 0709 12:29:21.428474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:21.428881 (+   407us) service_pool.cc:224] Handling call
0709 12:29:22.167932 (+739051us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:22.191618 (+ 23686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:22.850139 (+658521us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54002ed950. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:22.850251 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1698804608}
I20260709 12:29:22.852020  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.852111  9112 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:22.858512  9168 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:22.871724  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:22.874425  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2766) took 1475 ms. Trace:
I20260709 12:29:22.874801  4005 rpcz_store.cc:276] 0709 12:29:21.398997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:21.408323 (+  9326us) service_pool.cc:224] Handling call
0709 12:29:21.408565 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:21.939685 (+531120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:22.874157 (+934472us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b540006d454. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:22.874358 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1211571072}
I20260709 12:29:22.875401  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:22.875941  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:22.877276  4005 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:22.878180  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:22.870679  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.880697  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.858800  9257 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:22.797717  9353 consensus_queue.cc:237] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:22.861996  9427 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:22.862565  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:22.891817  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.862709  9261 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.864663  9268 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.869076  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:22.853828  3850 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 17: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:22.869728  3999 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:22.841789  4002 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:22.887472  4005 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:22.900681  4005 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:29:22.881165  3855 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:22.910277  3822 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:22.913408  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:22.914211  3855 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:22.915621  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.918526  9298 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:22.918989  9298 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:22.922451  9298 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:22.922711  9173 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.923823  9396 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:22.924855  9173 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:22.925365  9361 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:29:22.891232  9290 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.929211  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:22.932420  4536 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:22.939296  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:22.939877  4567 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:22.928074  9187 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.930076  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:22.889443  9345 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:22.940258  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.951519  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:22.893102  9304 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:22.908386  9257 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.981628  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:22.989224  9268 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:22.907843  9349 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:29:22.963990  9063 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.994949  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:22.997383  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 65066.3us
I20260709 12:29:22.938539  9432 consensus_queue.cc:1059] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:29:23.006896  4002 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 19.
I20260709 12:29:22.900728  9444 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 12:29:23.013761  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:22.987061  9367 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:22.967679  9345 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:23.006994  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:22.963901  9290 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:23.016841  9365 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:23.027777  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:23.028486  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:23.029745  3853 raft_consensus.cc:3055] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:23.034097  3853 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:23.034931  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:23.012612  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:23.036422  4567 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:23.033692  3926 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:23.038702  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:23.032387  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:23.008595  9421 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:22.987473  9257 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.039340  3970 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:23.042327  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:23.043258  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:23.043949  3930 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:23.046547  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:23.073432  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:23.074087  4001 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:23.026508  9027 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:22.999774  9063 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:23.096406  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 57174.4us
I20260709 12:29:23.098511  4002 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:23.089481  9261 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.091184  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:23.099997  4565 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:23.074563  3853 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:22.992033  9304 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:23.106709  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:23.109390  3970 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:23.110972  3853 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:23.029922  9367 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.113596  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:23.102538  9412 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:23.116074  4002 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:23.041368  9365 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.119882  4001 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:23.120440  9411 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 12:29:23.123099  9447 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:29:23.124312  3997 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:29:23.124683  3997 pending_rounds.cc:85] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 10
I20260709 12:29:23.124905  3997 pending_rounds.cc:107] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:29:23.125120  3997 raft_consensus.cc:2889] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:23.125429  3850 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:29:23.130707  9368 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:23.131247  9290 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:23.112963  9273 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:23.131980  9273 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.132377  9273 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:23.132088  9298 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:23.077283  9421 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.115226  9420 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:29:23.138877  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:23.100908  9416 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.140029  9365 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.140506  4565 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:23.133709  3895 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:23.142289  4001 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:23.143644  4001 raft_consensus.cc:1275] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:29:23.150104  3852 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:23.151638  3853 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:29:23.152119  3853 pending_rounds.cc:85] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 8
I20260709 12:29:23.152330  3853 pending_rounds.cc:107] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:29:23.152623  3853 raft_consensus.cc:2889] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:29:23.206558  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 284826us
W20260709 12:29:23.207346  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 60456.2us
I20260709 12:29:23.147008  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:23.211542  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 64596.7us
W20260709 12:29:23.211751  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 78165.3us
I20260709 12:29:23.100219  9027 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:23.137734  9421 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:23.229269  4002 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:23.231102  4002 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:29:23.118227  9261 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:23.199128  9361 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:29:23.256693  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 48993.9us
I20260709 12:29:23.216439  9412 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:23.214955  9299 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:29:23.262167  3895 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:23.247253  9290 raft_consensus.cc:3055] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:23.247617  9248 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:23.220173  9311 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:23.322048  9351 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:29:23.249765  9266 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.250810  9454 raft_consensus.cc:3055] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:29:23.329275  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 67198.3us
I20260709 12:29:23.255383  9455 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:23.341732  3895 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:23.259717  9298 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:23.325106  9412 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:23.365222  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 254610us
I20260709 12:29:23.319629  9290 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:29:23.354790  9447 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:29:23.257858  9261 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.340026  9131 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:23.261662  9361 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:23.339216  9187 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.340299  9454 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:23.361871  9412 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.407827  9298 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.329054  9437 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
W20260709 12:29:23.416601  9418 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:29:23.355772  9266 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.404832  9456 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:23.358088  9112 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:23.411793  9345 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:23.427995  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 86183.3us
I20260709 12:29:23.413021  9311 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:23.365864  9455 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:23.437922  3855 consensus_meta.cc:287] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.010s
I20260709 12:29:23.458560  3855 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 19.
I20260709 12:29:23.441114  3895 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:23.470929  3855 raft_consensus.cc:1275] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:29:23.475632  9433 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:23.479014  9131 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:23.479645  9131 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.479560  9273 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:23.482250  9131 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.482705  9273 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:23.436784  9416 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.440549  9304 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:23.457196  9311 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.495085  9248 raft_consensus.cc:697] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:29:23.534922  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 268500us
I20260709 12:29:23.491775  9257 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.518375  9311 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:23.455231  9456 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.435596  9298 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.542488  3821 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:23.542851  9461 log.cc:927] Time spent T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:29:23.541239  9027 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:23.543119  9427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.005s	sys 0.007s
W20260709 12:29:23.553787  9427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.006s	sys 0.007s
I20260709 12:29:23.559576  9456 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.493140  9454 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.560861  9454 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:23.566468  9261 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:23.566705  9467 log.cc:927] Time spent T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:29:23.437666  9290 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:23.565734  9259 consensus_meta.cc:287] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.784s	user 0.011s	sys 0.000s
I20260709 12:29:23.575409  9261 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:23.567893  9266 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.570618  9314 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:23.604349  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:23.605335  3932 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 13: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:23.603664  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:23.608204  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:23.606271  3895 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:23.578683  9476 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:23.611811  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:23.583974  9290 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:23.614681  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:23.577925  9261 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.616204  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:23.576296  9460 consensus_queue.cc:1175] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "073f84fcc295417f9bcc1eea29d2bb58" responder_term: 13 status { last_received { term: 11 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:29:23.579075  9259 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.614845  9353 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:23.615790  9361 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:23.618821  9476 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.642273  3929 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:23.633786  9112 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:23.615666  9437 consensus_queue.cc:1048] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 12:29:23.641268  9466 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.122s	user 0.001s	sys 0.001s
I20260709 12:29:23.653599  3929 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:23.656787  9298 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.658613  9259 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.659188  9476 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.659854  9311 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:23.662108  9311 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:23.662468  9278 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:23.609576  9248 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.655681  9437 consensus_queue.cc:1243] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer 4eedd844c09d456ca0b3614490dd1dbb log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:29:23.651262  9353 raft_consensus.cc:697] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:23.676860  9261 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.673369  9353 consensus_queue.cc:237] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:23.690194  9367 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:23.708293  9468 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 12:29:23.720314  9469 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.173s	user 0.002s	sys 0.000s
I20260709 12:29:23.723151  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2335) took 1319 ms. Trace:
I20260709 12:29:23.723587  3851 rpcz_store.cc:276] 0709 12:29:22.403420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:22.404008 (+   588us) service_pool.cc:224] Handling call
0709 12:29:22.404446 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:22.457209 (+ 52763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:22.457231 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:22.463512 (+  6281us) log.cc:844] Serialized 26 byte log entry
0709 12:29:22.734299 (+270787us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:22.734357 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:23.722730 (+988373us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b54000ee054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:23.722785 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:23.722835 (+    50us) raft_consensus.cc:1685] finished
0709 12:29:23.722850 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:23.723090 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9988,"raft.queue_time_us":186,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8522,"spinlock_wait_cycles":67176832,"thread_start_us":207622,"threads_started":1,"wal-append.queue_time_us":334023}
I20260709 12:29:23.731381  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:23.731948  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:23.732448  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:23.733019  3932 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:23.733608  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:23.739506  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:23.741022  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:23.743323  3930 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 12:29:23.744757  9444 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.001s	sys 0.011s
W20260709 12:29:23.745173  9444 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.001s	sys 0.011s
I20260709 12:29:23.747129  4001 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:29:23.749148  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:23.756582  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:23.757288  3997 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:23.757802  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:23.759279  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:23.759689  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:23.759861  4001 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:23.761984  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:23.762674  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:23.761818  9444 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:29:23.769713  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2769) took 1457 ms. Trace:
I20260709 12:29:23.770152  4004 rpcz_store.cc:276] 0709 12:29:22.311810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:22.312222 (+   412us) service_pool.cc:224] Handling call
0709 12:29:22.312619 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:22.425354 (+112735us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:29:22.441409 (+ 16055us) log.cc:844] Serialized 14 byte log entry
0709 12:29:22.524688 (+ 83279us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:22.524735 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:29:22.524781 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:22.844320 (+319539us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b180025d920. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea522 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:29:23.690589 (+846269us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b180025d920. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeb82a6 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419
0709 12:29:23.769484 (+ 78895us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540006ca54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:23.769529 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:23.769660 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":144452,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":76,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":9799,"spinlock_wait_cycles":275616256,"thread_start_us":82938,"threads_started":1,"wal-append.queue_time_us":158657,"wal-append.run_cpu_time_us":1087,"wal-append.run_wall_time_us":1024879}
I20260709 12:29:23.780396  9455 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:23.782403  9389 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:23.783074  9389 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.792661  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:23.793371  3855 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:23.783041  3997 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:23.794872  3970 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:23.803879  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:23.804580  3850 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
W20260709 12:29:23.811868  9453 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.682s	user 0.002s	sys 0.000s
I20260709 12:29:23.813378  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2784) took 1412 ms. Trace:
I20260709 12:29:23.813731  3999 rpcz_store.cc:276] 0709 12:29:22.400589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:22.904217 (+503628us) service_pool.cc:224] Handling call
0709 12:29:22.904574 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:22.904971 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:22.905011 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:22.908762 (+  3751us) log.cc:844] Serialized 26 byte log entry
0709 12:29:23.042768 (+134006us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:23.042807 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:23.042874 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:23.811244 (+768370us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:23.813075 (+  1831us) raft_consensus.cc:1685] finished
0709 12:29:23.813095 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:23.813310 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":11607,"spinlock_wait_cycles":37189504,"thread_start_us":133563,"threads_started":1,"wal-append.queue_time_us":221050}
I20260709 12:29:23.821084  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:23.824374  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:23.827107  3822 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:23.798839  9409 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:23.833367  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:23.834991  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:23.830456  9455 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:23.843082  9389 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.825176  9367 consensus_queue.cc:1059] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:29:23.844714  9367 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:23.845137  9367 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:23.846062  9367 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:23.846659  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:23.847100  9367 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:23.848034  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:23.849241  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:23.849900  3969 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:23.850268  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:23.850561  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:23.850939  3855 raft_consensus.cc:2393] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 19: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:23.851006  3969 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:23.851236  3854 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:29:23.851756  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:23.852080  9481 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:23.852509  9481 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.852826  9481 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:23.837129  9455 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:23.853571  9271 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:23.853789  9455 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:23.854076  9271 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:23.854557  9271 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:23.853008  9289 raft_consensus.cc:3055] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:23.856571  9289 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:23.856849  4568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1261) took 1509 ms. Trace:
I20260709 12:29:23.857460  9289 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.833621  9409 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.857236  4568 rpcz_store.cc:276] 0709 12:29:22.347262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:22.347410 (+   148us) service_pool.cc:224] Handling call
0709 12:29:22.347668 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:22.846448 (+498780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:23.856620 (+1010172us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54004880d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:23.856793 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1145774464}
I20260709 12:29:23.859915  3969 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:23.862514  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:23.860140  3850 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:29:23.853021  3855 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:23.869338  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:23.836524  9444 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:23.882301  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:23.862911  9409 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:23.873840  9346 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:23.879765  8741 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:23.889925  9027 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:29:23.891151  9289 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:23.883241  9474 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:23.893682  9444 raft_consensus.cc:697] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:23.938953  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2762) took 1113 ms. Trace:
I20260709 12:29:23.939457  3852 rpcz_store.cc:276] 0709 12:29:22.825732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:22.835161 (+  9429us) service_pool.cc:224] Handling call
0709 12:29:23.938714 (+1103553us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b5400018bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:23.938883 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701776256}
I20260709 12:29:23.941722  9474 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:23.942775  9474 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.945482  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:23.947847  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:23.949606  4538 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:23.953004  4568 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 12: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:23.957284  9474 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.958005  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:23.966401  4565 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:29:23.975835  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:23.978323  9483 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:23.979046  9483 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:23.979928  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1206) took 1724 ms. Trace:
I20260709 12:29:23.952811  9400 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.980327  9056 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:23.980499  9427 raft_consensus.cc:2764] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:29:23.960850  8741 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:23.981747  8741 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.980587  9400 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:23.980094  9035 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:23.983911  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:23.984254  8741 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:23.984676  9400 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:23.980350  4574 rpcz_store.cc:276] 0709 12:29:22.255577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:22.257988 (+  2411us) service_pool.cc:224] Handling call
0709 12:29:22.258427 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:22.291731 (+ 33304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:22.291760 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:22.856498 (+564738us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b4800060e58. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe056f00aa1 00007fe056ef7b37 00007fe056ef79ca 00007fe056fef26f 00007fe056feef37 00007fe05700355c 00007fe057003508 00007fe057003488 00007fe057003443 00007fe0570026ec 00007fe055f2ca96
0709 12:29:23.772876 (+916378us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b18002e6000. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeb82a6 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a
0709 12:29:23.773351 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:29:23.866211 (+ 92860us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:23.866271 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:23.866362 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:23.979697 (+113335us) raft_consensus.cc:1685] finished
0709 12:29:23.979717 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:23.979866 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57667,"raft.queue_time_us":33144,"raft.run_cpu_time_us":2183,"raft.run_wall_time_us":562493,"spinlock_wait_cycles":16951296,"thread_start_us":92414,"threads_started":1,"wal-append.queue_time_us":134502}
I20260709 12:29:23.994160  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:23.995030  4004 raft_consensus.cc:2368] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:23.995736  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:24.008301  3997 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:29:24.035564  3897 leader_election.cc:400] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:24.005650  9483 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:24.037314  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:24.038373  3925 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:24.049232  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:24.046821  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:24.053604  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:24.055248  3997 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 13: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:24.034157  9268 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.045733  9353 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:24.006017  9056 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:29:24.066605  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:24.055275  9433 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:24.052014  9035 consensus_queue.cc:1059] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:29:24.034986  9444 consensus_queue.cc:237] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:24.054036  9310 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:29:24.087698  9433 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:24.089175  9035 raft_consensus.cc:3055] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:24.089754  9035 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:24.090893  9035 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.092446  9035 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:24.109151  9452 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.986s	user 0.002s	sys 0.000s
I20260709 12:29:24.112959  4566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1359) took 1244 ms. Trace:
I20260709 12:29:24.113335  4566 rpcz_store.cc:276] 0709 12:29:22.868323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:22.868440 (+   117us) service_pool.cc:224] Handling call
0709 12:29:22.871167 (+  2727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:22.897177 (+ 26010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:22.897215 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:22.897698 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:29:23.044783 (+147085us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:23.044825 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:23.044890 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:24.108478 (+1063588us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:24.112686 (+  4208us) raft_consensus.cc:1685] finished
0709 12:29:24.112706 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:24.112904 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22154,"raft.queue_time_us":36181,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":15141,"spinlock_wait_cycles":52325632,"thread_start_us":146684,"threads_started":1,"wal-append.queue_time_us":213268}
I20260709 12:29:24.115949  9314 raft_consensus.cc:3055] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:24.116488  9314 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:24.086014  9475 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:24.069506  9268 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.117462  9314 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:24.146986  9314 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:29:24.150094  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 142003us
I20260709 12:29:24.077622  9353 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:24.156883  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:24.160418  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:24.166051  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:24.166685  4568 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:24.167263  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:24.168198  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:24.169298  4573 raft_consensus.cc:2368] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:24.169205  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:24.167598  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:24.096170  9431 consensus_queue.cc:1048] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:29:24.173183  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:24.173249  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:24.173902  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:24.178043  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:24.179306  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:24.179579  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:24.181227  4570 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:29:24.182185  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:24.182912  4566 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:29:24.191141  9492 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:29:24.192281  9413 log.cc:927] Time spent T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 1.810s	user 0.010s	sys 0.008s
I20260709 12:29:24.196800  4573 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 13: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:24.200599  3931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 1206) took 2624 ms. Trace:
I20260709 12:29:24.168012  9427 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:24.162822  9475 raft_consensus.cc:697] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:24.201089  3931 rpcz_store.cc:276] 0709 12:29:21.575846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:21.575959 (+   113us) service_pool.cc:224] Handling call
0709 12:29:21.576301 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:21.581444 (+  5143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:21.581491 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:21.595479 (+ 13988us) log.cc:844] Serialized 26 byte log entry
0709 12:29:22.216684 (+621205us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b18000903a0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:29:22.253170 (+ 36486us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:29:22.253204 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:22.253265 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:24.095865 (+1842600us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:24.200313 (+104448us) raft_consensus.cc:1685] finished
0709 12:29:24.200344 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:24.200526 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4707,"raft.queue_time_us":14378,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":14571,"spinlock_wait_cycles":22934016,"thread_start_us":36311,"threads_started":1,"wal-append.queue_time_us":727984}
I20260709 12:29:24.168963  9056 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:24.183921  9422 consensus_queue.cc:1059] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:29:24.184875  9481 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:24.272640  4006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2770) took 1878 ms (client timeout 2087 ms). Trace:
I20260709 12:29:24.212401  9056 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.210255  9427 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:24.273136  4006 rpcz_store.cc:269] 0709 12:29:22.394705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:22.411589 (+ 16884us) service_pool.cc:224] Handling call
0709 12:29:24.272462 (+1860873us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400128754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:24.272578 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292284160}
I20260709 12:29:24.277601  9497 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.295893  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1268) took 1426 ms. Trace:
I20260709 12:29:24.296343  4569 rpcz_store.cc:276] 0709 12:29:22.869604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:22.869747 (+   143us) service_pool.cc:224] Handling call
0709 12:29:22.871338 (+  1591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:24.188468 (+1317130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:24.188504 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:24.188550 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:29:24.188604 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:24.295675 (+107071us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400488ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:24.295721 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:24.295839 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3028660608}
W20260709 12:29:24.286845  9494 log.cc:927] Time spent T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 12:29:24.298974  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:24.303846  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 130181us
I20260709 12:29:24.308137  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:24.309811  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:24.311077  3897 leader_election.cc:400] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:24.312469  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:24.313745  3897 leader_election.cc:403] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:29:24.326620  4006 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:29:24.329191  3969 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:24.332890  8278 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:29:24.333400  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 195660us
I20260709 12:29:24.334898  4570 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:29:24.336280  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:24.333472  8278 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:24.342789  4000 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:29:24.324703  9437 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:24.353257  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:24.323312  4573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:29:24.356774  4573 raft_consensus.cc:606] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:24.331719  9360 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:24.331867  9027 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:24.365499  9290 consensus_queue.cc:1059] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:24.304884  9475 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:24.368554  9367 consensus_meta.cc:287] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
I20260709 12:29:24.369645  4001 raft_consensus.cc:2410] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:29:24.371075  9027 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:24.372439  9353 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:24.305807  9497 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.373311  9027 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:24.375138  9497 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:24.375964  9360 raft_consensus.cc:697] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:29:24.377375  9496 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:29:24.378785  9289 raft_consensus.cc:3055] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:24.379194  9289 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:24.379951  9289 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.376864  9360 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.327696  9144 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:29:24.385414  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 56298.7us
I20260709 12:29:24.423847  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:24.362257  9408 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:24.383400  9409 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:24.376865  9455 consensus_meta.cc:287] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.003s
I20260709 12:29:24.382678  8745 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:24.424188  9490 log.cc:927] Time spent T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.355s	user 0.003s	sys 0.000s
I20260709 12:29:24.423070  4566 raft_consensus.cc:2468] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 12.
I20260709 12:29:24.463658  4536 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:24.472285  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:29:24.473750  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 86966.7us
I20260709 12:29:24.433048  9481 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:24.476357  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:24.480737  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 157918us
I20260709 12:29:24.427898  9346 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:24.486290  4002 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:29:24.492734  3969 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:24.495872  3897 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:24.497221  9507 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:24.497634  9507 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:24.498009  9507 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:24.498095  9354 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:24.504442  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:24.506100  9507 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.511281  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:24.513594  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:24.514809  3855 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:24.514891  9431 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:24.516634  3897 leader_election.cc:400] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:24.519306  9507 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:24.473500  9349 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.478225  9299 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.476723  9035 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:24.485266  9497 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:24.545456  3897 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:24.546059  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 194207us
W20260709 12:29:24.520381  9271 consensus_meta.cc:287] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.002s
I20260709 12:29:24.569024  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:24.474691  9455 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.482285  9408 consensus_queue.cc:1059] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:29:24.552335  9215 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:29:24.488842  9346 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:24.483417  8745 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.566030  9132 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:24.560752  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:24.588986  3999 raft_consensus.cc:2368] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13.
I20260709 12:29:24.591877  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:24.592751  3851 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 10.
I20260709 12:29:24.597429  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:24.600761  3854 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:29:24.600888  9347 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:24.578220  8992 raft_consensus.cc:2804] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:24.601408  9476 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:24.601688  8992 raft_consensus.cc:697] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:24.602137  9476 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.602864  8992 consensus_queue.cc:237] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.604426  9476 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:24.604866  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:24.549249  9349 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:24.607264  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:24.607885  9349 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:24.608788  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:24.584744  9346 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:24.613288  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:24.537513  9431 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:29:24.628321  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:24.629144  3852 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:24.564021  9035 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.581418  9144 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:24.635957  4000 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:24.638518  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:24.641088  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:24.641903  3849 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:24.642208  3856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:24.642815  3856 raft_consensus.cc:606] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:24.643229  3856 raft_consensus.cc:614] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:24.574565  9271 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.647639  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:24.608753  9317 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:24.597126  9056 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:24.630618  9422 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.596748  9389 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:24.615998  9427 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:24.598711  9268 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:24.558751  9299 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:24.703815  4005 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:24.705165  3926 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: []
W20260709 12:29:24.657766  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 326712us
I20260709 12:29:24.637120  9349 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.658667  3999 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 13: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:24.706992  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:24.709666  3850 raft_consensus.cc:1240] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: []
W20260709 12:29:24.715557  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 226322us
I20260709 12:29:24.723332  3857 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:29:24.724650  3857 pending_rounds.cc:85] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 8
I20260709 12:29:24.725637  3857 pending_rounds.cc:107] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:29:24.726576  3857 raft_consensus.cc:2889] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:29:24.717730  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:24.719255  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:24.730661  3852 pending_rounds.cc:85] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 5
I20260709 12:29:24.730772  3855 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:24.731068  3852 pending_rounds.cc:107] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 12:29:24.731410  3852 raft_consensus.cc:2889] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:29:24.710536  9503 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:29:24.732976  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:24.706856  9453 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:29:24.647954  9144 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.774333  4568 raft_consensus.cc:1240] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:24.770821  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:24.721446  9481 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:24.799979  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:24.804040  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:24.805160  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:24.807266  4570 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:29:24.807499  4566 raft_consensus.cc:2410] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:29:24.808344  3857 raft_consensus.cc:2393] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 13: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:24.701494  9389 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.799027  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:24.735297  9409 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:24.822477  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:24.823896  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:24.824637  3857 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:24.826252  4536 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:24.687568  9317 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.720193  9349 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:24.769210  9444 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:24.793047  9354 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.830004  4536 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:24.839035  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:24.839469  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:24.858042  3857 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:24.701052  9422 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:24.861380  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:24.844813  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 363275us
W20260709 12:29:24.842458  9520 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:29:24.915328  4570 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:24.927893  3857 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:24.823720  9481 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:24.911139  9508 log.cc:927] Time spent T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 12:29:24.948622  9144 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:24.949091  4031 heartbeater.cc:646] Failed to heartbeat to 127.2.157.62:44099 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.2.157.62:44099 timed out after 15.000s (SENT)
W20260709 12:29:24.949945  9516 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 12:29:24.950884  9529 log.cc:927] Time spent T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:29:24.953537  9535 raft_consensus.cc:3060] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:24.955224  9432 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:24.978734  9502 log.cc:927] Time spent T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:29:24.981812  9389 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:24.982679  9538 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:25.026760  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:24.982841  9511 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:29:24.983625  9523 log.cc:927] Time spent T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 12:29:24.988986  9524 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:24.989756  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:25.037554  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:25.037986  3853 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:24.990192  3970 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:29:25.038661  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 48565.6us
I20260709 12:29:24.993443  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:24.993489  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:25.040411  9518 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:25.040875  9518 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:25.041340  9518 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:24.994258  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:25.041671  9524 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:25.043213  9317 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:25.044193  9524 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:25.024598  9063 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:25.045555  9422 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:25.022389  9432 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:25.052152  9481 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:25.052701  9271 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:24.864634  9444 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:25.015476  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:25.054618  9444 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:24.999554  3971 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:24.871739  9354 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:25.021420  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:25.063781  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:25.064498  3853 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:25.022701  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:24.897739  9512 consensus_queue.cc:1059] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.127s
I20260709 12:29:25.052559  9432 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:25.067381  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 237483us
I20260709 12:29:25.065404  3856 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:25.021831  9035 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:25.016105  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:25.069108  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 69674.7us
I20260709 12:29:25.028709  9427 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:25.013350  9455 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:25.077566  3970 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:25.080096  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:25.065518  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42066 (request call id 2341) took 1274 ms. Trace:
I20260709 12:29:25.073717  3971 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:25.084580  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:25.087636  3971 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:25.071063  9271 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:25.092629  3853 rpcz_store.cc:276] 0709 12:29:23.791092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:23.792199 (+  1107us) service_pool.cc:224] Handling call
0709 12:29:24.989590 (+1197391us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b5800010298. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056f9d0a0 00007fe056f9c984 00007fe0505176d4 00007fe050517662
0709 12:29:25.065126 (+ 75536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3775872}
W20260709 12:29:25.105104  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 237583us
I20260709 12:29:25.091884  3971 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:25.107635  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:25.108407  3853 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:25.109375  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:25.076570  9427 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:25.117018  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:25.114282  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:25.070379  9346 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.083667  9063 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:25.094413  9132 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:25.105350  9411 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:25.082752  9299 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:25.131181  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:25.134861  4536 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:25.139158  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:25.134824  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:25.123859  9427 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:25.037505  9538 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:25.148913  9525 log.cc:927] Time spent T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 12:29:25.150321  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:25.150534  9538 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:25.151226  9451 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 1.600s	user 0.003s	sys 0.001s
W20260709 12:29:25.151693  9314 consensus_meta.cc:287] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.004s	user 0.014s	sys 0.000s
I20260709 12:29:25.136390  9271 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:25.153517  9271 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:25.154042  9271 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:25.159310  9346 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:25.160162  3999 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:25.117406  9389 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:25.161144  9389 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:25.163461  9389 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:25.170707  9354 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:25.172565  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:25.172930  9547 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:25.174223  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:25.174837  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:25.175009  3931 raft_consensus.cc:2410] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:29:25.175099  3895 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:25.175546  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:25.175837  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:25.177052  3931 raft_consensus.cc:1240] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:25.177242  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:25.179479  9144 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:25.179857  9144 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:25.180262  9144 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:25.180049  9524 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:29:25.142663  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:25.183048  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:25.146826  9132 raft_consensus.cc:697] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:25.184288  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:25.144107  8745 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:25.186040  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:25.173794  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:25.140898  3848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.006s	sys 0.009s
I20260709 12:29:25.119194  9534 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:25.143455  9539 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:25.152998  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2782) took 2779 ms. Trace:
I20260709 12:29:25.130367  9531 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:25.142728  4003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.015s
W20260709 12:29:25.197113  4003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.000s	sys 0.016s
I20260709 12:29:25.190483  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:25.154114  9542 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:29:25.193413  3856 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:25.187525  3998 rpcz_store.cc:276] 0709 12:29:22.373407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:22.876291 (+502884us) service_pool.cc:224] Handling call
0709 12:29:22.876591 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:29:22.876965 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:22.876993 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:29:22.878384 (+  1391us) log.cc:844] Serialized 52 byte log entry
0709 12:29:22.930176 (+ 51792us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:22.982722 (+ 52546us) log.cc:844] Serialized 14 byte log entry
0709 12:29:22.984848 (+  2126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:22.984949 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:23.550731 (+565782us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b18003a30c0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:29:25.130011 (+1579280us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:25.152780 (+ 22769us) raft_consensus.cc:1685] finished
0709 12:29:25.152801 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:25.152932 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16010,"prepare.queue_time_us":52480,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":4317,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":3024,"spinlock_wait_cycles":44082048,"thread_start_us":51389,"threads_started":1,"wal-append.queue_time_us":141048}
I20260709 12:29:25.198676  3848 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:25.368804  9411 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:25.363901  9535 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:25.373165  4006 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:25.373903  4569 raft_consensus.cc:2468] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:25.374457  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:25.375608  3848 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 17: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:25.247677  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:25.298666  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:25.243002  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:25.291814  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2871) took 2254 ms. Trace:
I20260709 12:29:25.378974  3923 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:25.266409  3924 raft_consensus.cc:3055] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:25.382503  3924 raft_consensus.cc:740] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:25.224485  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:25.224543  3929 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 2266) took 2176 ms (client timeout 2419 ms). Trace:
I20260709 12:29:25.202957  3895 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:25.376576  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2804) took 1047 ms. Trace:
W20260709 12:29:25.394701  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 191855us
I20260709 12:29:25.395787  3895 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:25.385737  3929 rpcz_store.cc:269] 0709 12:29:23.034365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:23.034723 (+   358us) service_pool.cc:224] Handling call
0709 12:29:25.210976 (+2176253us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b54002e2554. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:25.211094 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1395424000}
I20260709 12:29:25.401866  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:25.404167  3821 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:25.390638  4003 rpcz_store.cc:276] 0709 12:29:24.328696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:24.332130 (+  3434us) service_pool.cc:224] Handling call
0709 12:29:24.332404 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:24.550191 (+217787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:24.550252 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:24.551057 (+   805us) log.cc:844] Serialized 26 byte log entry
0709 12:29:25.197601 (+646544us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:29:25.197646 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:25.198265 (+   619us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:25.376314 (+178049us) raft_consensus.cc:1685] finished
0709 12:29:25.376341 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:25.376510 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59343,"raft.queue_time_us":28806,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":1696,"thread_start_us":834883,"threads_started":2,"wal-append.queue_time_us":720266}
I20260709 12:29:25.407212  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:25.378938  3928 rpcz_store.cc:276] 0709 12:29:23.037288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:23.037405 (+   117us) service_pool.cc:224] Handling call
0709 12:29:23.039123 (+  1718us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:29:23.039468 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:23.039493 (+    25us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:29:23.101246 (+ 61753us) log.cc:844] Serialized 78 byte log entry
0709 12:29:23.441047 (+339801us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:23.469781 (+ 28734us) log.cc:844] Serialized 14 byte log entry
0709 12:29:23.475067 (+  5286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:23.475179 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:23.707664 (+232485us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:23.718213 (+ 10549us) raft_consensus.cc:1685] finished
0709 12:29:23.721913 (+  3700us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:25.291598 (+1569685us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b54002364d0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:25.291747 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32875,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":972,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":6470,"spinlock_wait_cycles":34987136,"thread_start_us":318059,"threads_started":1,"wal-append.queue_time_us":426634,"wal-append.run_cpu_time_us":4729,"wal-append.run_wall_time_us":1188255}
I20260709 12:29:25.383522  3924 consensus_queue.cc:260] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:25.475135  3856 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:25.449257  3895 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:25.462706  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:25.364337  9526 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.343s	user 0.001s	sys 0.001s
I20260709 12:29:25.196583  9539 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:25.495443  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 347545us
W20260709 12:29:25.500115  4001 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36516 (request call id 2798) took 1507 ms (client timeout 1904 ms). Trace:
W20260709 12:29:25.441998  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:25.479585  3924 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:29:25.500698  4001 rpcz_store.cc:269] 0709 12:29:23.992463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:23.995434 (+  2971us) service_pool.cc:224] Handling call
0709 12:29:25.482025 (+1486591us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400022bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:25.500035 (+ 18010us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857004928}
W20260709 12:29:25.467254  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 63196.8us
I20260709 12:29:25.487931  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1032) took 2938 ms. Trace:
I20260709 12:29:25.501864  4005 rpcz_store.cc:276] 0709 12:29:22.549038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:22.963557 (+414519us) service_pool.cc:224] Handling call
0709 12:29:23.942132 (+978575us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b58001b3f98. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056fb0fc0 00007fe056f9b929 00007fe056f9b3d2 00007fe050512bd4
0709 12:29:23.942336 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:24.705956 (+763620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:25.487708 (+781752us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b540032d054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:25.487874 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762136704}
I20260709 12:29:25.484337  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1220) took 1319 ms. Trace:
I20260709 12:29:25.498957  4537 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:25.505242  3821 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:25.506652  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:25.198856  9389 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:25.503119  4574 rpcz_store.cc:276] 0709 12:29:24.165044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:24.165199 (+   155us) service_pool.cc:224] Handling call
0709 12:29:24.165587 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:24.324154 (+158567us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:29:24.340253 (+ 16099us) log.cc:844] Serialized 14 byte log entry
0709 12:29:24.801100 (+460847us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:24.801165 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:29:24.801233 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:25.484102 (+682869us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540055c8d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:25.484155 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:25.484281 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15943,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":144329,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":15709,"spinlock_wait_cycles":364046720,"thread_start_us":460416,"threads_started":2,"wal-append.queue_time_us":377492}
W20260709 12:29:25.507547  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 226051us
I20260709 12:29:25.511224  9168 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:25.269286  9527 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:25.508828  3969 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:25.184387  9132 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.519809  3969 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:25.521600  9481 raft_consensus.cc:2804] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:25.522356  9481 raft_consensus.cc:697] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:25.410689  9512 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:25.523207  9512 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:25.523425  9481 consensus_queue.cc:237] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.398371  9433 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:25.526088  9408 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:25.526679  9408 raft_consensus.cc:697] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:25.527872  9512 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:25.362406  9299 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:25.199652  9483 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:25.362159  9545 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:25.476850  9524 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:25.410445  9455 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:29:25.517215  3852 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.001s	sys 0.027s
I20260709 12:29:25.473109  9422 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:25.482659  8992 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:25.399849  9419 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:25.505620  9411 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:25.477021  9522 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:25.540725  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1045) took 1444 ms. Trace:
I20260709 12:29:25.504530  9539 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:25.514667  9535 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:25.508422  9409 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:25.514907  9354 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:25.211397  9534 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.505378  9507 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:29:25.531746  9460 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:25.202927  9531 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:25.569947  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:25.571208  3927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 1234) took 1226 ms. Trace:
I20260709 12:29:25.567191  4002 rpcz_store.cc:276] 0709 12:29:24.096229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:24.096708 (+   479us) service_pool.cc:224] Handling call
0709 12:29:24.120030 (+ 23322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:24.486700 (+366670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:25.540352 (+1053652us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b540032b254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:25.540647 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841765632}
I20260709 12:29:25.527906  9408 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:25.562458  9518 consensus_meta.cc:287] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
W20260709 12:29:25.573820  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 482230us
W20260709 12:29:25.669248  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:25.574862  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 69764us
I20260709 12:29:25.670397  3821 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:25.549420  9524 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:25.676038  3971 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:25.561107  9420 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.000s	sys 0.029s
I20260709 12:29:25.560534  9551 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:25.690263  9551 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:25.661677  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 161300us
I20260709 12:29:25.695477  3897 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:25.697808  9475 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:25.698741  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:25.699352  4574 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
W20260709 12:29:25.700151  9427 consensus_meta.cc:287] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.004s
I20260709 12:29:25.700555  9427 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.701659  4568 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 13: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:25.572549  9411 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.703639  9411 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:25.674860  9518 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.681772  9570 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:29:25.707195  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:25.707953  4566 raft_consensus.cc:2393] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:25.707995  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:25.708743  3857 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:25.708876  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:25.709758  4572 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:25.710904  4570 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:29:25.662503  3927 rpcz_store.cc:276] 0709 12:29:24.345224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:24.345342 (+   118us) service_pool.cc:224] Handling call
0709 12:29:24.345628 (+   286us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:29:24.640808 (+295180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:24.640844 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:29:24.696555 (+ 55711us) log.cc:844] Serialized 52 byte log entry
0709 12:29:24.865228 (+168673us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:24.865368 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:24.865576 (+   208us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:25.570955 (+705379us) raft_consensus.cc:1685] finished
0709 12:29:25.570977 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:25.571146 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77835,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":1806,"thread_start_us":453739,"threads_started":2,"wal-append.queue_time_us":245982}
I20260709 12:29:25.560238  9455 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.709725  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:25.677181  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 179846us
I20260709 12:29:25.535395  9527 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.556870  9483 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:25.727131  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:25.728080  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:25.678872  3971 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:25.676620  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:25.679461  3924 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:29:25.729592  3924 pending_rounds.cc:85] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 9
I20260709 12:29:25.729849  3924 pending_rounds.cc:107] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 14.10
W20260709 12:29:25.729759  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 50969.4us
W20260709 12:29:25.730660  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 54126.1us
I20260709 12:29:25.731321  3821 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:25.731549  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:25.733492  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:25.612128  9563 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:25.734004  9563 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.735020  3924 raft_consensus.cc:2889] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:25.612776  9409 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:25.732887  3821 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:25.563122  9422 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.568569  9545 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.739753  9427 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:25.681417  9132 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:25.734937  9518 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:25.683730  9559 log.cc:927] Time spent T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:29:25.756075  9545 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:25.756258  9527 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:25.686026  9558 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 12:29:25.677979  9524 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:29:25.686452  9420 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.000s	sys 0.030s
I20260709 12:29:25.759186  8992 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:25.688798  9497 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:25.759944  9483 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:25.760104  9497 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:25.684288  9554 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.284s	user 0.000s	sys 0.000s
I20260709 12:29:25.662866  9278 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:25.693311  9551 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:25.661011  9354 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.570959  9419 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.740197  4571 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:29:25.740499  3821 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:25.788897  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 48469.6us
I20260709 12:29:25.789621  3821 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:25.739863  9512 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:29:25.731463  9560 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:29:25.762629  9278 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:25.733276  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:25.801333  3857 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:25.802218  4005 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:29:25.802346  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:25.764849  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:25.736174  9411 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:25.768283  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:25.770205  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:25.780501  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:25.762320  9539 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.738862  9455 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:25.763566  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2780) took 1153 ms. Trace:
W20260709 12:29:25.732426  9144 consensus_meta.cc:287] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 12:29:25.734807  9460 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:25.820505  9455 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:25.821559  9422 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:25.785640  4003 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:25.822829  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:25.565177  9299 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.825037  9299 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:25.799206  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:25.800417  3856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1409) took 1001 ms. Trace:
I20260709 12:29:25.735920  9522 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:25.767107  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:25.803296  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:25.828662  4572 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:25.814107  3854 rpcz_store.cc:276] 0709 12:29:24.610335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:24.611927 (+  1592us) service_pool.cc:224] Handling call
0709 12:29:24.612267 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:24.634341 (+ 22074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:24.634377 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:24.639630 (+  5253us) log.cc:844] Serialized 26 byte log entry
0709 12:29:25.142866 (+503236us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:29:25.144863 (+  1997us) log.cc:844] Serialized 14 byte log entry
0709 12:29:25.146332 (+  1469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:25.146408 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:25.763334 (+616926us) raft_consensus.cc:1685] finished
0709 12:29:25.763359 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:25.763490 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27053,"prepare.queue_time_us":1719,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":186623,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":12907,"thread_start_us":493838,"threads_started":1,"wal-append.queue_time_us":653884}
I20260709 12:29:25.802603  9570 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:25.806718  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:25.841318  4001 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:25.816023  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:25.851207  3998 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:25.826041  3856 rpcz_store.cc:276] 0709 12:29:24.799284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:25.487121 (+687837us) service_pool.cc:224] Handling call
0709 12:29:25.487702 (+   581us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:25.488428 (+   726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:25.488470 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:25.506594 (+ 18124us) log.cc:844] Serialized 26 byte log entry
0709 12:29:25.666854 (+160260us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:25.666915 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:25.667014 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:25.800216 (+133202us) raft_consensus.cc:1685] finished
0709 12:29:25.800239 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:25.800360 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5415,"thread_start_us":117681,"threads_started":1,"wal-append.queue_time_us":190557}
I20260709 12:29:25.762292  9497 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:25.804478  3969 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:25.830821  3854 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:29:25.913364  9555 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.436s	user 0.003s	sys 0.000s
I20260709 12:29:25.918290  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:25.927273  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:25.927938  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 123573us
I20260709 12:29:25.828256  9562 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:25.932641  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:25.933030  3854 raft_consensus.cc:1240] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:25.934233  4002 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:29:25.938858  4003 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
W20260709 12:29:25.956712  9509 log.cc:927] Time spent T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.901s	user 0.001s	sys 0.001s
I20260709 12:29:25.959223  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 1231) took 1623 ms. Trace:
I20260709 12:29:25.959712  3926 rpcz_store.cc:276] 0709 12:29:24.336283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:24.336449 (+   166us) service_pool.cc:224] Handling call
0709 12:29:24.358925 (+ 22476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:24.705645 (+346720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:25.958943 (+1253298us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54000d5054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:25.959152 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795812224}
I20260709 12:29:25.970329  9289 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:25.975028  9367 raft_consensus.cc:3055] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:25.975528  9367 raft_consensus.cc:740] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:25.976562  9367 consensus_queue.cc:260] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:25.979398  9563 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:25.981223  9354 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:25.983374  9419 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:25.984932  9409 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:25.992584  9534 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:25.993434  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:25.994166  3927 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:25.994575  9539 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:25.996279  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:25.994596  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.000703  9278 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:26.002099  9531 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:26.003942  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:26.004611  3926 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:25.828291  9144 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.977723  9367 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:26.006850  9144 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:26.009591  9271 consensus_meta.cc:287] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.855s	user 0.010s	sys 0.001s
I20260709 12:29:26.026365  9271 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:25.943202  9411 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:26.027755  9411 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:26.028167  9411 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:26.030936  9544 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.980s	user 0.007s	sys 0.004s
I20260709 12:29:26.011240  9536 consensus_queue.cc:1059] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:26.033025  9536 raft_consensus.cc:3055] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:26.033447  9536 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:26.034425  9536 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.035650  9536 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:25.946723  9562 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:26.036499  3926 raft_consensus.cc:2410] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:29:26.036828  9562 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:26.037513  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2809) took 1442 ms. Trace:
I20260709 12:29:26.038074  3997 rpcz_store.cc:276] 0709 12:29:24.595070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:24.596133 (+  1063us) service_pool.cc:224] Handling call
0709 12:29:24.596515 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:24.614776 (+ 18261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:24.614814 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:24.615426 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 12:29:24.918193 (+302767us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:29:24.918307 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:24.918443 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:26.030220 (+1111777us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:26.037132 (+  6912us) raft_consensus.cc:1685] finished
0709 12:29:26.037176 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:26.037442 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2666,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":18675968,"thread_start_us":302070,"threads_started":1,"wal-append.queue_time_us":406032}
I20260709 12:29:26.039616  9562 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:26.028378  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2787) took 1377 ms. Trace:
W20260709 12:29:25.983386  9550 log.cc:927] Time spent T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.935s	user 0.000s	sys 0.002s
I20260709 12:29:26.032321  3853 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:26.042835  8278 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:26.041091  3849 rpcz_store.cc:276] 0709 12:29:24.651020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:24.651180 (+   160us) service_pool.cc:224] Handling call
0709 12:29:24.699287 (+ 48107us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:29:24.922758 (+223471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:24.922807 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:29:25.010524 (+ 87717us) log.cc:844] Serialized 52 byte log entry
0709 12:29:25.387461 (+376937us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:25.387519 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:26.027746 (+640227us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540001a9d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:26.027819 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:26.027888 (+    69us) raft_consensus.cc:1685] finished
0709 12:29:26.027910 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:26.028292 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77906,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"spinlock_wait_cycles":408003328,"thread_start_us":318968,"threads_started":1,"wal-append.queue_time_us":440486}
I20260709 12:29:26.036387  9444 raft_consensus.cc:3055] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:26.052794  9444 raft_consensus.cc:740] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:26.053871  9444 consensus_queue.cc:260] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.055649  9444 raft_consensus.cc:3060] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:26.065832  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1050) took 1356 ms. Trace:
I20260709 12:29:26.066455  3999 rpcz_store.cc:276] 0709 12:29:24.709790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:24.714674 (+  4884us) service_pool.cc:224] Handling call
0709 12:29:24.714898 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:25.160611 (+445713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:26.065498 (+904887us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b5400127354. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:26.065749 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023583104}
I20260709 12:29:26.072260  9349 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:26.088723  9290 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:26.091375  9271 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:26.089457  9290 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:26.093015  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:26.095872  9290 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:26.096439  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:26.099941  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2797) took 1017 ms. Trace:
I20260709 12:29:26.100412  3853 rpcz_store.cc:276] 0709 12:29:25.084238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:25.113992 (+ 29754us) service_pool.cc:224] Handling call
0709 12:29:26.099765 (+985773us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54000550d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:26.099880 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2093924736}
W20260709 12:29:26.103556  9533 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 1.082s	user 0.001s	sys 0.010s
I20260709 12:29:26.108465  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2786) took 1468 ms. Trace:
I20260709 12:29:25.944054  9524 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.111981  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:26.112671  3848 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:26.116663  3856 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:29:26.119553  4569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 1374) took 1082 ms. Trace:
W20260709 12:29:26.120137  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:26.119932  4569 rpcz_store.cc:276] 0709 12:29:25.037162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:25.037304 (+   142us) service_pool.cc:224] Handling call
0709 12:29:26.119347 (+1082043us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b5400722254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:26.119479 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":771730816}
I20260709 12:29:26.121424  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:26.122015  3851 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:26.123587  9437 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:26.124167  9437 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.125741  4568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 1377) took 1046 ms. Trace:
W20260709 12:29:26.125075  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:26.126134  4568 rpcz_store.cc:276] 0709 12:29:25.079721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:25.079843 (+   122us) service_pool.cc:224] Handling call
0709 12:29:26.125558 (+1045715us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b540045ecd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:26.125685 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427748224}
I20260709 12:29:26.140627  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:26.141753  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:26.141968  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:26.142563  3853 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
I20260709 12:29:26.147971  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:26.148638  3926 raft_consensus.cc:2376] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15. Re-sending same reply.
I20260709 12:29:26.112591  9524 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:26.151146  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.151409  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:26.151525  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.150151  3850 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 13: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:26.151903  3851 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:26.153410  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.149487  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.156116  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:26.158269  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.158979  3928 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
W20260709 12:29:26.168581  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 379024us
I20260709 12:29:26.171715  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:26.176700  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:26.174607  3821 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:26.108949  3852 rpcz_store.cc:276] 0709 12:29:24.640242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:24.640396 (+   154us) service_pool.cc:224] Handling call
0709 12:29:24.648549 (+  8153us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:29:24.776111 (+127562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:24.776154 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:29:24.776832 (+   678us) log.cc:844] Serialized 52 byte log entry
0709 12:29:24.933363 (+156531us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:29:25.563838 (+630475us) log.cc:844] Serialized 14 byte log entry
0709 12:29:25.579551 (+ 15713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:25.982764 (+403213us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:26.107089 (+124325us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b1800332020. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeb82a6 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419
0709 12:29:26.108067 (+   978us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b54002a30d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:26.108130 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:26.108185 (+    55us) raft_consensus.cc:1685] finished
0709 12:29:26.108204 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:26.108396 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":108243,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":61627,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":22742,"spinlock_wait_cycles":223250944,"thread_start_us":601314,"threads_started":2,"wal-append.queue_time_us":201917}
I20260709 12:29:26.181741  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:26.182525  3931 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:26.184085  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:26.187790  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:26.190217  8278 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:26.192970  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.193593  3930 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:26.200013  3848 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:26.204835  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.205485  3930 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:26.206275  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.206821  3930 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:26.207563  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.208204  3930 raft_consensus.cc:2393] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 16: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:26.210251  9437 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:26.211038  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.150285  9261 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:26.212297  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:26.213028  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 63275.8us
I20260709 12:29:26.213789  3970 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:26.215610  3970 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:26.217164  3970 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:26.219048  9210 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:26.219470  9210 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:26.219873  9210 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:26.184428  9562 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:26.220949  9562 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:26.190797  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:26.168093  9357 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:26.212028  9261 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.222402  9132 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:26.231235  3969 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:26.231603  3851 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:26.190193  9460 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:26.225899  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:26.252660  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 43699us
I20260709 12:29:26.241593  4538 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:26.256666  3970 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:26.260602  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 448359us
I20260709 12:29:26.262267  3822 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:26.259179  3821 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:26.267616  3931 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:26.268388  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:26.268760  3895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.020s	sys 0.033s
I20260709 12:29:26.269158  3970 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:26.269152  3895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.020s	sys 0.033s
I20260709 12:29:26.271190  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:26.270243  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 550937us
I20260709 12:29:26.272063  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:26.272634  4004 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:26.267486  3821 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:26.245905  9367 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:29:26.276157  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:26.276971  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:26.288498  3998 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:29:26.282450  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:26.288507  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:26.251799  9408 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:26.257133  9537 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:26.294808  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:26.311254  4573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.018s	sys 0.097s
W20260709 12:29:26.336229  4573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.018s	sys 0.097s
I20260709 12:29:26.293787  3822 leader_election.cc:400] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13.
I20260709 12:29:26.337061  3822 leader_election.cc:403] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:29:26.314136  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:26.294340  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:26.331946  9408 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:26.338528  9408 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:26.318408  9347 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:26.342253  9347 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:26.344831  9347 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:26.344955  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 51350.1us
I20260709 12:29:26.295322  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:26.345835  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:26.259689  9561 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:26.346880  9561 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.348124  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:26.349342  9561 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:26.237612  9357 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:26.349572  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:26.350811  9534 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:26.350899  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:26.351576  9357 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:26.352218  9419 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:26.352626  9289 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:26.352942  3822 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:26.353375  9289 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:26.353753  9419 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:26.353814  9289 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:26.354178  3822 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:26.319401  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:26.322960  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:26.286996  8745 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:26.295617  9132 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:26.356305  9530 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:26.356945  9530 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.324867  3970 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:29:26.325254  3897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.085s	sys 0.158s
I20260709 12:29:26.295373  9460 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:26.360136  9460 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:26.360596  9460 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:26.319115  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:26.361423  3897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.086s	sys 0.158s
I20260709 12:29:26.119025  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:26.334978  3998 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:26.320928  3895 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:26.362819  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:26.363225  3822 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:26.364161  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:26.287570  9367 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:26.297689  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 56172.9us
I20260709 12:29:26.345602  9347 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 13.
I20260709 12:29:26.354362  9289 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:26.320469  9531 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:26.311877  9532 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:26.307723  9444 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:26.383460  9411 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:26.414172  9444 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:26.414585  9444 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:26.415879  9411 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:26.418260  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.418926  3924 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
I20260709 12:29:26.311291  9539 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:26.296818  4536 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:26.313367  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:26.378597  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:26.422840  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 126110us
I20260709 12:29:26.423213  9261 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:26.378849  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.423830  9532 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.381042  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:26.427103  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:26.351608  9534 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:29:26.398805  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:26.453779  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 55094.8us
I20260709 12:29:26.399930  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:26.400725  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 75933.2us
W20260709 12:29:26.384811  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 63961.4us
I20260709 12:29:26.381994  9367 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:26.462105  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:26.462396  9432 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:26.462882  9432 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:26.462110  3895 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:26.463539  9432 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:26.464161  3895 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:26.412204  9578 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:26.409314  9548 consensus_queue.cc:1059] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:29:26.466526  9261 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:26.412395  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.466964  9261 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:26.467391  9524 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:26.467394  9261 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:26.467824  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.469190  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:26.413192  3925 raft_consensus.cc:1240] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:26.462819  3998 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:26.470715  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.470963  3895 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:26.472121  3925 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:26.432166  3929 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 15. Current term is 16. Ops: []
W20260709 12:29:26.384022  9557 log.cc:927] Time spent T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:29:26.377130  9537 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.439227  3897 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:26.475011  9310 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:26.475780  9537 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:26.401636  9433 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:26.446398  9210 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.383109  9131 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:26.477444  3895 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:26.381978  9290 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:26.428443  9536 consensus_queue.cc:1059] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:29:26.488250  3822 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:26.450445  9573 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:29:26.452154  9562 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:26.428071  9531 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:26.382638  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.467978  9524 raft_consensus.cc:697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:26.472128  9577 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:26.511137  3849 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:29:26.439543  3923 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:26.477298  3928 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:26.385855  4538 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:26.478760  3970 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:26.480162  9144 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:26.432824  9538 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:26.484241  9532 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:26.486209  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.428908  9357 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:26.493743  3822 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:26.512714  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 126973us
I20260709 12:29:26.522231  4538 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:26.490391  9481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.012s	sys 0.013s
I20260709 12:29:26.515290  3999 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 18: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:26.517379  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:26.508404  9534 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:26.508184  9531 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:26.505941  9310 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:26.506559  9132 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:26.528904  4538 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:26.513722  9577 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:26.524940  9481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.013s	sys 0.013s
I20260709 12:29:26.527915  9562 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:29:26.531038  3822 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:26.556493  9579 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:26.557150  9579 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:26.558434  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:26.563126  9132 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:26.519861  9521 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:26.535121  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:26.536276  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:26.537305  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:26.541311  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:26.542050  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:26.568977  4571 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:26.569346  4570 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:26.514271  9548 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:26.570936  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:26.532025  9357 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:26.571802  3848 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:26.525496  9538 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:26.543406  9577 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:26.540863  9411 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:26.574196  8745 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:26.533191  9310 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:26.541646  9552 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:26.506624  9131 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:26.540800  9290 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:26.572240  9357 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.575947  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:26.581990  4566 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:26.573814  9538 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.578768  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:26.557682  9579 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:26.574873  9310 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:26.584605  3927 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:26.590370  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:26.593418  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:26.574987  9552 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:26.594184  9131 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:26.594288  9552 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:26.604369  4566 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:29:26.529963  9408 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:26.602810  9411 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:26.574821  8745 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.628096  8745 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:26.630362  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.632709  9552 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.634929  9552 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:26.635804  9210 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:26.621279  4566 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:29:26.622777  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:26.623126  4574 raft_consensus.cc:1275] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:29:26.642305  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:26.643440  9411 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:26.644047  9411 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:26.646978  9132 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:26.647697  9530 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:26.652721  9531 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:26.655555  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 176794us
I20260709 12:29:26.676318  3897 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:26.667536  9460 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.668825  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:26.671156  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:26.672844  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:26.705317  3971 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:26.711297  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:26.723340  4005 raft_consensus.cc:2368] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 16. Current term is 17.
I20260709 12:29:26.734853  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:26.737644  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 63044.4us
I20260709 12:29:26.733771  4537 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:26.745131  4001 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:29:26.746239  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:26.738855  3971 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:26.749356  3897 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:26.750308  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:26.749387  3971 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:26.751015  3856 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:26.588034  9261 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.752671  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:26.753296  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:26.753931  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:26.758786  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:26.757211  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:26.759617  4571 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:26.753597  4537 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:26.759827  4566 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:26.765905  4538 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:26.699780  8992 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:26.768008  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:26.765471  4537 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:26.595994  9524 consensus_queue.cc:237] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.737090  8745 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:29:26.777464  4537 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:26.782209  4574 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:29:26.755888  9561 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:26.755640  9552 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:26.768606  9421 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:26.722313  9131 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
W20260709 12:29:26.784616  3853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.008s	sys 0.022s
W20260709 12:29:26.793891  3853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.008s	sys 0.022s
I20260709 12:29:26.732347  9433 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:29:26.787961  9552 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:26.792429  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:26.795773  9433 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:26.796063  4001 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:26.796464  8278 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:26.776326  9132 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:29:26.657112  9411 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:26.795517  9552 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:26.797995  8278 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:26.778558  9168 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:26.824075  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:26.785571  9483 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:29:26.827304  4566 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:26.823459  9289 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:26.833793  9460 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:26.833788  9408 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:26.835175  9289 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:26.801704  8745 consensus_queue.cc:1048] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:29:26.836130  3855 raft_consensus.cc:2393] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:29:26.767791  9475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.019s	sys 0.009s
I20260709 12:29:26.837690  9261 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:26.781709  9427 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:26.822448  9432 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:26.798416  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 311166us
I20260709 12:29:26.788290  9561 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:26.787344  9309 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:26.841223  9561 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:26.808663  8278 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:26.781528  9271 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:29:26.841495  9432 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:26.843885  3857 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:26.774209  9367 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:26.845688  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:26.833272  3999 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:26.847433  3895 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:26.848371  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:26.848893  4003 raft_consensus.cc:2393] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 20: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:26.849548  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:26.854657  3853 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:29:26.857275  4573 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:26.859301  9531 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:26.830873  9168 consensus_queue.cc:1059] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:29:26.860874  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:26.861965  9561 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.862900  9131 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:26.863255  9577 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.864413  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:26.866883  3854 raft_consensus.cc:1240] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:29:26.872936  9309 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:26.874496  9367 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:26.875231  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:26.804626  9444 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:26.883345  4537 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:26.831630  3750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51804 (request call id 331) took 40701 ms (client timeout 15000 ms). Trace:
W20260709 12:29:27.043399  4572 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.005s	sys 0.007s
W20260709 12:29:27.108635  4572 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.007s	sys 0.007s
I20260709 12:29:26.858376  8278 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:26.987243  3852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.008s	sys 0.011s
W20260709 12:29:27.109843  3852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.009s	sys 0.016s
I20260709 12:29:26.985010  4002 raft_consensus.cc:2393] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 13: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:27.111836  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:26.850013  9537 consensus_queue.cc:1059] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:29:26.892634  9427 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 12:29:27.070811  3853 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:27.100023  4001 raft_consensus.cc:2393] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 16: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:27.117822  3931 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 18: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:27.122368  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:27.119665  8278 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:27.128971  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:27.129635  3857 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:27.121762  3969 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:27.131969  3850 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 18: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:27.100958  9421 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:27.149268  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:27.148540  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 399231us
W20260709 12:29:27.139030  9581 log.cc:927] Time spent T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
W20260709 12:29:27.156090  3849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.013s	sys 0.029s
W20260709 12:29:27.195396  3849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.014s	sys 0.029s
I20260709 12:29:27.140201  9367 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:29:27.242914  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 70054.5us
I20260709 12:29:27.250710  8278 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:27.257846  8278 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:27.261786  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 482914us
I20260709 12:29:27.264691  3971 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:27.268167  8278 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:27.268020  9433 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:29:27.260273  9132 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:27.271095  9132 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:27.273118  9132 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:27.260982  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:27.276036  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:27.276899  3930 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:29:27.278468  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:27.255903  9278 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:27.279755  9278 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.171867  9437 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 12:29:27.282015  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:27.282697  9437 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:27.282764  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:27.283277  9437 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:27.283583  4573 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:27.283654  9437 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:27.287232  9433 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:27.287775  9433 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:27.289744  9278 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:27.290632  9433 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:27.291249  9433 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:27.291810  9433 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:27.293332  9310 consensus_meta.cc:287] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.687s	user 0.006s	sys 0.003s
I20260709 12:29:27.294306  9433 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:27.293931  9310 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.296819  3855 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:29:27.297848  9310 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:27.308904  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:27.318382  9582 log.cc:927] Time spent T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
W20260709 12:29:27.320013  9585 log.cc:927] Time spent T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:29:27.324098  4005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2809) took 1001 ms. Trace:
I20260709 12:29:27.324661  4005 rpcz_store.cc:276] 0709 12:29:26.322386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:26.322671 (+   285us) service_pool.cc:224] Handling call
0709 12:29:27.323860 (+1001189us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b5400022bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:27.324031 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":845610880}
I20260709 12:29:27.326601  9561 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:27.330226  4003 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 12:29:27.331471  9579 consensus_meta.cc:287] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.729s	user 0.003s	sys 0.007s
I20260709 12:29:27.331914  9579 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:27.144209  9261 consensus_queue.cc:1059] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 12:29:27.335587  9261 raft_consensus.cc:3055] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:27.336158  9261 raft_consensus.cc:740] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:27.336627  9437 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.341121  9577 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:27.344959  3997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.024s	sys 0.020s
I20260709 12:29:27.172013  9513 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:29:27.364192  3997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.024s	sys 0.021s
I20260709 12:29:27.266976  9427 raft_consensus.cc:3055] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:27.162454  9131 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.204s
W20260709 12:29:27.366171  9583 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.486s	user 0.000s	sys 0.001s
I20260709 12:29:27.154045  9421 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.369464  9513 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:27.371826  9357 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:27.374253  9210 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:27.378252  9427 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:27.383849  9367 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:27.391690  9513 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:27.337368  9261 consensus_queue.cc:260] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.392488  9497 raft_consensus.cc:3055] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:27.399324  9579 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:27.404500  9536 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:27.408982  9497 raft_consensus.cc:740] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:27.423420  9411 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:27.437949  9552 consensus_meta.cc:287] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.617s	user 0.013s	sys 0.000s
I20260709 12:29:27.438484  9552 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:27.448320  9594 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 12:29:27.373750  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 110207us
I20260709 12:29:27.481534  3971 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:27.147786  3755 catalog_manager.cc:5697] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 11 to 16, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 16 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:27.485584  3971 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:27.486317  3848 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.007s	sys 0.018s
W20260709 12:29:27.486995  3848 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.007s	sys 0.018s
W20260709 12:29:27.494750  3970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.017s	sys 0.022s
W20260709 12:29:27.495416  3970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.017s	sys 0.023s
W20260709 12:29:27.498027  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 614525us
I20260709 12:29:27.494867  3850 raft_consensus.cc:2368] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 16. Current term is 17.
I20260709 12:29:27.506642  4567 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 18: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:29:27.507606  3896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.008s	sys 0.016s
W20260709 12:29:27.508183  3896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.008s	sys 0.016s
I20260709 12:29:27.508351  9132 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:27.508956  9132 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:27.509560  9132 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:27.422708  9367 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:27.526437  9444 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:27.527235  9409 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:27.528167  9409 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:27.530351  9481 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:27.531486  9481 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:27.533687  3822 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:27.535379  9530 raft_consensus.cc:3055] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:27.535924  9530 raft_consensus.cc:740] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:27.536926  9347 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:27.538160  9347 consensus_queue.cc:1059] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:29:27.540148  9347 raft_consensus.cc:3055] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:27.540668  9347 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:27.542557  9347 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.544694  9347 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:27.545787  9588 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.200s	user 0.004s	sys 0.000s
W20260709 12:29:27.547690  9597 log.cc:927] Time spent T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:29:27.560297  9497 consensus_queue.cc:260] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.568096  3851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2386) took 1134 ms. Trace:
I20260709 12:29:27.568563  9539 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:27.551429  9530 consensus_queue.cc:260] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.568629  3851 rpcz_store.cc:276] 0709 12:29:26.433851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:26.434106 (+   255us) service_pool.cc:224] Handling call
0709 12:29:26.434448 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:26.632256 (+197808us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:29:26.632303 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:26.632791 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 12:29:26.987008 (+354217us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:29:26.987048 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:27.268584 (+281536us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400054bd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:27.268657 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:27.546693 (+278036us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:27.567410 (+ 20717us) raft_consensus.cc:1685] finished
0709 12:29:27.567442 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:27.567801 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456845056,"thread_start_us":353905,"threads_started":1,"wal-append.queue_time_us":752597}
I20260709 12:29:27.571115  9530 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:27.573055  9548 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:27.574304  9215 consensus_queue.cc:1059] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:29:27.577791  9261 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:27.577154  9548 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.569531  9539 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.586079  9539 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:27.572537  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:27.587328  3851 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:27.587802  9278 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:27.588600  9278 raft_consensus.cc:697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:27.587872  9605 consensus_queue.cc:1059] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:29:27.591382  9605 raft_consensus.cc:3055] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:27.592008  9605 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:27.593600  9605 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:27.594727  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:27.594602  9548 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:27.596206  9420 consensus_queue.cc:1059] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:29:27.598135  9389 consensus_queue.cc:1175] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34711da9380944d2969a2bc3e203db3d" responder_term: 11 status { last_received { term: 11 index: 7 } last_committed_idx: 6 last_received_current_leader { term: 11 index: 7 } }
I20260709 12:29:27.599340  9215 raft_consensus.cc:3055] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:27.572665  9497 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:27.593410  3969 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:27.620561  9215 raft_consensus.cc:740] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:27.549291  9437 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:27.547626  9421 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:27.630827  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 92983.1us
I20260709 12:29:27.632216  3851 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:27.517597  9545 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:27.624552  9215 consensus_queue.cc:260] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.552234  9427 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.714941  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:27.716199  9357 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:29:27.717916  3857 consensus_meta.cc:287] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.002s
I20260709 12:29:27.718079  9210 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:27.718390  3857 raft_consensus.cc:2468] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:27.718664  9210 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:27.719661  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:27.720889  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:27.722414  3852 raft_consensus.cc:1240] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:27.723417  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:27.724668  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:27.725467  3850 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 18: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:27.726397  9605 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:27.727243  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 134204us
I20260709 12:29:27.717582  9409 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:27.741137  9215 raft_consensus.cc:3060] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:27.746932  3895 leader_election.cc:400] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 16. Current term is 17.
I20260709 12:29:27.747363  3895 leader_election.cc:403] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:29:27.749533  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 47555.5us
W20260709 12:29:27.108390  3750 rpcz_store.cc:269] 0709 12:28:46.128396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:46.128759 (+   363us) service_pool.cc:224] Handling call
0709 12:29:26.829636 (+40700877us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:21.249321 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:21.286477 (+ 37156us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:21.286546 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:29:21.286565 (+    19us) tablet.cc:662] Decoding operations
0709 12:29:21.287797 (+  1232us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:21.287886 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:21.287914 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:29:21.289212 (+  1298us) tablet.cc:701] Row locks acquired
0709 12:29:21.289263 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:29:21.289448 (+   185us) write_op.cc:270] Start()
0709 12:29:21.289612 (+   164us) write_op.cc:276] Timestamp: P: 1783600161289382 usec, L: 0
0709 12:29:21.289654 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:29:21.306293 (+ 16639us) log.cc:844] Serialized 5070 byte log entry
0709 12:29:22.000192 (+693899us) op_driver.cc:464] REPLICATION: finished
0709 12:29:22.047978 (+ 47786us) write_op.cc:301] APPLY: starting
0709 12:29:22.048084 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:22.072691 (+ 24607us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:22.072811 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:22.392868 (+320057us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:22.410327 (+ 17459us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:29:22.410391 (+    64us) write_op.cc:312] APPLY: finished
0709 12:29:22.410786 (+   395us) log.cc:844] Serialized 121 byte log entry
0709 12:29:22.410991 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:22.411148 (+   157us) write_op.cc:454] Released schema lock
0709 12:29:22.411215 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:22.411658 (+   443us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:22.411685 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":388135,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":46802,"apply.run_cpu_time_us":19772,"apply.run_wall_time_us":363645,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58415,"num_ops":13,"prepare.queue_time_us":317179,"prepare.run_cpu_time_us":55859,"prepare.run_wall_time_us":385271,"raft.queue_time_us":78695,"raft.run_cpu_time_us":11162,"raft.run_wall_time_us":27440,"replication_time_us":710328,"thread_start_us":500592,"threads_started":4,"wal-append.queue_time_us":292052,"wal-append.run_cpu_time_us":28081,"wal-append.run_wall_time_us":1806780}]]}
I20260709 12:29:27.682273  9545 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:27.665153  9278 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.769697  3999 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:29:27.770895  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:27.770305  3755 catalog_manager.cc:5697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 9 to 12, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 12 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:27.771545  3895 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:27.774173  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:27.775071  4002 raft_consensus.cc:2393] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 14: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:27.779045  9545 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:27.780017  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:27.779858  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:27.781180  3998 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:27.782063  9310 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:27.784036  9433 raft_consensus.cc:2804] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:27.786022  9357 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:27.813099  9357 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:27.815828  9357 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:27.790546  9409 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:27.816613  9409 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:27.818163  3851 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 11. Current term is 12. Ops: []
I20260709 12:29:27.819154  9409 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:27.821026  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2811) took 2108 ms. Trace:
I20260709 12:29:27.822410  9354 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:27.821381  4006 rpcz_store.cc:276] 0709 12:29:25.712560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:25.713209 (+   649us) service_pool.cc:224] Handling call
0709 12:29:25.713532 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:25.713762 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:29:26.146084 (+432322us) log.cc:844] Serialized 14 byte log entry
0709 12:29:27.333076 (+1186992us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b18003f1060. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee7455 00007fe0559cf3c7 00007fe051fe19a7 00007fe051ff10bf 00007fe051ff1038
0709 12:29:27.761943 (+428867us) log.cc:844] Serialized 14 byte log entry
0709 12:29:27.820481 (+ 58538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:27.820559 (+    78us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:29:27.820640 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:27.820735 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:27.820859 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5410,"prepare.queue_time_us":874897,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":109,"raft.queue_time_us":179,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4686,"spinlock_wait_cycles":3727744,"thread_start_us":1274636,"threads_started":3,"wal-append.queue_time_us":674309}
I20260709 12:29:27.825081  9606 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:27.826012  9606 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.826498  9537 raft_consensus.cc:3055] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:27.827008  9537 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:27.829447  9538 raft_consensus.cc:3055] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:27.829859  9538 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:27.830977  9538 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.832372  9538 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:27.791710  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:27.790452  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 62197.7us
I20260709 12:29:27.792053  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:27.794555  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:27.795145  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:27.796402  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:27.796664  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:27.794580  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:27.799721  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:27.799901  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:27.835122  4570 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 18: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:27.801038  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:27.801208  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 1394) took 1114 ms. Trace:
I20260709 12:29:27.801834  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:27.802860  9534 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:27.781567  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:27.785053  9481 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:27.783411  9599 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:29:27.840071  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:27.840807  9552 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:27.841508  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:27.810124  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:27.810452  9056 raft_consensus.cc:3055] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:27.810252  9433 raft_consensus.cc:697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:27.810837  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2389) took 1244 ms. Trace:
W20260709 12:29:27.811494  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 196374us
I20260709 12:29:27.811668  4537 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:27.812285  9421 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:27.836844  4003 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:27.838054  9310 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.810752  9347 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:27.842308  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:27.842371  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:27.842718  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:27.843204  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:27.843813  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:27.835671  4567 rpcz_store.cc:276] 0709 12:29:26.686321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:26.686450 (+   129us) service_pool.cc:224] Handling call
0709 12:29:27.800936 (+1114486us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b54007c2754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:27.801129 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1736037120}
I20260709 12:29:27.773231  3755 catalog_manager.cc:5697] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 8 to 12, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 12 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:27.844853  3822 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:27.856308  3929 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 18: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:27.865015  9354 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:27.865763  9354 raft_consensus.cc:697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:27.866037  3924 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:27.845750  9056 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:27.865661  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:27.847957  3849 rpcz_store.cc:276] 0709 12:29:26.566549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:26.567197 (+   648us) service_pool.cc:224] Handling call
0709 12:29:26.584684 (+ 17487us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:29:26.585088 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:26.585149 (+    61us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:29:26.586496 (+  1347us) log.cc:844] Serialized 52 byte log entry
0709 12:29:27.197197 (+610701us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:29:27.709528 (+512331us) log.cc:844] Serialized 14 byte log entry
0709 12:29:27.810297 (+100769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:27.810399 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:27.810452 (+    53us) raft_consensus.cc:1685] finished
0709 12:29:27.810477 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:27.810665 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":347392,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":75,"raft.queue_time_us":4832,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":12859,"thread_start_us":782734,"threads_started":2,"wal-append.queue_time_us":786116}
I20260709 12:29:27.882825  3931 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:29:27.883854  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:27.888362  3998 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 18: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:27.886493  4538 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:27.895206  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:27.896121  3997 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:27.898171  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:27.858562  9545 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:27.898420  3852 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 12: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:27.870020  9347 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.906715  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:27.867132  9354 consensus_queue.cc:237] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:27.909081  9310 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:27.861764  9537 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.910184  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:27.910754  9537 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:27.911060  4569 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 18: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:27.908906  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:27.909687  9433 consensus_queue.cc:237] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.902328  3755 catalog_manager.cc:5697] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 10 to 12, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 12 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:27.886430  9606 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:27.908843  4570 raft_consensus.cc:2393] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:27.913625  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:27.897272  9421 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:27.911207  9056 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.926568  9056 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:27.927603  9144 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:27.928473  9144 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:27.929471  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 118160us
I20260709 12:29:27.929987  9310 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:27.930698  9310 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.931290  9347 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:27.932838  9310 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:27.933063  3849 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:27.933595  9608 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:27.934237  3926 raft_consensus.cc:2410] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:29:27.934882  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:27.938055  9579 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:27.938644  9579 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:27.939668  3852 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 18: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:27.941011  9579 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:27.926661  9619 log.cc:927] Time spent T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:29:27.930994  9144 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:27.934010  9132 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.933625  3931 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:29:27.957809  9132 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:27.963492  3857 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:27.964008  3852 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:27.960611  3856 raft_consensus.cc:1275] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:29:27.941697  9579 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:29:27.968407  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 134901us
I20260709 12:29:27.898209  9534 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:27.972311  3755 catalog_manager.cc:5697] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 7 to 14, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 14 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:27.978012  3854 consensus_meta.cc:287] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.855s	user 0.005s	sys 0.014s
W20260709 12:29:27.984754  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:28.006037  9531 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:28.006798  9531 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.007212  9367 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:28.007949  9367 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:28.009676  9534 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:27.917018  9420 consensus_queue.cc:1059] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:29:28.020597  9420 raft_consensus.cc:3055] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:29:28.020990  9420 raft_consensus.cc:740] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:28.015336  3924 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:28.018399  3822 leader_election.cc:400] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 16. Current term is 17.
I20260709 12:29:28.023391  3822 leader_election.cc:403] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:28.017629  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:28.030598  9420 consensus_queue.cc:260] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:28.031632  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:28.033818  9389 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:28.034607  3998 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:29:28.034452  9389 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.036562  9389 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:28.021937  3854 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:28.038064  3755 catalog_manager.cc:5697] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 6 to 13, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 13 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:29:28.039665  9513 consensus_meta.cc:287] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.630s	user 0.006s	sys 0.006s
I20260709 12:29:28.040211  9513 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.041180  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:28.015309  9210 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.045954  9210 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:28.039760  3755 catalog_manager.cc:5697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 9 to 12, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 12 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:28.051259  3931 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:29:28.052577  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:28.054503  9637 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:28.014110  9579 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.059952  9579 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:27.963195  9552 consensus_queue.cc:1059] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:29:28.065732  3997 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:28.046137  9347 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 16. Current term is 17.
I20260709 12:29:28.073482  4570 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:29:28.063273  9367 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:28.076419  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:28.078449  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:28.079090  3924 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:28.089020  3925 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 15. Current term is 17. Ops: []
I20260709 12:29:28.071750  3755 catalog_manager.cc:5697] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 7 to 14, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 14 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:28.100239  3755 catalog_manager.cc:5697] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 8 to 13, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 13 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:29:28.101492  9629 log.cc:927] Time spent T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.115s	user 0.000s	sys 0.002s
I20260709 12:29:28.104839  4569 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:28.102362  3755 catalog_manager.cc:5697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 7 to 9, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 9 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:28.070955  9420 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:28.128744  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:28.105710  9531 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:28.131310  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:28.134701  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:28.115521  9513 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:28.137984  3997 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 18: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:29:28.137955  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 116999us
I20260709 12:29:28.142187  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:28.142935  4003 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:28.143347  3998 raft_consensus.cc:1240] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:29:28.146852  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:28.159909  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:28.167956  9427 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:28.134884  3755 catalog_manager.cc:5697] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 5 to 12, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 12 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:28.170885  3755 catalog_manager.cc:5697] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 9 to 14, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 14 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:28.172603  3755 catalog_manager.cc:5697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:28.175757  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:28.176506  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:28.132696  9056 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:28.177631  9056 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.181838  3855 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 16. Current term is 17. Ops: []
W20260709 12:29:28.184990  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 47614.9us
I20260709 12:29:28.204242  3755 catalog_manager.cc:5697] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 10 to 14, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 14 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:28.209836  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:28.187525  9056 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:29:28.210778  4569 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
W20260709 12:29:28.216341  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:28.217149  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:28.218179  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:28.214911  9347 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:28.220664  9389 consensus_queue.cc:1059] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:29:28.221602  9639 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
I20260709 12:29:28.221426  9347 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.221704  9513 consensus_queue.cc:1059] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:29:28.224035  9347 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:28.217641  9531 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:28.221944  9389 raft_consensus.cc:3055] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:28.226125  9389 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:28.227433  9389 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:28.229223  9389 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:28.188463  9261 consensus_queue.cc:1059] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:29:28.231536  3755 catalog_manager.cc:5697] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:28.239645  3970 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:28.225379  9531 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.243516  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:28.244483  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:28.245071  3848 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:28.237290  9545 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:28.248086  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:28.248661  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:28.238664  9608 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:28.247906  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:28.251267  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:28.253091  4566 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:28.253548  9627 raft_consensus.cc:3055] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:28.257836  9627 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:28.257934  4572 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:28.258988  9627 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.260578  9627 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:28.262209  3923 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 18: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:28.252487  3755 catalog_manager.cc:5697] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 9, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 9 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:28.255824  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:28.257097  9367 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:29:28.266327  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:28.267714  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:28.251832  9599 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 16. Current term is 17.
I20260709 12:29:28.275154  9636 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:28.280010  9636 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:28.280443  9636 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:28.286020  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:28.287684  3821 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:28.288552  9534 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:29:28.289340  9534 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:29:28.300859  9408 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:28.301570  9408 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.306841  9408 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:28.309068  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:28.311471  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:28.311662  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:28.312542  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:28.315742  9531 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:28.316111  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:28.321122  4003 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:28.273135  9347 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:28.323628  3928 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
W20260709 12:29:28.325155  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 73391.4us
W20260709 12:29:28.325589  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:28.326261  3970 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:28.321005  3821 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:28.327853  3855 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:29:28.319890  9408 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:28.340585  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:28.329262  3755 catalog_manager.cc:5697] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 6 to 7, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 7 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:28.335181  9636 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:28.349520  9641 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:29:28.350796  9210 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:29:28.359756  9645 log.cc:927] Time spent T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.082s	user 0.002s	sys 0.001s
I20260709 12:29:28.330579  9347 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:28.333262  9408 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:28.366439  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 119914us
I20260709 12:29:28.368652  4566 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:28.344384  9310 raft_consensus.cc:3055] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:29:28.374956  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 48818.9us
I20260709 12:29:28.376953  4571 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:29:28.373530  3755 catalog_manager.cc:5697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:28.378664  3970 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:28.347996  9534 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:29:28.380712  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 59797.1us
I20260709 12:29:28.387562  4570 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:28.366089  9545 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:28.390688  3971 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:28.376543  9347 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:28.377341  9408 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:28.377362  9310 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:28.396221  9310 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.397673  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:28.399071  9056 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:28.399627  9056 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.394208  3755 catalog_manager.cc:5697] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 8 to 13, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 13 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:28.392824  3821 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:28.412009  3854 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:29:28.401818  9562 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:28.414803  3970 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:28.388696  9608 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:28.409575  9310 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:28.416906  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:28.403759  9409 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:28.418380  9579 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:29:28.419327  9638 log.cc:927] Time spent T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:29:28.430563  3821 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:28.415848  9367 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:29:28.435391  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 44763.3us
I20260709 12:29:28.420801  9215 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:28.443733  9497 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:28.444319  9497 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.441547  3970 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:28.452010  3897 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:28.437626  9513 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:28.437415  9056 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:28.454909  3971 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:28.426398  9608 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.446748  9606 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:28.443758  9532 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:28.434577  9537 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:29:28.432570  9545 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:28.455242  9534 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:28.461205  3755 catalog_manager.cc:5697] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 13 to 17, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 17 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:28.466707  3821 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:28.480685  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:28.481348  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:28.447738  9215 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.481371  3848 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:28.466365  9278 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:29:28.466595  9144 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:28.487334  9531 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:28.463021  9562 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
W20260709 12:29:28.490864  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 49417.9us
I20260709 12:29:28.493937  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:28.494176  4536 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:28.493990  3755 catalog_manager.cc:5697] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 5 to 11, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 11 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:29:28.495869  9643 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:29:28.497067  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:28.497676  3925 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:28.465425  9513 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.500833  3755 catalog_manager.cc:5697] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:28.504472  9606 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:28.504604  9576 consensus_queue.cc:1059] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:29:28.505550  9642 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:29:28.506444  3897 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:28.508576  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 53733.4us
W20260709 12:29:28.512072  3741 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 95a53a95fd9f44e59c1b1615b9281948 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f3cab225ecb7488386a1a19239498cfe is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:28.517084  9545 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:28.501756  9531 raft_consensus.cc:697] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:28.519002  9531 consensus_queue.cc:237] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:28.521731  9605 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:28.505565  9576 raft_consensus.cc:3055] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:29:28.515569  3755 catalog_manager.cc:5697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 12, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 12 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:28.536249  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:28.536969  3854 raft_consensus.cc:1240] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 19. Current term is 20. Ops: []
I20260709 12:29:28.537420  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:28.506950  9056 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:28.512499  9411 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:28.544183  4566 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:28.488435  9534 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:28.552946  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 50112.4us
I20260709 12:29:28.556396  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:28.556994  3854 raft_consensus.cc:2393] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 17: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:28.568503  3850 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:28.569770  9534 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:28.571988  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:28.543066  9576 raft_consensus.cc:740] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:28.543550  9056 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:28.574419  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 68174.2us
I20260709 12:29:28.555150  3755 catalog_manager.cc:5697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:28.507170  9481 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:29:28.584054  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:28.581451  3822 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:28.580636  3895 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:28.590521  3755 catalog_manager.cc:5697] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 6 to 12, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 12 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:28.566255  9411 raft_consensus.cc:697] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:28.595706  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:28.599084  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:28.598376  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:28.581595  9056 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:28.603353  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:28.582050  9357 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:28.613963  9576 consensus_queue.cc:260] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:28.614382  9357 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.615315  9576 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:28.616611  9357 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:28.617274  8278 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:28.617631  8278 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:28.617686  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:28.618012  8278 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:28.618252  3930 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:29:28.618350  4566 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:29:28.586501  9210 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:29:28.610579  9411 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.611549  9608 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:28.611675  9215 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:28.612458  9605 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:28.612895  9592 consensus_queue.cc:1048] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:28.613315  9513 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:28.636485  4566 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:29:28.641309  9056 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.629144  3821 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:28.678362  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 49295.1us
I20260709 12:29:28.644174  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:28.660650  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:28.624420  9420 consensus_meta.cc:287] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.002s
I20260709 12:29:28.604470  3755 catalog_manager.cc:5697] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:28.674533  3932 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:29:28.673719  8278 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:28.681289  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 77352.3us
I20260709 12:29:28.681771  9545 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:28.682462  9310 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:29:28.685420  3821 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:28.688943  8278 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:28.687568  3895 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:28.692983  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:28.694648  3821 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:28.696628  8278 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:29:28.683314  9644 log.cc:927] Time spent T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 12:29:28.698966  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:28.693773  9357 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:29:28.701473  3852 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:29:28.701546  3855 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:29:28.703619  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:28.706864  9497 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:28.710994  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:28.711865  3854 raft_consensus.cc:2410] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:29:28.712013  9636 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:28.718295  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:28.722766  3971 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:28.723677  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:28.727718  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 50726.5us
I20260709 12:29:28.683166  9605 raft_consensus.cc:697] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:28.687988  9545 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:28.688510  9354 raft_consensus.cc:3055] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:28.689553  9562 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:28.743966  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:28.758906  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 60008.4us
I20260709 12:29:28.759132  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:28.734422  9409 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:28.738514  9637 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:28.739161  9545 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:28.737437  9357 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:28.791157  3855 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:29:28.791385  9409 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:28.738879  9354 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:28.793593  9210 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:28.740705  9389 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:28.738588  9278 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:28.788033  9592 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:28.801998  9357 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:28.806070  9608 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:28.762521  9562 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.836440  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:28.828088  9278 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.848183  3853 raft_consensus.cc:2410] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:29:28.850920  9608 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.851874  9278 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:28.854359  9409 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.861508  9537 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:28.862296  9537 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.866952  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:28.868371  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:28.876308  9354 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.877869  9354 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:28.834636  9357 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:28.853616  9608 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:28.840782  9592 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:28.842787  9215 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:28.836360  9606 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:28.914624  3897 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:28.864800  9537 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:28.922041  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:28.923004  3853 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:28.884289  9599 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
W20260709 12:29:28.932140  9647 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 12:29:28.912034  9389 raft_consensus.cc:697] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:28.909657  9481 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 12:29:28.927621  9627 consensus_meta.cc:287] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.667s	user 0.014s	sys 0.000s
W20260709 12:29:28.943190  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:28.910787  9347 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:28.984958  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 46689.6us
W20260709 12:29:28.973039  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 140685us
I20260709 12:29:28.987723  8992 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:28.988046  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:28.989982  9650 consensus_queue.cc:1059] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 12:29:28.995836  3997 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:29:28.998587  9389 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.000660  9545 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:28.933485  9367 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:29:28.971627  9408 consensus_meta.cc:287] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.554s	user 0.003s	sys 0.007s
I20260709 12:29:28.923784  9278 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:29:28.974802  9056 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:29.027796  9649 log.cc:927] Time spent T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:29:29.030519  9592 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:28.909467  9605 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.020773  3854 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:29:29.022426  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:29.044123  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:29.024049  9656 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:29.024427  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:29.041390  3853 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:29.042589  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:29.045326  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:29.048520  3923 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:29:29.049191  3997 raft_consensus.cc:2393] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 18: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:28.932633  9215 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:29.053486  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 144498us
I20260709 12:29:29.058921  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:29.062156  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:29.068900  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:29.018772  9651 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:28.975354  9606 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:29.019224  9532 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:29:29.076555  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 61333.8us
I20260709 12:29:29.081858  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:29.087368  3999 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 12: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:29.090938  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:29.034495  9408 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:29.091969  3897 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:29.094230  9651 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.095527  9606 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:29.070524  9481 raft_consensus.cc:3055] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:29.095840  9215 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:29.057607  9656 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.068131  9367 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:29.092732  9545 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:29.114846  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:29.104703  9481 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:29.104543  9599 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:29.138913  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:29.140415  3999 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:29.144340  9408 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:29.180565  9656 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:29.190914  9347 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:29.199698  3923 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
W20260709 12:29:29.142300  4537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.555s (SENT) [suppressed 4 similar messages]
I20260709 12:29:29.202973  3821 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:29.204576  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:29.206152  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:29.206967  3927 raft_consensus.cc:2410] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:29:29.207775  9562 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:29.209527  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 138104us
I20260709 12:29:29.210400  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:29.106757  9532 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:29.140640  9144 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:29:29.220053  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:29.225198  9671 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:29:29.225308  9357 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.227557  9357 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:29.225322  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:29.230108  3998 raft_consensus.cc:2410] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:29:29.237246  3854 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:29.236088  3969 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:29.239310  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:29.216289  9648 log.cc:927] Time spent T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:29:29.213573  9656 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:29.216854  9592 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:29.240247  4536 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:29.243635  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:29.251544  3999 raft_consensus.cc:2393] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 13: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:29.143007  9599 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:29.256963  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:29.266404  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:29.314404  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 104114us
I20260709 12:29:29.245208  9673 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:29.316674  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 174392us
I20260709 12:29:29.251920  9562 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:29.258385  9534 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:29.324826  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:29.246104  9592 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:29.322688  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:29.327147  4566 raft_consensus.cc:2410] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:29:29.328083  9592 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:29.328616  3822 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:29.329339  9636 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:29.306370  9656 raft_consensus.cc:697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:29.252724  9354 consensus_queue.cc:1059] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:29:29.245790  9481 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.333755  9674 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:29.336777  9309 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:29.325837  9627 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:29.341411  9309 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:29.342280  9532 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:29.342430  9309 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.343165  9354 raft_consensus.cc:3055] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:29.343571  9354 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:29.344380  9354 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.345772  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:29.341431  9627 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.342718  9656 consensus_queue.cc:237] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:29.348214  9627 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:29.323935  9278 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:29.338972  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:29.349234  9278 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.351558  9278 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:29.345645  9354 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:29.326009  9056 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:29.358218  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:29.334635  9636 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:29.359755  9651 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:29.352540  9534 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:29.404238  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 49839us
I20260709 12:29:29.360688  9056 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.336356  9673 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.358765  9674 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.428516  4567 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:29.429497  9674 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:29.432112  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:29.439601  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:29.439862  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:29.385309  9636 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.441542  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:29.445292  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:29.442215  4574 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:29.445847  4006 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:29.447654  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:29.440331  9627 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:29.443578  9420 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:29.447783  9658 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:29.490744  4537 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:29.495939  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:29.496603  4570 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:29.462591  9599 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:29.502169  4573 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:29:29.503592  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:29.504320  4571 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:29.505911  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:29.508688  9056 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:29.510993  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:29.497288  9679 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.111s	user 0.000s	sys 0.002s
I20260709 12:29:29.518397  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:29.519361  4570 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:29.520782  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:29.521507  3857 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:29.489446  9420 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.522995  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:29.523756  3927 raft_consensus.cc:2393] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 11: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:29.524046  9420 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:29.486395  9627 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.524719  4572 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
I20260709 12:29:29.526180  9627 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:29.498255  9658 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.528105  9658 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:29.533995  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:29.534648  4003 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:29.535336  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:29.490309  9310 consensus_queue.cc:1059] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:29:29.542745  3971 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:29.546058  9576 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:29.557296  3822 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:29.513147  9534 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:29.528685  9513 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:29:29.549358  4002 raft_consensus.cc:2410] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:29:29.559561  9655 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:29.572937  9655 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:29.573300  9655 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:29.577354  9310 raft_consensus.cc:3055] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:29.577757  9310 raft_consensus.cc:740] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:29.550873  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:29.578547  9310 consensus_queue.cc:260] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:29.579330  4006 raft_consensus.cc:2393] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 13: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:29.551188  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:29.537695  9651 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:29.580165  4571 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:29.552315  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:29.580847  3998 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:29.580559  9651 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:29.582782  9651 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:29.583124  9683 log.cc:927] Time spent T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.156s	user 0.002s	sys 0.000s
I20260709 12:29:29.583228  9576 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:29.585354  9576 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:29.579990  9310 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:29.513080  9210 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:29.586086  9367 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:29.549154  9677 log.cc:927] Time spent T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Append to log took a long time: real 0.212s	user 0.003s	sys 0.000s
I20260709 12:29:29.586275  9210 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:29.586138  9636 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:29.560478  4538 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:29.561923  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:29.564425  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:29.588457  9210 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:29.565534  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:29.568243  4005 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:44346
I20260709 12:29:29.589154  3925 raft_consensus.cc:2393] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:29.589218  4005 raft_consensus.cc:606] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:29.580338  3997 raft_consensus.cc:2410] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:29:29.551610  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:29.589776  9347 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:29.593358  4000 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:29.548300  9673 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:29.593815  3998 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:29.594237  9673 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:29.594449  3970 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:29.594764  9673 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:29.596560  9354 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:29.597000  9673 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:29.564966  9545 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:29.597658  9545 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:29.597740  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:29.598207  9545 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:29.602082  9665 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:29.603220  3970 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:29.603899  9354 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:29.604254  9665 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:29.604434  9354 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.606328  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:29.606588  9354 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:29.607879  9354 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:29.609943  3970 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:29.610076  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:29.610818  3855 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:29.617511  3822 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:29.626221  8278 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:29.628247  3925 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:29:29.628822  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:29.623194  9354 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:29.629469  3855 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:29.631533  9637 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:29.632448  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:29.633364  4570 raft_consensus.cc:2368] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12.
W20260709 12:29:29.634239  9684 log.cc:927] Time spent T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.207s	user 0.000s	sys 0.003s
I20260709 12:29:29.623668  3822 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:29.636374  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:29.637607  9534 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:29:29.637862  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 77492.4us
I20260709 12:29:29.638065  9534 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:29.638458  9534 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:29.641201  4538 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:29.643841  9688 log.cc:927] Time spent T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:29:29.646577  4572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:29:29.647207  4572 raft_consensus.cc:606] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:29.632586  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:29.647552  4572 raft_consensus.cc:614] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:29.651301  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:29.637764  8278 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:29.647986  3931 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:29.656054  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:29.656574  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:29.656716  3850 raft_consensus.cc:2368] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15.
I20260709 12:29:29.657389  4003 raft_consensus.cc:2410] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:29:29.658509  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:29.659068  3857 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:29.658905  3970 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:29.637633  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:29.662065  8278 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:29.662444  8278 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:29.662765  8278 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:29.652550  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:29.664584  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:29.661688  3822 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:29.667950  3856 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:29:29.668495  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 138879us
I20260709 12:29:29.671563  3970 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:29.673247  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:29.666293  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:29.670346  4536 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:29.674533  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:29.675127  3853 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:29.663669  9481 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:29.683152  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:29.664022  9215 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:29.700973  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:29.682186  9056 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:29.711823  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:29.667665  9309 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:29:29.676064  9534 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:29.713126  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:29.714727  9534 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:29.715431  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:29.682322  9367 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:29:29.716483  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:29.701849  9562 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:29.696069  9599 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:29.718116  9215 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:29.718566  9215 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:29.718324  9599 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.718964  9215 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:29.720659  9599 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:29.726779  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 55308.9us
W20260709 12:29:29.738302  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 76669.4us
I20260709 12:29:29.741240  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:29.756027  3895 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:29.768105  8278 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:29.769294  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:29.771113  3997 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:29:29.776818  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:30.024657  8278 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.024719  4000 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:30.029109  4000 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:29.769416  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:30.030467  4005 raft_consensus.cc:2368] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12.
I20260709 12:29:29.782838  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:29.783857  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:29.790408  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:30.035812  4003 raft_consensus.cc:2393] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 15: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:29:29.862329  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 202302us
I20260709 12:29:29.754799  9347 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:30.037173  9347 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:30.037609  9347 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:29.758347  9367 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:29.757191  9592 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.039876  3930 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:29:30.040963  9592 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.046463  9637 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:29:30.051625  9532 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:30.052399  9532 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.055366  8278 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:30.056118  8278 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:30.001783  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 331502us
W20260709 12:29:30.016058  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 456177us
I20260709 12:29:30.078143  9562 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:29:30.079479  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:30.081892  9562 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:30.082481  9562 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:30.082954  9562 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:30.088181  4536 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:30.091576  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:30.091939  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:29.775334  3822 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:29.778023  9576 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:30.094456  9656 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:30.094781  9576 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:30.095006  9656 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:30.095526  9656 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:30.016750  9545 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:30.097383  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:30.097510  3854 raft_consensus.cc:1240] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:30.095372  9576 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:29:30.132792  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 101696us
I20260709 12:29:30.134588  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:30.135700  9605 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:30.136421  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:30.136343  9605 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:30.137141  3930 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:29:30.138598  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:30.139221  3930 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
I20260709 12:29:30.140535  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:30.140605  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:30.140969  9545 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:30.145035  9605 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:30.017586  9056 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:30.017899  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:30.018631  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:30.019263  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:30.019274  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:30.021248  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:30.022158  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:29.710724  9661 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:30.022500  4001 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 17. Current term is 18. Ops: []
W20260709 12:29:30.150101  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 62020.3us
W20260709 12:29:30.150451  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 379079us
I20260709 12:29:30.172783  3822 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:30.162177  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:30.191917  8278 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:30.194975  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 59698.2us
I20260709 12:29:30.168002  3969 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:30.198602  4571 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:29:30.197913  3969 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:30.154511  9655 consensus_meta.cc:287] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.581s	user 0.012s	sys 0.006s
I20260709 12:29:30.158522  9309 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:30.246346  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:30.203287  8278 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:29:30.202983  3822 leader_election.cc:400] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12.
I20260709 12:29:30.252429  3822 leader_election.cc:403] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:30.155638  9411 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:29:30.249317  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 51487.6us
I20260709 12:29:30.202904  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:30.254650  4566 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 12.
I20260709 12:29:30.150197  9532 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.255970  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:30.256664  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:30.256747  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 53912.4us
I20260709 12:29:30.262173  3822 leader_election.cc:400] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12.
I20260709 12:29:30.150321  9699 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:30.265738  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:30.267518  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:30.257300  8278 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:29:30.257725  3969 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:30.259287  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:30.203543  9354 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:30.246129  9636 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:29:30.275285  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:30.149824  9215 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.277019  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:30.275429  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:30.196636  9661 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.281775  3850 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 20.
I20260709 12:29:30.202584  9534 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:30.264780  9278 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:30.308581  9278 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:30.309077  9278 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:30.310148  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:30.295109  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:30.265635  9699 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:30.322948  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 83692.5us
I20260709 12:29:30.298805  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:30.300611  3929 raft_consensus.cc:3055] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:30.326277  3929 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:30.301034  3853 raft_consensus.cc:1240] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:30.262034  9309 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.277966  9411 raft_consensus.cc:697] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:30.305969  3924 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:29:30.332273  3924 pending_rounds.cc:85] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 10
I20260709 12:29:30.281021  9357 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:30.307714  9534 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.283237  3969 leader_election.cc:400] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15.
I20260709 12:29:30.336158  3969 leader_election.cc:403] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:30.327584  4567 raft_consensus.cc:1275] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:29:30.256462  9655 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:30.328258  9481 consensus_meta.cc:287] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.631s	user 0.012s	sys 0.004s
W20260709 12:29:30.331207  9695 log.cc:927] Time spent T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:29:30.328424  3854 raft_consensus.cc:2393] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 12: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:30.329217  4005 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:44346
I20260709 12:29:30.348821  4005 raft_consensus.cc:606] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:30.349200  4005 raft_consensus.cc:614] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:30.329602  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:30.330526  4537 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:30.337359  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 54343.4us
I20260709 12:29:30.351213  9627 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:30.294003  9636 raft_consensus.cc:697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:30.353083  9636 consensus_queue.cc:237] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:30.326823  9699 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:30.332544  3924 pending_rounds.cc:107] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:29:30.335377  3929 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.362130  3924 raft_consensus.cc:2889] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:30.362406  3929 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:30.304672  9347 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.279315  9433 consensus_queue.cc:1059] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:29:30.351264  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:30.365365  9705 raft_consensus.cc:3055] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:30.365800  9705 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:30.366189  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:30.366990  9420 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:30.366820  9705 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:30.367380  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:30.367733  9420 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:30.368130  9513 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:30.368254  9705 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:30.345749  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:30.369310  4537 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:30.370622  4537 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:30.371352  9627 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:30.371723  4537 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:30.372545  9627 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:30.373790  4537 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:30.375375  9627 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:30.280382  9354 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:30.375679  4537 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:30.331419  9696 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:30.387573  3929 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:29:30.394757  3854 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:30.385805  3999 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:30.331310  9532 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:30.411090  3997 raft_consensus.cc:1240] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 15. Current term is 16. Ops: []
W20260709 12:29:30.411386  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 60440.9us
I20260709 12:29:30.309078  9562 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.344751  9210 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:29:30.416520  3848 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:29:30.410656  4537 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:30.378793  9354 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:30.414090  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:29:30.382007  9658 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:30.347962  9056 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:30.418716  3895 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:30.421545  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 75102.9us
I20260709 12:29:30.408130  9420 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:30.427824  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:30.428421  3931 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:29:30.405359  9690 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:30.424721  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:30.436904  4006 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:30.411175  9674 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:30.437600  8278 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12.
I20260709 12:29:30.417440  9579 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:30.381690  9665 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 12:29:30.463927  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:30.476250  4567 raft_consensus.cc:2393] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 16: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:30.422937  9347 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.481542  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:30.481855  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:30.489738  4572 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:30.436448  9433 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:29:30.414724  9696 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.417184  9532 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.494910  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:30.483175  8278 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:30.466423  9576 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:30.520612  8278 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.524672  3970 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:30.436887  9658 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.495530  9433 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:30.435967  9056 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.534489  3930 raft_consensus.cc:2393] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 15: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:30.503356  9627 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:30.535892  8278 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.536540  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:30.537506  9576 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:30.537654  9708 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:29:30.539458  9696 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:30.540195  4565 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:29:30.541008  9661 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.545338  9709 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:30.545739  9433 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:29:30.556365  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 79669.5us
I20260709 12:29:30.464267  9690 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.583681  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:30.603606  4569 raft_consensus.cc:2368] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12.
I20260709 12:29:30.604848  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:30.585867  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:30.586899  9278 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.587674  9699 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.557916  4568 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:30.591696  8278 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:30.594601  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:30.616271  3857 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:30.597584  9696 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:29:30.597954  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:30.599220  9627 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:29:30.491353  9579 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.474190  9674 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.605707  4571 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 18.
I20260709 12:29:30.619963  3848 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 18.
I20260709 12:29:30.627393  8278 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:30.645218  4566 raft_consensus.cc:2368] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13.
I20260709 12:29:30.651564  9534 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.652887  3999 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 2827) took 1391 ms. Trace:
I20260709 12:29:30.653292  3999 rpcz_store.cc:276] 0709 12:29:29.261790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:29.266131 (+  4341us) service_pool.cc:224] Handling call
0709 12:29:30.652710 (+1386579us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540032ffd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:30.652809 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2472099712}
I20260709 12:29:30.655157  3929 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:30.516093  9411 consensus_queue.cc:237] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.665714  8278 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:30.624976  9513 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:30.670045  9534 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:30.676077  9534 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:30.679437  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 87784.6us
W20260709 12:29:30.672345  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 261751us
I20260709 12:29:30.681142  4537 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:30.633147  9697 raft_consensus.cc:3055] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:30.684537  3857 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:30.639899  9722 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:30.664954  9215 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:30.692092  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:30.671108  9309 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:30.699994  8278 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:30.699544  3822 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:30.615206  9709 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.673281  9707 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:30.704761  8278 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:30.729523  8278 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:30.730023  8278 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:30.716084  9579 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.718565  9278 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.701921  9562 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.720002  9658 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.720260  9699 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:30.724673  9210 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15.
I20260709 12:29:30.725083  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:30.745553  3853 raft_consensus.cc:2393] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:30.725955  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:30.726275  3822 leader_election.cc:400] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12.
I20260709 12:29:30.746104  3848 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:30.684669  9697 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:29:30.695004  9712 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:29:30.728251  4536 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:30.746098  3822 leader_election.cc:403] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:29:30.752148  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 47734.2us
I20260709 12:29:30.752869  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:30.756182  3822 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:30.758351  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:30.760383  4536 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:30.760524  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:30.759181  4574 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:30.761286  4573 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:30.744338  9534 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:30.766234  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:30.766620  4001 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:29:30.769121  3854 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:29:30.770469  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:30.791962  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:30.794289  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:30.794497  3853 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:30.752717  9696 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:30.771135  9215 raft_consensus.cc:2804] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:29:30.821009  9215 raft_consensus.cc:697] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:30.803742  9723 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:30.822359  9723 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:30.822177  9215 consensus_queue.cc:237] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:30.824934  9656 consensus_meta.cc:287] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.729s	user 0.008s	sys 0.002s
I20260709 12:29:30.704371  9722 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.827134  9674 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:30.828438  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 413768us
W20260709 12:29:30.830039  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 402120us
I20260709 12:29:30.830569  8278 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:30.755146  9545 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12.
I20260709 12:29:30.762705  9636 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:30.766350  9699 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:30.771399  9690 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:30.754788  9532 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.815739  9420 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:30.816704  9709 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:30.760736  9056 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:30.735577  9707 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:30.822739  9723 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:30.804988  3897 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:30.835366  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:30.836053  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:30.865309  4574 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:30.843894  3856 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:30.844439  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:30.866534  3852 raft_consensus.cc:2393] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 18: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:30.847772  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:30.866982  3855 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:29:30.868681  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 63748.9us
I20260709 12:29:30.848156  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:30.849114  3853 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
W20260709 12:29:30.850342  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 325777us
I20260709 12:29:30.871546  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:30.825486  9656 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:30.860356  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:30.872691  4571 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:30.827208  9722 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.861967  8278 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.852073  9636 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:30.855979  9699 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:30.887359  3970 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:30.877537  9656 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:30.877934  3852 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:30.855613  9650 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:30.880064  9433 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:30.881915  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:30.882128  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:30.899744  3857 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:30.891837  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:30.900992  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:30.902547  4005 raft_consensus.cc:2410] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:29:30.903225  4570 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:29:30.905061  3856 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:30.909585  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:30.913774  4570 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:29:30.914150  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:30.915030  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:30.915293  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:30.915619  4571 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:30.920348  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:30.920974  3998 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 20.
I20260709 12:29:30.922448  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:30.922964  3970 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:30.935982  4571 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:30.937136  3855 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:30.937389  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:30.937752  3822 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:30.941716  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:30.943332  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:30.944101  3929 raft_consensus.cc:2393] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 16: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:30.944666  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:30.945307  3927 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
I20260709 12:29:30.946748  3998 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:29:30.940155  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:30.955466  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:30.956308  3926 raft_consensus.cc:3060] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:30.948665  3822 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:30.885497  9636 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:30.886456  9689 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:30.965341  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:30.991858  3927 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:29:30.898769  9699 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:30.962623  3822 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:30.947027  9481 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:29:30.982867  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 59973.8us
I20260709 12:29:30.985136  9409 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:30.986061  9562 raft_consensus.cc:993] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:30.903501  9606 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:30.993479  3848 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:31.001730  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:30.997705  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:30.998747  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 97992.6us
I20260709 12:29:31.005118  4536 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:31.008834  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:31.009464  3925 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 18.
I20260709 12:29:31.009663  8278 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:30.960584  9705 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:30.998972  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:31.013322  9354 consensus_meta.cc:287] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.000s
I20260709 12:29:30.991293  9689 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:31.021246  3926 raft_consensus.cc:2468] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:30.962283  9655 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:30.967942  9656 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:31.024508  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:31.025537  4573 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:30.989239  9579 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:31.023648  3821 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:31.030843  4574 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:31.035087  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:31.026090  9735 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:31.010566  9347 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:31.036077  3926 raft_consensus.cc:2368] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12.
I20260709 12:29:31.037283  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:31.041409  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:31.042080  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:31.043828  3923 raft_consensus.cc:1275] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:29:31.044317  3821 leader_election.cc:400] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 11. Current term is 12.
I20260709 12:29:31.044920  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:31.030819  9354 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:31.046736  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:31.046871  9733 consensus_queue.cc:1048] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.149s
I20260709 12:29:31.047888  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:31.048359  9310 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:31.028699  9658 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:31.049535  4002 raft_consensus.cc:2393] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 15: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:31.048585  9354 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:30.993764  9576 consensus_queue.cc:1059] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:29:31.052968  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:31.057245  3848 raft_consensus.cc:2393] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 15: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:31.028810  9562 raft_consensus.cc:1081] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:31.028621  9420 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:31.031106  9689 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:30.885159  9697 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.061731  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:31.075081  3895 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:31.039099  9722 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:31.076295  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:31.076386  9389 consensus_queue.cc:1059] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:31.077033  3928 raft_consensus.cc:2393] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 15: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:31.078976  9659 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:31.046645  9409 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:29:31.079512  9659 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:31.062307  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:31.031291  9579 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:31.031057  9656 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:31.065485  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:31.058585  9411 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:29:31.066409  9734 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:31.058727  9545 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:29:31.067052  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:31.035518  9716 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:31.034512  9705 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.071416  9433 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 21 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:31.059104  9735 raft_consensus.cc:697] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:31.072947  3971 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:31.034502  9661 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:31.061520  9310 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:31.077823  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:31.125417  3927 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:31.139891  3928 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
W20260709 12:29:31.137765  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 64894.4us
I20260709 12:29:31.141716  9706 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:31.141770  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:31.142721  9716 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:31.124166  9658 raft_consensus.cc:3055] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:31.074793  9420 raft_consensus.cc:697] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:31.060051  9733 consensus_queue.cc:1059] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 12:29:31.119972  9656 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:31.138552  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:31.131376  3897 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:31.120375  9579 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:31.149410  3926 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:31.123317  9722 raft_consensus.cc:697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:31.151283  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:29:31.155303  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 79348.7us
I20260709 12:29:31.158874  3931 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:31.139214  9357 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:31.164721  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:31.173898  3971 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:31.132370  9513 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:29:31.166561  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:31.166718  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:31.172477  3970 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:31.132647  9215 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:29:31.175115  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:31.146852  3848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42066
I20260709 12:29:31.182968  3848 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:31.183488  3848 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:31.176488  3931 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:31.148211  9658 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:31.177006  4005 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:29:31.191238  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:31.190850  9658 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.192251  9658 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:31.192507  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:31.178851  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:31.127142  9734 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.153172  9408 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:31.181165  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:31.177697  3999 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:31.137492  8992 consensus_queue.cc:1059] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:29:31.149068  9706 raft_consensus.cc:697] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:31.198967  4005 raft_consensus.cc:1275] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:29:31.176971  9655 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:31.202971  3848 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.203055  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:31.176040  9721 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:31.182089  9310 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:31.209995  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:31.181533  9367 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:29:31.213368  3997 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
W20260709 12:29:31.214861  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 47166.5us
I20260709 12:29:31.215389  8278 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:31.215608  3822 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:31.158766  9735 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.177565  9357 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.200217  9592 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:31.217247  9420 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.230302  9367 raft_consensus.cc:697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:31.231370  9367 consensus_queue.cc:237] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.232506  9659 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:31.202360  9409 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:31.224090  9705 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:31.229717  9716 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:31.225984  9722 consensus_queue.cc:237] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:31.223062  9706 consensus_queue.cc:237] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:31.237031  3848 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:31.232673  9699 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.239493  3998 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 18.
I20260709 12:29:31.232678  9747 consensus_queue.cc:1059] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:29:31.201557  9408 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:31.246552  3822 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:31.246718  8278 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:29:31.249624  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:31.248034  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:31.250017  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 68563.9us
I20260709 12:29:31.252271  3854 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:29:31.255232  8278 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:31.255287  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:31.255676  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:31.257237  8278 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:31.252594  9532 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:29:31.260152  9748 log.cc:927] Time spent T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:29:31.262856  9661 raft_consensus.cc:3055] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:31.263270  9661 raft_consensus.cc:740] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:31.264035  9661 consensus_queue.cc:260] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:31.265189  9661 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:31.251722  9707 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:31.217813  9655 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:31.270814  3897 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:31.271845  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:31.227571  9734 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:31.252326  9408 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:31.270339  9481 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:31.274746  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:31.277256  3997 raft_consensus.cc:3055] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:31.277637  3997 raft_consensus.cc:740] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:31.254369  9747 raft_consensus.cc:3055] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:31.282645  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:31.286170  9481 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:31.287501  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:31.287781  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:31.295013  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:31.290849  4006 raft_consensus.cc:3060] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:29:31.292311  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:31.278282  3997 consensus_queue.cc:260] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.296911  3997 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:31.299679  3850 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:31.287281  9144 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:31.301630  9144 consensus_queue.cc:1059] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:31.303555  9481 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:31.217607  9721 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:31.314725  3897 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:31.267823  9579 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.275410  9658 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:29:31.290464  9747 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:31.327952  3897 leader_election.cc:400] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13.
I20260709 12:29:31.328076  9752 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:31.330541  3897 leader_election.cc:403] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:31.342538  3997 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:31.343953  3854 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 21.
I20260709 12:29:31.343998  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:31.348394  8278 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:31.349004  8278 raft_consensus.cc:697] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:31.348520  9655 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.349967  8278 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.351174  9532 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:31.346657  3895 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:31.334568  9656 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.321547  9707 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:29:31.344931  9752 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13.
I20260709 12:29:31.362425  9699 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:31.365317  4006 raft_consensus.cc:2468] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 21.
I20260709 12:29:31.366716  9721 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:31.377418  9749 raft_consensus.cc:3055] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:31.377978  9749 raft_consensus.cc:740] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:31.380402  3821 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:31.380847  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:31.380779  3970 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:31.351760  9532 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.384011  3821 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:31.400046  3849 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:29:31.402828  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:31.404423  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:31.405282  4006 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:31.406947  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:31.395386  9659 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:31.388727  9722 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:31.487293  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:31.490410  3930 raft_consensus.cc:2393] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:31.492525  4537 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:31.494650  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:31.495445  4568 raft_consensus.cc:2368] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 18. Current term is 19.
I20260709 12:29:31.495648  9408 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.497469  9696 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:29:31.485962  9755 log.cc:927] Time spent T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:29:31.477609  9347 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:31.399483  9599 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:31.481818  9562 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:31.486279  9532 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:31.503477  4565 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: []
W20260709 12:29:31.503752  9739 log.cc:927] Time spent T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.434s	user 0.003s	sys 0.000s
I20260709 12:29:31.384833  9751 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:31.505450  3821 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:31.526109  4537 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:31.511678  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:31.507254  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:31.513523  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:31.388381  9545 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:31.516893  3897 leader_election.cc:400] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 18. Current term is 19.
I20260709 12:29:31.532059  3897 leader_election.cc:403] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:31.388083  9707 raft_consensus.cc:2804] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:29:31.519681  4538 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:31.403235  9636 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.512591  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:31.508574  9347 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:31.535434  3848 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:29:31.526847  4572 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:31.379172  9749 consensus_queue.cc:260] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.539372  4569 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:31.569577  9420 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:31.537386  9721 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:31.474898  9747 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:31.587560  9697 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:31.539703  9310 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:29:31.591275  3851 raft_consensus.cc:2368] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14.
I20260709 12:29:31.576799  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:31.570552  9726 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:31.579380  9714 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:29:31.600101  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51898 (request call id 1092) took 1237 ms. Trace:
I20260709 12:29:31.525521  9562 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.514602  9599 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:31.634737  9562 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:31.600172  9726 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:31.635596  9726 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:31.583431  9408 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:31.584378  9751 consensus_queue.cc:1059] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:29:31.588147  9747 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:31.526777  9696 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:31.641541  9696 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.642485  9357 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:31.602718  4538 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:31.644568  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:31.605501  9722 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:31.612537  9636 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:31.612620  9420 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:31.615497  9656 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:31.619472  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:31.658874  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:31.620386  9579 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:31.566717  9347 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:31.667689  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:31.627592  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:31.630407  9689 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.600621  4000 rpcz_store.cc:276] 0709 12:29:30.340159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:30.340335 (+   176us) service_pool.cc:224] Handling call
0709 12:29:30.340611 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:31.082267 (+741656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:31.082313 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:31.082368 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:29:31.082418 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:31.577707 (+495289us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54000c6554. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:31.577763 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:31.577939 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1705098112}
I20260709 12:29:31.649513  4569 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:31.652287  3897 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:31.654605  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:31.662595  4574 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:29:31.666016  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:31.672288  4573 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:31.667009  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:31.673208  4568 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:31.682740  3897 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:31.634740  9599 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:31.694497  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:31.704128  3853 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:31.653730  9699 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:31.705849  3930 raft_consensus.cc:1275] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:29:31.706300  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:31.707763  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:31.708334  3926 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:31.709401  3924 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:31.675028  9605 raft_consensus.cc:3055] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:31.713667  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:31.716965  3923 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:31.709489  3971 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:31.677413  9734 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:31.718482  4570 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:31.685379  9661 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:31.690600  8992 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:31.710685  9699 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:31.655622  9722 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:31.742352  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:31.743355  3854 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:31.720101  9749 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:31.794122  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:31.718075  9605 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:31.795648  3853 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:31.734263  9696 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:31.722131  9310 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 18. Current term is 19.
I20260709 12:29:31.735399  9562 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:31.721786  9734 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:31.905824  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:31.716221  9599 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:29:31.709619  9732 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:29:31.740869  9699 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:29:31.940209  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 194386us
I20260709 12:29:31.949891  4573 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:29:31.777788  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:31.978546  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:31.932976  3848 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:29:31.715633  9409 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
W20260709 12:29:31.960925  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 239331us
I20260709 12:29:31.965606  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:31.777040  9357 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:29:32.007242  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 324270us
I20260709 12:29:32.013388  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:32.014052  3853 raft_consensus.cc:3060] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:32.015751  4537 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:32.018796  3926 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:29:32.020695  9599 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:31.977092  9696 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:31.996356  9562 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:32.021343  9599 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:32.039024  9764 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:29:32.040643  3897 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:32.050590  9767 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
W20260709 12:29:32.054687  9765 log.cc:927] Time spent T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:29:32.055384  9696 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.058871  9773 consensus_queue.cc:1048] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:29:32.070850  9745 log.cc:927] Time spent T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.945s	user 0.000s	sys 0.036s
W20260709 12:29:32.083724  9723 consensus_meta.cc:287] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 1.181s	user 0.010s	sys 0.011s
I20260709 12:29:32.213048  9723 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.215601  9723 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:32.087309  9720 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:32.093487  3931 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:29:32.099020  9722 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:32.107621  3853 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:29:32.112767  9689 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:32.011791  9357 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.218675  9599 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:32.219367  9357 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:32.117622  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43302 (request call id 2969) took 1076 ms. Trace:
I20260709 12:29:32.220072  3924 rpcz_store.cc:276] 0709 12:29:31.041018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:31.041154 (+   136us) service_pool.cc:224] Handling call
0709 12:29:32.117430 (+1076276us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54000d5a54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:32.117528 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534620416}
I20260709 12:29:32.029940  9605 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.008078  9734 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:32.224562  3855 raft_consensus.cc:2368] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 18. Current term is 19.
W20260709 12:29:32.149999  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:32.172595  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 132071us
I20260709 12:29:32.173810  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:32.231577  9726 consensus_meta.cc:287] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.596s	user 0.014s	sys 0.004s
I20260709 12:29:32.232046  9726 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.131279  9562 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:32.177968  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:32.174090  3969 leader_election.cc:400] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14.
W20260709 12:29:32.250430  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 106151us
I20260709 12:29:32.251268  3969 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:32.240767  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:32.249754  3854 raft_consensus.cc:2368] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 17. Current term is 18.
I20260709 12:29:32.242528  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:32.257407  3895 leader_election.cc:400] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 17. Current term is 18.
I20260709 12:29:32.257833  3895 leader_election.cc:403] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:29:32.258792  4574 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:32.244786  3848 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:29:32.245438  3850 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 12:29:32.267964  3925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.002s	sys 0.023s
I20260709 12:29:32.178422  9733 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:29:32.268321  3971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.014s	sys 0.011s
W20260709 12:29:32.297338  3971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.014s	sys 0.013s
I20260709 12:29:32.237699  9771 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:32.258695  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:32.290575  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:32.291733  3969 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:32.268632  4536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.007s	sys 0.019s
W20260709 12:29:32.307086  4536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.008s	sys 0.020s
W20260709 12:29:32.297731  3925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.003s	sys 0.024s
I20260709 12:29:32.301234  4565 raft_consensus.cc:1240] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 18. Current term is 19. Ops: []
I20260709 12:29:32.286194  9747 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:32.315917  3854 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:29:32.304138  9749 consensus_meta.cc:287] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.509s	user 0.003s	sys 0.007s
I20260709 12:29:32.260608  9420 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:29:32.321686  4569 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:29:32.326756  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:32.309266  9481 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:32.334132  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:32.335084  4567 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:32.293545  4573 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:32.337666  4538 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:32.326098  9726 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:32.329171  9481 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:32.311204  9771 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:32.353578  9707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.013s	sys 0.022s
I20260709 12:29:32.352626  9481 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:32.349953  9697 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:29:32.401117  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 43928.4us
W20260709 12:29:32.383728  9707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.013s	sys 0.022s
I20260709 12:29:32.405694  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:32.408403  3924 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
W20260709 12:29:32.410949  9775 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:29:32.412846  9757 log.cc:927] Time spent T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.834s	user 0.000s	sys 0.005s
I20260709 12:29:32.414489  9783 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:29:32.426749  9696 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:29:32.433684  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2871) took 1184 ms. Trace:
I20260709 12:29:32.434257  3855 rpcz_store.cc:276] 0709 12:29:31.249258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:31.249394 (+   136us) service_pool.cc:224] Handling call
0709 12:29:32.433369 (+1183975us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b54000195d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:32.433574 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2240103296}
W20260709 12:29:32.436760  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 145104us
I20260709 12:29:32.437414  9776 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:32.438652  3969 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:32.440567  3895 leader_election.cc:400] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 18. Current term is 19.
I20260709 12:29:32.444229  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:32.445451  4000 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:32.446002  9659 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:32.448341  9782 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:32.448904  9782 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:32.451422  3970 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:32.451524  9782 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:32.445355  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:32.448032  9659 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:29:32.453502  4005 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:32.454001  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:32.454828  3855 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:32.448047  9367 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:32.457677  9367 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.459896  9367 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:32.460439  9367 raft_consensus.cc:2804] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:32.460916  9367 raft_consensus.cc:697] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:32.466110  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:32.467213  3856 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 16: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:32.467857  9481 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.468626  9706 raft_consensus.cc:3055] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:32.469012  9706 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:32.472553  9637 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:32.408107  9707 raft_consensus.cc:697] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:32.479962  3855 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:32.382477  9780 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:32.484643  9780 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.492448  3971 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:32.493307  9673 consensus_queue.cc:1059] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:29:32.494439  9673 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:32.495823  9673 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:32.495536  9707 consensus_queue.cc:237] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:32.496225  9673 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:32.496615  9673 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:32.498063  9357 raft_consensus.cc:3055] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:29:32.498481  9357 raft_consensus.cc:740] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:32.499267  9357 consensus_queue.cc:260] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.500456  9357 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:32.501525  9605 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:32.539001  4000 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:29:32.503546  9367 consensus_queue.cc:237] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.507345  9699 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.509353  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2862) took 1239 ms. Trace:
I20260709 12:29:32.540880  4004 rpcz_store.cc:276] 0709 12:29:31.270006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:31.270120 (+   114us) service_pool.cc:224] Handling call
0709 12:29:31.274689 (+  4569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:31.275047 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:31.275083 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:31.275470 (+   387us) log.cc:844] Serialized 26 byte log entry
0709 12:29:31.354833 (+ 79363us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:31.354876 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:31.354941 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:32.386036 (+1031095us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:32.413918 (+ 27882us) raft_consensus.cc:1685] finished
0709 12:29:32.413949 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:32.509285 (+ 95336us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1722,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10190,"spinlock_wait_cycles":37213440,"thread_start_us":64555,"threads_started":1,"wal-append.queue_time_us":216313}
I20260709 12:29:32.510381  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:32.542367  9699 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:32.543032  4574 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:32.543043  4572 raft_consensus.cc:1240] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:29:32.517531  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:32.546868  3855 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:32.524042  3897 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:32.526065  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:32.548388  4566 raft_consensus.cc:2393] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 19: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:32.527395  4567 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:32.549615  9705 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:32.550268  9705 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:32.550612  9705 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:32.553268  4565 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:29:32.555375  9481 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:32.555464  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:32.528998  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:32.531883  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:32.557657  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:32.557765  4570 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:32.557909  9673 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.558998  4537 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:32.559851  9699 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:32.560067  9673 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:32.560258  9699 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:32.560724  9699 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:32.561295  4574 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:32.532589  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:32.565217  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:32.566129  3924 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:32.569941  3855 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:29:32.536975  9780 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:32.469791  9706 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.580930  9706 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:32.540401  9210 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:29:32.523211  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:32.547569  9783 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:32.549499  9579 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:29:32.570585  8992 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:32.570884  4537 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:32.573848  4574 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:29:32.588362  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:32.425454  9734 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:32.575039  9347 consensus_meta.cc:287] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.885s	user 0.010s	sys 0.000s
I20260709 12:29:32.535403  9771 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:32.579304  3822 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:32.579190  9545 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:32.579880  9656 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:32.505424  3850 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:32.594836  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:32.606793  3926 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:32.596235  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:32.601400  4568 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:29:32.589121  4565 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:32.609627  3923 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:29:32.610092  3822 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:32.611253  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:32.532315  3928 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 19.
I20260709 12:29:32.619290  9534 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:32.619540  9721 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:32.620038  9579 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:32.620119  9534 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:32.620723  9786 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:32.619164  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:32.620466  9699 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.610123  8992 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:32.630192  8992 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:32.621068  9534 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.603204  9780 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:32.631314  3969 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:32.631624  9780 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:32.632074  9780 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:32.632329  9481 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:32.632917  9481 raft_consensus.cc:697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:32.624794  9661 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:32.635795  9734 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:32.636142  9481 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.620483  9637 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:32.638155  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:32.638602  4003 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:32.640216  4565 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:32.621343  9786 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.635218  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:32.640797  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:32.604807  4536 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:32.643754  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:32.645133  3897 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:32.651250  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:32.598179  9783 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:32.613500  4570 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 18.
I20260709 12:29:32.656705  3926 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:29:32.656235  3971 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:32.661650  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:32.672544  3849 raft_consensus.cc:2368] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 18. Current term is 19.
I20260709 12:29:32.662631  4573 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:32.663311  3850 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:32.618327  9747 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 17. Current term is 18.
I20260709 12:29:32.614527  9357 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:29:32.639724  9562 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.679009  3971 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:32.679836  3822 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:32.686092  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:32.611236  9347 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.686282  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:32.658942  9689 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:32.689347  4005 raft_consensus.cc:2393] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 16: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:32.683475  9656 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:32.666028  9771 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:29:32.666923  9655 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:29:32.691284  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:32.691541  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:32.692409  9655 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:32.692989  9655 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:32.693969  9210 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:32.695267  9783 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:32.683887  9389 consensus_queue.cc:1059] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:29:32.696218  9389 raft_consensus.cc:3055] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:32.696574  9389 raft_consensus.cc:740] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:32.620654  9579 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:32.698462  9310 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:32.699090  9310 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:32.699646  9579 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:32.691313  9656 raft_consensus.cc:697] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:32.701504  9310 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:32.680512  9659 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:32.701918  9656 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.692457  9357 raft_consensus.cc:3055] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:32.703842  9786 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:32.703788  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:32.704603  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:32.705015  9655 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.708786  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:32.701532  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:32.711721  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:32.656788  8992 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:29:32.697387  9389 consensus_queue.cc:260] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.713173  4536 leader_election.cc:400] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 18. Current term is 19.
I20260709 12:29:32.718216  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:32.768741  4536 leader_election.cc:403] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:29:32.722065  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:32.770027  4568 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:32.723086  4567 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:32.728323  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:32.773370  4006 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:32.765283  3932 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:29:32.776870  3932 pending_rounds.cc:85] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 12
I20260709 12:29:32.777179  3932 pending_rounds.cc:107] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:29:32.777479  3932 raft_consensus.cc:2889] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:32.765511  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 2354) took 1358 ms. Trace:
I20260709 12:29:32.779155  3925 rpcz_store.cc:276] 0709 12:29:31.402773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:31.402889 (+   116us) service_pool.cc:224] Handling call
0709 12:29:31.481405 (+ 78516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:31.516488 (+ 35083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:31.516518 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:31.517035 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:29:32.310483 (+793448us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:32.428635 (+118152us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:32.724186 (+295551us) log.cc:844] Serialized 14 byte log entry
0709 12:29:32.756151 (+ 31965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:32.756222 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:32.756266 (+    44us) raft_consensus.cc:1685] finished
0709 12:29:32.761352 (+  5086us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:32.761491 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97329,"prepare.queue_time_us":31414,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":74677,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":10379,"spinlock_wait_cycles":35712384,"thread_start_us":1052855,"threads_started":2,"wal-append.queue_time_us":804602}
I20260709 12:29:32.728737  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:32.722379  3895 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:32.775987  3822 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:32.790512  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:32.806169  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 83907.1us
I20260709 12:29:32.807255  3895 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:32.821053  9783 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:32.821789  9783 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:32.823371  9347 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:32.823908  9532 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:32.824383  9783 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:32.825016  9637 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:32.824420  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:32.827791  9721 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:29:32.832543  9705 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.839267  3923 raft_consensus.cc:1240] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:32.841185  9705 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:32.841993  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:32.836753  3970 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:32.714087  9659 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:32.757078  9420 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:32.851174  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:32.853648  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:32.885960  3924 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:32.856199  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:32.886449  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:32.886719  4573 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:29:32.888188  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 51514.6us
I20260709 12:29:32.858897  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:32.720253  9562 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:32.867264  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 112493us
I20260709 12:29:32.716825  9357 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:32.809667  9144 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:32.720252  9780 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:32.809505  9747 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:32.870725  9699 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:29:32.811177  9545 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:32.873153  9389 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:32.804644  9579 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:32.876909  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:32.924450  4568 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
W20260709 12:29:32.883906  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 170932us
I20260709 12:29:32.928369  4565 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:29:32.855125  4567 raft_consensus.cc:1240] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:32.889891  4538 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:32.890900  3927 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:32.881810  3932 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:32.893237  9673 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:32.911904  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:32.915659  3897 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:32.891726  9659 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:32.930811  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:32.931531  4002 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:32.933849  4573 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:32.937245  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:32.919605  9579 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:32.920214  9545 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:32.958662  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 68852.4us
I20260709 12:29:32.985042  4538 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:32.959502  9734 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:29:32.970813  3928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54068 (request call id 1294) took 1454 ms (client timeout 1765 ms). Trace:
W20260709 12:29:32.989326  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 73779.6us
I20260709 12:29:32.991079  4537 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:32.986253  3928 rpcz_store.cc:269] 0709 12:29:31.516435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:31.541568 (+ 25133us) service_pool.cc:224] Handling call
0709 12:29:32.970653 (+1429085us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54000ef6d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:32.970753 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082764160}
I20260709 12:29:32.932498  9789 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 18. Current term is 19.
I20260709 12:29:33.003659  3971 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:32.979156  3924 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:32.932262  9673 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:32.916880  9562 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:29:33.008361  4537 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:33.011871  9513 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:32.987426  9786 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:32.994022  9545 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:33.025250  4568 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:29:33.028903  9420 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:33.085286  9420 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:33.088512  9763 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:33.089105  9763 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 19 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:33.055081  4002 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:32.987695  9579 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:32.999934  9705 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:33.000912  9699 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:29:32.955140  9347 consensus_queue.cc:1059] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
W20260709 12:29:33.078244  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 70017.2us
I20260709 12:29:33.055253  9776 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:33.070719  9673 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:33.095189  9656 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:33.091702  9786 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
W20260709 12:29:33.151748  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 88780.4us
I20260709 12:29:33.164095  3854 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:29:33.146304  9408 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:33.106938  9776 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:33.172453  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 147177us
I20260709 12:29:33.144973  9656 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:33.192324  9656 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:33.149819  9534 consensus_queue.cc:1059] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
W20260709 12:29:33.193276  9802 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:29:33.197278  9776 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:33.160566  9763 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:33.174623  9408 raft_consensus.cc:697] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:33.211215  9408 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:33.226168  9786 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:33.241638  9794 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:29:33.242195  9805 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 12:29:33.243409  9798 log.cc:927] Time spent T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 12:29:33.244334  9800 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260709 12:29:33.245901  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 242351us
I20260709 12:29:33.246584  9409 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:33.247041  9801 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:29:33.247176  9409 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:33.248221  9812 log.cc:927] Time spent T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:29:33.251979  9807 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.083s	user 0.003s	sys 0.000s
I20260709 12:29:33.258071  9749 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:33.258651  9749 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:33.258872  9659 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:33.246251  9420 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:33.260679  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 48717.7us
I20260709 12:29:33.260867  9749 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:33.261178  9659 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:33.262650  9420 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:33.263993  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 113405us
W20260709 12:29:33.264560  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 228031us
W20260709 12:29:33.250561  9811 log.cc:927] Time spent T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.009s
I20260709 12:29:33.287930  4574 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:33.271988  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:33.274300  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:33.259814  9579 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:33.292608  4568 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:29:33.293174  9579 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:33.294216  3850 raft_consensus.cc:2393] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 17: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:33.293910  9357 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:33.296443  9673 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:33.249645  9409 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:33.264092  9806 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.070s	user 0.001s	sys 0.010s
I20260709 12:29:33.307579  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:33.324033  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:33.261538  9749 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:29:33.338740  4006 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:33.338769  4004 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:33.342970  4000 raft_consensus.cc:1275] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:29:33.362366  3853 raft_consensus.cc:1275] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:29:33.366484  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:33.368440  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:33.339454  9144 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:33.380743  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 287694us
W20260709 12:29:33.505911  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 134571us
I20260709 12:29:33.329686  9545 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:33.513486  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:33.514262  4567 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:33.516059  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:33.516242  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 132646us
I20260709 12:29:33.516767  4566 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:33.370015  9656 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.174s
I20260709 12:29:33.609398  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:33.614923  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 97262.4us
I20260709 12:29:33.610179  3930 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:33.619464  3971 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:33.620280  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:33.634840  3930 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:33.623100  4566 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:33.515196  9768 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 12:29:33.506559  9144 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:33.589828  9673 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:33.642009  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 123942us
W20260709 12:29:33.621732  9799 log.cc:927] Time spent T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:29:33.637761  9798 log.cc:927] Time spent T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:29:33.653465  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 264633us
I20260709 12:29:33.664889  3821 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:33.666841  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:33.670665  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:33.654284  9782 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:33.692987  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:33.694021  3929 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:33.696328  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:33.701021  3929 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:33.692072  3897 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:33.709354  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:33.738008  4000 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:29:33.712671  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:33.680253  9782 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:33.744206  9782 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:29:33.745684  9829 log.cc:927] Time spent T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 12:29:33.747113  9826 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:29:33.749015  9833 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:29:33.720629  9825 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:29:33.722618  9721 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:33.751295  9721 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:33.751816  9721 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:33.690027  9144 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:33.668897  9408 consensus_queue.cc:1048] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:29:33.769639  4000 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
W20260709 12:29:33.771584  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 152232us
W20260709 12:29:33.770354  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 121078us
I20260709 12:29:33.788359  3930 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
W20260709 12:29:33.790767  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 98804.7us
I20260709 12:29:33.798843  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:29:33.807394  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 142879us
I20260709 12:29:33.808238  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:33.810710  3848 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:29:33.815130  9835 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:33.815757  9835 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:33.816994  9782 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:33.820978  3931 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:33.812600  9144 raft_consensus.cc:2764] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:29:33.820729  9721 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:33.823386  3856 raft_consensus.cc:2368] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17.
I20260709 12:29:33.825486  9721 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:33.827303  9782 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:33.773095  9545 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:33.849813  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 51689.9us
I20260709 12:29:33.851673  3929 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
W20260709 12:29:33.853370  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 185330us
I20260709 12:29:33.855340  3848 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:33.855551  3897 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:33.856338  4568 raft_consensus.cc:1240] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:33.858445  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:33.863379  3821 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:33.874603  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:33.875314  4566 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:33.860721  9705 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:33.861281  9835 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:33.893080  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:33.896960  3929 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:33.900759  9810 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:33.901432  9810 raft_consensus.cc:697] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:33.902433  9810 consensus_queue.cc:237] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:33.905893  9846 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:33.906527  9846 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:33.864107  9832 consensus_queue.cc:1048] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:29:33.908789  9846 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:33.914116  9545 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:33.914409  4572 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:33.914778  9545 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:33.917438  9545 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:33.944243  4566 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:33.952363  3929 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
W20260709 12:29:33.962601  9844 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.274s	user 0.004s	sys 0.000s
I20260709 12:29:33.966217  9780 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:34.153394  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:34.152869  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:34.164916  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:34.165812  3849 raft_consensus.cc:2410] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:29:34.127508  9780 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:34.209220  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:34.127236  9699 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:34.211910  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:34.149585  9144 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:34.149974  9768 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:34.214811  9789 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:34.227118  9789 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.069377  9721 consensus_queue.cc:1059] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.226s
I20260709 12:29:34.126766  9656 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 12:29:34.197695  9836 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:34.249765  9836 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.252730  9836 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:34.173173  9834 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:34.255376  9834 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:34.259411  9144 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.267691  9309 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:34.268317  9309 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.222110  9780 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.274024  9768 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:34.275087  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 2995) took 1421 ms. Trace:
I20260709 12:29:34.276335  9768 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:34.277019  3850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2898) took 1426 ms. Trace:
I20260709 12:29:34.277478  3850 rpcz_store.cc:276] 0709 12:29:32.850762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:32.850923 (+   161us) service_pool.cc:224] Handling call
0709 12:29:34.276810 (+1425887us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54001e6754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:34.276954 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937327872}
I20260709 12:29:34.275538  3926 rpcz_store.cc:276] 0709 12:29:32.853367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:32.853521 (+   154us) service_pool.cc:224] Handling call
0709 12:29:32.854038 (+   517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:32.970514 (+116476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:32.970547 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:32.988557 (+ 18010us) log.cc:844] Serialized 26 byte log entry
0709 12:29:33.110588 (+122031us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:29:33.110642 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:34.274662 (+1164020us) spinlock_profiling.cc:243] Waited 76.5 ms on lock 0x7b54000d5f54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:34.274716 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:34.274770 (+    54us) raft_consensus.cc:1685] finished
0709 12:29:34.274788 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:34.275019 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54667,"raft.queue_time_us":50983,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":34189,"spinlock_wait_cycles":175978368,"thread_start_us":75192,"threads_started":1,"wal-append.queue_time_us":137851,"wal-append.run_cpu_time_us":2137,"wal-append.run_wall_time_us":1073652}
I20260709 12:29:34.288882  9779 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:34.289253  9144 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:34.289585  9779 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.292070  9779 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:34.292623  9782 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:34.293208  9782 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.295418  9734 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:34.298966  9734 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.302098  9734 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:34.295936  9659 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:34.302886  9659 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.289433  9347 raft_consensus.cc:3055] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:34.303450  9782 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:34.322494  3821 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:34.221488  9810 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:34.273772  9780 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:34.360999  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:34.361954  3931 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
W20260709 12:29:34.364969  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:34.305272  9347 raft_consensus.cc:740] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:34.318619  9789 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:34.225458  9699 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.337322  9846 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:34.351536  9810 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.472687  9689 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:34.473294  9689 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.476488  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:34.592343  3822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.023s	sys 0.044s
I20260709 12:29:34.478533  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:34.776696  3822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.033s	sys 0.057s
I20260709 12:29:34.777114  3928 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:34.476939  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:34.778499  3927 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:34.633513  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:34.772172  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:34.780364  9819 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:34.781239  9843 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:34.633345  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:34.779227  9408 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:34.781801  9843 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.782202  9408 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.784217  9843 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:34.784394  9408 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:34.779253  4005 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:34.780921  9819 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:34.786666  9819 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:34.786588  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:34.787345  3998 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:34.788170  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:34.498435  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:34.481343  9846 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:34.789664  9367 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:34.475394  9689 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:34.790545  9367 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.790858  9846 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:34.791661  9867 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:34.792243  9867 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.494334  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:34.792986  9367 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:34.794675  9867 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:34.536077  9780 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:34.495183  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:34.777519  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:34.797752  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:34.834136  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 45400us
I20260709 12:29:34.430708  9861 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:34.497924  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:34.813006  4536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.007s	sys 0.003s
I20260709 12:29:34.789489  4573 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 18.
W20260709 12:29:34.813428  3895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.003s	sys 0.007s
W20260709 12:29:34.813740  4568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.000s	sys 0.010s
I20260709 12:29:34.819131  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:34.836027  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 58596us
I20260709 12:29:34.836221  9656 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:34.838536  9656 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:34.839673  9656 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.802698  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:34.434485  9834 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:34.776077  3925 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:34.831235  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:34.835649  4574 raft_consensus.cc:2393] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 19: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:34.834915  9408 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:29:34.842576  3997 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:34.789497  4004 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 19.
I20260709 12:29:34.835027  9861 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:34.846184  9848 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:34.846923  9848 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:34.848500  3895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.003s	sys 0.007s
W20260709 12:29:34.849238  4568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.001s	sys 0.010s
I20260709 12:29:34.849726  9848 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:34.835714  4536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.007s	sys 0.003s
I20260709 12:29:34.855243  3851 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:29:34.856495  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:34.823155  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 459409us
I20260709 12:29:34.859745  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:34.650228  9720 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:34.535667  9309 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:34.875291  4568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1353) took 1017 ms. Trace:
I20260709 12:29:34.861923  3853 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 16: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:34.475224  9659 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:34.497052  9699 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:34.594033  9481 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:34.500137  9310 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:34.770593  9357 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:34.865182  9866 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:34.868392  9843 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:29:34.868525  9810 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:34.827536  9734 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:34.868873  9720 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.882531  3997 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:34.869731  9408 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:34.801308  9579 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:34.801777  9776 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:34.825783  9747 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:34.866963  3821 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:34.885349  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:34.875859  4568 rpcz_store.cc:276] 0709 12:29:33.857675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:33.858267 (+   592us) service_pool.cc:224] Handling call
0709 12:29:33.858574 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:33.864870 (+  6296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:33.864899 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:33.882708 (+ 17809us) log.cc:844] Serialized 26 byte log entry
0709 12:29:34.849770 (+967062us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:34.849832 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:34.849948 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:34.875081 (+ 25133us) raft_consensus.cc:1685] finished
0709 12:29:34.875102 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:34.875232 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6468,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":10031,"thread_start_us":922850,"threads_started":1,"wal-append.queue_time_us":943716}
I20260709 12:29:34.827839  9820 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:34.828682  9770 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:34.827381  9869 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:34.856613  9367 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:34.896621  3851 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:29:34.854126  9861 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:34.891116  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:34.899566  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:34.892400  4002 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:34.902043  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:34.882907  9545 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:34.907820  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:34.892616  9763 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.007s	sys 0.010s
I20260709 12:29:34.869673  9819 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:34.888041  9689 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:34.489992  9347 consensus_queue.cc:260] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.890033  9637 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:34.931394  3854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40038 (request call id 1504) took 1703 ms. Trace:
I20260709 12:29:34.931565  3970 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:34.935182  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 68335.6us
I20260709 12:29:34.936045  3969 leader_election.cc:400] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17.
I20260709 12:29:34.935431  3856 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:34.907088  9699 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:34.896219  9481 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:34.864948  9780 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.898643  9310 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:35.001680  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 130357us
I20260709 12:29:35.032424  3897 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:35.021974  3969 leader_election.cc:403] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 12:29:35.033126  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 125713us
I20260709 12:29:35.020364  3854 rpcz_store.cc:276] 0709 12:29:33.227796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:33.227936 (+   140us) service_pool.cc:224] Handling call
0709 12:29:33.228249 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:33.228461 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:29:33.518818 (+290357us) log.cc:844] Serialized 14 byte log entry
0709 12:29:34.527743 (+1008925us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b18003e7760. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee7455 00007fe051fcf060 00007fe051fe1716 00007fe051ff2287 00007fe051ff2208
0709 12:29:34.930142 (+402399us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:34.930218 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:29:34.930289 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:34.931204 (+   915us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:34.931333 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54144,"prepare.queue_time_us":282370,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":7795,"raft.queue_time_us":150293,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":8780,"spinlock_wait_cycles":8726784,"thread_start_us":692091,"threads_started":2}
I20260709 12:29:34.906807  9866 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.931326  9734 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:34.993865  9763 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.007s	sys 0.011s
I20260709 12:29:34.937233  9705 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:34.985687  9656 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:34.985743  9409 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:34.940421  9776 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:35.040176  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 104335us
I20260709 12:29:34.934602  9579 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.038970  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:35.046941  3931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:29:34.958175  9747 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:35.030061  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 98582.2us
I20260709 12:29:35.099056  3931 raft_consensus.cc:606] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:35.032336  9861 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:34.932875  9408 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:34.959322  9820 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:34.995446  9367 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:35.042387  9834 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:35.001367  9545 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:34.985217  9869 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.121575  9367 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:35.121733  9869 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.123945  9869 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:35.124713  9869 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.127074  9720 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:35.127977  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.128897  3854 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 19.
I20260709 12:29:35.132037  9869 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.100517  3931 raft_consensus.cc:614] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:29:35.114387  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 75971.8us
I20260709 12:29:35.135584  9820 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:35.001596  9819 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:35.135927  4537 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:34.981685  9770 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.101696  9848 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:35.066177  9705 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.112039  9656 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:35.108812  9409 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.044848  9309 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.065s
I20260709 12:29:35.017537  9689 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.034624  9699 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.139110  9763 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:35.043551  9778 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17.
I20260709 12:29:35.223313  9720 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:35.319151  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.327685  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:35.328840  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 285169us
I20260709 12:29:35.329773  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.260857  9848 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:35.224195  9870 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:35.337507  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:35.339063  9876 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:29:35.339793  9579 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.340113  9656 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:35.027225  9637 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.287195  9867 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:35.343199  9656 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:35.287070  9886 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:35.351394  4568 raft_consensus.cc:1240] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 12. Current term is 13. Ops: []
W20260709 12:29:35.352569  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 253384us
I20260709 12:29:35.361984  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.330621  9720 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:35.342476  9848 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:35.322454  9763 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:35.335747  9144 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:35.368597  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:35.370483  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.378420  4568 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:35.372295  4574 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:29:35.382764  4572 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:29:35.345039  9579 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:35.345247  3897 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:35.355193  9513 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:35.394073  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.367532  9720 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:35.396235  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.369797  9892 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:35.379982  9865 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:35.377640  9726 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:35.418103  9408 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:35.418761  9705 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.419720  9888 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:35.393667  9579 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.422159  9865 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:35.423899  9579 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:35.401333  9883 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:29:35.428635  9819 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:35.402092  9637 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.403090  9776 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:35.387004  9144 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:35.404512  9898 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:35.430088  9898 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.431660  9144 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:35.432086  9481 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:35.409662  9882 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:29:35.410586  9310 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:35.411600  9699 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:35.411851  9513 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.413801  9780 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:35.377853  9763 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:35.397101  4574 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:35.417701  9726 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.420259  9888 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.398972  9890 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:35.400108  9734 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:35.347108  9870 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.355979  9867 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.424537  9865 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:35.393110  9863 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.401s	user 0.001s	sys 0.000s
I20260709 12:29:35.463040  9890 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:35.426426  9877 log.cc:927] Time spent T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:29:35.425911  9892 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.468484  9890 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.469341  9892 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.354948  9886 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.471182  9870 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:35.471616  9886 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.473420  9867 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:29:35.474189  3848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42050 (request call id 2905) took 1518 ms. Trace:
I20260709 12:29:35.441500  9310 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:35.400279  9689 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.426990  9545 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:35.440460  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 96135.8us
I20260709 12:29:35.442505  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.476788  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:35.476882  9888 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.444480  4567 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:35.449040  4568 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:35.450223  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.480955  4565 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:35.481333  9747 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.451488  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.482239  4569 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:29:35.437868  9780 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:35.486060  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 1318) took 1011 ms. Trace:
I20260709 12:29:35.486171  9780 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.486546  3924 rpcz_store.cc:276] 0709 12:29:34.474659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:34.475787 (+  1128us) service_pool.cc:224] Handling call
0709 12:29:35.485285 (+1009498us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b5800132998. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056fb0fc0 00007fe056f9b929 00007fe056f9b3d2 00007fe050512bd4
0709 12:29:35.485505 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:35.485700 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:35.485728 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:35.485774 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:29:35.485816 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:35.485895 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:35.486005 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79403392}
I20260709 12:29:35.487955  9420 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:35.488605  9780 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:35.452309  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.452638  4538 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:35.490474  9817 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:35.491699  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.491928  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.492452  4569 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:35.492715  4565 raft_consensus.cc:2393] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 13: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:35.488709  9420 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.498347  9420 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:35.375509  9656 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.474623  3848 rpcz_store.cc:276] 0709 12:29:33.955819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:33.956013 (+   194us) service_pool.cc:224] Handling call
0709 12:29:33.956342 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:33.956733 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:29:34.134044 (+177311us) log.cc:844] Serialized 14 byte log entry
0709 12:29:34.438599 (+304555us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:34.439733 (+  1134us) log.cc:844] Serialized 26 byte log entry
0709 12:29:34.770064 (+330331us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:34.770103 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:34.770176 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:35.473954 (+703778us) raft_consensus.cc:1685] finished
0709 12:29:35.473976 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:35.474123 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32706,"prepare.queue_time_us":194161,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":6137,"raft.queue_time_us":15766,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":26788,"spinlock_wait_cycles":13487360,"thread_start_us":304097,"threads_started":1,"wal-append.queue_time_us":776484}
I20260709 12:29:35.477008  4573 raft_consensus.cc:2393] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 18: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:35.502008  9656 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.503314  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.507064  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.507385  9513 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:35.507727  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.509684  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.510563  4570 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:35.511323  9726 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:35.514783  9357 consensus_meta.cc:287] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.614s	user 0.013s	sys 0.000s
I20260709 12:29:35.515865  4003 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:29:35.516289  4003 pending_rounds.cc:85] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 11
I20260709 12:29:35.516558  4003 pending_rounds.cc:107] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:29:35.516853  4003 raft_consensus.cc:2889] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:35.517594  9655 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:35.453045  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.518244  9655 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:35.520406  9809 log.cc:927] Time spent T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 2.009s	user 0.007s	sys 0.020s
I20260709 12:29:35.521274  9898 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:35.521430  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.522090  9689 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:35.522262  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.522605  9689 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:35.522989  3925 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:35.498736  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:35.524065  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.524713  3927 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
W20260709 12:29:35.526193  4537 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.157.2:42279 timed out after 1.785s (SENT) [suppressed 3 similar messages]
I20260709 12:29:35.507428  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.529340  9861 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:35.529846  9861 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.522396  3929 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 12:29:35.535373  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 390407us
I20260709 12:29:35.535723  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.536682  3856 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:29:35.537497  3971 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:35.539160  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.540083  3929 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:35.544149  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:35.555218  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 197337us
I20260709 12:29:35.556939  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.523082  9689 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:35.563781  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.565265  3927 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:29:35.565788  3930 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:29:35.566090  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.566901  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.567848  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.569384  3929 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:35.570925  3928 raft_consensus.cc:2410] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:29:35.572230  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:35.575131  9875 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.266s	user 0.002s	sys 0.000s
I20260709 12:29:35.578246  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.584322  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:35.585100  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 49046.5us
I20260709 12:29:35.585201  9763 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.585825  3822 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:35.586156  9871 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:35.586666  4573 raft_consensus.cc:2410] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:29:35.586745  9871 raft_consensus.cc:697] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:35.587450  9816 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:35.587795  9871 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.588644  9816 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:29:35.589318  9816 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:35.590271  9815 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:35.590795  9815 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.591634  4536 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:35.592243  9874 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:35.592758  9874 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:35.593132  9770 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:35.593534  9815 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.594238  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.594811  9874 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:35.594899  4536 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:35.595238  9747 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:35.595535  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.538369  9367 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:35.597029  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.597304  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.597478  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.611068  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.611665  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.611764  3928 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:35.598673  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.531863  9861 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.603155  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.596827  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.612643  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.615661  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.620512  3822 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:35.629549  3971 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:35.630228  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:35.631840  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 264698us
I20260709 12:29:35.609019  3926 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:35.593750  9770 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:35.646579  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:35.647162  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.647637  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:35.601997  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.651026  4004 raft_consensus.cc:2368] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 16. Current term is 17.
I20260709 12:29:35.652097  3852 raft_consensus.cc:2410] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:29:35.633327  3926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54068 (request call id 1314) took 1160 ms. Trace:
I20260709 12:29:35.653470  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:35.634176  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.642937  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:35.643164  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:35.644986  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:35.645828  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:35.664460  3997 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:35.652261  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.658613  3971 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:35.672631  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:35.667032  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.677803  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:35.680996  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:35.667133  3971 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:35.684666  3971 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:35.684882  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:35.627175  9780 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:29:35.712934  4000 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:29:35.716128  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.648141  9656 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:35.702258  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.652912  3926 rpcz_store.cc:276] 0709 12:29:34.472957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:34.540948 (+ 67991us) service_pool.cc:224] Handling call
0709 12:29:35.498565 (+957617us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b5800132998. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056f9d0a0 00007fe056f9c984 00007fe0505176d4 00007fe050517662
0709 12:29:35.633270 (+134705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5092224}
I20260709 12:29:35.708928  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:35.733074  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.735527  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:35.736258  3931 raft_consensus.cc:3060] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:35.728420  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:35.701159  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 174994us
I20260709 12:29:35.653296  9770 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:35.666325  8992 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:35.658887  9481 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:35.717868  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.751013  3928 raft_consensus.cc:2468] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 19.
I20260709 12:29:35.607632  9818 consensus_queue.cc:1059] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 12:29:35.616230  9367 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:35.611681  9747 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.773504  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.752888  3928 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:29:35.752866  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.762352  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.706681  9408 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:35.717945  9808 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:35.781774  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.707001  9853 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:35.633415  9778 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 12:29:35.710045  9819 raft_consensus.cc:2804] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:35.740741  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.654865  9861 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 12:29:35.781102  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.745158  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.731537  9656 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:35.683197  9821 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
I20260709 12:29:35.789146  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.750015  9786 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:35.823442  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.791010  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:35.798141  3925 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 18.
I20260709 12:29:35.769906  9770 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:35.763411  9481 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:35.809257  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:35.781466  9408 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:35.818400  9892 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:35.824203  9819 raft_consensus.cc:697] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:35.776219  9848 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:35.768592  8992 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.823053  9656 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:35.841146  9892 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:35.941314  9892 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:35.845300  9896 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:29:35.942303  9896 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:35.942806  9896 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:35.951196  9367 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:35.846410  9819 consensus_queue.cc:237] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.847713  4574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:29:35.852640  9770 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.856155  9310 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:35.962141  9310 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:35.964776  9310 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:35.860188  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2889) took 2554 ms. Trace:
I20260709 12:29:35.965466  4003 rpcz_store.cc:276] 0709 12:29:33.305911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:33.306103 (+   192us) service_pool.cc:224] Handling call
0709 12:29:33.306507 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:35.517362 (+2210855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:35.859946 (+342584us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b540021acd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:35.860118 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5080013184}
I20260709 12:29:35.967226  4573 raft_consensus.cc:1240] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:35.798285  9808 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:35.971577  3857 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:35.972793  9808 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:35.878450  9866 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.833081  9786 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:35.976686  9786 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.885562  9659 raft_consensus.cc:3055] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:35.886433  9747 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.888831  9409 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:35.889976  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.843395  9720 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.026193  4566 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:36.029285  9878 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:35.836153  9408 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:36.029816  9878 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.032799  9878 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:35.920122  9905 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:29:35.921437  9673 raft_consensus.cc:3055] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:36.038403  9673 raft_consensus.cc:740] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:36.039580  9673 consensus_queue.cc:260] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.041163  9673 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:35.929450  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:36.042052  9409 consensus_queue.cc:1059] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:36.042963  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:36.044441  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:36.044550  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.932873  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2898) took 1134 ms. Trace:
W20260709 12:29:35.945520  9901 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:29:35.836602  9481 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:36.046805  4006 rpcz_store.cc:276] 0709 12:29:34.798874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:34.799002 (+   128us) service_pool.cc:224] Handling call
0709 12:29:34.799318 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:35.047557 (+248239us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:29:35.361630 (+314073us) log.cc:844] Serialized 14 byte log entry
0709 12:29:35.555315 (+193685us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:35.555388 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:29:35.555448 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:35.932543 (+377095us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54002bd754. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:35.932607 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:35.932794 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":235004,"prepare.queue_time_us":58340,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2868,"raft.queue_time_us":184210,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":570218880,"thread_start_us":266621,"threads_started":2,"wal-append.queue_time_us":62145}
I20260709 12:29:35.953380  9896 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.051921  9896 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:36.052665  9896 consensus_queue.cc:1059] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:29:36.056769  3755 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51802 (request call id 336) took 18168 ms (client timeout 15000 ms). Trace:
I20260709 12:29:35.986227  9659 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:36.083189  9888 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:36.083818  9888 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:36.083616  9659 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:36.067739  3755 rpcz_store.cc:269] 0709 12:29:17.900980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:17.931388 (+ 30408us) service_pool.cc:224] Handling call
0709 12:29:36.056649 (+18125261us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:29.120550 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:29.121203 (+   653us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:29.121251 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:29:29.121269 (+    18us) tablet.cc:662] Decoding operations
0709 12:29:29.124883 (+  3614us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:29.124977 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:29.125003 (+    26us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:29:29.127244 (+  2241us) tablet.cc:701] Row locks acquired
0709 12:29:29.127294 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:29:29.127485 (+   191us) write_op.cc:270] Start()
0709 12:29:29.127629 (+   144us) write_op.cc:276] Timestamp: P: 1783600169127407 usec, L: 0
0709 12:29:29.127667 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:29:29.145242 (+ 17575us) log.cc:844] Serialized 10130 byte log entry
0709 12:29:30.047576 (+902334us) op_driver.cc:464] REPLICATION: finished
0709 12:29:30.143188 (+ 95612us) write_op.cc:301] APPLY: starting
0709 12:29:30.143295 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:30.976957 (+833662us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:30.977095 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:32.114723 (+1137628us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:32.115130 (+   407us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 12:29:32.115194 (+    64us) write_op.cc:312] APPLY: finished
0709 12:29:32.115728 (+   534us) log.cc:844] Serialized 228 byte log entry
0709 12:29:32.378523 (+262795us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:32.400972 (+ 22449us) write_op.cc:454] Released schema lock
0709 12:29:32.411150 (+ 10178us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:32.411632 (+   482us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:32.411668 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":389925,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":95297,"apply.run_cpu_time_us":80882,"apply.run_wall_time_us":2268408,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112703,"num_ops":26,"prepare.queue_time_us":96797,"prepare.run_cpu_time_us":17069,"prepare.run_wall_time_us":189810,"raft.queue_time_us":459560,"raft.run_cpu_time_us":2780,"raft.run_wall_time_us":111042,"replication_time_us":919739,"thread_start_us":925501,"threads_started":5,"wal-append.queue_time_us":605850,"wal-append.run_cpu_time_us":19529,"wal-append.run_wall_time_us":2767590}]]}
I20260709 12:29:36.086220  9839 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:36.087016  9839 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:35.808679  9853 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:36.098730  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 200460us
I20260709 12:29:36.100332  9853 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:36.105458  9839 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:36.001101  8992 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:36.001434  9763 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:36.121788  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:36.001791  9770 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:36.006045  9347 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:35.941587  9655 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:36.011961  3749 catalog_manager.cc:5697] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 4 to 11. New cstate: current_term: 11 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:36.139627  9778 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:36.140306  9778 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:36.016984  9916 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:29:36.026114  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:36.143337  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:36.144680  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:35.901206  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:36.147739  4538 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:36.148562  9309 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:36.141065  3749 catalog_manager.cc:5697] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 7 to 8, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 8 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:36.148926  9309 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:36.149663  9309 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:36.153049  3749 catalog_manager.cc:5697] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 8 to 9, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 9 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:36.154455  9655 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:36.155064  9655 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:36.157075  9655 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:36.156422  3749 catalog_manager.cc:5697] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 2 to 6, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 6 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:36.029606  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:36.161039  4566 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:29:36.060232  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:36.042992  9409 raft_consensus.cc:3055] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:36.162302  9409 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:36.163333  9409 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.164803  9409 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:36.045651  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:36.166229  4571 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:36.063117  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:36.063196  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:36.064561  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:36.168169  4002 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:36.168649  4573 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:35.712734  9780 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:36.086324  9888 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:36.071873  4537 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:36.170557  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 98782.5us
I20260709 12:29:36.172219  4537 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:35.996351  9848 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:36.175616  9897 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:29:36.182010  9780 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:29:36.187702  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:36.199476  3749 catalog_manager.cc:5697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 1 to 12, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 12 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:36.094491  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:36.095396  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:36.109241  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:36.204509  3852 raft_consensus.cc:2393] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 16: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:36.115486  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:36.130718  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:36.136090  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:36.136986  9673 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:36.210454  9673 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:36.085805  9659 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:36.157626  9309 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.058228  9720 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:36.208359  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:36.230618  4568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.062s	sys 0.086s
W20260709 12:29:36.287731  4568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.062s	sys 0.086s
W20260709 12:29:36.231823  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 101216us
I20260709 12:29:36.224637  3931 raft_consensus.cc:2468] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:36.215678  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:36.215047  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:36.290167  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:36.206027  3998 raft_consensus.cc:2468] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:36.287788  3927 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
W20260709 12:29:36.294816  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 79864us
W20260709 12:29:36.295964  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 82179.8us
I20260709 12:29:36.299853  3897 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:36.301545  3932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.009s	sys 0.011s
W20260709 12:29:36.301924  3932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.010s	sys 0.011s
I20260709 12:29:36.301427  4537 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:36.340234  4571 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:36.340868  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:36.336861  4537 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:36.299727  9699 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:36.346016  4537 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:36.350137  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:36.351769  3929 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:36.250236  3895 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:36.223783  4573 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 20.
I20260709 12:29:36.300597  9747 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:36.298959  9853 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:36.369120  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:36.387432  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 137290us
I20260709 12:29:36.419682  4572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1492) took 1025 ms. Trace:
W20260709 12:29:36.366858  4570 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.048s	sys 0.111s
I20260709 12:29:36.343930  9720 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:29:36.420789  4570 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.048s	sys 0.112s
I20260709 12:29:36.417619  9853 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:36.343354  9842 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:36.423874  9853 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:36.343905  9834 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:36.351841  9820 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:36.426717  9820 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:36.353219  9888 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:36.427206  9820 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:36.427570  9888 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:36.197583  9408 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.428048  9888 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:36.400004  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:36.405508  3853 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:36.420207  4572 rpcz_store.cc:276] 0709 12:29:35.393814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:35.393962 (+   148us) service_pool.cc:224] Handling call
0709 12:29:35.413764 (+ 19802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:35.414060 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:35.414090 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:35.414644 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:29:35.768814 (+354170us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:35.768860 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:35.768938 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:36.419332 (+650394us) raft_consensus.cc:1685] finished
0709 12:29:36.419374 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:36.419602 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":353758,"threads_started":1,"wal-append.queue_time_us":872553}
I20260709 12:29:36.432358  3749 catalog_manager.cc:5697] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:36.367197  9747 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:36.434044  9747 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:36.434835  9673 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:36.437099  9656 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.407888  9705 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:36.438123  9705 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:36.438509  9705 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:36.439391  9656 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:36.441200  9309 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:36.443866  9851 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:36.444370  9851 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.410879  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:36.415691  9897 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:36.341163  9545 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:29:36.447254  3897 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:36.351646  9808 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 12:29:36.450801  9866 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:36.397323  9891 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.152s
I20260709 12:29:36.367596  9869 consensus_queue.cc:1059] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 12:29:36.454241  3897 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:36.454381  9869 raft_consensus.cc:3055] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:36.454790  9869 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:36.455669  9869 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.456884  9869 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:36.457075  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:36.458385  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:36.458389  3897 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:36.209386  4538 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:36.462339  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:36.348343  9699 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:29:36.463881  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 254608us
I20260709 12:29:36.445839  9820 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.466125  4538 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:36.467463  3928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.001s	sys 0.009s
W20260709 12:29:36.467157  3969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.000s	sys 0.011s
W20260709 12:29:36.468024  3928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.001s	sys 0.009s
W20260709 12:29:36.468081  3969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.000s	sys 0.011s
W20260709 12:29:36.469002  4567 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.002s	sys 0.010s
I20260709 12:29:36.474205  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:36.464150  9309 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:36.476539  4538 leader_election.cc:400] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 16. Current term is 17.
I20260709 12:29:36.479362  4538 leader_election.cc:403] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:29:36.485759  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:36.489502  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:36.491649  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:36.494338  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:36.494495  3850 raft_consensus.cc:1240] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:36.494971  3851 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:36.462090  9705 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:36.480036  4569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.003s	sys 0.008s
I20260709 12:29:36.447597  9851 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:36.483734  3969 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:36.484293  4567 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.002s	sys 0.010s
I20260709 12:29:36.464726  9699 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:29:36.540619  4569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.003s	sys 0.011s
W20260709 12:29:36.525058  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 51770.1us
W20260709 12:29:36.513563  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 55240.3us
I20260709 12:29:36.498301  4571 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 16: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:36.472173  9834 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:29:36.568239  9847 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.000s	sys 0.014s
W20260709 12:29:36.580032  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:36.580879  3929 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: []
W20260709 12:29:36.476428  9871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.000s	sys 0.010s
I20260709 12:29:36.465039  9866 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:36.574450  3897 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:36.447446  9842 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:36.547159  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:36.481155  9689 consensus_meta.cc:287] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.873s	user 0.011s	sys 0.000s
I20260709 12:29:36.545293  4574 raft_consensus.cc:606] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:36.585465  3895 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:36.593763  4574 raft_consensus.cc:614] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:29:36.481853  9865 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.003s	sys 0.007s
I20260709 12:29:36.475970  9726 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:29:36.581154  9847 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.000s	sys 0.015s
I20260709 12:29:36.575672  4538 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:36.587899  9871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.000s	sys 0.016s
I20260709 12:29:36.546118  8992 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:36.545374  9408 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:36.570909  9778 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:36.542788  9897 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 16. Current term is 17.
I20260709 12:29:36.600358  9851 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:29:36.599349  9865 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.006s	sys 0.010s
I20260709 12:29:36.654484  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:36.596711  9770 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:36.670913  4538 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:36.672147  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:36.600602  9768 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:29:36.650832  9819 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.017s	sys 0.000s
I20260709 12:29:36.605247  9720 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:36.607686  9866 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:36.681679  4538 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:36.683835  3821 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:36.687028  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:36.688570  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:36.695016  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:36.696739  3929 raft_consensus.cc:2393] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 14: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:36.662089  9408 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:36.673679  8992 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:36.699410  3821 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:36.701292  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:36.657692  9778 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:36.598049  9689 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.689416  9726 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:29:36.682932  9819 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.018s	sys 0.000s
I20260709 12:29:36.704305  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:36.698599  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:36.705963  3923 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:29:36.688338  9735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.011s	sys 0.020s
I20260709 12:29:36.707676  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:36.708856  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:36.710163  3971 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:36.715006  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:36.614696  9851 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.692756  9866 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:36.691413  9837 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:29:36.700405  9818 raft_consensus.cc:3055] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:36.718493  9747 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.726550  9770 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:36.749467  9770 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:36.482340  3749 catalog_manager.cc:5697] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 9 to 11, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 11 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:36.707939  9481 consensus_meta.cc:287] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.656s	user 0.006s	sys 0.005s
I20260709 12:29:36.746331  3924 raft_consensus.cc:2368] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 18. Current term is 19.
I20260709 12:29:36.701040  8992 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:36.688840  9839 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 12:29:36.754045  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 54701.1us
I20260709 12:29:36.705557  9656 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:36.773324  9705 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:36.772912  9481 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.773842  9820 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843)
I20260709 12:29:36.738240  9309 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:36.691354  9768 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.784104  9689 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:36.786288  9851 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:36.786358  9768 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:36.739915  9834 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:36.750279  9911 raft_consensus.cc:2804] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:29:36.779816  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:36.747695  9818 raft_consensus.cc:740] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:36.750361  9842 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:36.787783  3821 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:36.747337  9866 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:36.776947  8992 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:29:36.739610  9735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.011s	sys 0.021s
W20260709 12:29:36.804327  3997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.040s	sys 0.109s
W20260709 12:29:36.804766  3997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.040s	sys 0.109s
I20260709 12:29:36.805044  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:36.798751  9659 consensus_meta.cc:287] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 12:29:36.799319  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:36.799804  3924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 2390) took 1020 ms. Trace:
I20260709 12:29:36.813482  3924 rpcz_store.cc:276] 0709 12:29:35.780164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:35.780541 (+   377us) service_pool.cc:224] Handling call
0709 12:29:36.796597 (+1016056us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54000dc354. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:36.799727 (+  3130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2138006912}
I20260709 12:29:36.779016  9656 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:36.712843  9778 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:36.799458  3926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.020s	sys 0.044s
W20260709 12:29:36.817171  3926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.020s	sys 0.044s
I20260709 12:29:36.818650  3928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 2389) took 1050 ms. Trace:
I20260709 12:29:36.819060  3928 rpcz_store.cc:276] 0709 12:29:35.775680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:35.775792 (+   112us) service_pool.cc:224] Handling call
0709 12:29:35.776088 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:35.776316 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:35.776340 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:35.776814 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:29:36.468716 (+691902us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:36.468779 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:36.468883 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:36.818456 (+349573us) raft_consensus.cc:1685] finished
0709 12:29:36.818478 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:36.818599 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":687571,"threads_started":1,"wal-append.queue_time_us":934647}
I20260709 12:29:36.820271  3999 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 12:29:36.820626  3999 pending_rounds.cc:85] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 12
I20260709 12:29:36.819782  3821 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:36.820914  3999 pending_rounds.cc:107] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:29:36.821265  3999 raft_consensus.cc:2889] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:36.800448  9911 raft_consensus.cc:697] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 20 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:36.804370  9851 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:36.842463  3821 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:36.817410  9656 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:36.850109  9545 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:36.850657  9911 consensus_queue.cc:237] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.844348  9808 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:36.855237  9808 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.872448  9820 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:36.873147  9820 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.876137  9720 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:36.875082  3749 catalog_manager.cc:5697] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 7 to 8, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 8 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:36.876798  9720 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:36.879189  9720 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:36.881644  9747 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:36.841355  9842 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:36.883150  9481 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:36.875619  9820 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:36.885614  9778 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:36.800423  9834 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:36.962533  4537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.039s	sys 0.038s
W20260709 12:29:36.963737  4537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.039s	sys 0.038s
W20260709 12:29:36.965097  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 619155us
I20260709 12:29:36.968299  4537 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:36.963860  4536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.053s	sys 0.087s
W20260709 12:29:36.972259  4536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.053s	sys 0.087s
W20260709 12:29:36.968546  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 47673.6us
I20260709 12:29:36.977257  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:36.982030  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:37.006227  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:37.019832  3821 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:37.020788  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:37.021998  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:37.031834  9545 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:37.036468  3853 raft_consensus.cc:3060] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:29:36.966295  9780 consensus_meta.cc:287] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.783s	user 0.011s	sys 0.001s
I20260709 12:29:37.072237  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:36.972536  9842 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 12:29:37.037485  3749 catalog_manager.cc:5697] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 7 to 8, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 8 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:37.036159  9808 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:37.101369  8992 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:37.111665  9726 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:37.123486  4570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.013s	sys 0.006s
W20260709 12:29:37.124958  4570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.013s	sys 0.006s
W20260709 12:29:37.125967  3854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.007s	sys 0.011s
W20260709 12:29:37.126487  3854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.007s	sys 0.011s
W20260709 12:29:37.132494  3972 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.011s	sys 0.008s
W20260709 12:29:37.133028  3972 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.011s	sys 0.008s
W20260709 12:29:37.135545  3970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.000s	sys 0.019s
W20260709 12:29:37.136023  3970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.000s	sys 0.019s
W20260709 12:29:37.136731  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:37.139935  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:37.141489  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.142302  3998 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:37.142494  9481 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:37.143383  9481 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.143992  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:37.147485  9747 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:29:37.147964  9699 consensus_meta.cc:287] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.573s	user 0.004s	sys 0.007s
I20260709 12:29:37.148072  9747 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:37.148875  9699 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.150365  9747 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:37.123929  9726 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.126330  9878 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:29:37.157238  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:37.157629  4568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.012s	sys 0.007s
W20260709 12:29:37.160328  4568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.013s	sys 0.007s
W20260709 12:29:37.162269  3895 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.008s	sys 0.011s
W20260709 12:29:37.162648  3895 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.008s	sys 0.011s
W20260709 12:29:37.162969  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 577561us
I20260709 12:29:37.122059  9780 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:37.166824  4567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.038s	sys 0.064s
W20260709 12:29:37.167641  4567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.038s	sys 0.064s
I20260709 12:29:37.165524  4573 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:37.172928  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:37.176461  3854 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:37.153707  3998 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:37.181754  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:37.182541  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:36.964016  9818 consensus_queue.cc:260] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.184307  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:37.187376  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.128243  9770 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.192070  9776 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:29:37.183521  9869 consensus_meta.cc:287] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.726s	user 0.007s	sys 0.006s
I20260709 12:29:37.207486  9776 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.210676  9866 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.211858  3930 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 16: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:37.212981  9770 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:37.215247  8992 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:37.215359  9770 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:37.216919  9726 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:37.217911  3852 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:37.219453  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:37.222425  9699 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:37.185248  9872 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:37.224766  9763 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:37.206107  9481 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:37.213868  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.227113  4006 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
W20260709 12:29:37.197089  9888 consensus_meta.cc:287] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.769s	user 0.005s	sys 0.008s
I20260709 12:29:37.192523  4003 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:29:37.214460  9776 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:37.225683  4567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1370) took 1627 ms. Trace:
I20260709 12:29:37.236555  4565 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:29:37.232043  4570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1372) took 1525 ms. Trace:
I20260709 12:29:37.237579  3853 raft_consensus.cc:2468] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
W20260709 12:29:37.240633  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 73386.4us
I20260709 12:29:37.239297  4536 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:37.242904  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:37.187875  9689 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:37.237735  4570 rpcz_store.cc:276] 0709 12:29:35.600441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:35.600612 (+   171us) service_pool.cc:224] Handling call
0709 12:29:35.600886 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:35.601120 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:29:36.421199 (+820079us) log.cc:844] Serialized 14 byte log entry
0709 12:29:37.125476 (+704277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:37.125540 (+    64us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:29:37.125605 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:37.125733 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:37.125858 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10929,"prepare.queue_time_us":246584,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":90798,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"thread_start_us":1478074,"threads_started":2}
I20260709 12:29:37.234190  4567 rpcz_store.cc:276] 0709 12:29:35.597837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:35.597961 (+   124us) service_pool.cc:224] Handling call
0709 12:29:35.598219 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:35.598411 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:29:36.565357 (+966946us) log.cc:844] Serialized 14 byte log entry
0709 12:29:37.184512 (+619155us) log.cc:844] Serialized 14 byte log entry
0709 12:29:37.224345 (+ 39833us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:37.224423 (+    78us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:29:37.224500 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:37.225421 (+   921us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:37.225605 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39554,"prepare.queue_time_us":264033,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":82,"raft.queue_time_us":89023,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":180,"thread_start_us":1549389,"threads_started":2}
I20260709 12:29:37.264727  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.300274  3998 raft_consensus.cc:1240] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:37.248623  9656 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.308260  9656 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:37.308697  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:37.311059  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.312256  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.313817  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.316340  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:37.319717  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:37.328791  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:37.253690  9818 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:37.225243  9872 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:37.333372  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:37.336099  3821 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:37.253331  9699 raft_consensus.cc:2804] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:37.337410  3854 raft_consensus.cc:2468] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:37.236097  9888 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.298357  8992 consensus_queue.cc:1059] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
W20260709 12:29:37.347229  4538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.012s	sys 0.016s
I20260709 12:29:37.351305  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:37.357579  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:37.366693  3927 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
W20260709 12:29:37.366124  4538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.013s	sys 0.017s
W20260709 12:29:37.368656  3969 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.021s	sys 0.010s
W20260709 12:29:37.369115  3969 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.021s	sys 0.010s
W20260709 12:29:37.369822  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 886124us
I20260709 12:29:37.374490  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:37.362780  3970 connection.cc:256] RPC call timeout handler was delayed by -1.1580879429998276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260709 12:29:37.300870  9689 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.382074  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:37.383857  3932 raft_consensus.cc:3060] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:29:37.365635  9865 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.014s	sys 0.015s
W20260709 12:29:37.383050  3970 connection.cc:256] RPC call timeout handler was delayed by -1.1553879429998233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 12:29:37.344429  9786 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:37.388481  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:37.386497  9865 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.014s	sys 0.015s
I20260709 12:29:37.396034  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:37.396783  4570 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:37.396860  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:37.398667  4574 raft_consensus.cc:1240] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:37.404691  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:37.409955  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:37.383761  9699 raft_consensus.cc:697] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:37.413951  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:37.414099  3970 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:37.416404  3898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.017s	sys 0.059s
W20260709 12:29:37.416755  3898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.017s	sys 0.059s
I20260709 12:29:37.417905  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:37.426630  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:37.411347  3857 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:37.434154  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:37.436169  9872 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:37.436792  9872 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:37.438864  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:37.439038  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.440447  9699 consensus_queue.cc:237] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.419961  9778 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:37.411187  9770 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:37.443298  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.443989  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:37.444996  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:37.445490  3997 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.005s	sys 0.025s
I20260709 12:29:37.446741  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.416219  9655 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:37.448484  4570 raft_consensus.cc:2468] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:37.456300  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.457662  3854 raft_consensus.cc:1240] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:37.450554  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:37.451680  3997 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.005s	sys 0.025s
I20260709 12:29:37.458483  9780 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:37.448745  9778 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.465286  3850 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 17. Current term is 18. Ops: []
W20260709 12:29:37.450340  3897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.017s	sys 0.013s
W20260709 12:29:37.494315  3897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.018s	sys 0.013s
I20260709 12:29:37.483083  9655 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:37.496435  9778 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:37.498124  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 923681us
I20260709 12:29:37.499537  9888 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:37.484898  9689 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:37.487402  9776 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:37.467793  3969 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:37.505844  9776 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:37.456063  9936 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:29:37.462334  9931 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:37.511389  9931 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.511862  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.456208  9834 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:37.513984  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.514389  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:37.516404  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.516907  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:37.485710  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:37.487922  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:37.517661  4567 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:37.526521  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:37.527415  4570 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:37.531677  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.532346  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:37.458180  9819 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.014s	sys 0.016s
I20260709 12:29:37.536285  3932 raft_consensus.cc:2468] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 20.
I20260709 12:29:37.532397  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2918) took 1467 ms. Trace:
I20260709 12:29:37.547386  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:37.542567  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:37.549027  9655 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:37.464073  9770 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:37.538166  9819 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.014s	sys 0.016s
I20260709 12:29:37.558710  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:37.560678  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:37.575768  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:37.576640  4000 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:37.564224  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:37.565701  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:37.566018  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:37.580135  3925 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:37.546128  3997 rpcz_store.cc:276] 0709 12:29:36.065371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:36.065513 (+   142us) service_pool.cc:224] Handling call
0709 12:29:36.065902 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:36.066334 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:36.066375 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:36.066922 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:29:36.805157 (+738235us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:29:37.493547 (+688390us) log.cc:844] Serialized 14 byte log entry
0709 12:29:37.532063 (+ 38516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:37.532150 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:37.532195 (+    45us) raft_consensus.cc:1685] finished
0709 12:29:37.532208 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:37.532340 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12431,"prepare.queue_time_us":48954,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":27444,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":179,"thread_start_us":1386768,"threads_started":2,"wal-append.queue_time_us":1059140}
W20260709 12:29:37.568029  3928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.036s	sys 0.040s
I20260709 12:29:37.569232  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:37.569346  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 461894us
I20260709 12:29:37.583531  4569 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:37.585140  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:37.585979  4566 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 14: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:37.585860  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.588569  3897 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:37.596253  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:37.585140  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:37.597455  3897 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:37.608546  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:37.609347  4006 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:29:37.612452  3857 raft_consensus.cc:2410] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:29:37.616835  4000 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:37.618764  3854 raft_consensus.cc:1240] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 19. Current term is 20. Ops: []
I20260709 12:29:37.564055  9747 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:37.624610  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:37.623749  3822 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:37.624717  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:37.628495  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:37.632408  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:37.633371  4000 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
W20260709 12:29:37.634490  4537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.020s	sys 0.016s
W20260709 12:29:37.634903  4537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.020s	sys 0.016s
W20260709 12:29:37.635562  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 667315us
W20260709 12:29:37.630088  9911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.011s	sys 0.011s
I20260709 12:29:37.674765  3927 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:37.679932  4006 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 19.
W20260709 12:29:37.680996  3924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.026s	sys 0.031s
W20260709 12:29:37.696534  3924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.026s	sys 0.031s
I20260709 12:29:37.683589  3969 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:37.687901  9770 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:37.690639  9689 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:37.642261  9545 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
W20260709 12:29:37.674451  9911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.012s	sys 0.011s
I20260709 12:29:37.690639  4567 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 19.
I20260709 12:29:37.698376  3969 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:37.708766  3925 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:37.713716  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:37.718973  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 94443us
I20260709 12:29:37.640659  9747 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.722615  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:37.726673  4567 raft_consensus.cc:2368] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 19. Current term is 20.
W20260709 12:29:37.728366  3926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.007s	sys 0.031s
W20260709 12:29:37.728786  3926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.007s	sys 0.031s
I20260709 12:29:37.711854  9819 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:37.705631  9851 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:37.694180  9888 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:29:37.731278  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 412706us
I20260709 12:29:37.722214  9808 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:37.724211  3897 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:37.727233  9656 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:37.748571  4537 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:37.729259  9689 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:37.744180  3895 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:37.756127  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:37.758157  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:37.759116  3856 raft_consensus.cc:2393] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 16: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:37.761849  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:37.762533  3855 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:37.762750  3853 raft_consensus.cc:1240] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: []
W20260709 12:29:37.763659  9946 log.cc:927] Time spent T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:29:37.722254  9545 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.767674  3895 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:37.787096  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:37.791210  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:37.791831  3856 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:37.792822  4537 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:37.766600  9720 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:37.794318  9720 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:37.794435  9888 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:37.737866  9851 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.794752  9720 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:37.797298  9851 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:37.799675  9656 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:37.800282  9656 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.752723  9808 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.805166  9866 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:37.806348  9866 raft_consensus.cc:2804] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:37.806810  9866 raft_consensus.cc:697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:37.807296  9545 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:37.807410  9656 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:37.807734  9866 consensus_queue.cc:237] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:37.789346  9819 consensus_queue.cc:1059] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:29:37.809690  4536 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:37.814278  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:37.810478  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:37.816169  3999 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:37.794829  9888 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:37.799690  9878 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:37.825024  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:37.820207  4537 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:37.841257  3997 raft_consensus.cc:1240] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:37.847553  9947 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:37.848258  9947 raft_consensus.cc:697] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:37.849504  9808 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:37.829077  9888 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:37.814307  9911 consensus_queue.cc:1059] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:29:37.843149  9780 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:37.849357  9747 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:37.853262  9878 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:37.854684  8992 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:37.863277  9780 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:37.872246  9747 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:29:37.892212  9934 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.432s	user 0.002s	sys 0.002s
I20260709 12:29:37.875257  9878 raft_consensus.cc:697] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:37.911981  9931 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:37.914659  9941 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
I20260709 12:29:37.917088  9939 raft_consensus.cc:3055] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:37.918241  9936 raft_consensus.cc:3055] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:37.922444  9936 raft_consensus.cc:740] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:29:37.923270  9935 log.cc:927] Time spent T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.469s	user 0.000s	sys 0.002s
I20260709 12:29:37.923601  9936 consensus_queue.cc:260] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:37.925390  9936 raft_consensus.cc:3060] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:37.921838  9939 raft_consensus.cc:740] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:37.849341  9947 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:37.969956  3970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.003s	sys 0.019s
W20260709 12:29:37.970808  3970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.003s	sys 0.019s
W20260709 12:29:37.973064  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 534220us
W20260709 12:29:37.973744  3898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.014s	sys 0.023s
W20260709 12:29:37.974113  3971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.021s
W20260709 12:29:37.974639  3971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.000s	sys 0.021s
W20260709 12:29:37.975090  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 536550us
W20260709 12:29:37.974246  3898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.014s	sys 0.023s
I20260709 12:29:37.981554  3971 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:37.986120  4538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.065s	sys 0.026s
W20260709 12:29:37.986696  4538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.066s	sys 0.026s
W20260709 12:29:37.987187  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 561742us
I20260709 12:29:37.987561  4568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42526 (request call id 1380) took 1529 ms. Trace:
I20260709 12:29:37.988462  4538 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:37.988137  4568 rpcz_store.cc:276] 0709 12:29:36.458122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:36.458306 (+   184us) service_pool.cc:224] Handling call
0709 12:29:36.458695 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:36.459167 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:36.459210 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:36.459801 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:29:37.160777 (+700976us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:29:37.160817 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:37.160882 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:37.891548 (+730666us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:37.986724 (+ 95176us) raft_consensus.cc:1685] finished
0709 12:29:37.986767 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:37.987260 (+   493us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4180,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":11274,"spinlock_wait_cycles":15180672,"thread_start_us":700597,"threads_started":1,"wal-append.queue_time_us":970090}
I20260709 12:29:37.992709  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:37.996270  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:38.000715  3970 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:37.874437  8992 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.009955  4565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1507) took 2006 ms. Trace:
I20260709 12:29:38.013849  9481 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:38.017114  3971 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:37.878342  9780 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:38.019620  9819 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:38.019734  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43306 (request call id 2409) took 1357 ms. Trace:
W20260709 12:29:38.020637  9699 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.004s	sys 0.008s
I20260709 12:29:38.021304  9776 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:38.022544  9820 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:38.024657  9834 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:37.887351  9747 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:38.028760  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:38.062273  4565 rpcz_store.cc:276] 0709 12:29:36.003378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:36.150121 (+146743us) service_pool.cc:224] Handling call
0709 12:29:36.150556 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:37.237109 (+1086553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:38.009206 (+772097us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540052ab54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:38.009737 (+   531us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2496861568}
W20260709 12:29:38.123402  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 355670us
I20260709 12:29:38.123786  9834 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.126981  9818 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:38.127626  9818 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:38.096217  3932 rpcz_store.cc:276] 0709 12:29:36.662406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:36.670381 (+  7975us) service_pool.cc:224] Handling call
0709 12:29:38.019233 (+1348852us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54000efbd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:38.019450 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1582020480}
W20260709 12:29:38.109464  9699 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.004s	sys 0.008s
I20260709 12:29:38.096022  9819 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:38.133021  9820 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:38.148219  9819 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:29:38.158898  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:38.180235  8992 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:38.151396  9820 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:38.162640  4568 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 17. Current term is 18. Ops: []
W20260709 12:29:38.165055  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 164601us
I20260709 12:29:38.165688  9481 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:29:38.167044  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 150172us
I20260709 12:29:38.167797  9936 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:38.170202  9776 consensus_queue.cc:1059] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:29:38.171126  9763 raft_consensus.cc:493] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:38.186084  9776 raft_consensus.cc:3055] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:29:38.186352  9763 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:38.186766  9776 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:38.188450  9776 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:37.928170  9939 consensus_queue.cc:260] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.183322  9747 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:29:38.184018  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 363721us
W20260709 12:29:38.192988  3852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40038 (request call id 1550) took 1213 ms (client timeout 1580 ms). Trace:
W20260709 12:29:38.193470  3852 rpcz_store.cc:269] 0709 12:29:36.976791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:36.976989 (+   198us) service_pool.cc:224] Handling call
0709 12:29:38.148938 (+1171949us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54000181d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:38.190360 (+ 41422us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":446532992}
I20260709 12:29:38.193984  9776 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:38.193813  9878 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.205912  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:38.207500  9971 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:38.208240  9971 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:38.208918  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:38.209918  3928 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
I20260709 12:29:38.210222  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:38.211244  3851 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:38.142163  9818 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:38.208995  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:38.194518  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:38.218465  3932 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 19.
I20260709 12:29:38.219964  9834 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:38.230466  9818 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:38.213425  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:38.234381  3927 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 13.
W20260709 12:29:38.236227  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 522502us
I20260709 12:29:38.242748  3971 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:38.230581  3970 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:38.245602  9936 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:38.246477  3970 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:38.247555  9936 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:38.244318  9481 raft_consensus.cc:2804] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:38.250787  9939 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:38.237507  3822 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
W20260709 12:29:38.266027  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:38.267786  9481 raft_consensus.cc:697] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:38.267902  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:38.268934  3850 raft_consensus.cc:2393] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 18: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:38.269346  9481 consensus_queue.cc:237] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.276669  9735 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:38.277276  9735 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:38.277668  9735 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:38.282232  9851 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:29:38.283717  9942 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:38.283874  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 2933) took 1005 ms. Trace:
W20260709 12:29:38.289592  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:38.281018  9780 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.276809  3822 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:38.246969  9971 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:38.298022  9545 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:38.284353  4003 rpcz_store.cc:276] 0709 12:29:37.278376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:37.278543 (+   167us) service_pool.cc:224] Handling call
0709 12:29:37.278908 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:37.279278 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:37.279306 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:37.279774 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:29:37.719577 (+439803us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:29:38.282815 (+563238us) log.cc:844] Serialized 14 byte log entry
0709 12:29:38.283240 (+   425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:38.283379 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:38.283457 (+    78us) raft_consensus.cc:1685] finished
0709 12:29:38.283476 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:38.283683 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7939,"prepare.queue_time_us":14508,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":14867,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":1963,"spinlock_wait_cycles":576256,"thread_start_us":871978,"threads_started":2,"wal-append.queue_time_us":585997}
I20260709 12:29:38.314453  3970 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:38.317322  9958 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:38.319170  3970 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:38.321503  9959 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:38.323561  3970 leader_election.cc:400] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 18. Current term is 19.
I20260709 12:29:38.324590  3970 leader_election.cc:403] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:38.330972  9780 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:38.331921  9747 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:38.333581  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 360429us
I20260709 12:29:38.334745  9888 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.335366  9763 raft_consensus.cc:515] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.336010  3924 raft_consensus.cc:1240] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:38.343050  9655 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 18. Current term is 19.
I20260709 12:29:38.343784  9888 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:38.344341  3822 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:38.346140  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:38.346827  9545 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:38.347528  9545 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:38.347940  9545 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:38.348312  9545 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:38.351989  4536 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:38.353156  9961 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:38.353755  9961 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:38.353807  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:38.354754  3851 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:38.355219  9961 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.358659  9720 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.360980  9720 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:38.361431  3821 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:38.362491  9968 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:38.362879  9968 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:38.363246  9968 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:38.366323  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 66962.5us
I20260709 12:29:38.366868  9936 consensus_queue.cc:1059] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:38.368995  9936 raft_consensus.cc:3055] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:38.369485  9936 raft_consensus.cc:740] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:38.370501  9936 consensus_queue.cc:260] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.371835  9936 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:38.374054  9720 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:38.374881  9720 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.377270  9720 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:38.381202  9819 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:38.381974  3897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.011s	sys 0.040s
W20260709 12:29:38.382442  3897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.012s	sys 0.040s
I20260709 12:29:38.383580  9819 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:38.385211  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 630450us
W20260709 12:29:38.387955  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:38.342407  9763 leader_election.cc:290] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:38.386134  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:38.397630  3851 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
W20260709 12:29:38.413940  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 67987us
I20260709 12:29:38.421130  4536 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:38.429067  9309 raft_consensus.cc:2804] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:38.429656  9309 raft_consensus.cc:697] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:29:38.429741  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 106423us
I20260709 12:29:38.430696  9309 consensus_queue.cc:237] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.432672  3970 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:38.433491  9776 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:38.423826  9747 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:38.435796  3970 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:38.435915  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:38.436479  3821 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:38.437188  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:38.437530  3821 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:38.438529  9853 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:29:38.439112  9853 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:38.439260  9656 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:38.441522  9656 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:38.441984  9656 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:38.446117  9853 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:38.446125  3897 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:38.447296  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:38.446736  3822 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:38.448678  9869 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:29:38.449535  9842 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:29:38.440554  9851 consensus_queue.cc:1059] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:29:38.450048  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:38.450675  3857 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:38.451040  9851 raft_consensus.cc:3055] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:38.451574  9851 raft_consensus.cc:740] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:38.452687  9851 consensus_queue.cc:260] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.459993  9940 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:29:38.461740  3897 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:38.462375  9820 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.462743  9888 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:38.464046  3897 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:38.464924  9888 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:38.465166  3897 leader_election.cc:400] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 19. Current term is 20.
I20260709 12:29:38.465564  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:38.465544  9888 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:38.466935  9888 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.465543  3897 leader_election.cc:403] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:29:38.399642  9968 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.471639  9776 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:29:38.476212  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
W20260709 12:29:38.474745  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 206556us
I20260709 12:29:38.478437  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:38.484906  4568 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:29:38.486781  9851 raft_consensus.cc:3060] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:38.490806  9747 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 19. Current term is 20.
I20260709 12:29:38.492252  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:38.498636  3924 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:38.505043  9869 consensus_queue.cc:1059] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:29:38.475989  9545 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:38.506659  3857 raft_consensus.cc:2468] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:38.507411  9786 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:38.509277  9545 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:38.510115  9656 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.512389  9656 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:38.514387  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:38.514626  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:38.515187  3923 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:38.515935  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:38.516233  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:38.516592  3926 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:38.517653  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:38.518361  3928 raft_consensus.cc:3060] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:38.522576  3850 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 12. Current term is 13. Ops: []
I20260709 12:29:38.517679  3927 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:38.507069  9968 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:38.553066  9853 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.536360  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:38.527086  9820 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:38.537048  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 101373us
I20260709 12:29:38.506191  9735 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:38.543354  9818 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:38.544273  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:38.545334  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:38.545790  3897 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:38.546985  3923 raft_consensus.cc:1275] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:29:38.547521  3851 raft_consensus.cc:2468] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
I20260709 12:29:38.548892  9842 raft_consensus.cc:3055] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:38.532622  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:38.554978  3928 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 18.
I20260709 12:29:38.558197  3822 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:38.569483  3927 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:38.570178  3897 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:38.568122  9939 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:38.576444  9481 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:29:38.579352  9968 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:38.578879  3853 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:38.577673  9747 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:38.581739  3970 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:38.583632  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:38.567051  9842 raft_consensus.cc:740] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:38.584491  9655 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:38.586097  9655 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:38.586481  9655 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:38.590284  9655 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:38.590332  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:38.590809  9842 consensus_queue.cc:260] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.591845  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:38.592588  9842 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:38.593463  9747 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:38.594094  9939 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:38.595794  9735 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:38.599460  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:38.601507  3822 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:38.602445  9818 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.606033  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:38.608771  9968 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:38.609515  9968 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:38.610497  3852 raft_consensus.cc:1240] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 19. Current term is 20. Ops: []
I20260709 12:29:38.612586  9961 consensus_queue.cc:1059] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:29:38.613453  9961 raft_consensus.cc:3055] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:29:38.613772  9961 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:38.614979  9961 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.616402  9961 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:38.615422  3970 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:38.616496  9818 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:38.660189  9986 log.cc:927] Time spent T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.071s	user 0.005s	sys 0.000s
I20260709 12:29:38.671869  3927 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 19.
I20260709 12:29:38.675272  3924 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:38.667693  9853 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:38.679708  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:38.680948  3930 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:38.678350  4536 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:38.686240  9720 raft_consensus.cc:2804] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:38.686933  9720 raft_consensus.cc:697] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 17 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:38.686962  9974 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:38.688117  9720 consensus_queue.cc:237] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.688133  9974 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.695616  9853 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:29:38.696926  9853 raft_consensus.cc:3055] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:38.697716  9853 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:38.697157  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:38.692580  9818 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:38.699200  9853 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.700214  3971 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:38.714339  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 99031.9us
I20260709 12:29:38.713500  3822 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:38.707244  9776 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:38.726058  9968 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:38.725896  9974 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:38.735641  9853 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:29:38.742055  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:38.743878  9888 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:38.751510  9888 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.755002  9888 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:38.763017  3897 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:38.769920  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:38.783934  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:38.785166  3857 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:38.786386  3851 raft_consensus.cc:1240] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:38.788157  9820 consensus_queue.cc:1059] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:38.789070  9820 raft_consensus.cc:3055] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:38.789136  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:38.789497  9820 raft_consensus.cc:740] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:38.789736  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:38.790410  9820 consensus_queue.cc:260] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.791580  9820 raft_consensus.cc:3060] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:38.791697  3927 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 12:29:38.793896  9994 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.100s	user 0.003s	sys 0.000s
I20260709 12:29:38.794763  3932 raft_consensus.cc:1240] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260709 12:29:38.795192  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:38.795948  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:38.799595  9936 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:38.800625  9936 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:38.803117  9936 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:38.804456  3897 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:38.805536  9939 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:38.805764  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:38.806226  9939 raft_consensus.cc:697] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:38.806787  4003 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 14: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:38.807386  9939 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.816404  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:38.820122  3931 raft_consensus.cc:1275] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:29:38.776317  9888 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:38.821871  3930 raft_consensus.cc:3055] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:38.822381  3930 raft_consensus.cc:740] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:38.823355  3930 consensus_queue.cc:260] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.824779  3930 raft_consensus.cc:3060] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:38.826927  3897 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:38.831243  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:38.832746  9943 consensus_queue.cc:1059] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:38.835827  9974 raft_consensus.cc:3055] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:38.836333  9974 raft_consensus.cc:740] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:38.837455  9974 consensus_queue.cc:260] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.839438  9974 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:38.842420  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 341696us
I20260709 12:29:38.844343  3821 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:38.855605  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:38.846694  9747 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:29:38.861029  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:38.861153  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:38.852258  9842 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:38.864657  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:38.865454  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:38.870524  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:38.875327  4003 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 10.
I20260709 12:29:38.880600  3930 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:29:38.881775  3897 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:38.882802  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:38.883611  4566 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 20.
I20260709 12:29:38.885334  9842 raft_consensus.cc:697] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:38.891520  9842 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.891950  9655 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.894588  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:38.895056  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:38.892287  3853 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:29:38.896552  9776 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.897228  9776 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.900028  9776 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:38.900625  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:38.909430  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:38.909828  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:38.911190  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:38.911980  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:38.910746  4000 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
W20260709 12:29:38.913684  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 52390us
W20260709 12:29:38.920665  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:38.920914  9747 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:38.921430  9747 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:38.921860  9747 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:38.922266  9936 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.922798  9936 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:38.925737  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:38.930174  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 48482.8us
I20260709 12:29:38.931380  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:38.917585  3895 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:38.938334  9939 raft_consensus.cc:2804] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:38.938855  9939 raft_consensus.cc:697] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:38.942516  4568 raft_consensus.cc:1275] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:29:38.945235  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:38.949968  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:38.953225 10007 consensus_queue.cc:1059] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:38.959165  3999 raft_consensus.cc:1240] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:38.956995 10007 raft_consensus.cc:3055] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:38.967495  3969 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:38.971474  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:38.975385 10004 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:29:38.961545 10007 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:38.960423  9940 consensus_queue.cc:1059] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:29:38.982353  9819 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:38.993729  9940 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:38.994199  9940 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:38.997735 10007 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:38.999140 10007 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:38.999034  9776 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:39.000320  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:39.001554  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:39.002480  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:39.003413  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:39.004057  4006 raft_consensus.cc:1240] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:39.004460  4002 raft_consensus.cc:2410] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:29:39.008047  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:39.011685  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:39.011768  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:39.012707  3998 raft_consensus.cc:2468] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 13.
I20260709 12:29:38.982722  9939 consensus_queue.cc:237] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.017796  4005 raft_consensus.cc:2468] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 18.
I20260709 12:29:39.035367  9747 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:39.036456  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:39.041460  4002 raft_consensus.cc:1240] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:39.046175  9958 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:39.046993  9958 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:39.049341  9958 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:39.050485  4537 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:39.050940  3852 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:29:39.051573  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:39.053028  4537 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:39.053810  9820 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:38.995138  9940 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:39.054818  9720 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:39.055584  9940 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:39.055701  9720 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:39.056286  9720 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:39.056736  9720 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:39.054244  9820 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:39.058195  9820 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:39.062835  9851 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.063470  9851 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.064630  3853 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:29:39.069085  9747 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:39.069235  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:39.069355  9763 consensus_queue.cc:1059] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:29:39.070917  9943 raft_consensus.cc:3055] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:39.071313  9943 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:39.072400  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:39.072319  9943 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.073546  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:39.073701  9780 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:39.074209  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:39.074337  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:39.074807  9780 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.076875  9936 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:39.075240  4569 raft_consensus.cc:2410] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:29:39.078651  4003 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:29:39.078744  9780 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:39.077623  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:39.081036  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:39.081715  4002 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 18.
I20260709 12:29:39.083148  9943 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:39.084163  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:39.084735  3998 raft_consensus.cc:2376] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14. Re-sending same reply.
I20260709 12:29:39.085551  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:39.086158  3998 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 9.
I20260709 12:29:39.087003  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:39.087370  4005 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:39.087615  3998 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:39.088587  3998 raft_consensus.cc:3060] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:39.072528  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:39.090471  4566 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:39.092589  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:39.092664  9778 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:29:39.093911  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 56415.4us
I20260709 12:29:39.094087  9778 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:39.096024  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:39.096570  9778 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:39.099285  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:39.100221  4570 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:39.104620  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:39.106444  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:39.102833  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:39.113147  4004 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:29:39.104089  3969 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:39.114292  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:39.115144  4003 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 15: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:39.106204  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:39.113701  4565 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:39.116060  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:39.126425  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:39.127368  4006 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:39.044436  9655 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:39.075131  9309 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:29:39.148458  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:39.142400  3925 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:39.142315  3998 raft_consensus.cc:1275] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:29:39.145517 10010 log.cc:927] Time spent T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:29:39.147541  4568 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 18. Current term is 19. Ops: []
I20260709 12:29:39.151232  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:39.151880  3925 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:39.152047  4005 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:29:39.154474  3926 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:39.155061  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:39.155478  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:39.155745  3926 raft_consensus.cc:1240] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:39.156545  3897 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:39.157742  3897 leader_election.cc:304] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:39.158846  9939 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:39.159514  9939 raft_consensus.cc:2749] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:29:39.160229  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:39.161507  3897 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:39.147977  3970 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:39.163946  4566 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 20.
I20260709 12:29:39.168383  3897 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:39.170588  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 96457.5us
I20260709 12:29:39.170241  9655 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:39.171556  9888 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:39.175127  9939 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:39.182773  4539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:39.183810  3851 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:39.175603  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:39.178483  9763 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
W20260709 12:29:39.190380  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 64857.3us
I20260709 12:29:39.190943  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:39.194263 10004 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:39.194402  9819 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 12:29:39.211835  3970 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:39.210985  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 134962us
W20260709 12:29:39.223585  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 58448us
I20260709 12:29:39.225837  3970 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:39.226665  3923 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:39.227123  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:39.234154  9655 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:29:39.234889  9655 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:29:39.203326  9720 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.235116  9939 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:39.235522  9655 consensus_queue.cc:1048] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:29:39.236766  9720 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:39.237382  9778 consensus_queue.cc:1048] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:39.238849  9851 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:39.240780  4569 raft_consensus.cc:1240] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:39.242892  9936 consensus_queue.cc:1059] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:39.244112  9778 raft_consensus.cc:3055] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:39.243921  9820 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.244483  9778 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:39.245357  9778 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:39.223187  9819 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:39.247262  4571 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17. Ops: []
W20260709 12:29:39.247958  3972 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:39.246608  3970 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:39.251909  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:39.209843  9309 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:39.260308  3970 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:39.260738  3822 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:39.262748  9818 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:39.267266  9818 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:39.268374  4538 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:39.274756  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:39.276137  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:39.261174  9481 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:39.277410  3822 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:39.277549  9481 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:39.276949  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:39.279281  3931 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 18. Current term is 19. Ops: []
I20260709 12:29:39.280546  3930 raft_consensus.cc:1240] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 17. Current term is 18. Ops: []
W20260709 12:29:39.282383  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 88548.9us
I20260709 12:29:39.281891  9481 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:39.285435  9763 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:29:39.277701 10014 raft_consensus.cc:2804] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:39.211318  9974 consensus_queue.cc:1059] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:29:39.296087  9974 raft_consensus.cc:3055] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:39.296587  9974 raft_consensus.cc:740] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:39.282088  9656 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:39.283591 10000 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:39.310074  9786 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.310691  9786 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.312793  9786 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:39.313858 10008 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:29:39.317591  9778 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:39.320384  3822 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:39.286383  9853 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:39.321184  9853 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:39.321585  9853 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:39.294894  9869 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:39.325811 10000 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:39.326241 10000 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:39.308801  3897 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:39.334051  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:39.297484  9974 consensus_queue.cc:260] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.340178  9808 consensus_queue.cc:1059] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:39.340996  9808 raft_consensus.cc:3055] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:39.341383  9808 raft_consensus.cc:740] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:39.341208  9545 consensus_queue.cc:1059] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:29:39.330752  9944 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.342195  9944 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.342223  9808 consensus_queue.cc:260] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:39.343501  9808 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:39.339342  9939 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:39.344763  9944 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:39.345019  9939 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:39.345485  9545 raft_consensus.cc:3055] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:29:39.345954  9545 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:39.346906  9545 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.348137  9545 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:39.305989  9309 consensus_queue.cc:1059] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:29:39.350315  3923 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:39.350965  9943 raft_consensus.cc:3055] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:39.350641  9481 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.351336  9943 raft_consensus.cc:740] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:39.352294  9820 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:39.352211  9943 consensus_queue.cc:260] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.353848  9974 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:39.355288  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:39.358078  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:39.345505  9939 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:39.359453  9735 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:39.360833  9968 consensus_queue.cc:1059] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:39.362818  9968 raft_consensus.cc:3055] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:29:39.363231  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:39.364585  3755 catalog_manager.cc:5697] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:39.366380  3755 catalog_manager.cc:5697] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:39.368098  9853 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.369623  3755 catalog_manager.cc:5697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 12 to 13, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 13 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:39.331921  9786 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:39.379612  3821 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:39.380645  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 120449us
I20260709 12:29:39.381254  9851 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:39.361474  3822 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:39.363188  9968 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:39.386559  9968 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:39.388067  9968 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:39.385290  9853 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:39.381747  9851 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:39.392493  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 56675.6us
W20260709 12:29:39.400597  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 121384us
I20260709 12:29:39.405851  3897 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:39.402267  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:39.416848  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:39.420820  3998 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:29:39.421232  3970 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:39.422933  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:39.423651  3930 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:39.395738  9481 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:39.414774  9869 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:29:39.431169  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:39.414556  9851 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:39.418615 10007 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:29:39.460012  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:39.442591  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 46077us
I20260709 12:29:39.441617 10000 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.456383  9776 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:29:39.467712  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:39.463654  3755 catalog_manager.cc:5697] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 5 to 17, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 17 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:39.468185  3851 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:29:39.462957  3822 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:39.475603  3755 catalog_manager.cc:5697] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 12 to 14, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 14 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:39.479848  3755 catalog_manager.cc:5697] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 12 to 13, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 13 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:39.485256  3930 raft_consensus.cc:2468] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:39.488078  3857 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:39.472798  9936 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:29:39.493271  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 207294us
I20260709 12:29:39.493721  3822 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:39.490149  4567 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:39.473088  9776 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:39.478515  9786 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:39.504134  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:39.478375  9944 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:29:39.503904  9656 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:29:39.504680  9776 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:39.510483  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:39.511159  3997 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:39.475664  9735 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:29:39.498637  9974 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:29:39.512635  9735 raft_consensus.cc:3055] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:39.512992  9735 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:39.513772  9735 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.515043  9735 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:29:39.518195  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 89293.5us
W20260709 12:29:39.516536  9842 consensus_queue.cc:1175] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34711da9380944d2969a2bc3e203db3d" responder_term: 15 status { last_received { term: 15 index: 13 } last_committed_idx: 12 last_received_current_leader { term: 15 index: 13 } }
I20260709 12:29:39.508273  4569 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:39.523147  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:39.473866  9939 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:39.530530  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 54526us
I20260709 12:29:39.522874  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:39.540246  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:39.550554  3897 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:39.551970 10017 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:39.552418 10017 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:39.552733 10017 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:39.554705  9939 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:39.555476  4537 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:39.556751  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:39.557600  3857 raft_consensus.cc:2393] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 18: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:39.559612  9961 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:39.557482  4537 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:39.564580  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 58717.4us
I20260709 12:29:39.560233  9763 consensus_queue.cc:1048] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:29:39.565570  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:39.568714  3970 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:39.530987 10014 raft_consensus.cc:697] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 18 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:39.577916  4565 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:29:39.579787  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:39.581072  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:39.583666  3927 raft_consensus.cc:1275] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:29:39.584568  4004 raft_consensus.cc:1275] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:29:39.577456  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:39.584862  9656 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:39.590869  9656 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.597167  9943 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:39.606550  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:39.576128  9961 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:39.577014  9481 raft_consensus.cc:2804] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:39.620072  3927 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:39.622188 10000 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:39.626164  3755 catalog_manager.cc:5697] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 8 to 16. New cstate: current_term: 16 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:39.627673  3755 catalog_manager.cc:5697] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 14 to 17, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 17 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:39.628973  3755 catalog_manager.cc:5697] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:39.575973  9820 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:29:39.604413  9842 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:39.634234  9842 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:39.634696  9842 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:39.634775  9481 raft_consensus.cc:697] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:39.635982  9481 consensus_queue.cc:237] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:39.638266  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 115569us
I20260709 12:29:39.639020  4538 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:39.626313 10014 consensus_queue.cc:237] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.643651  3755 catalog_manager.cc:5697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 12 to 13, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 13 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:39.671655  4003 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 18.
I20260709 12:29:39.671710  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:39.655259  9778 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:39.682869  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 95183.9us
I20260709 12:29:39.684356 10016 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:39.684803 10016 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:39.685169 10016 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:39.686391  3850 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:29:39.687381  4538 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:39.666648  9309 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.688473  9309 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.658772  9763 consensus_queue.cc:1059] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:29:39.690809  9778 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.695560  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:39.673393  3755 catalog_manager.cc:5697] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:39.697970  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:39.703511  9786 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:39.703722  3850 raft_consensus.cc:1240] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 10. Current term is 11. Ops: []
W20260709 12:29:39.704850  3749 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51798 (request call id 321) took 49085 ms (client timeout 15000 ms). Trace:
I20260709 12:29:39.681512  9961 raft_consensus.cc:697] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 19 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:39.702740  3755 catalog_manager.cc:5697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:39.712668  4538 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:39.673233 10000 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:29:39.724648  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:39.723728  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:39.724023  3755 catalog_manager.cc:5697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:39.729945  3850 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:39.742318  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:39.700919  9309 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:39.728928  9974 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:39.743873  9786 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:29:39.748303  3755 catalog_manager.cc:5697] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 9 to 16, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 16 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:39.753082  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:39.752629  3755 catalog_manager.cc:5697] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 10 to 15, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 15 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:29:39.756691 10037 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:29:39.747701  9309 consensus_queue.cc:1048] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
W20260709 12:29:39.705279  3749 rpcz_store.cc:269] 0709 12:28:50.619798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:50.620028 (+   230us) service_pool.cc:224] Handling call
0709 12:29:39.704596 (+49084568us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:37.919522 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:37.920288 (+   766us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:37.920356 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:29:37.920386 (+    30us) tablet.cc:662] Decoding operations
0709 12:29:37.927380 (+  6994us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:37.927722 (+   342us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:37.928374 (+   652us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:29:37.929444 (+  1070us) tablet.cc:701] Row locks acquired
0709 12:29:37.929474 (+    30us) write_op.cc:260] PREPARE: finished
0709 12:29:37.929639 (+   165us) write_op.cc:270] Start()
0709 12:29:37.929753 (+   114us) write_op.cc:276] Timestamp: P: 1783600177929596 usec, L: 0
0709 12:29:37.929771 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:29:37.930614 (+   843us) log.cc:844] Serialized 3552 byte log entry
0709 12:29:38.560128 (+629514us) op_driver.cc:464] REPLICATION: finished
0709 12:29:38.735916 (+175788us) write_op.cc:301] APPLY: starting
0709 12:29:38.737100 (+  1184us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:38.755658 (+ 18558us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:38.756060 (+   402us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:38.971583 (+215523us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:38.971874 (+   291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:29:38.971933 (+    59us) write_op.cc:312] APPLY: finished
0709 12:29:38.972313 (+   380us) log.cc:844] Serialized 89 byte log entry
0709 12:29:38.972506 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:38.972682 (+   176us) write_op.cc:454] Released schema lock
0709 12:29:38.972743 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:38.973188 (+   445us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:38.973217 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":829659,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":162355,"apply.run_cpu_time_us":17500,"apply.run_wall_time_us":245302,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41711,"num_ops":9,"prepare.queue_time_us":420806,"prepare.run_cpu_time_us":34750,"prepare.run_wall_time_us":266301,"raft.queue_time_us":245493,"raft.run_cpu_time_us":21734,"raft.run_wall_time_us":202717,"replication_time_us":596636,"thread_start_us":957685,"threads_started":4,"wal-append.queue_time_us":227475}]]}
W20260709 12:29:39.762310  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 43967.8us
I20260709 12:29:39.754547  3755 catalog_manager.cc:5697] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 9 to 12, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 12 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:39.764144  3850 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 20.
I20260709 12:29:39.766608  3755 catalog_manager.cc:5697] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 7 to 9, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 9 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:39.728399  9939 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:29:39.768764  3969 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:39.772346 10023 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:29:39.772833 10023 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:39.773211 10023 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:39.776021 10022 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:39.776206 10025 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:29:39.783536  9961 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.790221  9778 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:39.770633  3755 catalog_manager.cc:5697] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 12 to 15, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 15 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:29:39.798265  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 73798.6us
W20260709 12:29:39.799721  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 218963us
I20260709 12:29:39.801136  3755 catalog_manager.cc:5697] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 7 to 12, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 12 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:39.774417  9481 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:29:39.764101  9763 consensus_queue.cc:1059] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 12:29:39.824898 10027 log.cc:927] Time spent T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.197s	user 0.000s	sys 0.004s
I20260709 12:29:39.828788  9776 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:39.841996  9974 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:39.843765 10048 consensus_queue.cc:1048] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:29:39.844461  9820 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:39.847252  9780 raft_consensus.cc:3055] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:29:39.850323 10026 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.229s	user 0.003s	sys 0.000s
I20260709 12:29:39.850859 10023 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.851223  9888 consensus_queue.cc:1048] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:39.811098  9481 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:39.854661  3897 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:39.856266  9851 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.867353  3755 catalog_manager.cc:5697] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 17 to 21, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 21 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:39.865042  9778 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.883952  3755 catalog_manager.cc:5697] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 11 to 15, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 15 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:39.889770  3755 catalog_manager.cc:5697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:39.894248  3755 catalog_manager.cc:5697] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 11 to 13, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 13 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:39.896826  3755 catalog_manager.cc:5697] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 10 to 12, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 12 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:39.821681  9842 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.914033  3755 catalog_manager.cc:5697] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 8 to 16, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 16 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:39.915467  3755 catalog_manager.cc:5697] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 6 to 17. New cstate: current_term: 17 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:39.916966  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:39.918697  3927 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:29:39.876765  9780 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:39.917704  3924 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
W20260709 12:29:39.924758  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 125552us
I20260709 12:29:39.926553  3755 catalog_manager.cc:5697] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 4 to 13. New cstate: current_term: 13 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:39.893105  9481 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:29:39.933521  3755 catalog_manager.cc:5697] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:39.935034  3852 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 16: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:39.939113  4002 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:29:39.929630  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:39.944334 10045 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:29:39.946069  3849 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:39.910310 10004 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:39.910982 10021 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.927887  9655 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.957975  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:39.948953  3755 catalog_manager.cc:5697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:39.961740  4537 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:39.967227  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:39.921093  9944 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:39.972206 10017 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.920042  9778 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.967502 10004 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:39.960057 10021 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:39.981941 10024 consensus_queue.cc:1059] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
W20260709 12:29:40.010387 10041 log.cc:927] Time spent T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:29:40.011085 10023 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:40.013211  3755 catalog_manager.cc:5697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 10 to 13, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 13 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:39.966869  9655 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:40.077632  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 144236us
I20260709 12:29:40.019076 10000 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.078661  3755 catalog_manager.cc:5697] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:40.083279  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 54923.5us
I20260709 12:29:40.084673  4001 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:40.084934  3755 catalog_manager.cc:5697] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:40.088362  3755 catalog_manager.cc:5697] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 11 to 14, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 14 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
W20260709 12:29:40.097892  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 150743us
I20260709 12:29:40.082340  9888 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:40.107601  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:40.110162  3850 raft_consensus.cc:2393] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 18: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:40.073395  9936 consensus_queue.cc:1059] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:29:40.111593  9936 consensus_queue.cc:1059] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:29:40.080893 10016 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.111970  9819 raft_consensus.cc:3055] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:40.112402  9819 raft_consensus.cc:740] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:40.074195  9780 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.114137 10016 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:40.115845  9655 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:40.116436  9655 raft_consensus.cc:3055] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:40.116781  9655 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:40.109999 10053 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:40.077364  9944 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.117678 10053 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.118117 10053 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:40.090819 10000 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.119400  9944 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:40.124954  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:40.130357  9888 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.113366  9819 consensus_queue.cc:260] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.151566  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:40.117686  9655 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.174397  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:40.178633  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 100276us
W20260709 12:29:40.181530  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 72110.8us
W20260709 12:29:40.183314  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:40.209461  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:40.210168  3853 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:40.211277  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:40.211866  3997 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:40.216869  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:40.187266  9819 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:40.220366  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:40.222404  9940 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:40.222808  9940 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:40.223165  9940 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:40.224737  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:40.226809  4569 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 20.
I20260709 12:29:40.228422  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:40.235214  4538 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:40.237305  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:40.164227 10004 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:40.239337  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:40.236284 10058 consensus_queue.cc:1059] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:29:40.246415 10058 consensus_queue.cc:1243] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:29:40.259812 10031 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:40.260697 10031 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.263576 10008 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:40.264277 10008 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.268034 10008 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:40.268375 10060 log.cc:927] Time spent T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:29:40.278566  9888 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:40.285007 10053 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.234351 10017 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:40.290786  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 112758us
I20260709 12:29:40.294023  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:40.305253  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:40.308991  3849 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:40.241910 10023 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:29:40.311501  3851 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
W20260709 12:29:40.322121  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 55883.8us
I20260709 12:29:40.323642  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:40.286695 10048 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:29:40.326625  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:40.327224  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:40.327823  3853 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:40.244974 10021 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:40.324359  3854 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:40.338869  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:40.361353  3969 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:40.286890  3850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:40.368067  3850 raft_consensus.cc:606] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:40.368472  3850 raft_consensus.cc:614] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:40.372762  3926 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:29:40.338971  9778 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:40.388655  3926 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:29:40.394995 10047 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:29:40.395684  9958 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:40.396116  9958 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.396476  9958 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:40.396878  3925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 2437) took 1005 ms. Trace:
I20260709 12:29:40.397279  3925 rpcz_store.cc:276] 0709 12:29:39.391109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:39.391249 (+   140us) service_pool.cc:224] Handling call
0709 12:29:39.419590 (+ 28341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:39.419924 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:39.419952 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:39.430514 (+ 10562us) log.cc:844] Serialized 26 byte log entry
0709 12:29:39.696742 (+266228us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b180045cdc0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:29:39.876334 (+179592us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:29:39.898491 (+ 22157us) log.cc:844] Serialized 14 byte log entry
0709 12:29:39.929667 (+ 31176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:39.929755 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:40.396590 (+466835us) raft_consensus.cc:1685] finished
0709 12:29:40.396696 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:40.396821 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50950,"prepare.queue_time_us":21724,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":33026,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":9699,"spinlock_wait_cycles":29521280,"thread_start_us":179377,"threads_started":1,"wal-append.queue_time_us":489363}
I20260709 12:29:40.401281  9776 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:40.406919  9655 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:40.425758  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:40.431468 10058 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:40.432850  4003 raft_consensus.cc:1275] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:29:40.433837  4004 raft_consensus.cc:1240] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:29:40.416000  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:40.439939  9808 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:40.440369  9808 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.440718  9808 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:40.442755  4537 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:40.443055  9720 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.443598  9720 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.444307 10023 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:29:40.445354 10058 consensus_queue.cc:1059] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:40.446657  9780 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:40.447571  9940 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.445487 10023 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:29:40.381055 10054 consensus_queue.cc:1059] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 12:29:40.470876  4568 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 9. Current term is 10. Ops: []
W20260709 12:29:40.493304  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 54503.3us
I20260709 12:29:40.472704  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:40.463423  4567 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:40.462795  4571 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:40.470022  3852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42050 (request call id 2973) took 1054 ms. Trace:
I20260709 12:29:40.507552  3852 rpcz_store.cc:276] 0709 12:29:39.415793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:39.416615 (+   822us) service_pool.cc:224] Handling call
0709 12:29:40.469788 (+1053173us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54000177d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:40.469956 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158242176}
I20260709 12:29:40.473665  4570 raft_consensus.cc:1275] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 12:29:40.462002  4565 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:29:40.463850  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:40.510643  4566 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
W20260709 12:29:40.515434  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 77172.5us
I20260709 12:29:40.508853  4570 pending_rounds.cc:85] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 11
I20260709 12:29:40.524708  4574 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:29:40.524587  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 183781us
I20260709 12:29:40.342880  9481 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.537060  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:40.537763  4005 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:40.449621  9851 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:40.457155 10018 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.451015 10053 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:40.453131 10000 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:40.452174 10044 raft_consensus.cc:3055] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:40.534236  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:40.433506  9974 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.445717  9720 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:40.432371 10034 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.795s	user 0.009s	sys 0.003s
I20260709 12:29:40.449702  9940 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:40.539834  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:40.556118  3926 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:29:40.556263  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 194989us
I20260709 12:29:40.472393 10031 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:40.524703  4570 pending_rounds.cc:107] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 16.12
W20260709 12:29:40.544719  4536 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:40.544816  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:40.463140  9961 raft_consensus.cc:3055] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:40.551108  9974 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.558449  4571 raft_consensus.cc:2393] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 15: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:40.557437  4570 raft_consensus.cc:2889] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:40.593297  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:40.529153  9763 consensus_queue.cc:1059] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:29:40.590821  9735 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.597472  9974 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:40.562722  9961 raft_consensus.cc:740] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:40.590981  9720 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.605176  9958 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.606791  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:40.555599  9820 consensus_queue.cc:1048] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 12:29:40.608518  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:40.622169  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:40.622777  4566 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:40.622310  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:40.609265  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:40.612928  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:40.625079  3925 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:29:40.622357  4571 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:40.613348  3926 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:40.615190  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:40.615661  3851 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:40.616626  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:40.556789 10044 raft_consensus.cc:740] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:40.628015  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:40.628516 10004 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:40.628882  9939 consensus_queue.cc:1048] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:40.629581 10061 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:40.630208  4573 raft_consensus.cc:2393] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 20: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:40.631413  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:40.617369  9763 consensus_queue.cc:1243] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer 34711da9380944d2969a2bc3e203db3d log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:29:40.655318  4567 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:29:40.654529  4565 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 16: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:29:40.656387  3970 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:40.659907  4005 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:40.664633  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:40.665454  3997 raft_consensus.cc:2393] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:40.666066  3851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:40.666639  3851 raft_consensus.cc:606] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:40.669202  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:40.671380  4538 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:40.563587 10018 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.619923  9545 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:29:40.619894  9786 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:29:40.617452  9869 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.048s
I20260709 12:29:40.632761 10021 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.694689 10021 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:40.679869  9842 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:40.681602  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:40.669500 10045 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:40.697829 10045 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:40.698215 10065 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:40.698740 10065 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:40.699965 10045 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:40.683074  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:40.621789  9720 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.702873  9720 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:40.704283  3854 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:29:40.632130 10031 consensus_queue.cc:1059] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:29:40.706367  9842 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.686348  3928 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:40.685737  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:40.690498  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 59245.1us
I20260709 12:29:40.658823 10032 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:40.690968 10023 raft_consensus.cc:2804] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:40.692540  9888 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:40.714564  9888 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:40.697459  9808 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.716777  9888 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:40.620276  9735 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:40.717519  9808 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:40.714676  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:40.711959  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:40.713692  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:40.722132  3854 raft_consensus.cc:3060] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:40.722191  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:40.720899  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:40.724684  9735 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:40.725236  9735 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:29:40.726074  4004 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 16: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:40.726716  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:40.727051 10025 raft_consensus.cc:3055] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:40.727339  3848 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:40.727505 10025 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:40.727990  3924 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:29:40.728817 10032 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:40.729408 10018 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:40.730928  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:40.731539  4004 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 18.
I20260709 12:29:40.731724  3895 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:40.732049 10032 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:40.709914 10061 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:40.733564 10061 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.734110 10018 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:40.735093 10018 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:40.706928  9842 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.735476 10018 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:40.738929  3822 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:40.739281  9842 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:40.740058  9842 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:40.740420  9842 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.740563  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:40.740801  9842 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:40.741164  4571 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:40.742218  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:40.742775  4004 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 18.
I20260709 12:29:40.744141  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:40.744776  3848 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 19.
I20260709 12:29:40.747316  4536 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:40.745653  3895 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:40.752313  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:40.754493  9940 raft_consensus.cc:3055] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:29:40.759392  4571 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
W20260709 12:29:40.719933 10034 log.cc:927] Time spent T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:29:40.753175  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:40.768193  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:40.768615  3822 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:40.718122  9808 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:40.777843  4537 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:40.812788  3931 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:40.759585 10045 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:29:40.755507 10023 raft_consensus.cc:697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:40.758648  9940 raft_consensus.cc:740] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:40.819038  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:40.827827  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 50086.5us
I20260709 12:29:40.772867 10000 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:40.795382  9309 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:29:40.826746  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 54130.4us
I20260709 12:29:40.754999 10054 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 12:29:40.795603  9545 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:40.831274  3932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 2440) took 1428 ms. Trace:
I20260709 12:29:40.826713  3897 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:40.832485  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:40.843456  3928 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 16: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:40.812319 10056 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.816707 10045 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.841751  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:40.759475  9961 consensus_queue.cc:260] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:40.852630 10078 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:29:40.854142  3897 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:40.856271  3854 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:40.830905 10004 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:40.840385  3932 rpcz_store.cc:276] 0709 12:29:39.397958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:39.398058 (+   100us) service_pool.cc:224] Handling call
0709 12:29:39.422280 (+ 24222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:39.448815 (+ 26535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:39.448848 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:39.506299 (+ 57451us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b2c0005c0c8. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe0508d0a11 00007fe0508e0372 00007fe052012a01 00007fe051fd743a 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2
0709 12:29:39.511737 (+  5438us) log.cc:844] Serialized 26 byte log entry
0709 12:29:39.566385 (+ 54648us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:29:39.585066 (+ 18681us) log.cc:844] Serialized 14 byte log entry
0709 12:29:39.585270 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:39.585334 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:39.690324 (+104990us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b1800445840. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeea3f3 00007fe04eeec7c1 00007fe04eeec779 00007fe04eeec709 00007fe04eeec6d1 00007fe04eeeb9cd 0000000000388634 0000000000388479 00007fe04eecd83a
0709 12:29:40.431540 (+741216us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:40.825738 (+394198us) raft_consensus.cc:1685] finished
0709 12:29:40.825770 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:40.825935 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21520,"prepare.queue_time_us":18433,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":29131,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"spinlock_wait_cycles":52425088,"thread_start_us":54233,"threads_started":1,"wal-append.queue_time_us":104796}
I20260709 12:29:40.813686  9808 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:40.865526  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:40.834882 10000 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:40.832469 10084 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:40.875763  4537 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:40.767958 10044 consensus_queue.cc:260] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.850260 10045 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:40.866562 10007 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:40.868039 10032 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.856145  9780 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:29:40.872782 10000 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:40.896546  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:40.869904 10004 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:40.876434 10068 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.050s	user 0.001s	sys 0.005s
I20260709 12:29:40.886772 10030 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:40.892040 10070 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.892926 10007 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:40.897698  9545 raft_consensus.cc:697] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:40.864158 10056 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:40.911347  9808 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:40.915863  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:40.900710 10014 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:40.886610  9940 consensus_queue.cc:260] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.976754  9940 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:40.977272 10075 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:40.889603 10023 consensus_queue.cc:237] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:40.978688 10090 log.cc:927] Time spent T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Append to log took a long time: real 0.075s	user 0.000s	sys 0.002s
I20260709 12:29:40.900908 10032 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.927389 10004 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:40.926836 10070 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:40.902860 10030 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:40.928051  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:40.993690  3849 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 16. Current term is 17. Ops: []
W20260709 12:29:40.929066 10085 log.cc:927] Time spent T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:29:40.934734 10081 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:40.917376 10007 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:40.996259 10030 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:41.030679 10032 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:41.031230 10056 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:41.034293  9842 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.035516  3848 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 18. Current term is 19. Ops: []
I20260709 12:29:41.035450 10081 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.036427  9842 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:41.019170  9808 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.038580  9808 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.040623  9808 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:40.964542 10018 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:40.980614 10061 consensus_queue.cc:1175] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "34711da9380944d2969a2bc3e203db3d" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 9 index: 9 } }
I20260709 12:29:41.044037 10021 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:41.043553 10018 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:41.043103 10045 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:41.048512 10097 log.cc:927] Time spent T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:29:41.051851 10000 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.053311 10044 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:41.055841  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:40.943732  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:41.060271  4571 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:29:41.063063 10000 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:40.977866 10075 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.065464 10075 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:40.949208 10083 log.cc:927] Time spent T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.255s	user 0.003s	sys 0.000s
I20260709 12:29:41.075498 10065 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:40.940490  9481 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:40.954146  3970 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:41.079840  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 125761us
I20260709 12:29:41.080577 10075 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:41.080968  3970 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:41.081415 10075 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:41.082383  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:40.951846 10025 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:40.895519 10084 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.082769 10075 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:41.083182  4566 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:40.963503  3821 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:41.084996 10084 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:40.967706  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:41.085269  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 121838us
I20260709 12:29:41.085855  3930 raft_consensus.cc:2393] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 20: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:41.086823 10022 consensus_queue.cc:1059] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:41.087646  3821 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:41.088037  9842 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:40.973382  4567 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:40.974437  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:40.980551  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:40.980921  3932 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 18: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:40.989492  3931 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:29:41.091020  9747 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:41.105213  9939 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.954490  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:41.027539 10093 log.cc:927] Time spent T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:29:41.048473 10045 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:41.107586  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:40.998232  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:41.113150  9851 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:41.163595  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:41.179420  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:41.180001  3857 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:41.181069  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:41.181384  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:41.164032  4571 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 21.
W20260709 12:29:41.165818  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 84927.8us
I20260709 12:29:41.165974  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:41.167491  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 47724us
I20260709 12:29:41.166849  3997 raft_consensus.cc:2393] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 17: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:41.169837  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:41.171792  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:41.173413  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:41.164680  4567 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:41.187186  3848 raft_consensus.cc:2393] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:41.185111  3932 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 18.
I20260709 12:29:41.189325  3970 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:41.192525  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:41.193091  3849 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:29:41.196352  3821 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:41.210561  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:41.211194  3932 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:41.212105  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:41.214003  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:41.214648  3931 raft_consensus.cc:2393] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 18: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:41.216274  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:41.216848  3932 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 13.
I20260709 12:29:41.220731  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:41.218263  3895 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:41.220841  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:41.221443  3850 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:41.177577  9869 raft_consensus.cc:3055] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:41.191875  9808 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:41.218964 10021 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:41.243603 10021 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.246538 10021 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:41.177759  9939 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.222489 10084 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:41.249770 10084 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:41.250437 10098 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:41.250890 10084 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.253983  3930 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 18: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
W20260709 12:29:41.266227  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 47187us
I20260709 12:29:41.202037 10087 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260709 12:29:41.273227  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:41.274931  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:41.197515  9944 consensus_queue.cc:1059] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:29:41.241693  9808 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.284153  3857 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:41.236580  9869 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:41.250916 10098 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.263113 10045 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:41.285662  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:41.231874 10007 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.284229  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:41.291548  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:41.287855  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:41.305919  3997 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:41.239296  9958 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:41.201689  9545 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.313020  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:41.321846  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:41.321249  3848 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:29:41.305171  3999 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:41.324827  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:41.334319  3852 raft_consensus.cc:2393] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 16: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:41.290002  9808 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:41.307894  3970 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:41.335390  4003 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 18.
I20260709 12:29:41.348672  3997 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 19.
I20260709 12:29:41.298316 10045 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.299165 10098 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:41.325857 10087 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.309091 10056 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:41.316089  9851 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:41.347800  9974 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:41.353130  9958 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:41.361315 10045 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:41.311610 10030 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.386360  9481 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.387037  9481 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.389585  9481 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:41.371938 10056 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.373041 10039 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.396472  3851 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:29:41.382328  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 113441us
I20260709 12:29:41.407295  3854 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 20.
I20260709 12:29:41.397904  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:41.378368  9958 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:41.396709 10056 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:41.375021 10087 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.420918  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:41.425668  3931 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:41.426970  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:41.414700  9958 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:41.431989  9481 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:41.435634  9481 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.436082  9481 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:41.437948  3853 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:41.409602 10039 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.455200  3822 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:41.458310  3822 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:41.460515 10007 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:41.417107  9869 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.480127 10087 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:41.481158 10087 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:41.481266 10081 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:41.489524  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 176375us
I20260709 12:29:41.450064 10107 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:41.500324  9481 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.506592  3849 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 21.
I20260709 12:29:41.508157  9481 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:41.509536  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:41.506870  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:41.510111  3931 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:41.516129  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:41.516976  3997 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:41.521136 10030 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:41.522074 10099 log.cc:927] Time spent T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:29:41.490190 10036 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:41.524312 10036 raft_consensus.cc:697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:41.525269 10036 consensus_queue.cc:237] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.517799 10066 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.528892 10066 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.519680  3822 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:41.537221 10066 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:41.481818 10087 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:41.483888 10108 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.542418  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:41.489917 10039 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:41.549687  4537 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:41.543109  9735 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:41.554728  9735 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.555214  9735 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:41.548331 10108 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.561045 10108 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:41.562441 10087 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.566438 10077 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:41.566912 10077 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.567241 10077 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:41.571050  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:41.571653  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:41.573350  4572 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:29:41.574088 10106 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.574477  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:41.574821 10106 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.576903  9958 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.578272  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:41.579051  4566 raft_consensus.cc:2393] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 17: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:41.578951  9958 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:41.583544  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:41.584168  4003 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:41.584903  4574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1346) took 1049 ms. Trace:
I20260709 12:29:41.586150  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:41.585295  4574 rpcz_store.cc:276] 0709 12:29:40.535967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:40.536101 (+   134us) service_pool.cc:224] Handling call
0709 12:29:40.546836 (+ 10735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:40.591250 (+ 44414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:40.591289 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:40.591760 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:29:40.818222 (+226462us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b18004194a0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:29:40.899775 (+ 81553us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:29:40.899814 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:41.584609 (+684795us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b5400512054. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:41.584657 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:41.584704 (+    47us) raft_consensus.cc:1685] finished
0709 12:29:41.584717 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:41.584848 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6519,"raft.queue_time_us":8714,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3932,"spinlock_wait_cycles":122643968,"thread_start_us":81358,"threads_started":1,"wal-append.queue_time_us":382105}
I20260709 12:29:41.587849  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:41.588796 10114 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:41.589222 10114 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.577491 10106 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:41.599345  3895 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:41.603587  4567 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:41.607533  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:41.591624  3931 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:41.593776  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:41.589560 10114 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:41.610145  4571 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 11.
W20260709 12:29:41.609678  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:41.610662  3970 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:41.611660  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:41.616598  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:41.616887  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:41.615231  3927 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 18.
I20260709 12:29:41.608243  4574 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:41.622838  3897 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:41.537428 10098 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.631243  3897 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:41.622133  9958 raft_consensus.cc:2804] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:41.623067 10081 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:41.623433 10106 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:29:41.603935  9808 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.636288 10065 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.641705  4566 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:41.648095 10065 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:41.647830  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 135569us
I20260709 12:29:41.650385 10065 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:41.652484  3969 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:41.654254 10065 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:29:41.655061 10065 raft_consensus.cc:697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 21 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:41.656030 10065 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.662305  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:41.664240  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:41.664681  3931 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:41.664906  3857 raft_consensus.cc:2393] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 13: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:41.633610  9888 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:41.665735  3970 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:41.667249  3854 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 18. Current term is 19. Ops: []
I20260709 12:29:41.668720  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:41.668969  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:41.670725  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:41.681115  3997 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:41.681556  3850 raft_consensus.cc:2368] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17.
I20260709 12:29:41.662583  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1354) took 1026 ms. Trace:
I20260709 12:29:41.683854  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:41.684693  4006 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:41.644836 10106 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.634055 10004 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:29:41.645376  9958 raft_consensus.cc:697] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:41.647358 10081 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:41.682116  4573 rpcz_store.cc:276] 0709 12:29:40.648851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:40.661650 (+ 12799us) service_pool.cc:224] Handling call
0709 12:29:40.666778 (+  5128us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:29:40.711621 (+ 44843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:40.711663 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:29:40.743372 (+ 31709us) log.cc:844] Serialized 52 byte log entry
0709 12:29:40.941518 (+198146us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b1800238600. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:29:41.185539 (+244021us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:29:41.336853 (+151314us) log.cc:844] Serialized 14 byte log entry
0709 12:29:41.341320 (+  4467us) log.cc:844] Serialized 14 byte log entry
0709 12:29:41.341522 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:41.582336 (+240814us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b1800238600. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eeb82a6 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe056f00aa1 00007fe056ef7b37 00007fe056ef79ca 00007fe056fef26f
0709 12:29:41.582917 (+   581us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b4800060e58. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe056f00aa1 00007fe056ef7b37 00007fe056ef79ca 00007fe056fef26f 00007fe056feef37 00007fe05700355c 00007fe057003508 00007fe057003488 00007fe057003443 00007fe0570026ec 00007fe055f2ca96
0709 12:29:41.658435 (+ 75518us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b54006a3954. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:41.658507 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:41.658587 (+    80us) raft_consensus.cc:1685] finished
0709 12:29:41.658607 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:41.658802 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27545,"prepare.queue_time_us":71032,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":20079,"raft.run_cpu_time_us":2852,"raft.run_wall_time_us":247303,"spinlock_wait_cycles":143451392,"thread_start_us":358454,"threads_started":2,"wal-append.queue_time_us":548085}
I20260709 12:29:41.686497 10008 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:41.687587 10075 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:41.687372 10102 consensus_queue.cc:1059] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 12:29:41.696404 10106 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:41.710311  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:41.708258  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 77476.7us
I20260709 12:29:41.695639  9958 consensus_queue.cc:237] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.686823 10045 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.719611  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:41.707580 10075 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.720227  4573 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:41.720256  3895 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
W20260709 12:29:41.730990  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 44648.2us
I20260709 12:29:41.731957  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:41.732553  4000 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:29:41.733922  3926 raft_consensus.cc:2368] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14.
I20260709 12:29:41.739054 10081 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.714226  9808 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:41.730108 10075 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:41.761543 10070 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:41.731868 10102 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:29:41.712715 10120 consensus_queue.cc:1059] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 12:29:41.825439  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 78632.8us
I20260709 12:29:41.827504  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:41.821969  4573 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:41.828446  3854 raft_consensus.cc:2393] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:41.832389  4000 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:41.834378 10062 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:41.832072 10102 raft_consensus.cc:697] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:41.834501  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:41.834492  9961 raft_consensus.cc:3060] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:41.835678 10102 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.837975 10045 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:41.830307 10025 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:41.840658 10098 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:41.839967 10075 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.860814  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:41.861999  3926 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:41.861162  3969 leader_election.cc:400] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17.
I20260709 12:29:41.862985  3969 leader_election.cc:403] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:41.863996  9778 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17.
I20260709 12:29:41.865643  3822 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:41.840062 10077 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.873064  4573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:29:41.884842  3857 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:29:41.875288  9851 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:41.886399  9939 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:41.886807  9851 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:41.887705  9851 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.890143  9747 raft_consensus.cc:3055] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:29:41.890559  9747 raft_consensus.cc:740] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:41.891414  9747 consensus_queue.cc:260] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.892441  9747 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:29:41.893421 10124 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.111s	user 0.000s	sys 0.003s
I20260709 12:29:41.895563  3850 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:29:41.899698 10056 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:41.900309  9763 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:29:41.903657  4003 raft_consensus.cc:2368] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 17. Current term is 18.
I20260709 12:29:41.902218  3999 raft_consensus.cc:2368] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 17. Current term is 18.
I20260709 12:29:41.914139  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:41.903839  3969 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:41.916018  3926 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 19.
I20260709 12:29:41.926223  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:41.926872  3857 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:41.901834 10056 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:41.859453  9735 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:41.945320  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 282731us
I20260709 12:29:41.922253 10098 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.948625  3821 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:41.861477 10062 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.924139 10021 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:41.917701 10016 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.918147 10114 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:41.960477 10000 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:41.961652  9735 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:41.889737  9820 consensus_queue.cc:1059] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:29:41.968938  3897 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:41.979430 10077 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:41.981544 10075 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:41.968869  4568 raft_consensus.cc:1275] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:29:42.034847  4568 pending_rounds.cc:85] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 11
I20260709 12:29:42.035023  3970 leader_election.cc:400] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14.
I20260709 12:29:42.035147  4568 pending_rounds.cc:107] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:29:41.957180  3857 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:42.035377  3970 leader_election.cc:403] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:29:42.035553  4568 raft_consensus.cc:2889] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:41.996474  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:42.035049  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:42.036279  3856 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:42.011809  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:42.017760  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:42.019629  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:42.037264  3926 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:42.037657  3931 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 18
W20260709 12:29:42.022315  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 53458.6us
I20260709 12:29:42.022994 10056 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:42.042065  3897 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:42.030664  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 165095us
I20260709 12:29:42.047529  3926 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:29:41.987233 10021 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:42.052088  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:42.054319  3926 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:42.055419  4573 raft_consensus.cc:606] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:42.055971  4573 raft_consensus.cc:614] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:42.063730  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:42.065104  3931 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:42.068447  3926 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 19.
I20260709 12:29:42.049325 10081 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:41.987896 10098 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.070990  3971 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:42.066390  9939 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:42.055670 10021 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:42.002031 10016 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.066536 10120 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:42.048543  9778 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:42.054140  9819 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:42.060146  9961 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.077839  3821 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:42.051155  9888 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:29:42.097692 10062 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.098040  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:42.098776  3997 raft_consensus.cc:2393] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 19: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:42.074046  9943 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.102023 10098 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.102210  9943 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.080792  9939 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.041273 10000 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:42.104450  9943 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:42.104633  9939 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.104808 10108 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:42.076098  9820 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.054639 10056 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.078435  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:42.112493  4566 raft_consensus.cc:2393] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 16: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:42.086169  3931 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:29:42.086970  9778 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:42.087409  3927 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:29:42.087980  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:42.089089  9961 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.090081  9819 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.092772 10114 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.093941 10130 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:42.094522 10106 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.096544  4003 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 18. Current term is 19. Ops: []
I20260709 12:29:42.128777  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:42.129385  4571 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:42.082602  3970 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:42.093698  4568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1559) took 1547 ms. Trace:
I20260709 12:29:42.130185  4568 rpcz_store.cc:276] 0709 12:29:40.545995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:40.547015 (+  1020us) service_pool.cc:224] Handling call
0709 12:29:40.582918 (+ 35903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:42.055270 (+1472352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:42.093483 (+ 38213us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400705b54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:42.093642 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3186546048}
I20260709 12:29:42.108415  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:42.113852  4574 raft_consensus.cc:2368] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17.
I20260709 12:29:42.116703  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:42.113744  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:42.073931 10129 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:42.118983  3856 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:42.106181  9820 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.076336 10102 raft_consensus.cc:2764] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:29:42.079392 10030 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:42.127077  3924 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:29:42.136951  3924 pending_rounds.cc:85] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 11
I20260709 12:29:42.137267  3924 pending_rounds.cc:107] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:29:42.137506  3924 raft_consensus.cc:2889] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:42.084800 10081 raft_consensus.cc:697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:42.143414  3897 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:42.144845  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 62306.6us
I20260709 12:29:42.145517  3970 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:42.145813  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:42.146581  4573 raft_consensus.cc:3060] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:42.146592  9481 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:42.142828  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:29:42.152549  9481 raft_consensus.cc:697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:42.153328  9481 consensus_queue.cc:237] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:42.154649  3897 leader_election.cc:400] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 17. Current term is 18.
W20260709 12:29:42.156185  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 43630.4us
I20260709 12:29:42.158026 10045 raft_consensus.cc:2764] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:29:42.158635  3895 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:42.160792  3998 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:29:42.161336 10065 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:42.161907 10065 raft_consensus.cc:697] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:42.162973  3931 raft_consensus.cc:1240] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 18. Current term is 19. Ops: []
I20260709 12:29:42.162770 10065 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.164197  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:42.164590 10111 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:42.161365 10084 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:29:42.165287 10111 raft_consensus.cc:697] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:42.165935  3997 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:29:42.165375 10084 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:42.166308 10111 consensus_queue.cc:237] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:42.167335 10084 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:42.143131 10108 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:42.170508 10108 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:42.168485 10084 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:42.172652  3897 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:42.173383 10039 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:29:42.174005 10129 raft_consensus.cc:697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:42.174939 10129 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.175944 10077 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:42.176504 10077 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.120728 10130 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:42.164513  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:42.182070  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:42.186791  4571 raft_consensus.cc:2393] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 in current term 14: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:42.183318  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:42.153721  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:42.184593  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:42.194557  4573 raft_consensus.cc:2468] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:42.195120  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:42.195868  4006 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:42.198086 10024 consensus_queue.cc:1059] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:29:42.104499 10000 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:42.206211  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:42.198793 10024 consensus_queue.cc:1243] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:29:42.188158 10130 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:42.202904 10131 raft_consensus.cc:493] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:42.150197 10030 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.199002  9958 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:42.205410  3897 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:42.244318  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 58630.8us
I20260709 12:29:42.222961 10106 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.214782 10087 raft_consensus.cc:993] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:29:42.265951  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:42.265507  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 60217.8us
I20260709 12:29:42.266381  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:42.268759  4573 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:42.245400  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:42.270047 10148 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:42.270938 10148 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:42.269198  4568 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:42.271418 10148 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.273921 10148 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:42.276217  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:42.277245  3932 raft_consensus.cc:2393] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 18: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:42.278884  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:42.213045  9943 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 12:29:42.289183  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:42.307140  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 86881.7us
W20260709 12:29:42.300038  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 103536us
I20260709 12:29:42.160001  9786 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:42.266001 10111 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:42.331277 10120 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 13. Current term is 14.
I20260709 12:29:42.386140 10111 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:42.386623 10111 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:42.333303  9819 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.334242  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:42.395040  4000 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:42.351531 10030 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.229323 10081 consensus_queue.cc:237] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.309008 10104 raft_consensus.cc:1081] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:29:42.375453  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:42.411334  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:42.378038 10016 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:42.349154 10054 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:29:42.407028  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 98694.6us
I20260709 12:29:42.244876 10131 raft_consensus.cc:515] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.412195  4574 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:42.309099  9763 raft_consensus.cc:3055] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:29:42.440343  9763 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:42.441123 10056 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.441273  9763 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.442709  9763 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:42.445276 10077 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.426337 10054 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.447561 10054 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:42.427484  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:42.448318  4568 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 11.
I20260709 12:29:42.386590 10120 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:42.449103 10120 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:42.451191 10120 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:42.427699  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:42.430130 10131 leader_election.cc:290] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.431850 10134 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:42.460700  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:42.462615  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:42.465975  3898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:42.472061  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:42.472903  3856 raft_consensus.cc:2368] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12.
I20260709 12:29:42.473453  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:42.474185  4571 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:42.474843  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:42.479127  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:42.479429  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:42.481300  3969 leader_election.cc:400] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12.
I20260709 12:29:42.481791  3969 leader_election.cc:403] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:42.482256  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:42.486779  3850 raft_consensus.cc:2393] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 17: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:42.481231  3971 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:42.487573  3897 leader_election.cc:400] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 17. Current term is 18.
I20260709 12:29:42.487875  3897 leader_election.cc:403] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:42.482836  4565 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:42.488358  4572 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:29:42.503881  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:42.506137  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:42.506206  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:42.508826  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:42.509204  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:42.506996  4002 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:42.514632  4572 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:29:42.514884  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:42.515970  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:42.519533  4571 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:42.524441  4538 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:42.526962  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:42.527144  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 45990.6us
I20260709 12:29:42.527886  4569 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
I20260709 12:29:42.531260  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:42.532220  4566 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:29:42.535356  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:42.537659  4570 raft_consensus.cc:2393] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:42.536244  4537 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:42.538102  4005 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:29:42.542619  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:42.542951  3850 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:29:42.541564  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:42.544720  3822 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:42.545311  4565 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:42.546141  3971 leader_election.cc:400] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17.
I20260709 12:29:42.502911  9958 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:42.546933  3998 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 18. Current term is 19. Ops: []
I20260709 12:29:42.537396  9819 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:29:42.535244  9747 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 17. Current term is 18.
I20260709 12:29:42.478730 10021 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:42.478670 10036 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:29:42.529561 10025 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:29:42.480470 10134 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:42.544761 10151 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:42.547019  9786 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:42.550232 10104 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:42.497144 10130 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.570863  4002 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:29:42.566730  9481 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:42.574954  4003 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:42.574738  9786 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.582180  9786 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:42.567252 10153 consensus_queue.cc:1048] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:29:42.586092  3997 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:42.589958  9961 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:42.549700 10098 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:29:42.564350 10154 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:42.603313  3971 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:42.608174  3971 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:42.610105  3971 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:42.613010  9481 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:42.613571  9481 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:42.613997  9481 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:42.578369 10016 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:42.612092  9851 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:29:42.616194  9958 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:42.590526  9961 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.617653  9869 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:42.618990 10134 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:42.620329 10141 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:29:42.625447  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 89281.6us
I20260709 12:29:42.627163  4003 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 19.
I20260709 12:29:42.602751 10104 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:42.615051 10120 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:42.580071 10126 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:29:42.632659  3997 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:42.605813 10147 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:42.612957 10153 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:42.643424  4568 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:29:42.640720  9481 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:42.631232  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 100096us
I20260709 12:29:42.630183 10131 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:42.644791  4538 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:42.656643  4538 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:42.663930 10111 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.664819  3926 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:42.666191 10160 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:42.666566 10154 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:42.666260 10104 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.670819  3856 raft_consensus.cc:1240] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:29:42.671939 10098 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:29:42.672477  3849 raft_consensus.cc:1240] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:42.672869 10130 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.674345  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:42.677736  3895 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:42.677842  9888 consensus_queue.cc:1059] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:42.630666 10084 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:29:42.678448  9786 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.679569 10018 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:42.679927  4574 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:42.680583  9888 raft_consensus.cc:3055] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:42.680980  9888 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:42.665685 10111 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.681704  9481 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.682004 10054 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:42.648229 10153 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.682967 10153 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:42.684495  9820 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:42.648422 10147 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.686379  9778 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:42.687994 10147 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:42.681806  9888 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:42.689999  9888 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:42.692543  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:42.695461  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:42.698324  3932 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 18. Current term is 19. Ops: []
I20260709 12:29:42.702188  3851 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:29:42.658095 10131 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:42.666903 10160 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.633385  9961 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.720124  4006 raft_consensus.cc:1240] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:42.725106  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:42.727367 10111 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:42.735507  9961 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:42.680626  9786 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.740336  4571 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:42.740525  9819 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 11. Current term is 12.
W20260709 12:29:42.709205 10141 log.cc:927] Time spent T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:29:42.743194  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:42.744858  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:42.746070  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:42.752889  4574 raft_consensus.cc:2368] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17.
I20260709 12:29:42.753640  4571 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:42.756461  3971 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:42.759205  3971 leader_election.cc:400] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17.
I20260709 12:29:42.759526  3971 leader_election.cc:403] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:29:42.759575  3851 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:29:42.760164 10120 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:42.711848 10151 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:29:42.772617 10021 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:42.733160  3924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43302
I20260709 12:29:42.773661  3924 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:42.774035  3924 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:29:42.760878 10120 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:42.775151 10120 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.779762 10131 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:42.780289 10131 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17.
I20260709 12:29:42.709542 10160 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:42.788322  4001 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:42.801862  4571 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:42.750140  9958 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:42.803383  3822 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:42.803910  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:42.809177  3928 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:29:42.807256  3999 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:42.810838  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:42.814733  4000 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:29:42.809144  3924 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.796629  9943 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:42.811954  9842 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:42.827083  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:42.830893  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:42.831454  3856 raft_consensus.cc:3055] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:29:42.831737  3856 raft_consensus.cc:740] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:42.832409  3856 consensus_queue.cc:260] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.833214 10160 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.833580  3856 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:29:42.820529  9763 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:42.812276  9958 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.899155  3924 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 21 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:42.900630  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 52389us
I20260709 12:29:42.835235 10118 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.837069  9763 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.932703 10081 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.933306 10081 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.944350  9763 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:42.842697  9842 raft_consensus.cc:697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:42.954780  3926 raft_consensus.cc:1275] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:29:42.921607 10031 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.955749 10031 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.956351  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:42.957291  3932 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
I20260709 12:29:42.960049  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:42.962522  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:42.964030  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b08017bb344d72aa432be8a7d5d03f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:42.982057 10104 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.982787 10104 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.984380  9819 consensus_queue.cc:1048] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:29:42.984875  3970 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:42.986070  9819 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:29:42.986577  9819 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:42.987098  9819 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:29:42.989238  9958 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:42.989961  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:42.991101  9958 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:42.990957 10140 consensus_queue.cc:1059] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:29:42.992660  9869 raft_consensus.cc:3055] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:29:42.993018  9869 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:42.993860  9869 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:42.995016  9869 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:42.995537  3970 leader_election.cc:304] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:42.998915  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:42.999506  4573 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:29:42.825788  9943 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.004496  9943 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:43.006529  9819 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.008284 10160 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:43.008769  9842 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:42.986387 10118 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.021041  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:43.028839  3856 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 21.
I20260709 12:29:43.001994  9763 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.017719  4573 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 12.
I20260709 12:29:43.030802  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:42.985520 10104 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:43.039764 10155 log.cc:927] Time spent T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Append to log took a long time: real 0.456s	user 0.005s	sys 0.005s
I20260709 12:29:43.040483  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:43.051462  3857 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 15.
I20260709 12:29:43.070550  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:43.031432 10151 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.073187  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:43.074808  3969 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:43.081647  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:43.070914  9958 raft_consensus.cc:2749] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:29:43.040514 10036 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:29:43.117449  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:43.118921  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:43.122493  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:43.123394  3855 raft_consensus.cc:2393] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 17: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:43.124619  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:43.125306  3925 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:43.126614  3970 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:43.127489 10077 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:43.127776  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:43.127905 10077 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:43.128545 10077 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:43.128629  3924 raft_consensus.cc:2368] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 18. Current term is 19.
I20260709 12:29:43.130648  3926 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:29:43.105051 10075 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:43.096549 10120 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:43.101061 10031 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:43.146008  3970 leader_election.cc:400] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 18. Current term is 19.
I20260709 12:29:43.146380  3970 leader_election.cc:403] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:29:43.098107 10151 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.137220 10153 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.154191  9763 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:43.155144  9819 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:43.156132 10118 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:43.162804  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:43.176074 10170 log.cc:927] Time spent T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:29:43.179289 10169 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:29:43.186525  4001 raft_consensus.cc:2393] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 15: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:43.187635 10153 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:43.188671 10152 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:43.190294  9819 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:43.190409 10152 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:43.190864  9819 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.193393  9819 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:43.195134  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:43.196816  3851 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:29:43.200234 10167 log.cc:927] Time spent T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:29:43.207343  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:43.208223  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:43.210016  3928 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:29:43.190889 10152 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.205276  3970 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:43.226078  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:43.216177  3851 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:29:43.231266  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:43.231881  3926 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:43.232321  4004 raft_consensus.cc:2368] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:43.201493 10130 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 18. Current term is 19.
I20260709 12:29:43.147292 10120 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:43.224071  9958 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:43.292480  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:43.292959  9888 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:29:43.300103 10120 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:43.230834 10104 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:29:43.251833  9819 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:29:43.320202  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:43.322306  3932 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 10.
W20260709 12:29:43.318094 10176 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:29:43.328245  4005 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:29:43.331652  4005 pending_rounds.cc:85] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 11
I20260709 12:29:43.331920  4005 pending_rounds.cc:107] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:29:43.332162  4005 raft_consensus.cc:2889] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:43.328835  3970 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:43.334914  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:43.331063  3926 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:43.339344  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:43.339979  3999 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 14.
W20260709 12:29:43.340648  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 109811us
W20260709 12:29:43.343253  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:43.346547  3821 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:43.343389  3970 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:43.351995  9481 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:43.352566  9481 raft_consensus.cc:697] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:43.356549  3822 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:43.360463  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:43.366531  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:43.368819 10007 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:43.369592 10007 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:43.372355 10007 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:43.373936  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:43.374616  4566 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
W20260709 12:29:43.375013  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 298221us
I20260709 12:29:43.378369  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:43.378836  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:43.379658  4569 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 16: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:43.372334 10160 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.381338  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:43.353466  9481 consensus_queue.cc:237] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.382411  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:43.386168  4571 raft_consensus.cc:2393] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 15: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
W20260709 12:29:43.387835  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 327268us
I20260709 12:29:43.388870  3969 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:43.389528  4006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2980) took 1114 ms. Trace:
I20260709 12:29:43.312142  9958 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:43.339643  9819 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:29:43.389950  4006 rpcz_store.cc:276] 0709 12:29:42.269202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:42.269325 (+   123us) service_pool.cc:224] Handling call
0709 12:29:42.269620 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:42.734829 (+465209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:43.383267 (+648438us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b5400128254. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:43.383418 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035657600}
I20260709 12:29:43.396090  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:43.396963  4567 raft_consensus.cc:2368] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:43.400112 10066 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:43.401517  4574 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:29:43.406910  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:43.415942  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:43.388358 10153 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:43.421152  4567 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 12:29:43.425320  4567 pending_rounds.cc:85] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 13
I20260709 12:29:43.425614  4567 pending_rounds.cc:107] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 12:29:43.425817  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:43.425874  4567 raft_consensus.cc:2889] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:43.426465  4568 raft_consensus.cc:3060] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:29:43.405790 10098 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:29:43.439424  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 224174us
I20260709 12:29:43.384934 10075 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:29:43.442996  3895 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:43.418434  9819 raft_consensus.cc:697] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:43.444355  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:43.463176  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:43.394115 10160 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.478152  4567 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:29:43.461380 10098 raft_consensus.cc:697] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:43.494946  4573 raft_consensus.cc:2393] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 10: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:43.467063 10096 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:29:43.623653  9869 consensus_meta.cc:287] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.002s
I20260709 12:29:43.489568 10039 raft_consensus.cc:2804] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:29:43.658783  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 194821us
I20260709 12:29:43.660501  3853 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:29:43.662184  3853 pending_rounds.cc:85] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting all ops after (but not including) 10
I20260709 12:29:43.662545  3853 pending_rounds.cc:107] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:29:43.662848  3853 raft_consensus.cc:2889] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:43.623270 10096 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:43.670040  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 182267us
I20260709 12:29:43.635897 10152 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:43.674824  3997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 3010) took 1153 ms. Trace:
I20260709 12:29:43.677464  3997 rpcz_store.cc:276] 0709 12:29:42.514899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:42.515702 (+   803us) service_pool.cc:224] Handling call
0709 12:29:43.667708 (+1152006us) spinlock_profiling.cc:243] Waited 69.4 ms on lock 0x7b540007f8d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:43.667817 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159685504}
I20260709 12:29:43.487061 10114 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.162s
I20260709 12:29:43.673319 10096 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:29:43.679526 10077 consensus_meta.cc:287] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Time spent flushing consensus metadata: real 0.550s	user 0.005s	sys 0.005s
I20260709 12:29:43.663821 10180 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
W20260709 12:29:43.722304 10179 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
W20260709 12:29:43.725203 10175 log.cc:927] Time spent T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:29:43.729668  4565 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:29:43.732625 10184 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:43.734519  9958 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:43.720786 10183 raft_consensus.cc:493] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:43.738620  9786 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.739503  9786 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.741442  4002 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 3016) took 1090 ms. Trace:
I20260709 12:29:43.678983  9819 consensus_queue.cc:237] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.741869  4002 rpcz_store.cc:276] 0709 12:29:42.651162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:42.651311 (+   149us) service_pool.cc:224] Handling call
0709 12:29:42.651606 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:42.702026 (+ 50420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:42.702055 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:42.702458 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 12:29:43.020695 (+318237us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b180032f140. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:29:43.233616 (+212921us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:43.233660 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:43.233727 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:43.741115 (+507388us) raft_consensus.cc:1685] finished
0709 12:29:43.741139 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:43.741377 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4189,"raft.queue_time_us":50729,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":20261,"spinlock_wait_cycles":13922688,"thread_start_us":212720,"threads_started":1,"wal-append.queue_time_us":724480}
I20260709 12:29:43.742672  9786 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:43.746922  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:43.747782  4565 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:43.703174 10077 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:43.750047 10192 raft_consensus.cc:493] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:43.750680 10192 raft_consensus.cc:515] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.752012 10077 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:43.752864 10192 leader_election.cc:290] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:43.752943  3998 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:43.739439 10183 raft_consensus.cc:515] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.756661  3822 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:43.765333  9869 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:43.791785  4568 raft_consensus.cc:2468] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 21.
I20260709 12:29:43.709674 10098 consensus_queue.cc:237] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.795544 10114 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:43.797487  9869 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:43.817554  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 153284us
I20260709 12:29:43.823525  3852 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:43.796489 10039 raft_consensus.cc:697] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:43.835758  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:43.815169 10160 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:43.842428 10183 leader_election.cc:290] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:43.844025  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:43.819856 10114 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.820056  9869 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:43.849563 10204 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:43.855976  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 386471us
W20260709 12:29:43.880460 10197 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:29:43.882589  3897 leader_election.cc:400] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:43.882946  3897 leader_election.cc:403] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 12:29:43.883754 10188 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:29:43.886687 10114 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:43.888634  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:43.889185  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:43.896719  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812f8e58e6d54e67a0d699b41fc6815b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:43.898705  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:43.899639  3930 raft_consensus.cc:2393] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 15: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
I20260709 12:29:43.864044 10148 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.905751 10198 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:43.911512  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 3019) took 1205 ms. Trace:
I20260709 12:29:43.911981  4003 rpcz_store.cc:276] 0709 12:29:42.705808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:42.812405 (+106597us) service_pool.cc:224] Handling call
0709 12:29:42.812699 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:42.813043 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:29:43.348372 (+535329us) spinlock_profiling.cc:243] Waited 879 us on lock 0x7b18004ce9a0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee7455 00007fe0559cf3c7 00007fe051fe19a7 00007fe051ff10bf 00007fe051ff1038
0709 12:29:43.649506 (+301134us) log.cc:844] Serialized 14 byte log entry
0709 12:29:43.770010 (+120504us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:43.771020 (+  1010us) log.cc:844] Serialized 26 byte log entry
0709 12:29:43.771163 (+   143us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:29:43.771203 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:43.771271 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:43.904879 (+133608us) raft_consensus.cc:1685] finished
0709 12:29:43.911290 (+  6411us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:43.911437 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9507,"prepare.queue_time_us":137228,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":12193,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":30669,"spinlock_wait_cycles":2021632,"thread_start_us":411508,"threads_started":2,"wal-append.queue_time_us":153671}
W20260709 12:29:43.904374 10190 log.cc:927] Time spent T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 12:29:43.947448  3971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.014s	sys 0.022s
W20260709 12:29:43.947892  3971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.014s	sys 0.022s
W20260709 12:29:43.948241  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 568421us
W20260709 12:29:43.953747  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 76011.2us
I20260709 12:29:43.873816 10204 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:43.947381 10196 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:29:43.909405 10148 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:43.968258  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 64356.5us
I20260709 12:29:43.965289 10200 consensus_queue.cc:1059] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:29:43.948077 10039 consensus_queue.cc:237] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:43.995213 10200 consensus_queue.cc:1243] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer 4eedd844c09d456ca0b3614490dd1dbb log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:29:44.028129 10081 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:44.036334 10096 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.041148  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43306 (request call id 2498) took 1046 ms. Trace:
I20260709 12:29:44.041366 10148 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:44.037474  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.045835  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:44.049273  9869 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.068886  3852 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 20.
W20260709 12:29:44.071237  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 102229us
I20260709 12:29:44.078359  4536 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:44.073277  3850 raft_consensus.cc:1240] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:29:44.051397  3929 rpcz_store.cc:276] 0709 12:29:42.994882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:43.156893 (+162011us) service_pool.cc:224] Handling call
0709 12:29:43.157298 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:43.157722 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:43.157758 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:43.158338 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:29:44.040583 (+882245us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b18003e0620. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe051b7f4bc 00007fe04eecd48b 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1
0709 12:29:44.040722 (+   139us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:29:44.040756 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:44.040819 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:44.040863 (+    44us) raft_consensus.cc:1685] finished
0709 12:29:44.040873 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:44.041092 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4181,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":12138,"spinlock_wait_cycles":33375488,"thread_start_us":281797,"threads_started":1,"wal-append.queue_time_us":280683}
I20260709 12:29:44.074435  9869 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:44.078573 10204 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:44.123875  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 45618.2us
I20260709 12:29:44.125662  9943 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:29:44.121940  3897 leader_election.cc:400] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15.
I20260709 12:29:44.126780  9943 raft_consensus.cc:493] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.134510  4000 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 3018) took 1429 ms. Trace:
I20260709 12:29:44.134743 10200 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:29:44.135051  4000 rpcz_store.cc:276] 0709 12:29:42.705557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:42.727420 (+ 21863us) service_pool.cc:224] Handling call
0709 12:29:42.806420 (+ 79000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:42.815360 (+  8940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:44.134306 (+1318946us) spinlock_profiling.cc:243] Waited 78.7 ms on lock 0x7b5400129150. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd68ad 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:44.134451 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181042432}
I20260709 12:29:44.140137  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:44.133395  9943 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:29:44.141376  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:44.152493 10130 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:44.155719 10096 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:44.159221  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:44.159912  4005 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:29:44.161118  9819 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:44.161749  9819 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:44.164059  9819 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:44.164105  3853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2608) took 1119 ms. Trace:
I20260709 12:29:44.165376  3852 raft_consensus.cc:1240] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:44.167207  3851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:44.171319  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.172652  3929 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:29:44.173000  3929 pending_rounds.cc:85] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 10
I20260709 12:29:44.173199  3929 pending_rounds.cc:107] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:29:44.173388  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "274c43c8bd05433a8c00fffabbd5b8b7" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.174268  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:44.153246 10130 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:44.173409  3929 raft_consensus.cc:2889] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:44.181205  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:44.184366  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:44.164932  3853 rpcz_store.cc:276] 0709 12:29:43.045116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:43.121698 (+ 76582us) service_pool.cc:224] Handling call
0709 12:29:43.141065 (+ 19367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:43.663339 (+522274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:44.163852 (+500513us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b5400019fd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:44.164044 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1168790912}
I20260709 12:29:44.188942  3857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40038 (request call id 1634) took 1451 ms. Trace:
I20260709 12:29:44.189448  3857 rpcz_store.cc:276] 0709 12:29:42.737963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:42.742873 (+  4910us) service_pool.cc:224] Handling call
0709 12:29:44.188743 (+1445870us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54001e7654. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:44.188871 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687794560}
I20260709 12:29:44.197027  4005 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:44.175504  9819 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.213768  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:44.201062  4537 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:44.216197  4000 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
W20260709 12:29:44.193538 10217 log.cc:927] Time spent T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:29:44.199162  9851 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:44.198314  9842 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:44.218405 10147 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:44.222107  4003 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:29:44.214582  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:44.223905  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.228655  4005 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 13.
I20260709 12:29:44.193179 10096 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:29:44.236472  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.226282 10192 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.243884  3931 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 10.
I20260709 12:29:44.227437  9819 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:44.231526 10198 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.226500  9851 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.202021 10213 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
W20260709 12:29:44.262519  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 45786.9us
I20260709 12:29:44.242678 10032 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:44.232940 10126 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:29:44.259791  9851 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:44.259305 10147 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:44.298332 10130 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:44.298470 10147 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.280232 10065 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:29:44.301417 10147 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:44.233032  9842 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.282742 10032 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.290462  9943 raft_consensus.cc:515] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.295547  9819 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:44.263675 10198 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:44.241534 10214 consensus_queue.cc:1059] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:29:44.261117 10192 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.303316  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:44.307917  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 85235.2us
I20260709 12:29:44.309343  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:44.308907  3897 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:44.312741 10219 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:29:44.373185  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 63921.2us
I20260709 12:29:44.315806  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:44.374312  4537 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:44.372895  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 64078.3us
I20260709 12:29:44.380790  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:44.392503 10032 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:44.372313 10147 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:44.393396 10147 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.382411 10193 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:29:44.394433 10193 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:44.394884 10193 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:44.395808 10147 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:44.313238 10151 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:44.410991  3970 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:44.380847 10222 raft_consensus.cc:2749] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:29:44.422153 10222 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:44.422713 10222 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.425027 10222 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:44.397552 10129 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:44.426615 10129 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:44.427923 10193 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:44.428773 10129 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:44.430151 10193 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:44.440536  9481 raft_consensus.cc:3055] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:44.441006  9481 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:44.382239 10159 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:44.442720  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:44.444025  3854 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:44.444345  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:44.444943  4005 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:44.442945  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:44.441721  9481 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.445866  4536 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:44.448330  9481 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:44.314743 10039 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 12:29:44.453341 10198 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:44.454537  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:44.381971 10219 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:44.456357  9819 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:44.457358 10219 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:44.458738 10214 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:44.459059  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:44.459545  3998 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 3026) took 1122 ms. Trace:
I20260709 12:29:44.459966  3998 rpcz_store.cc:276] 0709 12:29:43.337354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:43.347018 (+  9664us) service_pool.cc:224] Handling call
0709 12:29:43.391515 (+ 44497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:43.753622 (+362107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:44.459303 (+705681us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400219dd4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:44.459462 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830583168}
I20260709 12:29:44.460979  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:44.462924  9842 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:44.453374 10130 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:29:44.464651 10192 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:44.470671  4005 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:44.471370  3999 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:44.474723  4573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42516 (request call id 1605) took 1093 ms. Trace:
I20260709 12:29:44.475419  4573 rpcz_store.cc:276] 0709 12:29:43.380850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:43.381112 (+   262us) service_pool.cc:224] Handling call
0709 12:29:44.474387 (+1093275us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b540055c8d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:44.474602 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251240704}
I20260709 12:29:44.114674  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:44.477677  4004 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36516 (request call id 2986) took 1196 ms. Trace:
I20260709 12:29:44.478101  4004 rpcz_store.cc:276] 0709 12:29:43.285146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:43.286214 (+  1068us) service_pool.cc:224] Handling call
0709 12:29:43.286619 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:43.424808 (+138189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:43.424836 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:43.424876 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:29:43.424907 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:44.477450 (+1052543us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54000f87d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:44.477499 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:44.477621 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317324032}
I20260709 12:29:44.481658 10208 raft_consensus.cc:3055] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:44.482270 10208 raft_consensus.cc:740] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:44.483418 10208 consensus_queue.cc:260] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.486297 10116 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:44.486400 10098 raft_consensus.cc:493] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:44.486750 10126 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:44.487213 10098 raft_consensus.cc:515] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.487139 10116 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.487325 10126 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.490046 10116 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:44.490669  3855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2610) took 1439 ms. Trace:
I20260709 12:29:44.491050  3855 rpcz_store.cc:276] 0709 12:29:43.051101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:43.123963 (+ 72862us) service_pool.cc:224] Handling call
0709 12:29:44.477432 (+1353469us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5800010298. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb2b71 00007fe04eeb2a22 00007fe057dcb8d9 00007fe056f25ee0 00007fe056fef0ab 00007fe056fef131 00007fe056fb0fc0 00007fe056f9b929 00007fe056f9b3d2 00007fe050512bd4
0709 12:29:44.477634 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:44.477798 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:44.477822 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:44.477859 (+    37us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:29:44.490402 (+ 12543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:44.490469 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:44.490592 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38711168}
I20260709 12:29:44.491640 10126 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:44.489620 10098 leader_election.cc:290] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:44.486428  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36516 (request call id 2988) took 1128 ms. Trace:
I20260709 12:29:44.492911  4001 rpcz_store.cc:276] 0709 12:29:43.358378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:43.366252 (+  7874us) service_pool.cc:224] Handling call
0709 12:29:44.486186 (+1119934us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b540006d454. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fdb2fa 00007fe056f9cb17 00007fe0505176d4 00007fe050517662 00007fe050517591 00007fe05051750c 00007fe0505167c2 00007fe05031248c 00007fe0503118c6 00007fe05031126f
0709 12:29:44.486357 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177245056}
I20260709 12:29:44.460669  9943 leader_election.cc:290] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:44.498641  3971 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:44.498883  4003 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:29:44.509585  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.511710  3932 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:44.516181  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.519896  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:44.522545  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.521096  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:44.532109  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 86356.7us
W20260709 12:29:44.532267  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 81913.6us
I20260709 12:29:44.533659  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:44.534840  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:44.535409  3855 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:29:44.536849  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:44.542409  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.546510  4000 raft_consensus.cc:2410] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:29:44.525230 10208 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:44.558157 10116 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:44.614569 10116 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:44.627594 10116 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:44.562491  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:44.638517  4000 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:29:44.563977  4565 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:29:44.566093  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:44.640451  4574 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 18.
I20260709 12:29:44.642407  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:44.568027  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:44.573961 10189 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:44.578212  9943 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:44.587374 10228 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:44.594481  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:44.598407  4568 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: []
I20260709 12:29:44.546911 10160 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:44.599964 10159 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
W20260709 12:29:44.658459  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 282051us
I20260709 12:29:44.561450  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9116f60a784d21bf919694ec32bdbb" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:44.637459  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 126514us
W20260709 12:29:44.644804  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 106541us
W20260709 12:29:44.644874  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 90944.7us
I20260709 12:29:44.660233  3897 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:44.652293  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:44.653496  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:44.573066  9851 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.651418  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:44.666908  4574 raft_consensus.cc:2393] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 21: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:44.667773  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:44.660202  4537 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:44.671620  3897 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:44.674620  4573 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:29:44.646342  9842 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.684520  4569 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:29:44.655186 10140 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:44.661013 10031 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:44.697544  3855 raft_consensus.cc:2468] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 21.
I20260709 12:29:44.697979  3971 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:44.699424  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:44.699601  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.700147  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7185a57fbd78466ab6ccbbbd0453c2aa" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:44.701347  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.702955  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.659104 10160 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:44.647152  9888 consensus_queue.cc:1059] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:29:44.735092  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:44.734782  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:44.732438  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:44.737619  3928 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 12:29:44.742996  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 61546.9us
W20260709 12:29:44.743043  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 50683.7us
I20260709 12:29:44.670595 10111 raft_consensus.cc:493] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:44.679512 10024 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:44.751713  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.683751  9944 raft_consensus.cc:2749] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:44.659489  9943 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.707999 10222 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:29:44.762486  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:44.685253 10148 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:44.766462  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:44.747437 10031 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.767486 10222 raft_consensus.cc:493] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.764802 10024 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.789695  3970 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:44.730772 10180 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:44.737833 10160 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:44.654246 10189 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.666049 10159 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:44.785279  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 87397.7us
I20260709 12:29:44.809145  3970 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:44.797572  9481 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:29:44.803527  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:44.811309  4573 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:44.661500 10228 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.704859  9842 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:44.816370  3897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:44.778895 10081 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:44.789278 10222 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:44.731444 10140 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.828442  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.792946 10153 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:44.832728  3970 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:44.833582  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:44.828231  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.833066  3971 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:44.837199  3999 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:44.840795  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:44.850301  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:44.764603 10111 raft_consensus.cc:515] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.854269  4536 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:44.864494 10183 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:44.864990  3897 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:44.866641  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 122715us
I20260709 12:29:44.867304 10007 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:44.826481 10066 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:44.877820  4573 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 18.
I20260709 12:29:44.787906 10148 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:44.880021  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 47050.8us
I20260709 12:29:44.881191  3971 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:44.882498  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 49844.2us
I20260709 12:29:44.884600  3897 leader_election.cc:304] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:44.891441  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e92801c3904600b054e99343413645" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:44.850538 10151 raft_consensus.cc:2749] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:44.896348  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:44.900520  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:44.807220 10180 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.920099  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2105a333194a478762048de8b5853c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:44.873872 10183 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.923630  4574 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:29:44.925333  3850 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:29:44.889542 10075 raft_consensus.cc:2749] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:44.844192 10081 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:44.893625 10065 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:44.858814 10129 consensus_queue.cc:1059] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 12:29:44.893162 10213 raft_consensus.cc:2749] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:29:44.933744  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 189180us
I20260709 12:29:44.894636 10229 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:44.964128  4573 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:29:44.881238 10126 consensus_queue.cc:1059] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 12:29:44.948887  3895 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:44.868944 10224 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 12:29:44.918320  9888 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:44.929199 10183 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:44.893585 10007 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:44.971514  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 130816us
I20260709 12:29:44.924906 10227 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:44.976635  4573 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:29:44.980079  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:44.986522  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:44.988489  3850 raft_consensus.cc:1217] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Deduplicated request from leader. Original: 13.11->[14.12-14.12]   Dedup: 14.12->[]
I20260709 12:29:44.989041  3850 raft_consensus.cc:1240] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:29:44.990736 10226 raft_consensus.cc:2804] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:29:44.991335 10226 raft_consensus.cc:697] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 21 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:44.992269 10226 consensus_queue.cc:237] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:44.994688 10211 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:44.995564 10227 raft_consensus.cc:697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:44.996052 10211 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:29:44.996608 10227 consensus_queue.cc:237] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:44.961915  9851 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:44.981108 10230 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:29:45.007258  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac74d3d7308e4121b8d2bbb920bb9294" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:45.013787  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.011610  3895 leader_election.cc:304] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:45.015946 10198 raft_consensus.cc:2749] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:44.984035 10129 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:45.029894  3822 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:45.034695  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:44.983418  9888 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:45.049847  3855 raft_consensus.cc:1275] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:29:45.027853  9943 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:45.031162 10031 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:44.984920 10229 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.041540 10024 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:45.028666 10198 consensus_queue.cc:1059] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
W20260709 12:29:45.058782 10236 log.cc:927] Time spent T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:29:45.036141 10098 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:29:45.065769  4569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:45.033250 10129 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.050406 10189 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:45.056524  9842 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:45.059816 10135 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
W20260709 12:29:45.098100  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 118349us
I20260709 12:29:45.117777  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:45.078999 10228 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:45.086908 10241 log.cc:927] Time spent T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:29:45.148037  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 65070.1us
I20260709 12:29:45.114625 10007 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:45.161564  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:45.162879  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 308674us
I20260709 12:29:45.165571  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.168943  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.170586  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:45.176213  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.155264 10247 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:45.129469 10239 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:29:45.158996 10208 consensus_meta.cc:287] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.000s
W20260709 12:29:45.167371 10232 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 12:29:45.189941 10238 log.cc:927] Time spent T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 12:29:45.177471 10231 log.cc:927] Time spent T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
I20260709 12:29:45.194156  3929 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:29:45.205418  3929 pending_rounds.cc:85] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 11
I20260709 12:29:45.205734  3929 pending_rounds.cc:107] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:29:45.206002  3929 raft_consensus.cc:2889] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:45.190689 10180 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:45.168589 10140 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:45.157956 10096 consensus_queue.cc:1059] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:29:45.180500 10007 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:45.182519 10118 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:29:45.200018  4537 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:45.199811 10226 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.203018 10239 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:45.201843 10000 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:45.189079  3822 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:45.235291 10226 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:45.299249  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 110276us
I20260709 12:29:45.299850  9545 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:45.231089 10111 leader_election.cc:290] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:45.235526 10254 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:29:45.305806 10251 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:45.306856 10226 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:45.308386 10183 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.309998  9888 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:45.309660 10222 raft_consensus.cc:515] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.298036 10240 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:45.328379  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:45.329483  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:45.338332  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 138393us
W20260709 12:29:45.326547 10160 consensus_meta.cc:287] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.509s	user 0.005s	sys 0.005s
W20260709 12:29:45.327239 10232 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:29:45.359298  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:45.382202 10250 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:29:45.383025 10183 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:45.383805 10253 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:29:45.384543 10240 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:45.385365 10264 log.cc:927] Time spent T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 12:29:45.386488 10255 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:29:45.387066  3822 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:45.387903 10257 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 12:29:45.388454  3822 leader_election.cc:304] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:45.383172 10234 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:29:45.235937 10007 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:45.408964  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace1274bf4f34853b37ab7a08103d367" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:45.411356  4574 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:45.425439  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:45.434247  4567 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.009s	sys 0.008s
W20260709 12:29:45.434737  4567 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.009s	sys 0.008s
I20260709 12:29:45.429323  3849 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42066 (request call id 2627) took 1112 ms. Trace:
I20260709 12:29:45.401464 10229 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:45.444784  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:45.436044  3849 rpcz_store.cc:276] 0709 12:29:44.316770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:44.380148 (+ 63378us) service_pool.cc:224] Handling call
0709 12:29:44.387961 (+  7813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:44.388439 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:44.388485 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:44.389109 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 12:29:44.463890 (+ 74781us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b18003604c0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:29:44.661803 (+197913us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:44.692701 (+ 30898us) log.cc:844] Serialized 14 byte log entry
0709 12:29:44.829821 (+137120us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b18003604c0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04ee64c0a 00007fe0585a4219 00007fe04eeeca40 00007fe04eee74e4 00007fe04eee7455 00007fe051fcf060 00007fe051fe1716 00007fe051ff2287 00007fe051ff2208
0709 12:29:44.874151 (+ 44330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:44.874242 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:45.429109 (+554867us) raft_consensus.cc:1685] finished
0709 12:29:45.429133 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:45.429260 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106933,"prepare.queue_time_us":27875,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":36,"raft.queue_time_us":142479,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":22555,"spinlock_wait_cycles":48307840,"thread_start_us":240065,"threads_started":2,"wal-append.queue_time_us":397430}
I20260709 12:29:45.410180 10129 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:45.476642  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
W20260709 12:29:45.479027  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 461452us
I20260709 12:29:45.435051 10118 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:29:45.434844 10135 raft_consensus.cc:2749] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:29:45.406358 10160 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.443361 10240 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:45.438374 10024 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:45.440219 10007 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:45.509094  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
W20260709 12:29:45.513031 10267 log.cc:927] Time spent T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:29:45.489934 10271 log.cc:927] Time spent T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:29:45.520740 10222 leader_election.cc:290] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:45.526031 10235 log.cc:927] Time spent T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.647s	user 0.000s	sys 0.003s
I20260709 12:29:45.527115  4003 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 3038) took 1001 ms. Trace:
I20260709 12:29:45.421974 10239 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.527468  4003 rpcz_store.cc:276] 0709 12:29:44.525687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:44.525985 (+   298us) service_pool.cc:224] Handling call
0709 12:29:44.526389 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:29:44.543680 (+ 17291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:29:44.543727 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:29:44.544133 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 12:29:44.603633 (+ 59500us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b180036f880. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe04eecce07 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b770d1 00007fe051f92a0f
0709 12:29:44.696816 (+ 93183us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:29:44.696856 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:44.696919 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:29:45.525434 (+828515us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
0709 12:29:45.526890 (+  1456us) raft_consensus.cc:1685] finished
0709 12:29:45.526933 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:45.527058 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16806,"raft.queue_time_us":16896,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":13253,"spinlock_wait_cycles":51310720,"thread_start_us":92997,"threads_started":1,"wal-append.queue_time_us":281871}
I20260709 12:29:45.530340  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:45.530913 10193 raft_consensus.cc:3055] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:29:45.531056  3932 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:45.531381 10193 raft_consensus.cc:740] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:45.532347 10193 consensus_queue.cc:260] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.533584 10193 raft_consensus.cc:3060] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:29:45.502454 10024 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.539601 10024 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:45.506461 10160 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:45.507243  4566 raft_consensus.cc:1240] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:45.540802 10198 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:45.541431 10198 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:45.494124 10246 log.cc:927] Time spent T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.495s	user 0.003s	sys 0.000s
W20260709 12:29:45.545066 10272 log.cc:927] Time spent T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.208s	user 0.000s	sys 0.002s
I20260709 12:29:45.546370 10198 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:45.551266  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:45.551584  3932 raft_consensus.cc:2468] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 11.
W20260709 12:29:45.553674 10252 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.473s	user 0.002s	sys 0.007s
I20260709 12:29:45.600337 10199 raft_consensus.cc:3055] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:45.600880 10199 raft_consensus.cc:740] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:29:45.601743 10270 log.cc:927] Time spent T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.244s	user 0.000s	sys 0.002s
W20260709 12:29:45.604115 10276 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.124s	user 0.004s	sys 0.000s
I20260709 12:29:45.604177  3929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43302 (request call id 3175) took 1097 ms. Trace:
I20260709 12:29:45.605073  3929 rpcz_store.cc:276] 0709 12:29:44.506334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:44.508868 (+  2534us) service_pool.cc:224] Handling call
0709 12:29:44.509132 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:45.206444 (+697312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:45.603895 (+397451us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54000d5554. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:45.604118 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574387584}
W20260709 12:29:45.605794  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 724673us
I20260709 12:29:45.608357  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:45.610008 10021 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:45.610445  4570 raft_consensus.cc:1240] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 21 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:29:45.611621 10021 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:45.612150 10021 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:45.614668 10153 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:29:45.617347  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:45.618600 10203 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:45.619261  4001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 3039) took 1087 ms. Trace:
I20260709 12:29:45.619165 10203 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:45.620339  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:45.619639  4001 rpcz_store.cc:276] 0709 12:29:44.532013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:44.533639 (+  1626us) service_pool.cc:224] Handling call
0709 12:29:44.558665 (+ 25026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:44.558888 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:29:45.066215 (+507327us) log.cc:844] Serialized 14 byte log entry
0709 12:29:45.618935 (+552720us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:45.618990 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:29:45.619044 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:45.619108 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:45.619210 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":459950,"prepare.queue_time_us":86853,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1787,"raft.queue_time_us":444679,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":537087,"threads_started":2,"wal-append.queue_time_us":274840}
I20260709 12:29:45.621024  4574 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:45.621457 10203 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:45.623396 10148 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:45.624792 10021 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:45.626133  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:45.627753  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:45.629365 10081 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:29:45.631230  3928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.019s	sys 0.021s
W20260709 12:29:45.632347  3928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.019s	sys 0.021s
I20260709 12:29:45.601753 10199 consensus_queue.cc:260] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.637271 10199 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:45.620733 10159 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:45.639861  9842 raft_consensus.cc:3055] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:45.640355  9842 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:45.641335  9842 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:45.644398  9842 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:45.645394 10182 raft_consensus.cc:3055] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:45.646000 10182 raft_consensus.cc:740] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:45.651463  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.655443  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.657581  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:29:45.662010  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 426115us
I20260709 12:29:45.662978  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.668815  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.669142  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.655642  4566 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42178 (request call id 1386) took 1094 ms. Trace:
I20260709 12:29:45.673460  4566 rpcz_store.cc:276] 0709 12:29:44.560971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:44.564986 (+  4015us) service_pool.cc:224] Handling call
0709 12:29:44.601188 (+ 36202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:45.540347 (+939159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:45.655409 (+115062us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54006de7d4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd7e01 00007fe051fd683e 00007fe056f9b419 00007fe050512bd4 00007fe050512b62 00007fe050512a91 00007fe050512a0c 00007fe050511cc2 00007fe05031248c 00007fe0503118c6
0709 12:29:45.655582 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2083116416}
I20260709 12:29:45.674819  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:45.676959  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:45.678297 10245 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:45.678931 10245 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.681497 10245 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:45.686329  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 297935us
I20260709 12:29:45.687588  3822 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:45.699625  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 212630us
I20260709 12:29:45.699875  4572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42516 (request call id 1612) took 1030 ms. Trace:
I20260709 12:29:45.700971  3895 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:45.705421  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.712399  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.715500  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.701261  4572 rpcz_store.cc:276] 0709 12:29:44.669580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:44.677818 (+  8238us) service_pool.cc:224] Handling call
0709 12:29:44.678157 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:29:44.678350 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:29:44.739831 (+ 61481us) log.cc:844] Serialized 14 byte log entry
0709 12:29:45.685614 (+945783us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b18002ceba0. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe057db2ab1 00007fe057dbf281 00007fe051b7f4bc 00007fe04eecd48b 00007fe057d279a9 00007fe04eee969b 00007fe04eee793f 00007fe04eee9c02 00007fe051b7120b 00007fe051b76d23 00007fe051b7723a
0709 12:29:45.699363 (+ 13749us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:29:45.699443 (+    80us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:29:45.699519 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:29:45.699625 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:29:45.699797 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13434,"prepare.queue_time_us":100389,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"spinlock_wait_cycles":29935360,"thread_start_us":114212,"threads_started":2,"wal-append.queue_time_us":153308}
I20260709 12:29:45.726888  3822 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:45.727275  4536 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:45.728705  3822 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:45.731863  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.730223 10227 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:45.702908 10228 raft_consensus.cc:2749] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:29:45.745643  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:45.740247  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 131405us
I20260709 12:29:45.710469  9842 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:45.758575  9481 consensus_queue.cc:1059] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:29:45.758334  3971 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:45.735702 10024 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:29:45.738682 10126 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:45.731837 10249 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:45.757114 10182 consensus_queue.cc:260] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:45.782763 10182 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:29:45.783870  3823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:45.794528  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.767730  4537 leader_election.cc:304] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:45.769640  9481 raft_consensus.cc:3055] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:29:45.796945  9481 raft_consensus.cc:740] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:29:45.797464  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 71957us
I20260709 12:29:45.787739 10224 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:45.797849  9481 consensus_queue.cc:260] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.802462  9481 raft_consensus.cc:3060] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:29:45.802956  9943 raft_consensus.cc:2804] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:29:45.803627  9943 raft_consensus.cc:697] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:45.758178  9842 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:45.799667 10126 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:45.818055 10126 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:45.818835  3928 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:45.804572  9943 consensus_queue.cc:237] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:45.816846  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 932662us
W20260709 12:29:45.812083  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 83478.7us
I20260709 12:29:45.813236 10286 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:45.823330  3822 leader_election.cc:304] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:45.824738  3822 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:45.831535  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.834409  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.836934  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:45.840862  3895 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:45.846920 10140 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:45.847126 10260 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:29:45.850761 10260 consensus_queue.cc:1048] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:29:45.841989 10131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.081s	user 0.038s	sys 0.055s
W20260709 12:29:45.858755 10131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.038s	sys 0.060s
I20260709 12:29:45.858494 10286 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.860824 10286 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:45.864244 10199 raft_consensus.cc:493] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:45.864826 10199 raft_consensus.cc:515] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.866978 10199 leader_election.cc:290] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:45.866997  9842 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:45.871517  3897 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:45.873351 10260 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:29:45.819036 10126 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:45.880709  3820 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:29:45.886251  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 58740.5us
I20260709 12:29:45.888480  3897 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:45.890082  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 65421.7us
I20260709 12:29:45.891253  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:45.893762  3897 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:45.900208  3928 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 12:29:45.826743  9545 raft_consensus.cc:2749] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:45.908406  3897 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:45.902817 10199 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:29:45.910822  3924 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 12:29:45.911237  3924 pending_rounds.cc:85] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 13
I20260709 12:29:45.911451  3924 pending_rounds.cc:107] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:29:45.911732  3924 raft_consensus.cc:2889] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:45.912739  3923 raft_consensus.cc:1240] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 10. Current term is 11. Ops: []
I20260709 12:29:45.894106 10181 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:45.896710 10260 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:45.916062  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.925518  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "781f4e626c2b4af0af08871cfde2d83e" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:45.896500 10286 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:45.926662  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b3145ab3db147c9a4fd5ca3a3ccc700" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:45.925007  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fd9ef15e49a427d989c258ac6614daa" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:45.928751  3822 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:45.933089  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10f480d05fc4f71af73fcd88b588f21" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.929673  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:45.934157  4001 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 16: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:45.930958 10199 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:45.934782 10199 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:45.917763 10116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.091s	user 0.014s	sys 0.023s
I20260709 12:29:45.929076  9481 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.939420  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.911917 10208 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:45.936985  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a445f8740fa847ed9ac463915fa09725" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.939678  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5149ad67f39c49a6b07934b58605690c" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.938071  3822 leader_election.cc:304] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:45.917191 10203 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.929834  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.939934  9481 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.963491  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.938519  3897 leader_election.cc:304] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:45.906795  9944 consensus_queue.cc:1059] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:29:45.968492  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383a24e3cada4485922ab39de63b4de9" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.968680  3854 raft_consensus.cc:1240] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:29:45.969624  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.925413 10260 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:45.924659 10189 raft_consensus.cc:493] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:45.966429  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a53a95fd9f44e59c1b1615b9281948" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.966632  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.967547  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:45.939683 10116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.014s	sys 0.024s
I20260709 12:29:45.967787  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.970861  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.964555  4006 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 12.
I20260709 12:29:45.971447  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:45.974797  9944 raft_consensus.cc:3055] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:45.975361 10066 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:46.000918 10066 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:46.002554 10292 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:46.003134 10066 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:46.003072 10292 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:46.005234 10292 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:45.994647  9944 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:46.007300  9944 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.935642 10184 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:29:46.008520  9944 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:45.976363 10211 raft_consensus.cc:2749] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:29:46.010488 10293 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:29:45.962380 10219 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:29:45.985713 10199 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:45.991629  9481 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:46.011847 10294 log.cc:927] Time spent T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:29:45.995610  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.997040  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:45.999115 10189 raft_consensus.cc:515] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:45.986557 10260 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:46.015086  4004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb53ea47358c4bca95e2856114bf0412" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
W20260709 12:29:46.030093  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 91989.2us
I20260709 12:29:46.030561  4004 raft_consensus.cc:2410] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:29:46.015086  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.017402  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:45.963014 10203 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.023566  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:46.026597  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:46.026715  3755 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51802 (request call id 337) took 7620 ms. Trace:
I20260709 12:29:45.932345 10220 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.942438 10222 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 12:29:46.041479  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.019852 10291 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:46.049959  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5bc554f69c94b9887b24097921bd77e" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:46.030916 10219 raft_consensus.cc:2749] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:46.054733  3856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26de30c1b5e74f05815f13d9ceea7f45"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:46.055361  3856 raft_consensus.cc:606] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:46.055779  3856 raft_consensus.cc:614] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:46.032933  3755 rpcz_store.cc:276] 0709 12:29:38.401691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:38.402001 (+   310us) service_pool.cc:224] Handling call
0709 12:29:46.022016 (+7620015us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:40.543640 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:40.552370 (+  8730us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:40.552421 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:29:40.552446 (+    25us) tablet.cc:662] Decoding operations
0709 12:29:40.680634 (+128188us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:40.680730 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:40.680765 (+    35us) tablet.cc:685] Acquiring locks for 33 operations
0709 12:29:40.694070 (+ 13305us) tablet.cc:701] Row locks acquired
0709 12:29:40.694120 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:29:40.694280 (+   160us) write_op.cc:270] Start()
0709 12:29:40.705292 (+ 11012us) write_op.cc:276] Timestamp: P: 1783600180694221 usec, L: 0
0709 12:29:40.705324 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:29:40.738179 (+ 32855us) log.cc:844] Serialized 12788 byte log entry
0709 12:29:41.076665 (+338486us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b5400046ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd2e28 00007fe055a0d581 00007fe055a0cd58 00007fe055a119f1 00007fe055a119a9 00007fe055a11939 00007fe055a11901 00007fe055a10b2d 0000000000388634 0000000000388479
0709 12:29:41.358839 (+282174us) op_driver.cc:464] REPLICATION: finished
0709 12:29:41.546156 (+187317us) write_op.cc:301] APPLY: starting
0709 12:29:41.547149 (+   993us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:41.586361 (+ 39212us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b5400046ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f40571 00007fe051fd432a 00007fe051f59f14 00007fe051f59ec3 00007fe051f59e38 00007fe051f59df3 00007fe051f590dc 00007fe051f82e16 00007fe051f6acbb 00007fe051f5539d 00007fe051f58d75
0709 12:29:41.884807 (+298446us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:41.884836 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:42.130739 (+245903us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:42.260174 (+129435us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=66,key_file_lookups=66,delta_file_lookups=66,mrs_lookups=0
0709 12:29:42.267158 (+  6984us) write_op.cc:312] APPLY: finished
0709 12:29:42.362708 (+ 95550us) log.cc:844] Serialized 284 byte log entry
0709 12:29:42.539863 (+177155us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:42.555625 (+ 15762us) write_op.cc:454] Released schema lock
0709 12:29:42.562631 (+  7006us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:42.563184 (+   553us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:42.563231 (+    47us) write_op.cc:454] Released schema lock
0709 12:29:43.039211 (+475980us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b4400022b4c. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04ee10c85 00007fe04ee116a2 00007fe051b831db 00007fe051b7eaaf 00007fe051b7286e 00007fe051b71bb6 00007fe051b717d8 00007fe051b7b221 00007fe051b7b1d9 00007fe051b7b169
Metrics: {"mutex_wait_us":256762,"reported_tablets":47,"spinlock_wait_cycles":9984,"child_traces":[["op",{"apply.queue_time_us":149611,"apply.run_cpu_time_us":75735,"apply.run_wall_time_us":1032876,"cfile_cache_hit":134,"cfile_cache_hit_bytes":141935,"num_ops":33,"prepare.queue_time_us":162760,"prepare.run_cpu_time_us":31338,"prepare.run_wall_time_us":533239,"raft.queue_time_us":307555,"raft.run_cpu_time_us":36016,"raft.run_wall_time_us":295215,"replication_time_us":628412,"spinlock_wait_cycles":75443456,"thread_start_us":538414,"threads_started":5,"wal-append.queue_time_us":358897,"wal-append.run_cpu_time_us":47237,"wal-append.run_wall_time_us":2786296}]]}
I20260709 12:29:46.074050  4538 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.083276  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:46.084264  9481 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:46.085101  9481 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:46.094455  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:46.054015 10291 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:46.100525 10279 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:29:46.105610 10290 log.cc:927] Time spent T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:29:46.122718 10189 leader_election.cc:290] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:46.126109  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:29:46.130462  3896 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:29:46.161785  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.048580 10220 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.165921  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.165452 10222 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:46.170717 10184 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:46.171140 10184 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:46.171030 10222 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.171551 10184 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:46.172880 10291 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:46.177296  3895 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.178452  9481 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:29:46.175683  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 64978.5us
I20260709 12:29:46.182021  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.179806  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:46.166072 10270 log.cc:927] Time spent T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:29:46.188800  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.189967  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.192225  3895 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.188211  3970 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.197342 10031 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:46.191318 10032 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:46.200968 10222 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:46.203810  3895 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.204509  3970 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.214645  3895 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.165766 10225 consensus_queue.cc:1059] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 12:29:46.228411  3970 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.183986 10152 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:46.236461  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.238042  9481 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:46.208679 10031 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:46.241684  3856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:46.251809  3856 raft_consensus.cc:606] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:46.252170  3856 raft_consensus.cc:614] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:46.242848  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:46.208021  9778 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:29:46.208369 10208 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:46.208621 10227 raft_consensus.cc:493] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:46.229431 10292 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:46.228767 10274 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:46.259209  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:46.232065 10062 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:46.244136 10199 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:46.249011 10084 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:46.269322  3930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:46.269120 10062 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.286928  4006 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 13. Current term is 14. Ops: []
I20260709 12:29:46.288326  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecfd004856c24015ae137dfd5fd34b2c" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:46.241179 10152 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:46.261507 10151 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:46.261870 10189 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:46.296267  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:46.299872  4003 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:46.298374  3822 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.260758 10208 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:46.273845 10062 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:46.293982  9778 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:46.306849  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 232867us
I20260709 12:29:46.262384 10227 raft_consensus.cc:515] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.308859  3856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:46.310382  3856 raft_consensus.cc:606] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.312008  4538 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.305274 10182 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:29:46.316511  4538 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:46.316864  3930 raft_consensus.cc:1240] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 12:29:46.318701  3822 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:46.326264  4538 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.314711 10062 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:46.345212  4538 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:29:46.346509  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 131979us
I20260709 12:29:46.347533  3895 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.319963 10301 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:46.302330 10189 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:46.302302 10151 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.351862  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:46.314582  9778 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.360038  4538 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:46.346761  9943 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:46.345780 10182 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:46.364785  4538 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:46.366426  4538 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.342427 10303 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:29:46.352452 10239 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:46.351162 10220 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:46.369434  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.352208 10031 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:46.368219  3895 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.380223 10208 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:46.355038 10249 raft_consensus.cc:493] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:46.383226 10152 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:46.384248  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:46.374482 10227 leader_election.cc:290] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:46.385113  3856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:46.387531  3969 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.387688  9778 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:46.347533 10062 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:46.395422  4570 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:29:46.378024  9961 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:29:46.468068 10249 raft_consensus.cc:515] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.469518 10062 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:46.442864  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:46.472937 10031 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:46.369474 10159 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:46.368932 10024 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:29:46.472282  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 104139us
I20260709 12:29:46.368692 10279 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:46.475198  3895 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.475936 10081 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:46.477412  3856 raft_consensus.cc:606] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:46.477859  3856 raft_consensus.cc:614] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:46.478718  9961 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:46.479233  9961 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:29:46.398869  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:46.460893  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5f24773bb44448a1cb122558f0c4c9" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:46.487989 10280 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:46.488560 10280 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.437764 10189 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:46.436168 10151 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:46.496001  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:46.497786 10286 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:46.445343  3970 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.498359 10286 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.498383  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:46.502032 10247 raft_consensus.cc:993] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:29:46.502599 10126 raft_consensus.cc:1081] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:29:46.502861 10219 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:46.504761 10151 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:46.509348 10152 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:46.511385  4570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42526
I20260709 12:29:46.515177  3856 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:46.446471 10203 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:46.525115  3856 raft_consensus.cc:606] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:46.527544  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:29:46.530280  9944 consensus_meta.cc:287] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.521s	user 0.002s	sys 0.011s
I20260709 12:29:46.545168 10280 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:46.545527  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:29:46.546346  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 158858us
I20260709 12:29:46.546998  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:46.550545  3850 raft_consensus.cc:1275] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:29:46.550559  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
W20260709 12:29:46.552874  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 107640us
I20260709 12:29:46.558495  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.558954  3856 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:29:46.562423  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.565461  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:46.573300  3848 raft_consensus.cc:1275] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:29:46.573197  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.574326  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:46.575706  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.577571  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.576001  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.578392  3849 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:46.584324  3928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:46.596203  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:46.556612 10260 consensus_meta.cc:287] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
I20260709 12:29:46.597211  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:46.598315  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:46.597810  4574 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:29:46.602020  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:46.604023  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.605600  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.607023  3853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.621222  4536 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.555013 10184 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.556877 10203 consensus_queue.cc:1059] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
I20260709 12:29:46.632841  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:46.639643  3998 raft_consensus.cc:2468] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:46.635375  3971 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:46.640551  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 53681.9us
I20260709 12:29:46.645236 10148 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:29:46.478741 10249 leader_election.cc:290] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:46.648981  4005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:46.655030  3971 leader_election.cc:304] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.622277 10152 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:46.650303  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8693e7a0624445758baf0b77c7686e0c" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:46.670431  4003 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:29:46.670907  4003 pending_rounds.cc:85] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 9
I20260709 12:29:46.671135  4003 pending_rounds.cc:107] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:29:46.671372  4003 raft_consensus.cc:2889] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:46.672509  3852 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 15. Current term is 16. Ops: []
I20260709 12:29:46.657619 10203 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:46.676410 10084 raft_consensus.cc:2749] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:46.681834  3971 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:46.683432 10189 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:46.683848 10189 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:46.684222 10189 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:46.687055 10203 raft_consensus.cc:3055] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:29:46.687477 10203 raft_consensus.cc:740] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:46.688058 10184 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:46.688303 10203 consensus_queue.cc:260] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.648768 10301 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:46.653673 10286 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:46.690595 10203 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:46.652588 10228 consensus_queue.cc:1048] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:29:46.697059  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:46.691836 10152 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:46.609833 10260 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.702682  3999 raft_consensus.cc:1275] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:29:46.700477  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 102575us
I20260709 12:29:46.705368  3998 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:29:46.707495  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 51998.3us
I20260709 12:29:46.713286  4571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:46.714136  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:46.724449  3928 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:46.725720  4538 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.722278  3969 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.731561  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:46.731490  3969 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.719465  3750 catalog_manager.cc:5697] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 8 to 10, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 10 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:46.738150  3998 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 12:29:46.738525  3998 pending_rounds.cc:85] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 11
I20260709 12:29:46.738752  3998 pending_rounds.cc:107] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 12:29:46.738967  3998 raft_consensus.cc:2889] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:46.706740 10025 consensus_queue.cc:1059] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:29:46.736379  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.730983 10084 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:46.730345 10303 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:46.748636  3750 catalog_manager.cc:5697] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 11 to 15, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 15 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:46.758363  3969 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.760048  3969 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.762640  3969 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.747921 10285 raft_consensus.cc:2749] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:29:46.763815  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.730367 10301 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:29:46.734941 10160 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:29:46.771238  3969 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.759297 10291 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:29:46.809267 10321 raft_consensus.cc:993] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:29:46.781167 10280 raft_consensus.cc:3055] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:46.764555 10021 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:29:46.786654 10318 log.cc:927] Time spent T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:29:46.773350 10120 raft_consensus.cc:2749] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:46.788894  9961 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.764376  9778 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:46.774106 10077 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:29:46.793928  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 50768.1us
I20260709 12:29:46.794936 10224 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:46.855746 10224 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:46.857908 10224 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:46.757755 10032 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:29:46.765949 10084 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:46.808422 10189 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.860715 10189 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:46.810465  3897 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:46.861325  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.862073  3850 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
W20260709 12:29:46.862129  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 51714.3us
I20260709 12:29:46.838397 10247 raft_consensus.cc:1081] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:29:46.863181  3897 leader_election.cc:304] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.863420 10245 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:46.864548 10245 raft_consensus.cc:2749] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:29:46.816521  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 72492.8us
I20260709 12:29:46.867259  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:46.868233  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:46.868255  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:46.815721  3750 catalog_manager.cc:5697] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 8 to 13, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 13 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:46.846454 10152 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:46.846903 10260 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:46.849658  4570 raft_consensus.cc:493] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:46.850577  9961 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:46.852154  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:46.876701  4570 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:46.844334  9778 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:46.816033 10280 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:46.866421  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:46.874230  3929 raft_consensus.cc:1275] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:29:46.867069  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:46.883227  3969 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.883785  3856 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 14.
I20260709 12:29:46.842484 10056 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
W20260709 12:29:46.877308  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 128960us
I20260709 12:29:46.882405  3750 catalog_manager.cc:5697] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 11 to 18, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 18 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:46.884763  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:46.887190  3969 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:46.882467  3821 leader_election.cc:304] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.893172  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.896281  3750 catalog_manager.cc:5697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 10 to 17, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 17 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:46.904946  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadf6ff4956f47ff8a85f77d02584a0d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:46.886157  9778 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:46.918836  3750 catalog_manager.cc:5697] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 7 to 10, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 10 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:46.891754 10189 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:46.895351 10152 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:29:46.885906 10245 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:29:46.911983 10077 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:29:46.912909 10260 raft_consensus.cc:2749] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:29:46.916055 10321 raft_consensus.cc:2749] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:29:46.936203  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 94079.4us
W20260709 12:29:46.940156 10323 log.cc:927] Time spent T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:29:46.944001 10280 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.945469 10280 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:46.945516 10224 raft_consensus.cc:3055] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:46.946125 10224 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:46.947161 10224 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:46.924512 10189 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:46.936842 10081 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:29:46.975121 10189 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:46.963423  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:46.922323 10160 consensus_queue.cc:1048] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:29:46.935634 10077 raft_consensus.cc:493] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:46.984112 10077 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:29:46.965585  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 43879.2us
I20260709 12:29:46.971037  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:46.990504  3821 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:46.999538 10328 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:47.045964  3750 catalog_manager.cc:5697] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.056077  3750 catalog_manager.cc:5697] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 9 to 15, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 15 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:47.057420  3750 catalog_manager.cc:5697] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.058833  3750 catalog_manager.cc:5697] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 9 to 12, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 12 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.067945  3750 catalog_manager.cc:5697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 12 to 13, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 13 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:47.076588 10319 log.cc:927] Time spent T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.313s	user 0.003s	sys 0.000s
I20260709 12:29:47.077740  3750 catalog_manager.cc:5697] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 13 to 15, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 15 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.090420  3999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36530
I20260709 12:29:47.091022  3999 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:47.091373  3999 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:47.087354  4570 raft_consensus.cc:515] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.093454  4566 raft_consensus.cc:1240] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 12. Current term is 14. Ops: []
I20260709 12:29:47.105684  4003 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:47.131721 10077 raft_consensus.cc:515] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:47.156632  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:47.144949  3750 catalog_manager.cc:5697] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 13 to 15, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 15 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:47.137564  9778 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.158241  3750 catalog_manager.cc:5697] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 11 to 16, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 16 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.164434  9778 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:47.165215  4001 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:29:47.175866  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:47.179351  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:47.161835  3750 catalog_manager.cc:5697] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 8 to 13, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 13 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.184556  3969 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:47.187639  9778 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:29:47.203115 10077 leader_election.cc:290] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:47.203817  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:47.204432  3852 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:47.207831 10189 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:47.211503  3852 raft_consensus.cc:2468] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:47.212141  3850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:47.212710  3850 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:47.215735  3969 leader_election.cc:304] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:47.219053  3999 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.226409  3998 raft_consensus.cc:1240] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:47.228242  4538 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:47.233584  3999 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:47.234709  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:47.235198  3852 raft_consensus.cc:3055] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:47.235432  3852 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:47.226924 10151 raft_consensus.cc:2804] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:47.237277 10151 raft_consensus.cc:697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:47.238209 10151 consensus_queue.cc:237] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:47.241977 10126 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:29:47.243050 10285 raft_consensus.cc:3055] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:47.243403 10285 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:47.244141 10285 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.244266  3852 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.245471  3852 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:47.232771  9961 raft_consensus.cc:2749] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:29:47.252848 10228 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:29:47.257185  3850 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:29:47.245496 10285 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:47.215056 10189 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:47.261691  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:47.274430  4568 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:47.277536  4570 leader_election.cc:290] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:47.279019  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:47.279652  3855 raft_consensus.cc:3055] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:29:47.279964  3855 raft_consensus.cc:740] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:47.280643  3855 consensus_queue.cc:260] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.281713  3855 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:29:47.286401  4568 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:47.291865  3852 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:47.292052  3855 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:47.295246 10224 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:47.296047  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e53a5bcc4f45a3a3ba300b44b04925" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:47.296747 10025 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:29:47.301666  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 378899us
I20260709 12:29:47.313162  4536 leader_election.cc:304] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:47.302937  3971 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:47.303692  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:47.305898  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:47.318073  3931 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:29:47.319317  3852 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:29:47.320179 10199 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:47.320792 10199 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.323077 10199 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:47.325695  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:47.331101  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:47.331714  3849 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:47.335119 10120 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:47.336340 10120 raft_consensus.cc:697] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:47.339511 10208 consensus_queue.cc:1059] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:47.339895 10120 consensus_queue.cc:237] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:47.328047  9961 raft_consensus.cc:2804] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:47.341122  9961 raft_consensus.cc:697] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:47.341673  4006 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:29:47.341982  9961 consensus_queue.cc:237] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.344007 10208 raft_consensus.cc:3055] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:47.344393 10208 raft_consensus.cc:740] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:47.344589 10160 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:29:47.345168 10208 consensus_queue.cc:260] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:47.345685  3895 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:47.346334 10208 raft_consensus.cc:3060] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:47.347299 10260 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:47.347683 10260 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:47.348013 10260 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:47.315961 10025 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.354542  4568 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:47.316493 10301 raft_consensus.cc:3055] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:47.364764  3931 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:29:47.365190  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017f50df9e3498d929adc22812d22cf" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:47.365823  3999 raft_consensus.cc:3060] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:29:47.328989 10203 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:47.370921  3998 raft_consensus.cc:1240] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:29:47.367877  9944 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:47.362702 10301 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:47.380594  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:47.381487  3852 raft_consensus.cc:2393] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 17: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:47.382480 10025 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:47.383082  9944 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:47.386371  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:47.393051  3999 raft_consensus.cc:2468] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 14.
I20260709 12:29:47.381951 10203 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:47.427726 10203 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.422071 10301 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.464463  9944 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:47.471333 10301 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:47.473912 10260 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.499725  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:47.503842 10247 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:47.504442 10247 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.504755 10081 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:47.505328 10081 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.506557 10247 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:47.486927  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:47.508665  3855 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 19.
I20260709 12:29:47.512692  3931 raft_consensus.cc:2368] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 17. Current term is 18.
I20260709 12:29:47.515091 10260 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:47.515254 10081 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:47.517127  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:47.517724  4568 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:29:47.519088  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:47.519764  3929 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
W20260709 12:29:47.520092 10337 log.cc:927] Time spent T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:29:47.521020  3895 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:47.522259  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:47.522478 10081 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:29:47.522877  4566 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:47.523067 10081 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:47.523607 10081 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:47.526064  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf2cd47e3c44d995fbbb863bf3d5ac" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:47.526616  3852 raft_consensus.cc:3060] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:47.526715  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:47.527551  4568 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 18.
I20260709 12:29:47.527518  3855 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:29:47.529222  4537 leader_election.cc:400] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 17. Current term is 18.
I20260709 12:29:47.530071  4537 leader_election.cc:403] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:47.529124  3897 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:47.535084  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:47.536060  4568 raft_consensus.cc:2393] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb in current term 17: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:47.532501  3897 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:47.537477  3852 raft_consensus.cc:2468] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 18.
I20260709 12:29:47.537019 10260 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:47.541253 10260 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:47.541622 10260 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:47.531359 10301 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 17. Current term is 18.
I20260709 12:29:47.549909  3821 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:47.566092 10032 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:47.566511 10032 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:29:47.566882 10032 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:47.542500 10208 raft_consensus.cc:2804] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:47.577585 10208 raft_consensus.cc:697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:47.579879 10208 consensus_queue.cc:237] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.597759 10032 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.600247 10260 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.605927 10032 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:47.607753 10260 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:47.614303 10081 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:47.610535  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:47.626783  4566 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:47.628157 10081 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:47.628746  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:47.629362  3855 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:47.636554  3855 raft_consensus.cc:2468] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 20.
I20260709 12:29:47.637609  3895 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:47.641033  4566 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 18.
I20260709 12:29:47.618405  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:47.622223  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:47.653277  3849 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:47.608354  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:47.643365  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415f89d9faf145eba38570ddee93ff31" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:47.640034 10081 raft_consensus.cc:2804] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:29:47.667130 10081 raft_consensus.cc:697] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:47.668138  4568 raft_consensus.cc:2368] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 17. Current term is 18.
I20260709 12:29:47.669564  3931 raft_consensus.cc:2368] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 17. Current term is 18.
I20260709 12:29:47.669847  3822 leader_election.cc:400] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 17. Current term is 18.
I20260709 12:29:47.670208  3822 leader_election.cc:403] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:29:47.671185  3849 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 18.
I20260709 12:29:47.671636  3821 leader_election.cc:400] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Vote denied by peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279) with higher term. Message: Invalid argument: T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 17. Current term is 18.
I20260709 12:29:47.672650  3895 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:47.673091 10321 raft_consensus.cc:2749] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095) with higher term. Message: Invalid argument: T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4eedd844c09d456ca0b3614490dd1dbb for earlier term 17. Current term is 18.
I20260709 12:29:47.676105 10031 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:47.686976 10031 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:47.687853 10031 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.685954 10081 consensus_queue.cc:237] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:47.727705  3849 raft_consensus.cc:1275] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:29:47.730646 10224 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:29:47.733105  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:47.750350  3929 raft_consensus.cc:1275] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:29:47.750844  3929 pending_rounds.cc:85] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting all ops after (but not including) 8
I20260709 12:29:47.751094  3929 pending_rounds.cc:107] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:29:47.751349  3929 raft_consensus.cc:2889] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:47.765357 10203 consensus_queue.cc:1048] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:29:47.820421 10084 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:47.820945 10084 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.823086 10084 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:47.824692  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:47.825637  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:47.833181  3931 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:29:47.834884  3970 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:47.838037 10203 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:29:47.838449 10203 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:47.838861 10203 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:29:47.874166  3750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51804 (request call id 333) took 16807 ms (client timeout 15000 ms). Trace:
I20260709 12:29:47.875988  4566 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:29:47.876293  3755 catalog_manager.cc:5697] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 13 to 21, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 21 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.878587 10084 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:29:47.878489  3755 catalog_manager.cc:5697] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 14 to 15, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 15 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.880255  3755 catalog_manager.cc:5697] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.881513  3755 catalog_manager.cc:5697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:47.882743  3755 catalog_manager.cc:5697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 13 to 14, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 14 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:47.884188  3755 catalog_manager.cc:5697] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 17 to 19, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 19 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:47.885725  3755 catalog_manager.cc:5697] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.886986  3755 catalog_manager.cc:5697] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 16 to 18, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 18 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:47.888422  3755 catalog_manager.cc:5697] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 17 to 19, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 19 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:47.890178  3755 catalog_manager.cc:5697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:47.891397  3755 catalog_manager.cc:5697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 13 to 15, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 15 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } attrs { replace: true } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.893137  3755 catalog_manager.cc:5697] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 14 to 16, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 16 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.894675  3852 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:47.894484  3755 catalog_manager.cc:5697] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 13 to 14, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 14 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.896050  3755 catalog_manager.cc:5697] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 15 to 18, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 18 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.897866  3755 catalog_manager.cc:5697] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 15 to 17, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 17 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.899482  3755 catalog_manager.cc:5697] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 15 to 17, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 17 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } }
I20260709 12:29:47.900861  3755 catalog_manager.cc:5697] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 14 to 21, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 21 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
W20260709 12:29:47.874645  3750 rpcz_store.cc:269] 0709 12:29:31.066724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:31.066940 (+   216us) service_pool.cc:224] Handling call
0709 12:29:47.874072 (+16807132us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:47.509164 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:47.510544 (+  1380us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:47.510582 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:29:47.510603 (+    21us) tablet.cc:662] Decoding operations
0709 12:29:47.516776 (+  6173us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:47.516871 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:47.516901 (+    30us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:29:47.518135 (+  1234us) tablet.cc:701] Row locks acquired
0709 12:29:47.518156 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:29:47.518304 (+   148us) write_op.cc:270] Start()
0709 12:29:47.518426 (+   122us) write_op.cc:276] Timestamp: P: 1783600187518256 usec, L: 0
0709 12:29:47.518455 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:29:47.519153 (+   698us) log.cc:844] Serialized 5824 byte log entry
0709 12:29:47.615941 (+ 96788us) op_driver.cc:464] REPLICATION: finished
0709 12:29:47.659832 (+ 43891us) write_op.cc:301] APPLY: starting
0709 12:29:47.659920 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:47.703488 (+ 43568us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:47.703598 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:47.834109 (+130511us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:47.834890 (+   781us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:29:47.834943 (+    53us) write_op.cc:312] APPLY: finished
0709 12:29:47.835285 (+   342us) log.cc:844] Serialized 139 byte log entry
0709 12:29:47.835451 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:47.835600 (+   149us) write_op.cc:454] Released schema lock
0709 12:29:47.835653 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:47.846500 (+ 10847us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:47.846540 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":43317,"apply.run_cpu_time_us":21003,"apply.run_wall_time_us":176210,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66767,"num_ops":15,"prepare.queue_time_us":116877,"prepare.run_cpu_time_us":60440,"prepare.run_wall_time_us":77332,"raft.queue_time_us":26409,"raft.run_cpu_time_us":21046,"raft.run_wall_time_us":39665,"replication_time_us":97330,"spinlock_wait_cycles":1131264,"thread_start_us":182063,"threads_started":4,"wal-append.queue_time_us":67506}]]}
I20260709 12:29:47.902480  3852 raft_consensus.cc:1240] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 19. Current term is 20. Ops: []
I20260709 12:29:47.902295  3755 catalog_manager.cc:5697] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 9 to 19. New cstate: current_term: 19 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.904314  3755 catalog_manager.cc:5697] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 15 to 16, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 16 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.906097  3755 catalog_manager.cc:5697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 13 to 15, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 15 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.907430  3755 catalog_manager.cc:5697] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.908674  3755 catalog_manager.cc:5697] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 13 to 15, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 15 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.897529 10280 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:29:47.910007  3755 catalog_manager.cc:5697] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 6 to 17, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 17 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.911679  3755 catalog_manager.cc:5697] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.912047 10224 consensus_queue.cc:1059] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:47.912900 10152 raft_consensus.cc:3055] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:29:47.913324 10152 raft_consensus.cc:740] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:47.913499  3755 catalog_manager.cc:5697] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 16 to 17, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 17 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.916774  3755 catalog_manager.cc:5697] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 13 to 14, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 14 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:47.935046 10152 consensus_queue.cc:260] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:47.936362 10152 raft_consensus.cc:3060] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:47.951135  4001 raft_consensus.cc:1275] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:29:47.962695  4001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cd145ac0c9d4f1fbf7e300e3d5cd972"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:44346
I20260709 12:29:47.963519  4001 raft_consensus.cc:606] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:47.963944  4001 raft_consensus.cc:614] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:47.954726 10280 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:47.957525 10301 consensus_queue.cc:1048] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:29:47.973048 10280 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:47.982491  3849 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:29:48.012019  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:48.013191  3929 raft_consensus.cc:2393] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 19: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:48.028425  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
W20260709 12:29:48.037415  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 59322us
I20260709 12:29:48.029351  3849 raft_consensus.cc:606] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:48.037084 10280 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:47.991623 10203 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:48.036402 10224 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 12:29:48.065961  3998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "611a21088f764ac6bf8767713d911869"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:44346
I20260709 12:29:48.066133  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:48.066597  3998 raft_consensus.cc:606] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:48.075942 10203 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:48.057286 10280 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:48.078269 10280 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:48.080983 10280 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:48.083557  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:48.084205  3849 raft_consensus.cc:606] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:48.084522  3849 raft_consensus.cc:614] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:48.085598  4001 raft_consensus.cc:2368] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 19. Current term is 20.
I20260709 12:29:48.088838  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:48.089416  4566 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:29:48.091977  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:48.092605  4006 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
I20260709 12:29:48.094314  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:48.096784  3929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "455f8427897049759001979ea81adec1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:48.097398  3929 raft_consensus.cc:3060] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:48.097838  4538 leader_election.cc:400] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 19. Current term is 20.
I20260709 12:29:48.098193  4538 leader_election.cc:403] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:48.101848  4568 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:29:48.103665  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a196cfd02592426389eee8bd2a8edb36"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:48.104236  3849 raft_consensus.cc:606] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:48.104580  3849 raft_consensus.cc:614] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:29:48.105757  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:29:48.107625  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:48.108367  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:48.138046  4566 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 20.
I20260709 12:29:48.142318 10327 raft_consensus.cc:993] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:29:48.143636 10327 raft_consensus.cc:1081] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:29:48.144829  4566 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:29:48.099601 10280 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:48.164908  3971 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:48.144987 10355 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 19. Current term is 20.
I20260709 12:29:48.167835 10224 raft_consensus.cc:2804] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:29:48.147934 10280 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:29:48.118677 10031 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:29:48.185851  3932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43302
I20260709 12:29:48.186496  3932 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:48.186863  3932 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:48.161661  9944 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:29:48.184149 10280 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:48.197245  3932 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:48.192994 10224 raft_consensus.cc:697] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 20 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:48.212438  3932 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:48.231451 10224 consensus_queue.cc:237] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:48.281350  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 90486.1us
I20260709 12:29:48.317826  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:48.319684  3855 raft_consensus.cc:3055] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:48.320400  3855 raft_consensus.cc:740] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:48.322486  3855 consensus_queue.cc:260] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:48.326719  3855 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:48.380825  3929 raft_consensus.cc:2468] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 20.
I20260709 12:29:48.389902 10358 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:48.391237 10358 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:48.394433  4006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:48.417156  4006 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:48.421240 10358 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:48.446237  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 52390.3us
W20260709 12:29:48.447158  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 47583.9us
I20260709 12:29:48.471833  4001 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 12:29:48.472265  4001 pending_rounds.cc:85] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 11
I20260709 12:29:48.472523  4001 pending_rounds.cc:107] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 12:29:48.472795  4001 raft_consensus.cc:2889] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:48.480885  4006 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:48.515105  3855 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
W20260709 12:29:48.519203  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 162847us
I20260709 12:29:48.535030 10081 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:48.553519  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:29:48.554581  3932 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 17: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:48.568113  3897 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:48.566648  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:48.576713  4572 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:48.588189 10031 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:48.588886 10031 raft_consensus.cc:697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:48.605015  3850 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:29:48.605561  3856 raft_consensus.cc:1275] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:29:48.618296 10031 consensus_queue.cc:237] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:48.627415 10371 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:48.628280 10371 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:48.632757  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 57589.6us
I20260709 12:29:48.636179 10377 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:48.636967 10377 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:48.647948  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 170357us
W20260709 12:29:48.658356  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 55611.5us
I20260709 12:29:48.658686  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:48.668449  3971 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:48.671763 10377 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:48.672662 10364 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:48.674185 10152 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:29:48.674664 10152 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:48.674350 10364 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:48.675071 10152 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:48.677062 10364 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:48.683375  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:48.684849 10152 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:48.702986 10333 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:29:48.709776  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:48.717970  4565 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:48.722235  3848 raft_consensus.cc:2393] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 16: Already voted for candidate 4eedd844c09d456ca0b3614490dd1dbb in this term.
I20260709 12:29:48.729028  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:48.732653 10320 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:48.733119 10320 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:48.733533 10320 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:48.732681 10032 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:48.734601 10032 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:48.737071 10032 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:48.741012  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:48.741860  4568 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:48.743259  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:48.744726 10247 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:29:48.745136 10247 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting leader election (detected failure of leader f3cab225ecb7488386a1a19239498cfe)
I20260709 12:29:48.745575 10247 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:48.754910  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:48.774080  3848 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 18.
I20260709 12:29:48.760048  3855 raft_consensus.cc:1275] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:29:48.786252 10369 raft_consensus.cc:993] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:29:48.787071 10084 raft_consensus.cc:1081] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:29:48.789300 10247 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:48.791936 10247 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:48.794446  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:48.759564 10081 consensus_queue.cc:1048] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:29:48.794495  4536 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:48.760922 10371 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:48.811160  4565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "611a21088f764ac6bf8767713d911869"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42516
I20260709 12:29:48.821287  4565 raft_consensus.cc:493] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:48.822396  4565 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:48.846016  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:48.850600  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:48.828086 10370 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:48.858167 10370 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:29:48.858587 10370 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:48.835376 10152 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:48.866000 10378 consensus_queue.cc:1048] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:29:48.893488  4568 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:29:48.895032  4572 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:48.901707  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:48.902591  4565 raft_consensus.cc:515] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:48.910293  3971 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:48.915778  4565 leader_election.cc:290] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:48.990866 10247 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:49.011168 10247 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:49.012172 10247 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.017719 10356 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:49.018407 10356 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.020648 10356 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:49.024638 10370 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.026206  3855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:49.027098  3855 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:49.028645  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:49.029642  4003 raft_consensus.cc:2393] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 18: Already voted for candidate 34711da9380944d2969a2bc3e203db3d in this term.
W20260709 12:29:49.030483  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 120271us
I20260709 12:29:49.031982  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:49.032800  3998 raft_consensus.cc:3055] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:49.033164  3998 raft_consensus.cc:740] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:49.035727 10386 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:49.036345 10386 raft_consensus.cc:697] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:49.086895  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:49.027122 10370 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:49.078040  3998 consensus_queue.cc:260] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.037400 10386 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.092928  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:49.123103  3997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:49.126245  4003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:49.079833 10320 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:49.129069  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 159721us
I20260709 12:29:49.129527 10320 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
W20260709 12:29:49.130322 10280 consensus_meta.cc:287] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Time spent flushing consensus metadata: real 0.892s	user 0.014s	sys 0.011s
I20260709 12:29:49.130364  3848 raft_consensus.cc:2368] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17.
I20260709 12:29:49.130872 10280 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.132822  3926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611a21088f764ac6bf8767713d911869" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:49.133190 10280 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:49.133399  3926 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:49.133936  3969 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:49.135257  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:49.135882  4572 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:49.145092  3926 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
W20260709 12:29:49.151448  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 111382us
I20260709 12:29:49.171149  3854 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 18.
I20260709 12:29:49.174979  3998 raft_consensus.cc:3060] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:49.176935  4536 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:49.179252  4001 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
I20260709 12:29:49.186134  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:49.170718 10356 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:49.189007 10369 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:49.228317 10369 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.192436 10356 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:49.231153 10356 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:49.191834  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:49.239476  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 129866us
W20260709 12:29:49.271508  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 72968.2us
I20260709 12:29:49.190001 10280 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:49.280150  3856 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:29:49.294445  3928 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:29:49.303898  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:49.305519  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:49.310012  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:49.313474 10280 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 18 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:49.314487 10280 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.316818  3969 leader_election.cc:400] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Vote denied by peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843) with higher term. Message: Invalid argument: T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17.
I20260709 12:29:49.320286  9944 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:29:49.326155 10084 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:29:49.326361  4002 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
W20260709 12:29:49.345119  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 43657.2us
I20260709 12:29:49.351039  3998 raft_consensus.cc:2468] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:29:49.368047  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb" is_pre_election: true
I20260709 12:29:49.351464  9944 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:49.376498  9944 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.378899  9944 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:49.380879 10369 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:49.384925  4572 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 17.
I20260709 12:29:49.413372  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:49.417186  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:49.422390  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 69972.2us
I20260709 12:29:49.423178  4538 leader_election.cc:304] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:49.434432  4565 raft_consensus.cc:1275] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:29:49.427548 10280 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:49.429219 10371 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:29:49.465864  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 82877us
I20260709 12:29:49.434839 10364 raft_consensus.cc:2804] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:49.472754  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:29:49.481427 10403 log.cc:927] Time spent T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: Append to log took a long time: real 0.063s	user 0.001s	sys 0.001s
I20260709 12:29:49.481717 10364 raft_consensus.cc:697] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:49.465842 10280 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:49.501312  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
W20260709 12:29:49.503645  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 63083.9us
I20260709 12:29:49.512295  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:49.513149  3932 raft_consensus.cc:2393] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe in current term 17: Already voted for candidate 073f84fcc295417f9bcc1eea29d2bb58 in this term.
I20260709 12:29:49.516801 10364 consensus_queue.cc:237] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.478545 10371 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 17 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:49.556564  3822 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:49.506001 10280 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:49.565673 10356 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.567027  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:49.568289 10356 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:49.567078  3999 raft_consensus.cc:2368] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 18. Current term is 19.
W20260709 12:29:49.575318 10404 log.cc:927] Time spent T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58: Append to log took a long time: real 0.221s	user 0.002s	sys 0.000s
I20260709 12:29:49.578339 10412 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:49.578913 10412 raft_consensus.cc:697] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:49.579823 10412 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.582135 10402 consensus_queue.cc:1048] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:29:49.587109  3998 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:29:49.597620 10399 log.cc:927] Time spent T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:29:49.598060  4538 leader_election.cc:400] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 election: Vote denied by peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709) with higher term. Message: Invalid argument: T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cab225ecb7488386a1a19239498cfe for earlier term 18. Current term is 19.
W20260709 12:29:49.611464  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 70355.8us
I20260709 12:29:49.614531  4567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:49.629773  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ec95afb9e240f29bd517e63249c8d2" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:49.630407  3848 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:29:49.637148 10405 log.cc:927] Time spent T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: Append to log took a long time: real 0.200s	user 0.002s	sys 0.000s
I20260709 12:29:49.639971  4002 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:29:49.642019  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:49.642719  4002 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 17.
I20260709 12:29:49.642764 10371 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.649295  3848 raft_consensus.cc:2468] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:29:49.627049 10247 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:29:49.649356 10280 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.676237  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:49.682578 10031 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:29:49.696751 10280 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:49.697778  4570 raft_consensus.cc:2393] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 34711da9380944d2969a2bc3e203db3d in current term 18: Already voted for candidate f3cab225ecb7488386a1a19239498cfe in this term.
I20260709 12:29:49.699498  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:49.719310  3969 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:49.720953 10402 raft_consensus.cc:2804] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:49.721470 10402 raft_consensus.cc:697] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:49.722105  4566 raft_consensus.cc:1240] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:49.723889 10410 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:29:49.724364 10410 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:49.724710 10410 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:49.726163  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:49.754807 10402 consensus_queue.cc:237] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.757694  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:29:49.767666 10417 log.cc:927] Time spent T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:29:49.772974  4538 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:49.750124 10247 consensus_queue.cc:1059] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:29:49.819024 10416 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:29:49.821903 10247 raft_consensus.cc:3055] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:49.822362 10247 raft_consensus.cc:740] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:49.823251 10247 consensus_queue.cc:260] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.824600 10247 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:49.836146  3848 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 18. Current term is 19. Ops: []
W20260709 12:29:49.837348  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 64458us
W20260709 12:29:49.840620 10420 log.cc:927] Time spent T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:29:49.854353  4566 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:49.848577 10416 consensus_queue.cc:1059] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:29:49.860627 10280 raft_consensus.cc:3055] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:29:49.861047 10280 raft_consensus.cc:740] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:49.861896 10280 consensus_queue.cc:260] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.862862 10280 raft_consensus.cc:3060] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:49.868359 10203 consensus_queue.cc:1059] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:49.894721  3852 raft_consensus.cc:1240] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Rejecting Update request from peer 34711da9380944d2969a2bc3e203db3d for earlier term 16. Current term is 17. Ops: []
I20260709 12:29:49.895995 10203 raft_consensus.cc:3055] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:49.940148  3749 catalog_manager.cc:5697] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 14 to 15, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 15 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:49.942504 10203 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:49.954867 10120 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:49.961210 10410 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:49.963613 10410 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:49.972116  3749 catalog_manager.cc:5697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 12 to 21. New cstate: current_term: 21 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:29:49.996330  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 51413.7us
I20260709 12:29:49.954825  3755 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51802 (request call id 338) took 2872 ms. Trace:
I20260709 12:29:50.012226  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:50.012923  4001 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:50.014773  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:49.999037  3755 rpcz_store.cc:276] 0709 12:29:47.082430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:47.088450 (+  6020us) service_pool.cc:224] Handling call
0709 12:29:49.954590 (+2866140us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:47.937786 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:47.938318 (+   532us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:47.938351 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:29:47.938368 (+    17us) tablet.cc:662] Decoding operations
0709 12:29:47.940105 (+  1737us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:47.940187 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:47.940960 (+   773us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:29:47.972243 (+ 31283us) tablet.cc:701] Row locks acquired
0709 12:29:47.972262 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:29:47.972398 (+   136us) write_op.cc:270] Start()
0709 12:29:47.972518 (+   120us) write_op.cc:276] Timestamp: P: 1783600187972360 usec, L: 0
0709 12:29:47.972541 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:29:47.983724 (+ 11183us) log.cc:844] Serialized 10058 byte log entry
0709 12:29:47.995756 (+ 12032us) op_driver.cc:464] REPLICATION: finished
0709 12:29:47.996290 (+   534us) write_op.cc:301] APPLY: starting
0709 12:29:47.996368 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:48.221871 (+225503us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:48.242001 (+ 20130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:49.230211 (+988210us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:49.291542 (+ 61331us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 12:29:49.291614 (+    72us) write_op.cc:312] APPLY: finished
0709 12:29:49.292273 (+   659us) log.cc:844] Serialized 228 byte log entry
0709 12:29:49.418237 (+125964us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:49.418957 (+   720us) write_op.cc:454] Released schema lock
0709 12:29:49.419093 (+   136us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:49.505322 (+ 86229us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:49.506964 (+  1642us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8064,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":280,"apply.run_cpu_time_us":79113,"apply.run_wall_time_us":1473304,"cfile_cache_hit":104,"cfile_cache_hit_bytes":108576,"num_ops":26,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":6593,"prepare.run_wall_time_us":46259,"replication_time_us":23025,"spinlock_wait_cycles":56192,"thread_start_us":125418,"threads_started":1,"wal-append.queue_time_us":125870}]]}
I20260709 12:29:50.048623 10424 consensus_queue.cc:1059] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 12:29:50.049494 10424 consensus_queue.cc:1243] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Peer 4eedd844c09d456ca0b3614490dd1dbb log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:29:50.052479 10203 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:50.054129 10203 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:50.058692  3749 catalog_manager.cc:5697] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 9 to 11, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 11 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:50.042411 10120 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:29:50.062131  3749 catalog_manager.cc:5697] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 13 to 16, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 16 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:50.062287  4001 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 18.
I20260709 12:29:50.077756  4001 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:29:50.065765  3749 catalog_manager.cc:5697] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 6 to 14, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 14 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:50.086678  3897 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:50.092949 10416 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:29:50.094051 10400 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:50.100554 10400 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:50.101743 10400 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:50.105566  4001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:44346
I20260709 12:29:50.106324  4001 raft_consensus.cc:606] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:50.106701  3998 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 12:29:50.107168  3998 pending_rounds.cc:85] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: Aborting all ops after (but not including) 11
I20260709 12:29:50.107429  3998 pending_rounds.cc:107] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:29:50.107707  3998 raft_consensus.cc:2889] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:50.116389  3848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:50.117053  3848 raft_consensus.cc:606] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:50.117112  4565 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:29:50.127018  3999 raft_consensus.cc:1240] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 18. Current term is 19. Ops: []
I20260709 12:29:50.131443  3925 raft_consensus.cc:1275] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:29:50.132174  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:44346
I20260709 12:29:50.132831  3999 raft_consensus.cc:606] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 21 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:50.126176 10409 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:29:50.137032 10032 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:50.138800 10355 consensus_queue.cc:1048] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:50.148747 10426 raft_consensus.cc:993] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:29:50.149293 10426 raft_consensus.cc:1081] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 21 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:29:50.158129  4566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42516
I20260709 12:29:50.159279  4566 raft_consensus.cc:493] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:50.159727  4566 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:29:50.202558  3848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:50.203233  3848 raft_consensus.cc:606] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:50.232079 10320 raft_consensus.cc:993] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:29:50.232758 10320 raft_consensus.cc:1081] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:29:50.240113  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:29:50.242090  3924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43302
I20260709 12:29:50.242889  3924 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:50.243336  3924 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:50.244554  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:50.252053  4566 raft_consensus.cc:515] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:50.245779  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:50.271190  3923 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:50.280455  4565 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 12:29:50.318217  4565 pending_rounds.cc:85] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 14
I20260709 12:29:50.318614  4565 pending_rounds.cc:107] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:29:50.318928  4565 raft_consensus.cc:2889] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:50.332520  4566 leader_election.cc:290] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:50.330420  3924 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:50.339965  4000 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 17. Current term is 18. Ops: []
I20260709 12:29:50.343585  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:50.350492  4000 raft_consensus.cc:3055] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:29:50.350814  4000 raft_consensus.cc:740] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:50.353381  3848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:50.354074  3848 raft_consensus.cc:3055] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:29:50.354496  3848 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:50.356161  3924 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:50.334681 10426 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:29:50.357244  3848 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:50.362952  3848 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:50.363981  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7d3aec426d4ef7aa5adcd0ab4c8da2" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:50.363896  4000 consensus_queue.cc:260] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:50.364660  3849 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:29:50.365411  4000 raft_consensus.cc:3060] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:29:50.369211 10396 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:29:50.372630  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:50.375527  3998 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:29:50.372597 10421 raft_consensus.cc:3055] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:50.378433 10421 raft_consensus.cc:740] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:50.372627 10416 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:29:50.389971 10416 consensus_queue.cc:1243] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:29:50.413360  3855 raft_consensus.cc:1275] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:29:50.426357 10402 consensus_queue.cc:1048] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:29:50.438230  3998 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:50.439497  3897 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:50.440296 10410 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:29:50.440774 10410 raft_consensus.cc:697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:50.441674 10410 consensus_queue.cc:237] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:50.456182  4000 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 22.
I20260709 12:29:50.460074  4538 leader_election.cc:304] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:50.464052  3849 raft_consensus.cc:2468] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 22.
I20260709 12:29:50.421813  3848 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:29:50.480545 10416 raft_consensus.cc:2804] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:29:50.519670 10416 raft_consensus.cc:697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 22 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:50.551779  3925 raft_consensus.cc:1240] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 LEADER]: Rejecting Update request from peer f3cab225ecb7488386a1a19239498cfe for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:29:50.551923 10416 consensus_queue.cc:237] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:50.554639 10247 raft_consensus.cc:993] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:29:50.555222 10247 raft_consensus.cc:1081] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:29:50.555981 10364 consensus_queue.cc:1059] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:29:50.556818 10364 consensus_queue.cc:1243] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Peer 073f84fcc295417f9bcc1eea29d2bb58 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:29:50.566042  4002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36530
I20260709 12:29:50.566679  4002 raft_consensus.cc:493] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:50.567075  4002 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:50.586869 10421 consensus_queue.cc:260] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:50.598502  4002 raft_consensus.cc:515] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:50.606680  4002 leader_election.cc:290] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:29:50.603749 10421 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:50.633955  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:50.634871  3852 raft_consensus.cc:3055] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:50.635308  3852 raft_consensus.cc:740] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:50.636404  3852 consensus_queue.cc:260] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:50.670769  3852 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:50.687883  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc613acf018f4e72bbca376671df9f71" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:50.688597  3923 raft_consensus.cc:3060] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:50.710758  3755 catalog_manager.cc:5697] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 12 to 20. New cstate: current_term: 20 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:50.712391  3755 catalog_manager.cc:5697] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 15 to 18, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 18 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:50.724143 10358 raft_consensus.cc:993] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:29:50.724704 10358 raft_consensus.cc:1081] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:29:50.725278  3998 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:29:50.717657  3923 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:50.742769  3755 catalog_manager.cc:5697] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:50.752400  3970 leader_election.cc:304] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:50.753064  3925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43306
I20260709 12:29:50.753639  3925 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:50.753952 10426 raft_consensus.cc:2804] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:50.754664 10426 raft_consensus.cc:697] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:50.755625 10426 consensus_queue.cc:237] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:50.754033  3925 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:50.744997  3755 catalog_manager.cc:5697] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 17 to 20, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 20 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:50.759050  3852 raft_consensus.cc:2468] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:29:50.762897 10441 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:29:50.759857  3755 catalog_manager.cc:5697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 13 to 14, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 14 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:50.771534  4566 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:29:50.771970  4566 pending_rounds.cc:85] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Aborting all ops after (but not including) 13
I20260709 12:29:50.772204  4566 pending_rounds.cc:107] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:29:50.772444  4566 raft_consensus.cc:2889] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:50.770749  3925 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:50.780622  3852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:50.781354  3852 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:50.782692 10208 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:29:50.789424  3925 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:50.817350  3852 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:50.820216  3895 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:50.822924  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8fdf36221e4313b4289cb50019ec4f" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:50.823473  4002 raft_consensus.cc:3055] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:50.823783  4002 raft_consensus.cc:740] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:50.826521  4002 consensus_queue.cc:260] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:50.825539 10441 raft_consensus.cc:2804] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:50.828075 10441 raft_consensus.cc:697] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:50.828991 10441 consensus_queue.cc:237] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:50.835933  4002 raft_consensus.cc:3060] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:50.883361  4002 raft_consensus.cc:2468] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:29:50.892740  3749 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51804 (request call id 334) took 3402 ms. Trace:
I20260709 12:29:50.893219  3749 rpcz_store.cc:276] 0709 12:29:47.490493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:47.490695 (+   202us) service_pool.cc:224] Handling call
0709 12:29:47.588368 (+ 97673us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b5400046ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f41090 00007fe051fdff3a 00007fe057d95e9c 00007fe057e9404e 00007fe0563552a4 00007fe056355232 00007fe056355161 00007fe0563550dc 00007fe056354392 00007fe05031248c 00007fe0503118c6
0709 12:29:47.596910 (+  8542us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b5400010810. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe04ed72db1 00007fe04eeb3640 00007fe057d8a846 00007fe057e9490e 00007fe0563552a4 00007fe056355232 00007fe056355161 00007fe0563550dc 00007fe056354392 00007fe05031248c 00007fe0503118c6
0709 12:29:50.892670 (+3295760us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:50.250548 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:50.251193 (+   645us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:50.251248 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:29:50.251272 (+    24us) tablet.cc:662] Decoding operations
0709 12:29:50.252023 (+   751us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:50.252142 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:50.252173 (+    31us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:29:50.252843 (+   670us) tablet.cc:701] Row locks acquired
0709 12:29:50.252887 (+    44us) write_op.cc:260] PREPARE: finished
0709 12:29:50.253051 (+   164us) write_op.cc:270] Start()
0709 12:29:50.253203 (+   152us) write_op.cc:276] Timestamp: P: 1783600190252987 usec, L: 0
0709 12:29:50.253221 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:29:50.254676 (+  1455us) log.cc:844] Serialized 2044 byte log entry
0709 12:29:50.274934 (+ 20258us) op_driver.cc:464] REPLICATION: finished
0709 12:29:50.284101 (+  9167us) write_op.cc:301] APPLY: starting
0709 12:29:50.284203 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:50.339173 (+ 54970us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:50.361946 (+ 22773us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:50.432753 (+ 70807us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:50.450202 (+ 17449us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:29:50.450248 (+    46us) write_op.cc:312] APPLY: finished
0709 12:29:50.450485 (+   237us) log.cc:844] Serialized 57 byte log entry
0709 12:29:50.482691 (+ 32206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:50.485581 (+  2890us) write_op.cc:454] Released schema lock
0709 12:29:50.488514 (+  2933us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:50.510117 (+ 21603us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:50.510150 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":113080,"reported_tablets":46,"spinlock_wait_cycles":113657472,"child_traces":[["op",{"apply.queue_time_us":8915,"apply.run_cpu_time_us":10721,"apply.run_wall_time_us":225977,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25007,"num_ops":5,"prepare.queue_time_us":35174,"prepare.run_cpu_time_us":3737,"prepare.run_wall_time_us":4480,"replication_time_us":21550,"thread_start_us":48604,"threads_started":2}]]}
I20260709 12:29:50.950950  3852 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:29:50.952581 10441 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:50.970335  3998 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:29:50.974205 10441 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:50.977710  3755 catalog_manager.cc:5697] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 15 to 16, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 16 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:50.979660  3755 catalog_manager.cc:5697] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 16 to 18, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 18 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:50.981650  3755 catalog_manager.cc:5697] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 14 to 15, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 15 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:50.983448  3755 catalog_manager.cc:5697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 13 to 14, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 14 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:51.028842  3749 catalog_manager.cc:5697] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 15 to 17, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 17 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:51.042917  4002 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 22 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:29:51.045183 10421 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:29:51.075722  3749 catalog_manager.cc:5697] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 7 to 19. New cstate: current_term: 19 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:51.077476  3749 catalog_manager.cc:5697] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 13 to 18, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 18 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:51.079377  3749 catalog_manager.cc:5697] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 14 to 15, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 15 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:51.080925  3749 catalog_manager.cc:5697] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 13 to 18, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 18 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:51.082165  3749 catalog_manager.cc:5697] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:51.181207  3852 raft_consensus.cc:1275] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 22 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:29:51.182739 10416 consensus_queue.cc:1048] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:29:51.198587  3751 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39516 (request call id 224) took 79340 ms (client timeout 15000 ms). Trace:
W20260709 12:29:51.199007  3751 rpcz_store.cc:269] 0709 12:28:31.858497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:31.889599 (+ 31102us) service_pool.cc:224] Handling call
0709 12:28:34.299933 (+2410334us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b5400046ad4. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f41090 00007fe051fdff3a 00007fe057d95e9c 00007fe057e9404e 00007fe0563552a4 00007fe056355232 00007fe056355161 00007fe0563550dc 00007fe056354392 00007fe05031248c 00007fe0503118c6
0709 12:29:51.198367 (+76898434us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":364220,"reported_tablets":38,"spinlock_wait_cycles":70724480}
I20260709 12:29:51.200753  3749 catalog_manager.cc:5697] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 21 to 22, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 22 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:51.204345  3923 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:51.214272  3855 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:51.206699 10203 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:29:51.217793 10410 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
W20260709 12:29:51.239430  3753 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39516 (request call id 226) took 37021 ms (client timeout 15000 ms). Trace:
W20260709 12:29:51.241169  3753 rpcz_store.cc:269] 0709 12:29:14.218247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:14.218524 (+   277us) service_pool.cc:224] Handling call
0709 12:29:51.239223 (+37020699us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4132063,"reported_tablets":39}
I20260709 12:29:51.287154  3849 raft_consensus.cc:1275] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:51.288480 10426 consensus_queue.cc:1048] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:51.327368  4002 raft_consensus.cc:1275] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:51.329010 10208 consensus_queue.cc:1048] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:51.362287  3746 catalog_manager.cc:5697] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 12 to 14, leader changed from f3cab225ecb7488386a1a19239498cfe (127.2.157.4) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 14 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:51.484050  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:29:51.575466  3746 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51798 (request call id 323) took 13134 ms (client timeout 15000 ms). Trace:
W20260709 12:29:51.576097  3746 rpcz_store.cc:269] 0709 12:29:38.440645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:38.440901 (+   256us) service_pool.cc:224] Handling call
0709 12:29:51.575367 (+13134466us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:29:51.405284 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:29:51.405842 (+   558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:29:51.405899 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:29:51.405923 (+    24us) tablet.cc:662] Decoding operations
0709 12:29:51.406280 (+   357us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:29:51.406340 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:29:51.406372 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:29:51.406572 (+   200us) tablet.cc:701] Row locks acquired
0709 12:29:51.406588 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:29:51.406731 (+   143us) write_op.cc:270] Start()
0709 12:29:51.406851 (+   120us) write_op.cc:276] Timestamp: P: 1783600191406685 usec, L: 0
0709 12:29:51.406872 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:29:51.407506 (+   634us) log.cc:844] Serialized 530 byte log entry
0709 12:29:51.409845 (+  2339us) op_driver.cc:464] REPLICATION: finished
0709 12:29:51.415398 (+  5553us) write_op.cc:301] APPLY: starting
0709 12:29:51.418249 (+  2851us) tablet.cc:1367] starting BulkCheckPresence
0709 12:29:51.419092 (+   843us) tablet.cc:1370] finished BulkCheckPresence
0709 12:29:51.419191 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:29:51.419881 (+   690us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:29:51.420021 (+   140us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:29:51.420065 (+    44us) write_op.cc:312] APPLY: finished
0709 12:29:51.420247 (+   182us) log.cc:844] Serialized 25 byte log entry
0709 12:29:51.420413 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:51.420495 (+    82us) write_op.cc:454] Released schema lock
0709 12:29:51.420540 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:29:51.420894 (+   354us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:29:51.420926 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22839,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":204,"apply.run_cpu_time_us":2731,"apply.run_wall_time_us":5451,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4176,"num_ops":1,"prepare.queue_time_us":131,"prepare.run_cpu_time_us":2515,"prepare.run_wall_time_us":2515,"replication_time_us":2841}]]}
I20260709 12:29:51.639737 10321 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:51.640411 10321 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:51.642769 10321 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:51.654644  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:29:51.655424  4565 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 18.
I20260709 12:29:51.675623  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:29:51.738867  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 63349.7us
I20260709 12:29:51.683975  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:29:51.740310  3998 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 18.
I20260709 12:29:51.728960  3923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:29:51.741001  3923 raft_consensus.cc:606] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:51.742890 10032 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:29:51.743422 10032 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:51.743877 10032 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:29:51.788430  3747 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51798 (request call id 322) took 32701 ms (client timeout 15000 ms). Trace:
W20260709 12:29:51.788991  3747 rpcz_store.cc:269] 0709 12:29:19.087482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:19.087755 (+   273us) service_pool.cc:224] Handling call
0709 12:29:51.788306 (+32700551us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41474,"reported_tablets":47}
I20260709 12:29:51.810428  3925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:29:51.811197  3925 raft_consensus.cc:606] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:51.822057  3748 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39516 (request call id 225) took 59764 ms (client timeout 15000 ms). Trace:
W20260709 12:29:51.841933  3748 rpcz_store.cc:269] 0709 12:28:52.057617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:52.058010 (+   393us) service_pool.cc:224] Handling call
0709 12:29:51.821951 (+59763941us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":763771,"reported_tablets":39}
I20260709 12:29:51.968075  3925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:29:51.968891  3925 raft_consensus.cc:606] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:29:51.975322  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 46483.7us
W20260709 12:29:51.986073  3752 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51804 (request call id 332) took 42311 ms (client timeout 15000 ms). Trace:
W20260709 12:29:51.986588  3752 rpcz_store.cc:269] 0709 12:29:09.643451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:09.643734 (+   283us) service_pool.cc:224] Handling call
0709 12:29:51.951923 (+42308189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7786,"reported_tablets":46}
I20260709 12:29:51.998600  3923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:29:51.999262  3923 raft_consensus.cc:606] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Received request to transfer leadership to TS f3cab225ecb7488386a1a19239498cfe
I20260709 12:29:52.017004 10032 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:52.058837 10032 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:52.067237  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:52.067939  4566 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:52.072813  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:52.073642  3998 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:52.085969  4566 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 19.
I20260709 12:29:52.087925  4002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:44346
I20260709 12:29:52.088513  4002 raft_consensus.cc:606] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:52.098891 10469 raft_consensus.cc:993] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:52.099581 10469 raft_consensus.cc:1081] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:52.100800  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:29:52.103618  3855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:29:52.104228 10469 raft_consensus.cc:993] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:52.104261  3855 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:52.104969  3855 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:52.104965 10469 raft_consensus.cc:1081] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:52.109855  3849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:29:52.110461  3849 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:52.110841  3849 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:52.087532  3822 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:52.114595 10461 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:52.115077 10461 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:52.115876 10461 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:52.116228  3855 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:52.118353  3855 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:52.122421  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:52.123004  4002 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:52.123827  3998 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 19.
I20260709 12:29:52.124297  3849 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:52.120244  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:52.125304  3925 raft_consensus.cc:3055] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:52.127101  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:52.127460  3849 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:52.127712  3923 raft_consensus.cc:3055] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:29:52.128072  3923 raft_consensus.cc:740] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:52.125636  3925 raft_consensus.cc:740] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:52.128859  3923 consensus_queue.cc:260] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:52.129488  3925 consensus_queue.cc:260] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:52.130453  3923 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:52.136869 10208 raft_consensus.cc:993] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:29:52.137394 10208 raft_consensus.cc:1081] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Signalling peer f3cab225ecb7488386a1a19239498cfe to start an election
I20260709 12:29:52.139222  4565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea"
dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
 from {username='slave'} at 127.0.0.1:42178
I20260709 12:29:52.139794  4565 raft_consensus.cc:493] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:52.140136  4565 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:52.140828  3923 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 19.
I20260709 12:29:52.142201  3821 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:52.143052 10032 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:52.143764 10032 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:52.144707 10032 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:52.151659  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:52.152207  4566 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:29:52.152873  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 56359.7us
W20260709 12:29:52.155709  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 70483.5us
I20260709 12:29:52.162139  4566 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 19.
I20260709 12:29:52.166829  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:52.167836  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:52.168301  4565 raft_consensus.cc:515] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:52.170740  4002 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:52.179275  3822 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:52.195887 10032 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:52.196655 10032 raft_consensus.cc:697] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:52.199189 10032 consensus_queue.cc:237] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:52.212388  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:52.213039  3923 raft_consensus.cc:3055] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:29:52.213366  3923 raft_consensus.cc:740] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:52.214205  3923 consensus_queue.cc:260] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:52.215265  3923 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:52.221650  3925 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:52.239915  3923 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
I20260709 12:29:52.247397  4565 leader_election.cc:290] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:52.247695  4537 leader_election.cc:304] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:52.249754  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8cb467dd69d4e7785fd70c9c63614ea" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:52.250530  4000 raft_consensus.cc:3060] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:29:52.254879 10464 raft_consensus.cc:2804] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:29:52.255460 10464 raft_consensus.cc:697] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 17 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:29:52.256366 10464 consensus_queue.cc:237] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:52.273168  4002 raft_consensus.cc:1240] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Rejecting Update request from peer 073f84fcc295417f9bcc1eea29d2bb58 for earlier term 14. Current term is 15. Ops: []
W20260709 12:29:52.290874  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 111721us
I20260709 12:29:52.299350  3925 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
W20260709 12:29:52.306392  3754 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39516 (request call id 227) took 18567 ms (client timeout 15000 ms). Trace:
W20260709 12:29:52.306833  3754 rpcz_store.cc:269] 0709 12:29:33.739114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:33.739356 (+   242us) service_pool.cc:224] Handling call
0709 12:29:52.306197 (+18566841us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":563873,"reported_tablets":39}
I20260709 12:29:52.343657  4000 raft_consensus.cc:2468] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
W20260709 12:29:52.379287  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 56114.4us
I20260709 12:29:52.390535 10441 raft_consensus.cc:993] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:52.391098 10441 raft_consensus.cc:1081] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:52.396934  3854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:29:52.397461  3854 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:52.397822  3854 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:52.408857  3854 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:52.421558  3854 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:52.423101  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:52.423671  4000 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:52.425261  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:52.426017  3923 raft_consensus.cc:3055] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:29:52.426301  3923 raft_consensus.cc:740] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:52.427011  3923 consensus_queue.cc:260] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:52.429085  3923 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:29:52.434325  4000 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:52.445032  3822 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:52.445940 10032 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:29:52.446653 10032 raft_consensus.cc:697] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:52.447131  3750 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39516 (request call id 228) took 2477 ms. Trace:
I20260709 12:29:52.447449 10032 consensus_queue.cc:237] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:52.458148  3750 rpcz_store.cc:276] 0709 12:29:49.958230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:49.958634 (+   404us) service_pool.cc:224] Handling call
0709 12:29:52.435191 (+2476557us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104221,"reported_tablets":39}
I20260709 12:29:52.478931  3923 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 16.
I20260709 12:29:52.490940  3754 catalog_manager.cc:5697] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 18 to 19, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 19 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:52.499806  3754 catalog_manager.cc:5697] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:52.501493  3754 catalog_manager.cc:5697] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 14 to 15, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 15 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:52.503072  3754 catalog_manager.cc:5697] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 15 to 16, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 16 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:52.497910  3750 catalog_manager.cc:5697] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 16 to 17, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 17 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:52.536042  4002 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:29:52.538285 10483 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:29:52.562920 10471 raft_consensus.cc:993] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:52.563501 10471 raft_consensus.cc:1081] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:52.567339  3849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42066
I20260709 12:29:52.567979  3849 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:52.568368  3849 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:52.583802  3849 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:52.585915  3849 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Requested vote from peers 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:52.586936  4566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:52.595099  4566 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:52.587637  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:52.598541  4000 raft_consensus.cc:3055] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:29:52.598899  4000 raft_consensus.cc:740] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:52.604161  4000 consensus_queue.cc:260] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:52.605341  4000 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:52.646973  3923 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:29:52.653064  4566 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 19.
I20260709 12:29:52.657629  4000 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 19.
I20260709 12:29:52.663590  3822 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:52.665434  3923 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:29:52.673000 10032 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:29:52.675335 10461 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:52.682229 10461 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:52.683225 10461 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:52.686864  3925 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:29:52.688347 10480 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:29:52.671273 10459 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 12:29:52.695281  4566 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:29:52.725354 10032 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:29:52.740274  4002 raft_consensus.cc:1275] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:29:52.741797  4565 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:29:52.747995 10460 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:29:52.754153 10458 consensus_queue.cc:1048] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 12:29:52.875885  4001 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:29:52.892088 10474 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:52.987102  3925 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:29:52.990916 10474 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:29:53.023630  3998 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:29:53.028721 10474 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:29:53.126910  3754 catalog_manager.cc:5697] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 18 to 19, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 19 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:53.170219  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 63260.5us
I20260709 12:29:53.254963  4565 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:29:53.256642 10032 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:29:53.301467  3998 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:29:53.303930 10474 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:29:53.426368  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:29:53.728374  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 80002.2us
W20260709 12:29:53.730058  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 79634.1us
W20260709 12:29:53.737355  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 54519.7us
W20260709 12:29:53.783507  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 131957us
I20260709 12:29:53.841951  3854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ff60edb937844e9aaed043337660571"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:53.842614  3854 raft_consensus.cc:606] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:29:53.844519  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:29:53.846546  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:53.847380  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:29:53.963940  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 44246.6us
W20260709 12:29:54.011124  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 85929.4us
I20260709 12:29:54.318688 10527 raft_consensus.cc:993] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:29:54.351045 10032 raft_consensus.cc:1081] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:29:54.377854  3925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ff60edb937844e9aaed043337660571"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43302
I20260709 12:29:54.378508  3925 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:54.378887  3925 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:54.395275  3925 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:54.412485  3849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:54.413070  3849 raft_consensus.cc:3055] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:29:54.413260  3849 raft_consensus.cc:740] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:54.415740  3925 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:54.416708  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff60edb937844e9aaed043337660571" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:54.417312  3998 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:54.420027  3849 consensus_queue.cc:260] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:54.426211  3849 raft_consensus.cc:3060] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:54.431805  3998 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 20.
I20260709 12:29:54.433144  3897 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:29:54.435107 10368 raft_consensus.cc:2804] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:29:54.435595 10368 raft_consensus.cc:697] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:54.443564  3849 raft_consensus.cc:2468] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 20.
I20260709 12:29:54.444800 10368 consensus_queue.cc:237] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:54.546597  3750 catalog_manager.cc:5697] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 19 to 20, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 20 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:54.904937  3998 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:29:54.907552 10516 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:29:54.967396  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:29:55.027031  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 87392.2us
I20260709 12:29:55.050951  3925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:29:55.051553  3925 raft_consensus.cc:606] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:55.060736  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:29:55.070969  3854 raft_consensus.cc:1275] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:29:55.072561 10368 consensus_queue.cc:1048] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:29:55.085942  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:55.089036  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:55.546204 10516 raft_consensus.cc:993] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:55.546741 10516 raft_consensus.cc:1081] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:55.549638  3854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:29:55.550233  3854 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:55.550585  3854 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:55.582474  3854 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:55.589221  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:55.589862  3927 raft_consensus.cc:3055] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:29:55.590198  3927 raft_consensus.cc:740] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:29:55.590957  3927 consensus_queue.cc:260] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:55.592105  3927 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:55.599628  3854 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:55.604817  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:55.605463  4002 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:29:55.602792  3927 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:55.626706  3821 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:55.628628  4002 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:29:55.629806 10529 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:29:55.635842 10529 raft_consensus.cc:697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:55.636709 10529 consensus_queue.cc:237] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:55.660570  3750 catalog_manager.cc:5697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 14 to 15, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 15 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:56.000279  4572 consensus_queue.cc:237] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:56.027333  3849 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:56.028941 10536 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:29:56.067726  4002 raft_consensus.cc:1275] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:29:56.080806 10521 consensus_queue.cc:1048] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:29:56.099490 10536 raft_consensus.cc:2955] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 3 to 10, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:56.118134  3849 raft_consensus.cc:2955] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 3 to 10, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:56.148262  3741 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 12:29:56.156646  3750 catalog_manager.cc:5697] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe reported cstate change: config changed from index 3 to 10, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New cstate: current_term: 15 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:29:56.207161  3927 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:29:56.221967 10529 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:56.225015  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:29:56.214543  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 228812us
I20260709 12:29:56.254261  4001 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:29:56.255769 10526 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:29:56.302824  3849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:56.303648  3849 raft_consensus.cc:606] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:56.314330  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:29:56.316075  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:56.316859  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:29:56.360420  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 91443.5us
W20260709 12:29:56.344249 10557 log.cc:927] Time spent T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:29:56.451717  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 60862.6us
W20260709 12:29:56.452903  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 91637.3us
W20260709 12:29:56.508234  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 49782.3us
W20260709 12:29:56.571883  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 62599.2us
I20260709 12:29:56.586009  3917 tablet_service.cc:1558] Processing DeleteTablet for tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 with delete_type TABLET_DATA_TOMBSTONED (TS 073f84fcc295417f9bcc1eea29d2bb58 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:44648
W20260709 12:29:56.592877 10544 log.cc:927] Time spent T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:29:56.642252 10589 tablet_replica.cc:333] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:29:56.692255 10589 raft_consensus.cc:2243] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:56.749748 10589 raft_consensus.cc:2272] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:56.790941 10589 ts_tablet_manager.cc:1916] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:29:56.816810  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 47259.8us
I20260709 12:29:56.823768  3998 raft_consensus.cc:2955] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 3 to 10, VOTER 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } } }
I20260709 12:29:56.868124 10583 raft_consensus.cc:993] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:29:56.868695 10583 raft_consensus.cc:1081] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
W20260709 12:29:56.904372  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 115951us
I20260709 12:29:56.906059  3998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36530
I20260709 12:29:56.906693  3998 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:56.907140  3998 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:56.922257  3998 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:56.938333  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:56.939011  3854 raft_consensus.cc:3055] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:29:56.939383  3854 raft_consensus.cc:740] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:56.941080  3998 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:56.941762  3854 consensus_queue.cc:260] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:56.947888  3854 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:56.988063  3854 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:29:56.990063  3969 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:56.995031 10550 raft_consensus.cc:2804] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:29:56.995638 10550 raft_consensus.cc:697] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:56.996565 10550 consensus_queue.cc:237] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:29:57.046363  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 106230us
I20260709 12:29:57.050812  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf4f0ff3c484df18d42d887c059c170" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:57.051560  4570 raft_consensus.cc:3060] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:29:57.059329  3750 catalog_manager.cc:5697] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 18 to 19, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 19 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:57.070675 10589 ts_tablet_manager.cc:1929] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.9
I20260709 12:29:57.071477 10589 log.cc:1199] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 073f84fcc295417f9bcc1eea29d2bb58: Deleting WAL directory at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/wals/2cd145ac0c9d4f1fbf7e300e3d5cd972
I20260709 12:29:57.095855  3740 catalog_manager.cc:5028] TS 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): tablet 2cd145ac0c9d4f1fbf7e300e3d5cd972 (table test-workload [id=d9414e0696b542ed971437326e01ed15]) successfully deleted
I20260709 12:29:57.103298  4570 raft_consensus.cc:2468] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:29:57.601729  3854 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:29:57.603080 10598 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:29:57.623805  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:57.650195  4570 raft_consensus.cc:1275] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:29:57.661978 10550 consensus_queue.cc:1048] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:29:57.782886  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 68794.9us
W20260709 12:29:57.830281  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 54252.7us
I20260709 12:29:57.889092  4002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:44346
I20260709 12:29:57.889756  4002 raft_consensus.cc:606] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:29:57.892488  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:29:57.933226  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:57.947698  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:58.029978 10622 raft_consensus.cc:993] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:58.031368 10614 raft_consensus.cc:1081] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:29:58.042907  3854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42066
I20260709 12:29:58.043560  3854 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:58.043974  3854 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:29:58.046883  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 111879us
I20260709 12:29:58.052172  3854 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:58.054680  3854 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:29:58.058909  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:29:58.059769  4002 raft_consensus.cc:3055] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:29:58.060374  4002 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:58.061308  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:29:58.062124  3927 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:58.070979  4002 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:29:58.072621  4002 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:29:58.078583  3927 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 20.
I20260709 12:29:58.080382  3821 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:29:58.087982 10616 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:29:58.088563 10616 raft_consensus.cc:697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:58.089690 10616 consensus_queue.cc:237] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:29:58.095058  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 258801us
I20260709 12:29:58.139120  4002 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 20.
I20260709 12:29:58.195452  3750 catalog_manager.cc:5697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 19 to 20, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 20 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:58.208153  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 54470.7us
I20260709 12:29:58.707983  3925 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:29:58.711345 10529 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:58.702864  3999 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:29:58.739100 10616 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:29:59.202571  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:59.364858  3854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d772c24bae14b138d4062798651f82f"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:29:59.365726  3854 raft_consensus.cc:606] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Received request to transfer leadership to TS 34711da9380944d2969a2bc3e203db3d
I20260709 12:29:59.368191  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:29:59.370280  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:59.371448  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:59.481115 10618 raft_consensus.cc:993] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:29:59.482003 10616 raft_consensus.cc:1081] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Signalling peer 34711da9380944d2969a2bc3e203db3d to start an election
I20260709 12:29:59.485482  3999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d772c24bae14b138d4062798651f82f"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
 from {username='slave'} at 127.0.0.1:36530
I20260709 12:29:59.486128  3999 raft_consensus.cc:493] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.486492  3999 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:59.503512  3999 raft_consensus.cc:515] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:59.507082  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:29:59.507858  3854 raft_consensus.cc:3055] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:29:59.508212  3854 raft_consensus.cc:740] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:29:59.509141  3854 consensus_queue.cc:260] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:59.510481  3854 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:59.551339  3999 leader_election.cc:290] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:29:59.551690  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d772c24bae14b138d4062798651f82f" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:29:59.552420  4572 raft_consensus.cc:3060] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:29:59.560833  4572 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:59.563097  3971 leader_election.cc:304] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:29:59.565383 10614 raft_consensus.cc:2804] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:29:59.565955 10614 raft_consensus.cc:697] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:29:59.567013 10614 consensus_queue.cc:237] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:29:59.581811  3854 raft_consensus.cc:2468] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:29:59.611644  3754 catalog_manager.cc:5697] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 17 to 18, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 18 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:00.080878  3855 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:30:00.084424 10622 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:30:00.149678  4570 raft_consensus.cc:1275] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:30:00.151314 10614 consensus_queue.cc:1048] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:30:00.477272  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:00.643085  3998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b"
dest_uuid: "34711da9380944d2969a2bc3e203db3d"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:44346
I20260709 12:30:00.643766  3998 raft_consensus.cc:606] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:00.647377  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:30:00.649194  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:00.650005  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:30:00.838519  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 50425us
I20260709 12:30:01.080401 10614 raft_consensus.cc:993] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:30:01.083343 10614 raft_consensus.cc:1081] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:30:01.105369  3854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42066
I20260709 12:30:01.106124  3854 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:01.106526  3854 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:30:01.163966  3854 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:01.169368  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:30:01.169993  3927 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:30:01.170785  3854 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:01.182376  3927 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 19.
I20260709 12:30:01.191323  3821 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:30:01.192611  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:30:01.193275  4002 raft_consensus.cc:3055] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:30:01.193550  4002 raft_consensus.cc:740] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:30:01.194092 10529 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:30:01.194651 10529 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:30:01.195550 10529 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:01.194464  4002 consensus_queue.cc:260] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:01.213104  4002 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:30:01.240337  4002 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 19.
I20260709 12:30:01.254658  3754 catalog_manager.cc:5697] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 18 to 19, leader changed from 34711da9380944d2969a2bc3e203db3d (127.2.157.3) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 19 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
W20260709 12:30:01.276337  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 71515.1us
I20260709 12:30:01.586526  3998 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:30:01.590858 10529 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:30:01.663081  3927 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:30:01.669724 10654 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:30:01.881052  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:01.986948  3855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
mode: GRACEFUL
new_leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:58174
I20260709 12:30:01.987612  3855 raft_consensus.cc:606] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 LEADER]: Received request to transfer leadership to TS 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:30:01.994333  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:30:01.996366  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:01.997327  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:02.516842 10670 raft_consensus.cc:993] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: : Instructing follower 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:30:02.517410 10670 raft_consensus.cc:1081] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 LEADER]: Signalling peer 073f84fcc295417f9bcc1eea29d2bb58 to start an election
I20260709 12:30:02.519218  3925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
 from {username='slave'} at 127.0.0.1:43302
I20260709 12:30:02.519819  3925 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:02.520188  3925 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:30:02.661470  3925 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:30:02.691808  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 116127us
I20260709 12:30:02.697115  3925 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 21 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:02.699769  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:30:02.700414  3998 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:30:02.710594  3998 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 21.
I20260709 12:30:02.712145  3897 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:30:02.713140 10625 raft_consensus.cc:2804] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:30:02.713864 10625 raft_consensus.cc:697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:30:02.714821 10625 consensus_queue.cc:237] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:02.742558  4000 raft_consensus.cc:1240] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Rejecting Update request from peer 4eedd844c09d456ca0b3614490dd1dbb for earlier term 20. Current term is 21. Ops: []
I20260709 12:30:02.743207  3754 catalog_manager.cc:5697] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 20 to 21, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 21 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:02.746568 10670 consensus_queue.cc:1059] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:30:02.757185 10670 raft_consensus.cc:3055] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:30:02.757596 10670 raft_consensus.cc:740] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:30:02.753854  3854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb5663ff7fe4055bcad8b1fe2d00403" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
I20260709 12:30:02.759039 10670 consensus_queue.cc:260] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:02.760418 10670 raft_consensus.cc:3060] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:30:02.811766  3854 raft_consensus.cc:2468] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 21.
I20260709 12:30:03.148816  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:03.243718  4000 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:30:03.245491 10656 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:30:03.258502  3854 raft_consensus.cc:1275] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:30:03.260174 10680 consensus_queue.cc:1048] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:30:03.616526  3925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852"
dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
mode: GRACEFUL
new_leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:45114
I20260709 12:30:03.617187  3925 raft_consensus.cc:606] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Received request to transfer leadership to TS 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:03.620662  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:30:03.622566  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:03.638236  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:03.854094 10690 raft_consensus.cc:993] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: : Instructing follower 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:30:03.854606 10690 raft_consensus.cc:1081] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Signalling peer 4eedd844c09d456ca0b3614490dd1dbb to start an election
I20260709 12:30:03.859061  3854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852"
dest_uuid: "4eedd844c09d456ca0b3614490dd1dbb"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:30:03.859622  3854 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:03.859977  3854 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:30:03.872155  3854 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:03.875516  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:30:03.876132  3925 raft_consensus.cc:3055] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:30:03.876426  3925 raft_consensus.cc:740] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:30:03.877236  3925 consensus_queue.cc:260] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:03.879506  3925 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:30:03.887221  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "4eedd844c09d456ca0b3614490dd1dbb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:30:03.887892  3998 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:30:03.892753  3854 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:03.911876  3998 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:30:03.913174  3822 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb; no voters: 
I20260709 12:30:03.914175 10670 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:30:03.914680 10670 raft_consensus.cc:697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Becoming Leader. State: Replica: 4eedd844c09d456ca0b3614490dd1dbb, State: Running, Role: LEADER
I20260709 12:30:03.915607 10670 consensus_queue.cc:237] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:03.932343  3925 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4eedd844c09d456ca0b3614490dd1dbb in term 15.
I20260709 12:30:03.954738  3747 catalog_manager.cc:5697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb reported cstate change: term changed from 14 to 15, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1). New cstate: current_term: 15 leader_uuid: "4eedd844c09d456ca0b3614490dd1dbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:04.321179  3999 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:30:04.322907 10529 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:30:04.381668  3927 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Refusing update from remote peer 4eedd844c09d456ca0b3614490dd1dbb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:30:04.383893 10529 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:30:04.466081  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 65686.8us
W20260709 12:30:04.476629  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 56448.7us
W20260709 12:30:04.491055  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 72285us
W20260709 12:30:04.531782  3822 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 50938.2us
I20260709 12:30:04.784991  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 1
I20260709 12:30:05.223474  2676 tablet_server.cc:179] TabletServer@127.2.157.1:0 shutting down...
W20260709 12:30:05.252079  3895 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 12:30:05.292831  3895 consensus_peers.cc:597] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.299573  3895 consensus_peers.cc:597] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.331638  4536 consensus_peers.cc:597] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.333226  4536 consensus_peers.cc:597] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.386116  3821 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 46208.3us
W20260709 12:30:05.390609  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 54034.9us
W20260709 12:30:05.420418  3969 consensus_peers.cc:597] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.419375  3895 consensus_peers.cc:597] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.423195  3969 consensus_peers.cc:597] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.424276  3969 consensus_peers.cc:597] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.425686  3969 consensus_peers.cc:597] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.464035  4536 consensus_peers.cc:597] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.466596  3969 consensus_peers.cc:597] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.467357  3969 consensus_peers.cc:597] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.472462  3895 consensus_peers.cc:597] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.477716  4536 consensus_peers.cc:597] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.522205  3969 consensus_peers.cc:597] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.521016  3895 consensus_peers.cc:597] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.546718  3895 consensus_peers.cc:597] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.553902  4536 consensus_peers.cc:597] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.554440  3895 consensus_peers.cc:597] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.554430  3969 consensus_peers.cc:597] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.559944  3895 consensus_peers.cc:597] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:05.575652  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:30:05.576606  3895 consensus_peers.cc:597] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:05.579363  2676 tablet_replica.cc:333] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
W20260709 12:30:05.582425  3895 consensus_peers.cc:597] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:05.594696  3895 consensus_peers.cc:597] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:05.599166  2676 raft_consensus.cc:2243] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.599908  2676 raft_consensus.cc:2272] T 6017f50df9e3498d929adc22812d22cf P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.602998  2676 tablet_replica.cc:333] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
W20260709 12:30:05.603446  4536 consensus_peers.cc:597] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:05.604028  2676 raft_consensus.cc:2243] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.604684  2676 raft_consensus.cc:2272] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 4eedd844c09d456ca0b3614490dd1dbb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.618862  2676 tablet_replica.cc:333] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
W20260709 12:30:05.624488  4536 consensus_peers.cc:597] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:05.631192  2676 raft_consensus.cc:2243] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.634974  2676 raft_consensus.cc:2272] T 26de30c1b5e74f05815f13d9ceea7f45 P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.637861  2676 tablet_replica.cc:333] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
W20260709 12:30:05.645378  3969 consensus_peers.cc:597] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:05.653359  2676 raft_consensus.cc:2243] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:30:05.654542  2676 raft_consensus.cc:2272] T 378a06c64b37451cbad82415b967e001 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.667047  2676 tablet_replica.cc:333] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.668072  2676 raft_consensus.cc:2243] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:30:05.670508  2676 raft_consensus.cc:2272] T 7d8564889b304f44b9b2b4ad6e5687c4 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:05.676726  3895 consensus_peers.cc:597] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:05.680786  2676 tablet_replica.cc:333] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
W20260709 12:30:05.684113  3895 consensus_peers.cc:597] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:05.688432  2676 raft_consensus.cc:2243] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.689234  2676 raft_consensus.cc:2272] T 4ff60edb937844e9aaed043337660571 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.692191  2676 tablet_replica.cc:333] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
W20260709 12:30:05.701382  4536 consensus_peers.cc:597] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:05.702791  2676 raft_consensus.cc:2243] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:30:05.705642  2676 raft_consensus.cc:2272] T 821e5786ae7e416cb9f41668b6ee4718 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.716146  2676 tablet_replica.cc:333] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.729444  2676 raft_consensus.cc:2243] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.730283  2676 raft_consensus.cc:2272] T ba2105a333194a478762048de8b5853c P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.733811  2676 tablet_replica.cc:333] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.747419  2676 raft_consensus.cc:2243] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.762463  2676 raft_consensus.cc:2272] T a196cfd02592426389eee8bd2a8edb36 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.772300  2676 tablet_replica.cc:333] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
W20260709 12:30:05.782716  4536 consensus_peers.cc:597] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:05.790649  2676 raft_consensus.cc:2243] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.791436  2676 raft_consensus.cc:2272] T d1e53a5bcc4f45a3a3ba300b44b04925 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.809305  2676 tablet_replica.cc:333] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.818785  2676 raft_consensus.cc:2243] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.819676  2676 raft_consensus.cc:2272] T a445f8740fa847ed9ac463915fa09725 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.822652  2676 tablet_replica.cc:333] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.823561  2676 raft_consensus.cc:2243] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.825388  2676 raft_consensus.cc:2272] T ac74d3d7308e4121b8d2bbb920bb9294 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.843271  2676 tablet_replica.cc:333] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.844264  2676 raft_consensus.cc:2243] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.866357  2676 raft_consensus.cc:2272] T 7185a57fbd78466ab6ccbbbd0453c2aa P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.869555  2676 tablet_replica.cc:333] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.870486  2676 raft_consensus.cc:2243] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:30:05.871803  2676 raft_consensus.cc:2272] T 9a955b1f59694973b581077ee60e7e4a P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.874538  2676 tablet_replica.cc:333] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.880384  2676 raft_consensus.cc:2243] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.881191  2676 raft_consensus.cc:2272] T 3d5f24773bb44448a1cb122558f0c4c9 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.884074  2676 tablet_replica.cc:333] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.888492  2676 raft_consensus.cc:2243] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:30:05.889667  2676 raft_consensus.cc:2272] T d70a29fa5e29440f92c76824dcf74449 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.892421  2676 tablet_replica.cc:333] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.902567  2676 raft_consensus.cc:2243] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.903471  2676 raft_consensus.cc:2272] T e10f480d05fc4f71af73fcd88b588f21 P 4eedd844c09d456ca0b3614490dd1dbb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.907985  2676 tablet_replica.cc:333] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.909410  2676 raft_consensus.cc:2243] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.910416  2676 raft_consensus.cc:2272] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.913230  2676 tablet_replica.cc:333] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.926613  2676 raft_consensus.cc:2243] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.927314  2676 raft_consensus.cc:2272] T 65ec95afb9e240f29bd517e63249c8d2 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.934967  2676 tablet_replica.cc:333] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.935981  2676 raft_consensus.cc:2243] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:30:05.937165  2676 raft_consensus.cc:2272] T e9a1caee5b3c48638d8c44f6919fb5ed P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.940088  2676 tablet_replica.cc:333] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.940915  2676 raft_consensus.cc:2243] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:05.941936  2676 raft_consensus.cc:2272] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.953850  2676 tablet_replica.cc:333] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.954778  2676 raft_consensus.cc:2243] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:30:05.955900  2676 raft_consensus.cc:2272] T e9c4439798ed4427881ec18a55649f4b P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.960573  2676 tablet_replica.cc:333] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.966187  2676 raft_consensus.cc:2243] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:30:05.967288  2676 raft_consensus.cc:2272] T 66c9e284191247a69a13f47c43baec1b P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.978160  2676 tablet_replica.cc:333] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.979183  2676 raft_consensus.cc:2243] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.979992  2676 raft_consensus.cc:2272] T ecfd004856c24015ae137dfd5fd34b2c P 4eedd844c09d456ca0b3614490dd1dbb [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.987809  2676 tablet_replica.cc:333] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.988726  2676 raft_consensus.cc:2243] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:05.989535  2676 raft_consensus.cc:2272] T 1fd9ef15e49a427d989c258ac6614daa P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:05.996480  2676 tablet_replica.cc:333] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:05.997303  2676 raft_consensus.cc:2243] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.002302  2676 raft_consensus.cc:2272] T dc613acf018f4e72bbca376671df9f71 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.004971  2676 tablet_replica.cc:333] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.005828  2676 raft_consensus.cc:2243] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:06.006847  2676 raft_consensus.cc:2272] T d5c03e098f9a45cd94c52ada1bc9fa11 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.012545  2676 tablet_replica.cc:333] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.014547  2676 raft_consensus.cc:2243] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.029597  2676 raft_consensus.cc:2272] T 2bf4f0ff3c484df18d42d887c059c170 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.054319  2676 tablet_replica.cc:333] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.055186  2676 raft_consensus.cc:2243] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.058111  2676 raft_consensus.cc:2272] T 274c43c8bd05433a8c00fffabbd5b8b7 P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.061074  2676 tablet_replica.cc:333] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.074894  2676 raft_consensus.cc:2243] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:30:06.076169  2676 raft_consensus.cc:2272] T 36aa23e03c114b66abce211a070a9c93 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.079068  2676 tablet_replica.cc:333] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.080024  2676 raft_consensus.cc:2243] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.080605  2676 raft_consensus.cc:2272] T 8d772c24bae14b138d4062798651f82f P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.085189  2676 tablet_replica.cc:333] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.088733  2676 raft_consensus.cc:2243] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.089502  2676 raft_consensus.cc:2272] T 3d9116f60a784d21bf919694ec32bdbb P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.092315  2676 tablet_replica.cc:333] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.098589  2676 raft_consensus.cc:2243] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.099504  2676 raft_consensus.cc:2272] T 86e92801c3904600b054e99343413645 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.116603  2676 tablet_replica.cc:333] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.129418  2676 raft_consensus.cc:2243] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:30:06.130703  2676 raft_consensus.cc:2272] T 9589deb8c4b64410a1f3793a7f6f1498 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.147784  2676 tablet_replica.cc:333] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.148685  2676 raft_consensus.cc:2243] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.149312  2676 raft_consensus.cc:2272] T ace1274bf4f34853b37ab7a08103d367 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.151934  2676 tablet_replica.cc:333] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.152736  2676 raft_consensus.cc:2243] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:06.178056  2676 raft_consensus.cc:2272] T 08e2bc60b69b4f4086209185a5fe10a4 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.199509  2676 tablet_replica.cc:333] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.206614  2676 raft_consensus.cc:2243] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.207442  2676 raft_consensus.cc:2272] T 2c8fdf36221e4313b4289cb50019ec4f P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.218560  2676 tablet_replica.cc:333] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.219426  2676 raft_consensus.cc:2243] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.222308  2676 raft_consensus.cc:2272] T eadf6ff4956f47ff8a85f77d02584a0d P 4eedd844c09d456ca0b3614490dd1dbb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.237609  2676 tablet_replica.cc:333] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.238518  2676 raft_consensus.cc:2243] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.246678  2676 raft_consensus.cc:2272] T 95a53a95fd9f44e59c1b1615b9281948 P 4eedd844c09d456ca0b3614490dd1dbb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.256108  2676 tablet_replica.cc:333] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.258517  2676 raft_consensus.cc:2243] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:06.266836  2676 raft_consensus.cc:2272] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.270218  2676 tablet_replica.cc:333] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.280284  2676 raft_consensus.cc:2243] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:06.282815  2676 raft_consensus.cc:2272] T 71bbfa14190c41d4a2fa5064e97996f1 P 4eedd844c09d456ca0b3614490dd1dbb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.285923  2676 tablet_replica.cc:333] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.286815  2676 raft_consensus.cc:2243] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.287593  2676 raft_consensus.cc:2272] T 415f89d9faf145eba38570ddee93ff31 P 4eedd844c09d456ca0b3614490dd1dbb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.290632  2676 tablet_replica.cc:333] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.291416  2676 raft_consensus.cc:2243] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.292040  2676 raft_consensus.cc:2272] T ebb5663ff7fe4055bcad8b1fe2d00403 P 4eedd844c09d456ca0b3614490dd1dbb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.294585  2676 tablet_replica.cc:333] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.295306  2676 raft_consensus.cc:2243] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.296144  2676 raft_consensus.cc:2272] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 4eedd844c09d456ca0b3614490dd1dbb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.298869  2676 tablet_replica.cc:333] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.299676  2676 raft_consensus.cc:2243] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:30:06.300941  2676 raft_consensus.cc:2272] T 008722eae8ea40db92fea0a5f70961f3 P 4eedd844c09d456ca0b3614490dd1dbb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.304364  2676 tablet_replica.cc:333] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.305124  2676 raft_consensus.cc:2243] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.305822  2676 raft_consensus.cc:2272] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 4eedd844c09d456ca0b3614490dd1dbb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:06.308940  2676 tablet_replica.cc:333] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb: stopping tablet replica
I20260709 12:30:06.309661  2676 raft_consensus.cc:2243] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:06.310408  2676 raft_consensus.cc:2272] T 812f8e58e6d54e67a0d699b41fc6815b P 4eedd844c09d456ca0b3614490dd1dbb [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:06.493227  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 79072.2us
W20260709 12:30:06.509220  3969 connection.cc:769] client connection to 127.2.157.1:32843 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:30:06.837895 10699 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:06.838542 10699 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:06.843096  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:30:06.843384 10699 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:30:06.852982  4536 leader_election.cc:336] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:06.853561  4536 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:06.854573 10699 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:30:06.889894 10720 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:06.890470 10720 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:06.893620  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
W20260709 12:30:06.911682  3895 leader_election.cc:336] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:06.912206  3895 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:06.913823 10703 raft_consensus.cc:2749] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:30:06.892668 10720 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:06.949355 10657 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:06.950356 10657 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:06.955924  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:30:06.961653 10724 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:06.962220 10724 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:06.964752 10724 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:06.970018  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:30:06.971915 10657 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:06.979063  3969 leader_election.cc:336] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:06.979588  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:06.980406 10657 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:30:06.983739 10699 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:06.984239 10699 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:06.984686  3969 leader_election.cc:336] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:06.985129  3969 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:06.987594 10699 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:06.990775  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:30:06.995291 10724 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:30:06.996470 10723 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:30:06.996876  4536 leader_election.cc:336] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:06.996992 10723 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:06.997555  4536 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:06.999397 10723 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:07.000717 10692 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:30:07.003091  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:30:07.020597 10724 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.021278 10724 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:07.031747  3969 leader_election.cc:336] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.048593  3969 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.048719 10724 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:30:07.050084 10657 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:30:07.049995  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:30:07.068733 10699 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.069459 10699 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.073549 10699 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:07.073974 10720 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.074513 10720 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.074548  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
W20260709 12:30:07.080240  4536 leader_election.cc:336] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:07.080288  3969 leader_election.cc:336] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.088176  4536 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:30:07.087659  3895 leader_election.cc:336] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.089329 10692 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:30:07.089766 10720 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:07.094274 10720 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.088399  3969 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
I20260709 12:30:07.099502 10728 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.098578 10724 raft_consensus.cc:2749] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:30:07.094944 10720 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.100191 10728 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.107980 10728 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:30:07.108335  3895 leader_election.cc:336] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.109568  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:30:07.111159  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:30:07.124792  3998 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 19.
I20260709 12:30:07.127351 10724 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.128039 10724 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.134259  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:30:07.134883  4565 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:30:07.136032  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:30:07.136866 10657 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:30:07.137212 10657 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.137533 10657 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:30:07.143484 10719 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.144098 10719 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.147267  3897 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.148187  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:30:07.148840  3998 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 19.
I20260709 12:30:07.149014 10730 raft_consensus.cc:2749] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:30:07.150207  4538 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:30:07.150852  4536 leader_election.cc:336] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.151077 10729 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:30:07.151535 10729 raft_consensus.cc:493] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.151902 10729 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:30:07.152100  3897 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:30:07.152859 10728 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:30:07.153234 10728 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.153605 10728 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:30:07.154436 10724 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:30:07.162555 10729 raft_consensus.cc:515] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.168301 10699 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.175042 10699 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.177620 10699 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:07.170220  3895 leader_election.cc:336] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.167438 10719 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:07.184244 10703 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.184872 10703 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.187019 10703 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:30:07.187307  4536 leader_election.cc:336] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.194891  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:30:07.195612  3927 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 19.
I20260709 12:30:07.188536 10728 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.200888 10728 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:07.197454  4537 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.174401 10720 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:07.205444 10692 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:30:07.206214 10692 raft_consensus.cc:493] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.208140 10692 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:30:07.211338  3895 leader_election.cc:336] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.219013 10728 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.220400 10728 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.222736 10728 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:07.167092 10657 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:07.230291  4536 leader_election.cc:336] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:07.231647  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 58730.1us
I20260709 12:30:07.232582  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378a06c64b37451cbad82415b967e001" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:30:07.235596  4572 raft_consensus.cc:3060] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:30:07.234247 10657 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:30:07.243309  4572 raft_consensus.cc:2468] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 20.
I20260709 12:30:07.244804  3971 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:30:07.245635 10657 raft_consensus.cc:2804] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:30:07.246853 10657 raft_consensus.cc:697] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 20 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:30:07.247740 10657 consensus_queue.cc:237] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.250923  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c4439798ed4427881ec18a55649f4b" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:30:07.251668  3998 raft_consensus.cc:3060] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:30:07.262094  3998 raft_consensus.cc:2468] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 20.
I20260709 12:30:07.263375  4538 leader_election.cc:304] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.265954 10731 raft_consensus.cc:2804] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:30:07.266500 10731 raft_consensus.cc:697] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 20 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:30:07.267478 10731 consensus_queue.cc:237] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.270547 10728 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.271095 10728 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.274502 10728 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:07.276621 10713 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.277166 10713 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.279201 10713 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:07.271687 10729 leader_election.cc:290] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:30:07.275761  3895 leader_election.cc:336] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.282292  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8564889b304f44b9b2b4ad6e5687c4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:30:07.282886  3999 raft_consensus.cc:3060] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:30:07.286218  4002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:30:07.286859  4002 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
I20260709 12:30:07.287688  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:30:07.288264  3927 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:30:07.292953  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:30:07.293756  4000 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:30:07.295063  3970 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:30:07.295928 10713 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:30:07.296355 10713 raft_consensus.cc:493] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.296720 10713 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:30:07.297895 10692 raft_consensus.cc:515] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.299417 10728 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.308029 10728 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.309276 10692 leader_election.cc:290] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:07.310221 10728 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:07.303836  4001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:30:07.310357  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36aa23e03c114b66abce211a070a9c93" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:30:07.311079  3925 raft_consensus.cc:3060] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:30:07.307339  3895 leader_election.cc:336] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.320169  3897 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.321240  3897 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.324712  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:30:07.326056 10720 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:30:07.321823 10728 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:30:07.326582 10720 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.328146 10720 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:30:07.329675  3925 raft_consensus.cc:2468] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 20.
I20260709 12:30:07.325681  3999 raft_consensus.cc:2468] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 20.
I20260709 12:30:07.332348  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:30:07.341681 10730 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:30:07.321731  4536 leader_election.cc:336] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:07.334493  3895 leader_election.cc:336] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.345831 10730 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:07.335332  3969 leader_election.cc:336] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.351898 10730 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:30:07.354310  3897 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.355506  3897 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.357405  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:30:07.358064  4572 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 14.
W20260709 12:30:07.358626  3895 leader_election.cc:336] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.360599  4536 leader_election.cc:304] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.336658 10713 raft_consensus.cc:515] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.326741 10728 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.342852  4000 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
W20260709 12:30:07.367461  3969 leader_election.cc:336] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.362092 10703 raft_consensus.cc:2749] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:30:07.370877  3969 leader_election.cc:336] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.362306 10730 raft_consensus.cc:2749] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:30:07.373148  3895 leader_election.cc:336] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.364296 10728 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:30:07.387751 10720 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.410729 10657 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.406711 10724 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.411244 10713 leader_election.cc:290] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:07.411444 10724 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.412566 10720 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:07.413203 10720 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:30:07.419301  3969 leader_election.cc:336] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:07.425010  3969 leader_election.cc:336] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.411342 10657 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.421216  3747 catalog_manager.cc:5697] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 19 to 20, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 20 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:07.418850  3750 catalog_manager.cc:5697] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 19 to 20, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 20 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:30:07.402228 10731 raft_consensus.cc:2804] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:30:07.426028  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 69506.4us
I20260709 12:30:07.413672 10724 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:07.433621  3897 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.435689  3897 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.439023 10657 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:07.413679 10720 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:30:07.443616  3895 leader_election.cc:336] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.444254 10720 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:07.440491  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821e5786ae7e416cb9f41668b6ee4718" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:30:07.444970  3927 raft_consensus.cc:3060] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:30:07.441654 10734 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:30:07.447350 10734 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.447732 10734 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:30:07.438179 10730 raft_consensus.cc:2804] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:30:07.449527 10730 raft_consensus.cc:697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:30:07.434691 10731 raft_consensus.cc:697] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 20 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
W20260709 12:30:07.458703  3895 leader_election.cc:336] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.457548 10730 consensus_queue.cc:237] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.456455  3927 raft_consensus.cc:2468] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:30:07.468806  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:30:07.469110  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:30:07.469487  3925 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:30:07.469839  3931 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 17.
I20260709 12:30:07.457612 10731 consensus_queue.cc:237] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.483491  3970 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:30:07.484434 10713 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:30:07.484601  3970 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.484894 10713 raft_consensus.cc:493] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.485316 10713 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:30:07.485544 10725 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:30:07.485999 10725 raft_consensus.cc:493] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.486418 10725 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:30:07.494539 10713 raft_consensus.cc:515] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.500249 10728 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.496076 10725 raft_consensus.cc:515] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.498086  3970 leader_election.cc:304] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.503134 10657 raft_consensus.cc:2804] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:30:07.503676 10657 raft_consensus.cc:697] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:30:07.504751 10657 consensus_queue.cc:237] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:30:07.505175  2676 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3878)
W20260709 12:30:07.518930  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 83318.9us
I20260709 12:30:07.520668 10734 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.522548 10703 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.526885 10703 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.528985 10703 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:07.522989 10735 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.530150 10725 leader_election.cc:290] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:07.530542  3895 leader_election.cc:336] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.524559  3897 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.526283 10728 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:07.531083 10734 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:07.531032 10735 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:07.525496  3969 leader_election.cc:336] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.533850 10734 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:30:07.533965 10735 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:30:07.534338 10734 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.534734 10734 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:30:07.536114  3895 leader_election.cc:336] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:07.539923  3969 consensus_peers.cc:597] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:07.544050  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:30:07.544853  4565 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
W20260709 12:30:07.541271  3895 leader_election.cc:336] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.546623  3897 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
W20260709 12:30:07.547156  3895 leader_election.cc:336] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.548017  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e525bb5cdfd4c23b6ca117d6d5a526d" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:30:07.548595  4000 raft_consensus.cc:3060] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:30:07.548910  3931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3cd5d9caa54ebe9ef9762ebb258852" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:30:07.549476  3931 raft_consensus.cc:3060] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:30:07.556074 10713 leader_election.cc:290] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:07.557368 10728 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:30:07.557725  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:30:07.557796 10728 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.558501 10728 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:30:07.562755  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a1caee5b3c48638d8c44f6919fb5ed" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:30:07.563347  3932 raft_consensus.cc:3060] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:30:07.563383 10725 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.563948 10725 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.566817  4000 raft_consensus.cc:2468] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
I20260709 12:30:07.578588 10728 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.580936 10728 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:30:07.570591  3931 raft_consensus.cc:2468] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:30:07.582170  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c03e098f9a45cd94c52ada1bc9fa11" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:30:07.604215  3970 leader_election.cc:304] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
W20260709 12:30:07.590291  3895 consensus_peers.cc:597] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:07.605235 10657 raft_consensus.cc:2804] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:30:07.605741 10657 raft_consensus.cc:697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:30:07.582185  3932 raft_consensus.cc:2468] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 18.
I20260709 12:30:07.570518 10734 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.600581  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70a29fa5e29440f92c76824dcf74449" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:30:07.608316  3999 raft_consensus.cc:3060] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:30:07.609453 10734 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:30:07.609634  3970 leader_election.cc:304] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:30:07.610980 10724 raft_consensus.cc:2804] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:30:07.611479 10724 raft_consensus.cc:697] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:30:07.611848 10657 consensus_queue.cc:237] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.612376 10724 consensus_queue.cc:237] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.601154  3752 catalog_manager.cc:5697] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 19 to 20, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 20 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:07.601979  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e2bc60b69b4f4086209185a5fe10a4" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:30:07.615713  3998 raft_consensus.cc:3060] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:30:07.602487  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:30:07.602707  3927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:30:07.604347  4565 raft_consensus.cc:3060] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:30:07.589682 10725 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:07.616350  4000 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 19.
I20260709 12:30:07.618036  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a955b1f59694973b581077ee60e7e4a" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe"
I20260709 12:30:07.619633  3927 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 19.
I20260709 12:30:07.620270  4572 raft_consensus.cc:3060] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:30:07.606503  3747 catalog_manager.cc:5697] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 16 to 17, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 17 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:07.621016  3970 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:30:07.622285  3999 raft_consensus.cc:2468] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
W20260709 12:30:07.624559  3969 leader_election.cc:336] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.625732  3897 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.626971  4572 raft_consensus.cc:2468] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 15.
I20260709 12:30:07.633950  3897 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.634661 10725 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:30:07.635180 10725 raft_consensus.cc:493] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.635588 10725 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:30:07.635327  3754 catalog_manager.cc:5697] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 19 to 20, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 20 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:30:07.637650 10730 raft_consensus.cc:2749] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:30:07.642921 10725 raft_consensus.cc:515] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.650899 10713 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.656395 10713 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.657145 10725 leader_election.cc:290] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:07.645679  4565 raft_consensus.cc:2468] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
W20260709 12:30:07.658130  3969 leader_election.cc:336] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.658751 10723 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.659638  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9589deb8c4b64410a1f3793a7f6f1498" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:30:07.668965  3932 raft_consensus.cc:3060] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:30:07.668890 10723 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.671133 10723 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:07.676328  3932 raft_consensus.cc:2468] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 20.
W20260709 12:30:07.631042  3895 leader_election.cc:336] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.662783 10734 raft_consensus.cc:2804] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:30:07.678429 10734 raft_consensus.cc:697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:30:07.679677 10734 consensus_queue.cc:237] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:30:07.682026  3895 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 62865.2us
I20260709 12:30:07.682138  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:30:07.682066  3998 raft_consensus.cc:2468] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 16.
W20260709 12:30:07.692993  3969 leader_election.cc:336] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.681617 10713 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:30:07.694708  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58" is_pre_election: true
I20260709 12:30:07.695423  3932 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 15.
I20260709 12:30:07.688645  3970 leader_election.cc:304] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:30:07.696971 10713 raft_consensus.cc:2804] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:30:07.697491 10713 raft_consensus.cc:697] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 20 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
W20260709 12:30:07.701905  4536 consensus_peers.cc:597] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:07.702278  3897 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:30:07.703958 10713 consensus_queue.cc:237] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.699652  3970 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:30:07.721841  3897 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.722405 10734 raft_consensus.cc:2804] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:30:07.725618  3895 leader_election.cc:336] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.728425  3897 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.730815 10723 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:30:07.731242 10723 raft_consensus.cc:493] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.731598 10723 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:30:07.733588  3969 leader_election.cc:336] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:07.735721  3969 leader_election.cc:336] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.736132  3969 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb, f3cab225ecb7488386a1a19239498cfe
W20260709 12:30:07.737076  3969 leader_election.cc:336] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.738035 10728 raft_consensus.cc:2804] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:30:07.738391 10725 raft_consensus.cc:2749] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:30:07.738598 10728 raft_consensus.cc:697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:30:07.739534 10728 consensus_queue.cc:237] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.745966 10735 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:30:07.747344  3897 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.746425 10735 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.748560 10735 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:30:07.751938  3754 catalog_manager.cc:5697] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 15 to 16, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 16 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:07.762416  3998 raft_consensus.cc:1275] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 12:30:07.746974 10734 raft_consensus.cc:697] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
W20260709 12:30:07.764947  4536 consensus_peers.cc:597] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:07.765513  4536 consensus_peers.cc:597] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:07.765370 10734 consensus_queue.cc:237] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.766664 10730 raft_consensus.cc:2804] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:30:07.767211 10730 raft_consensus.cc:697] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:30:07.768045 10730 consensus_queue.cc:237] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.771858  3897 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.774228 10703 raft_consensus.cc:2804] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:30:07.774744 10703 raft_consensus.cc:697] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:30:07.775600 10703 consensus_queue.cc:237] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.781172 10719 consensus_queue.cc:1048] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:30:07.778676 10735 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.780522 10731 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
W20260709 12:30:07.798717  3969 consensus_peers.cc:597] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:07.798485 10731 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:07.800757 10731 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:07.800846 10735 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:30:07.805548  3895 leader_election.cc:336] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.773926 10723 raft_consensus.cc:515] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:07.811645  4565 raft_consensus.cc:1275] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:30:07.805938  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:30:07.812642  4000 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 16.
I20260709 12:30:07.813393 10723 leader_election.cc:290] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:07.814774  3932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71bbfa14190c41d4a2fa5064e97996f1" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "073f84fcc295417f9bcc1eea29d2bb58"
I20260709 12:30:07.815384  3932 raft_consensus.cc:3060] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:30:07.811672  4536 leader_election.cc:336] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:07.818192  4538 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.819077 10657 consensus_queue.cc:1048] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:30:07.822824 10731 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:30:07.823233 10731 raft_consensus.cc:493] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4eedd844c09d456ca0b3614490dd1dbb)
I20260709 12:30:07.823608 10731 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:30:07.825069  3932 raft_consensus.cc:2468] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34711da9380944d2969a2bc3e203db3d in term 16.
I20260709 12:30:07.826340  3970 leader_election.cc:304] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 
I20260709 12:30:07.827427 10657 raft_consensus.cc:2804] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:30:07.827927 10657 raft_consensus.cc:697] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Becoming Leader. State: Replica: 34711da9380944d2969a2bc3e203db3d, State: Running, Role: LEADER
I20260709 12:30:07.828758 10657 consensus_queue.cc:237] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:30:07.851490  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 71131.7us
I20260709 12:30:07.855177  3754 catalog_manager.cc:5697] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 15 to 16, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 16 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:07.865166  3754 catalog_manager.cc:5697] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 17 to 18, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 18 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:07.866032  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c9e284191247a69a13f47c43baec1b" candidate_uuid: "073f84fcc295417f9bcc1eea29d2bb58" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:30:07.866755  4000 raft_consensus.cc:3060] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:30:07.867105  3754 catalog_manager.cc:5697] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 19 to 20, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 20 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:07.917584  4000 raft_consensus.cc:2468] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 073f84fcc295417f9bcc1eea29d2bb58 in term 20.
I20260709 12:30:07.927783  3747 catalog_manager.cc:5697] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 15 to 16, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 16 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:07.931594  3897 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d; no voters: 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:07.932461  3747 catalog_manager.cc:5697] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 14 to 15, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 15 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:07.934902  3747 catalog_manager.cc:5697] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 14 to 15, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 15 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:07.936385  3747 catalog_manager.cc:5697] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 15 to 16, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 16 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:07.938465 10735 raft_consensus.cc:2804] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:30:07.939015 10735 raft_consensus.cc:697] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 LEADER]: Becoming Leader. State: Replica: 073f84fcc295417f9bcc1eea29d2bb58, State: Running, Role: LEADER
I20260709 12:30:07.946179 10735 consensus_queue.cc:237] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:30:07.954802  3969 leader_election.cc:336] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:07.959721  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 55173.4us
I20260709 12:30:07.965018  4000 raft_consensus.cc:1275] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:30:07.968457  3895 consensus_peers.cc:597] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:07.968541 10731 raft_consensus.cc:515] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:07.969218  3895 consensus_peers.cc:597] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:07.969650  3895 consensus_peers.cc:597] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:07.970060  3895 consensus_peers.cc:597] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:07.970947 10731 leader_election.cc:290] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Requested vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:07.989415  3932 raft_consensus.cc:1275] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:30:07.995467 10723 consensus_queue.cc:1048] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:30:07.998092  3932 raft_consensus.cc:1275] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:30:08.000864  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008722eae8ea40db92fea0a5f70961f3" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:30:08.001489  4000 raft_consensus.cc:3060] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:30:08.004303 10755 consensus_queue.cc:1048] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:30:08.010509  4000 raft_consensus.cc:2468] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 17.
W20260709 12:30:07.965304  3969 consensus_peers.cc:597] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:08.012480  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 47226us
W20260709 12:30:08.013003  3969 consensus_peers.cc:597] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:08.011823  4538 leader_election.cc:304] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 
I20260709 12:30:08.014899 10755 raft_consensus.cc:2804] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:30:08.015816 10755 raft_consensus.cc:697] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 17 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:30:08.016747 10755 consensus_queue.cc:237] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:08.023731  3895 consensus_peers.cc:597] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:08.029404  4536 leader_election.cc:336] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:08.013533  3969 consensus_peers.cc:597] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:08.058732  3969 consensus_peers.cc:597] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:08.065440  3895 consensus_peers.cc:597] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:08.066039  3895 consensus_peers.cc:597] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:08.053228 10734 consensus_queue.cc:1048] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
W20260709 12:30:08.075030  4536 consensus_peers.cc:597] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:08.071540  3747 catalog_manager.cc:5697] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d reported cstate change: term changed from 15 to 16, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 34711da9380944d2969a2bc3e203db3d (127.2.157.3). New cstate: current_term: 16 leader_uuid: "34711da9380944d2969a2bc3e203db3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: HEALTHY } } }
W20260709 12:30:08.090332  3969 consensus_peers.cc:597] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:08.112601  3969 consensus_peers.cc:597] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:08.127092  4536 consensus_peers.cc:597] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:08.127760  4536 consensus_peers.cc:597] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:08.130431  3932 raft_consensus.cc:1275] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:30:08.134107  3969 consensus_peers.cc:597] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:08.147507  3895 consensus_peers.cc:597] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:08.174011  4536 consensus_peers.cc:597] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:08.163985 10723 consensus_queue.cc:1048] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
W20260709 12:30:08.180950  3969 consensus_peers.cc:597] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:08.181479  3969 consensus_peers.cc:597] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:08.189599  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 103142us
W20260709 12:30:08.192561  3895 consensus_peers.cc:597] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:08.193506  3895 consensus_peers.cc:597] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:08.190907  3747 catalog_manager.cc:5697] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 reported cstate change: term changed from 19 to 20, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2). New cstate: current_term: 20 leader_uuid: "073f84fcc295417f9bcc1eea29d2bb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } }
W20260709 12:30:08.211244  4536 consensus_peers.cc:597] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:08.216137  3895 consensus_peers.cc:597] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:08.216691  3895 consensus_peers.cc:597] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:08.226442  4536 consensus_peers.cc:597] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:08.227074  3999 raft_consensus.cc:1275] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:30:08.228416  3752 catalog_manager.cc:5697] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 16 to 17, leader changed from 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 17 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:30:08.243302  3895 consensus_peers.cc:597] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:08.250612 10728 consensus_queue.cc:1048] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:30:08.276165  4572 raft_consensus.cc:1275] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:30:08.284304 10753 consensus_queue.cc:1048] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:30:08.286310  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 102880us
W20260709 12:30:08.295305  4536 consensus_peers.cc:597] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:08.317260  3925 raft_consensus.cc:1275] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:30:08.322124  3971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 116969us
W20260709 12:30:08.335069  4536 consensus_peers.cc:597] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:08.346581  3927 raft_consensus.cc:1275] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:30:08.345850 10725 consensus_queue.cc:1048] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
W20260709 12:30:08.384269  3895 consensus_peers.cc:597] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:08.384889  3895 consensus_peers.cc:597] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:08.385025 10774 consensus_queue.cc:1048] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
W20260709 12:30:08.410392  3969 consensus_peers.cc:597] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:08.411171  3969 consensus_peers.cc:597] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:08.414968  3895 consensus_peers.cc:597] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:08.430235  3895 consensus_peers.cc:597] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:08.442283  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:41095, user_credentials={real_user=slave}} blocked reactor thread for 64163us
I20260709 12:30:08.445519  4565 raft_consensus.cc:1275] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:30:08.457083  3998 raft_consensus.cc:1275] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:30:08.457532  3999 raft_consensus.cc:1275] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:30:08.463884 10729 consensus_queue.cc:1048] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:30:08.471819  3927 raft_consensus.cc:1275] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Refusing update from remote peer 34711da9380944d2969a2bc3e203db3d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:30:08.476352  3969 consensus_peers.cc:597] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:08.495077  3969 consensus_peers.cc:597] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:08.504066  4536 consensus_peers.cc:597] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:08.506018  2676 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 3878)
I20260709 12:30:08.509277 10723 consensus_queue.cc:1048] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:30:08.519129 10730 consensus_queue.cc:1048] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:30:08.522930  3999 raft_consensus.cc:1275] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:30:08.532006 10730 consensus_queue.cc:1048] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:30:08.564747 10753 consensus_queue.cc:1048] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 12:30:08.631654  3895 consensus_peers.cc:597] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:08.665633  3999 raft_consensus.cc:1275] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Refusing update from remote peer 073f84fcc295417f9bcc1eea29d2bb58: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:30:08.667800  3895 consensus_peers.cc:597] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:08.718875 10753 consensus_queue.cc:1048] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:30:08.769696  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 50326.7us
W20260709 12:30:09.507684  2676 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 3878)
W20260709 12:30:10.024142  3969 consensus_peers.cc:597] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.133349  4536 consensus_peers.cc:597] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.189065  3969 consensus_peers.cc:597] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:10.233035  3895 consensus_peers.cc:597] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.237062  3969 consensus_peers.cc:597] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.248114  3895 consensus_peers.cc:597] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.276434  3895 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111) [suppressed 423 similar messages]
W20260709 12:30:10.332091  4536 consensus_peers.cc:597] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:10.353003  4536 consensus_peers.cc:597] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.378113  3969 consensus_peers.cc:597] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:10.384598  3969 consensus_peers.cc:597] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.386091  3895 consensus_peers.cc:597] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.386803  4536 consensus_peers.cc:597] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.391261  4536 consensus_peers.cc:597] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:10.423276  3895 consensus_peers.cc:597] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.459492  3895 consensus_peers.cc:597] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.467402  4536 consensus_peers.cc:597] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.481220  3969 consensus_peers.cc:597] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.487145  3895 consensus_peers.cc:597] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.492739  3895 consensus_peers.cc:597] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:10.508292  2676 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 3878)
W20260709 12:30:10.544443  3895 consensus_peers.cc:597] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:10.551152  3969 consensus_peers.cc:597] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.567955  4536 consensus_peers.cc:597] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.574234  3969 consensus_peers.cc:597] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.604967  3969 consensus_peers.cc:597] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.622244  3895 consensus_peers.cc:597] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.631343  3895 consensus_peers.cc:597] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:10.651571  4536 consensus_peers.cc:597] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.662211  3895 consensus_peers.cc:597] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.685501  4536 consensus_peers.cc:597] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.764185  4536 consensus_peers.cc:597] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.777770  3969 consensus_peers.cc:597] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:10.824184  3895 consensus_peers.cc:597] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.826347  3895 consensus_peers.cc:597] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.846259  3895 consensus_peers.cc:597] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.866094  3895 consensus_peers.cc:597] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:10.900753  4536 consensus_peers.cc:597] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.922916  3969 consensus_peers.cc:597] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:10.940160  3969 consensus_peers.cc:597] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:10.957567  3969 consensus_peers.cc:597] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:11.089437  3895 consensus_peers.cc:597] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:11.092037  3895 consensus_peers.cc:597] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:11.118628  3895 consensus_peers.cc:597] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:11.125746  3895 consensus_peers.cc:597] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:11.173854  3969 consensus_peers.cc:597] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:11.189172  3969 consensus_peers.cc:597] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:11.247414  4536 consensus_peers.cc:597] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:11.306373  3895 consensus_peers.cc:597] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:11.351676  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 79346.5us
W20260709 12:30:11.510908  2676 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 3878)
W20260709 12:30:12.402732  3969 consensus_peers.cc:597] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:12.476229  3969 consensus_peers.cc:597] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:12.511488  2676 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 3878)
W20260709 12:30:12.649272  4536 consensus_peers.cc:597] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:12.796469  3895 consensus_peers.cc:597] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:12.841147  3969 consensus_peers.cc:597] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:12.847772  4536 consensus_peers.cc:597] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:12.860312  3969 consensus_peers.cc:597] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:12.870853  4536 consensus_peers.cc:597] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:12.874336  3895 consensus_peers.cc:597] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:12.876566  4536 consensus_peers.cc:597] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:12.901096  3895 consensus_peers.cc:597] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:12.914181  3895 consensus_peers.cc:597] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:12.971966  4536 consensus_peers.cc:597] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:12.974157  3895 consensus_peers.cc:597] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:12.974639  3895 consensus_peers.cc:597] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.000650  3969 consensus_peers.cc:597] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.018105  3969 consensus_peers.cc:597] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.024634  3895 consensus_peers.cc:597] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.061893  3969 consensus_peers.cc:597] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.162138  4536 consensus_peers.cc:597] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:13.170639  3895 consensus_peers.cc:597] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:13.205417  4536 consensus_peers.cc:597] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.239833  3895 consensus_peers.cc:597] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.254958  3895 consensus_peers.cc:597] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:13.259694  3969 consensus_peers.cc:597] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.272754  4536 consensus_peers.cc:597] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.288144  3895 consensus_peers.cc:597] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.295660  3969 consensus_peers.cc:597] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:13.325932  3895 consensus_peers.cc:597] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.354387  3897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 64244.9us
W20260709 12:30:13.354677  3969 consensus_peers.cc:597] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.380882  4536 consensus_peers.cc:597] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.387745  3969 consensus_peers.cc:597] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.394040  4536 consensus_peers.cc:597] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:30:13.407953  2676 tablet_server.cc:196] TabletServer@127.2.157.1:0 shutdown complete.
W20260709 12:30:13.417006  3895 consensus_peers.cc:597] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.461692  3895 consensus_peers.cc:597] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:13.471763  4536 consensus_peers.cc:597] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.482501  3969 consensus_peers.cc:597] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.569375  3895 consensus_peers.cc:597] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.585268  3969 consensus_peers.cc:597] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:13.597414  3895 consensus_peers.cc:597] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:13.606302  3895 consensus_peers.cc:597] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:13.617413  3969 consensus_peers.cc:597] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:13.629494  3895 consensus_peers.cc:597] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.670816  3895 consensus_peers.cc:597] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:13.691701  3969 consensus_peers.cc:597] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:13.707916  4536 consensus_peers.cc:597] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:14.029210  3895 consensus_peers.cc:597] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:30:14.102792  2676 tablet_server.cc:179] TabletServer@127.2.157.2:0 shutting down...
W20260709 12:30:14.113086  3970 consensus_peers.cc:597] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:14.126837  4537 consensus_peers.cc:597] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:14.127462  3970 consensus_peers.cc:597] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:14.142304  3970 consensus_peers.cc:597] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:14.174927  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 54526.9us
W20260709 12:30:14.178308  3970 consensus_peers.cc:597] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:14.196779  4537 consensus_peers.cc:597] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:14.243499  3970 consensus_peers.cc:597] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:14.269407  3970 consensus_peers.cc:597] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:14.292447  4537 consensus_peers.cc:597] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:14.386049  4537 consensus_peers.cc:597] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:14.390187  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:14.393183  2676 tablet_replica.cc:333] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.394440  2676 raft_consensus.cc:2243] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.400727  2676 raft_consensus.cc:2272] T fb53ea47358c4bca95e2856114bf0412 P 073f84fcc295417f9bcc1eea29d2bb58 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.404114  2676 tablet_replica.cc:333] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.405071  2676 raft_consensus.cc:2243] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.408877  2676 raft_consensus.cc:2272] T 611a21088f764ac6bf8767713d911869 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:14.414630  3970 consensus_peers.cc:597] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:14.415060  2676 tablet_replica.cc:333] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.416105  2676 raft_consensus.cc:2243] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.419809  2676 raft_consensus.cc:2272] T 4ff60edb937844e9aaed043337660571 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:14.423060  3970 consensus_peers.cc:597] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:14.425020  2676 tablet_replica.cc:333] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.431834  2676 raft_consensus.cc:2243] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:30:14.435766  4537 consensus_peers.cc:597] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:14.439649  2676 raft_consensus.cc:2272] T ebb5663ff7fe4055bcad8b1fe2d00403 P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.444345  2676 tablet_replica.cc:333] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
W20260709 12:30:14.451761  3970 consensus_peers.cc:597] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:14.454540  3970 consensus_peers.cc:597] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:14.454965  2676 raft_consensus.cc:2243] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.456087  2676 raft_consensus.cc:2272] T a196cfd02592426389eee8bd2a8edb36 P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.459122  2676 tablet_replica.cc:333] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.460104  2676 raft_consensus.cc:2243] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.461392  2676 raft_consensus.cc:2272] T 7d8564889b304f44b9b2b4ad6e5687c4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.464398  2676 tablet_replica.cc:333] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
W20260709 12:30:14.470464  3970 consensus_peers.cc:597] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:14.468294  2676 raft_consensus.cc:2243] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.471901  2676 raft_consensus.cc:2272] T ba2105a333194a478762048de8b5853c P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.475346  2676 tablet_replica.cc:333] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
W20260709 12:30:14.485858  4537 consensus_peers.cc:597] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:14.488066  3970 consensus_peers.cc:597] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:14.489943  2676 raft_consensus.cc:2243] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.490809  2676 raft_consensus.cc:2272] T 5149ad67f39c49a6b07934b58605690c P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:14.493350  3970 consensus_peers.cc:597] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:14.494551  2676 tablet_replica.cc:333] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.495533  2676 raft_consensus.cc:2243] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.496447  2676 raft_consensus.cc:2272] T 26de30c1b5e74f05815f13d9ceea7f45 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.499989  2676 tablet_replica.cc:333] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
W20260709 12:30:14.508996  4537 consensus_peers.cc:597] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:14.503670  2676 raft_consensus.cc:2243] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.517407  2676 raft_consensus.cc:2272] T d1e53a5bcc4f45a3a3ba300b44b04925 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.520634  2676 tablet_replica.cc:333] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.521462  2676 raft_consensus.cc:2243] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.522625  2676 raft_consensus.cc:2272] T ac74d3d7308e4121b8d2bbb920bb9294 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.528542  2676 tablet_replica.cc:333] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.529352  2676 raft_consensus.cc:2243] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.530449  2676 raft_consensus.cc:2272] T 7185a57fbd78466ab6ccbbbd0453c2aa P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.532918  2676 tablet_replica.cc:333] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.533720  2676 raft_consensus.cc:2243] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.536868  2676 raft_consensus.cc:2272] T 9a955b1f59694973b581077ee60e7e4a P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:14.539251  4537 consensus_peers.cc:597] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:14.540560  3970 consensus_peers.cc:597] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:14.542387  2676 tablet_replica.cc:333] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.543318  2676 raft_consensus.cc:2243] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.545060  2676 raft_consensus.cc:2272] T d70a29fa5e29440f92c76824dcf74449 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.548116  2676 tablet_replica.cc:333] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.549192  2676 raft_consensus.cc:2243] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.550077  2676 raft_consensus.cc:2272] T dc613acf018f4e72bbca376671df9f71 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.553169  2676 tablet_replica.cc:333] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.554064  2676 raft_consensus.cc:2243] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.561193  2676 raft_consensus.cc:2272] T 88b08017bb344d72aa432be8a7d5d03f P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.570537  2676 tablet_replica.cc:333] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.571385  2676 raft_consensus.cc:2243] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.572206  2676 raft_consensus.cc:2272] T e9a1caee5b3c48638d8c44f6919fb5ed P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.574827  2676 tablet_replica.cc:333] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.575804  2676 raft_consensus.cc:2243] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.576424  2676 raft_consensus.cc:2272] T 383a24e3cada4485922ab39de63b4de9 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.578846  2676 tablet_replica.cc:333] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.579538  2676 raft_consensus.cc:2243] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.584116  2676 raft_consensus.cc:2272] T d5c03e098f9a45cd94c52ada1bc9fa11 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.592079  2676 tablet_replica.cc:333] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.592995  2676 raft_consensus.cc:2243] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.593770  2676 raft_consensus.cc:2272] T c5bc554f69c94b9887b24097921bd77e P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:14.611716  4537 consensus_peers.cc:597] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:14.621618  2676 tablet_replica.cc:333] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.622714  2676 raft_consensus.cc:2243] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:30:14.641752  4537 consensus_peers.cc:597] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:14.641978  2676 raft_consensus.cc:2272] T 1fd9ef15e49a427d989c258ac6614daa P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.675065  2676 tablet_replica.cc:333] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.676808  2676 raft_consensus.cc:2243] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.694785  2676 raft_consensus.cc:2272] T a8cb467dd69d4e7785fd70c9c63614ea P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.710728  2676 tablet_replica.cc:333] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.711542  2676 raft_consensus.cc:2243] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.712205  2676 raft_consensus.cc:2272] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.714808  2676 tablet_replica.cc:333] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.715476  2676 raft_consensus.cc:2243] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.735746  2676 raft_consensus.cc:2272] T 66c9e284191247a69a13f47c43baec1b P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.739845  2676 tablet_replica.cc:333] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.740608  2676 raft_consensus.cc:2243] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.741181  2676 raft_consensus.cc:2272] T 821e5786ae7e416cb9f41668b6ee4718 P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.759698  2676 tablet_replica.cc:333] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.760512  2676 raft_consensus.cc:2243] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.761574  2676 raft_consensus.cc:2272] T 274c43c8bd05433a8c00fffabbd5b8b7 P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:14.776057  3969 consensus_peers.cc:597] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:30:14.777911  2676 tablet_replica.cc:333] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.778738  2676 raft_consensus.cc:2243] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.779371  2676 raft_consensus.cc:2272] T 36aa23e03c114b66abce211a070a9c93 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.787858  2676 tablet_replica.cc:333] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.788606  2676 raft_consensus.cc:2243] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.789716  2676 raft_consensus.cc:2272] T 08e2bc60b69b4f4086209185a5fe10a4 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.792397  2676 tablet_replica.cc:333] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.793164  2676 raft_consensus.cc:2243] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.816223  2676 raft_consensus.cc:2272] T ace1274bf4f34853b37ab7a08103d367 P 073f84fcc295417f9bcc1eea29d2bb58 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.821200  2676 tablet_replica.cc:333] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.823654  2676 raft_consensus.cc:2243] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.833743  2676 raft_consensus.cc:2272] T 20fdebd7b9154e47beb5e08a62175fe5 P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.837951  2676 tablet_replica.cc:333] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.838781  2676 raft_consensus.cc:2243] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.839432  2676 raft_consensus.cc:2272] T 3d9116f60a784d21bf919694ec32bdbb P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.841915  2676 tablet_replica.cc:333] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.842617  2676 raft_consensus.cc:2243] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.843333  2676 raft_consensus.cc:2272] T 86e92801c3904600b054e99343413645 P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.846071  2676 tablet_replica.cc:333] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.846843  2676 raft_consensus.cc:2243] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.847681  2676 raft_consensus.cc:2272] T 9589deb8c4b64410a1f3793a7f6f1498 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.850286  2676 tablet_replica.cc:333] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.851032  2676 raft_consensus.cc:2243] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.852190  2676 raft_consensus.cc:2272] T 2c8fdf36221e4313b4289cb50019ec4f P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.854897  2676 tablet_replica.cc:333] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.855669  2676 raft_consensus.cc:2243] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.859122  2676 raft_consensus.cc:2272] T dcafa6aa2cb54d969725d5e69f9b4a5d P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.861982  2676 tablet_replica.cc:333] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.862797  2676 raft_consensus.cc:2243] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.863973  2676 raft_consensus.cc:2272] T eadf6ff4956f47ff8a85f77d02584a0d P 073f84fcc295417f9bcc1eea29d2bb58 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.873682  2676 tablet_replica.cc:333] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.874826  2676 raft_consensus.cc:2243] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.875473  2676 raft_consensus.cc:2272] T 781f4e626c2b4af0af08871cfde2d83e P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.880481  2676 tablet_replica.cc:333] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.881335  2676 raft_consensus.cc:2243] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.882005  2676 raft_consensus.cc:2272] T 95a53a95fd9f44e59c1b1615b9281948 P 073f84fcc295417f9bcc1eea29d2bb58 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.884720  2676 tablet_replica.cc:333] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.885474  2676 raft_consensus.cc:2243] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.886615  2676 raft_consensus.cc:2272] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.890633  2676 tablet_replica.cc:333] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.891274  2676 raft_consensus.cc:2243] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.891831  2676 raft_consensus.cc:2272] T 71bbfa14190c41d4a2fa5064e97996f1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.894228  2676 tablet_replica.cc:333] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.894935  2676 raft_consensus.cc:2243] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.896072  2676 raft_consensus.cc:2272] T 415f89d9faf145eba38570ddee93ff31 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.898923  2676 tablet_replica.cc:333] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.899649  2676 raft_consensus.cc:2243] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.902462  2676 raft_consensus.cc:2272] T 8abf2cd47e3c44d995fbbb863bf3d5ac P 073f84fcc295417f9bcc1eea29d2bb58 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.905509  2676 tablet_replica.cc:333] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.906261  2676 raft_consensus.cc:2243] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.906919  2676 raft_consensus.cc:2272] T 455f8427897049759001979ea81adec1 P 073f84fcc295417f9bcc1eea29d2bb58 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.912632  2676 tablet_replica.cc:333] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.913370  2676 raft_consensus.cc:2243] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.914487  2676 raft_consensus.cc:2272] T 812f8e58e6d54e67a0d699b41fc6815b P 073f84fcc295417f9bcc1eea29d2bb58 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.916930  2676 tablet_replica.cc:333] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.919414  2676 raft_consensus.cc:2243] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:14.919976  2676 raft_consensus.cc:2272] T 8693e7a0624445758baf0b77c7686e0c P 073f84fcc295417f9bcc1eea29d2bb58 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:14.922545  2676 tablet_replica.cc:333] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58: stopping tablet replica
I20260709 12:30:14.923393  2676 raft_consensus.cc:2243] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:30:14.924916  2676 raft_consensus.cc:2272] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 073f84fcc295417f9bcc1eea29d2bb58 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:15.083654  3969 consensus_peers.cc:597] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:15.229596  4536 consensus_peers.cc:597] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:15.261197  4536 consensus_peers.cc:597] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:15.277477  4536 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111) [suppressed 495 similar messages]
W20260709 12:30:15.280135  4536 consensus_peers.cc:597] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:15.290660  3969 consensus_peers.cc:597] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:15.315933  3969 consensus_peers.cc:597] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:15.339574  3969 consensus_peers.cc:597] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:15.374024  2676 connection.cc:466] server connection from 127.0.0.1:54068 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54068 (request call id 2005) could send its response
W20260709 12:30:15.390869  4536 consensus_peers.cc:597] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:15.427201  4536 consensus_peers.cc:597] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:30:15.582942 10795 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:15.583719 10795 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:15.591982 10795 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:15.598480  3969 leader_election.cc:336] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:15.631194  3970 leader_election.cc:336] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:15.632015 10796 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:15.633442 10796 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:15.635721 10796 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:15.637528  3970 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:30:15.642491  4537 leader_election.cc:336] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:15.668203 10805 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:30:15.676666  3969 consensus_peers.cc:597] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:15.677928  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 46768.7us
W20260709 12:30:15.682817  4536 leader_election.cc:336] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:15.685968  4536 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:15.692029 10806 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:30:15.757539  3969 consensus_peers.cc:597] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:30:15.758450 10795 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:15.759320 10795 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:15.761453 10795 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:15.765430 10801 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:15.766116 10801 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:15.768189 10801 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:15.777766 10805 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:15.778324 10805 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:15.780493 10805 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:15.783105 10795 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:15.790517 10795 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:30:15.791338  4536 consensus_peers.cc:597] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:30:15.793591 10795 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:15.795181  3970 leader_election.cc:336] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:15.808655  3970 leader_election.cc:336] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:15.816712 10796 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:15.836072 10796 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:15.821231 10801 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:15.839855 10801 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:30:15.830367  3969 leader_election.cc:336] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:15.846088  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:30:15.847478  3969 leader_election.cc:336] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:15.854575  3969 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:30:15.849838  4537 leader_election.cc:336] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:15.851140 10796 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:15.852993 10801 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:15.847955 10795 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:30:15.858702 10805 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:30:15.864295  3970 leader_election.cc:336] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:15.867070 10796 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:15.872627 10796 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:15.867569 10805 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:15.902913 10805 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:15.906177 10805 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:15.888197 10795 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:15.913589  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:30:15.941776  3999 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 18.
I20260709 12:30:15.941715 10795 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:15.944409 10795 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:15.926915 10796 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:15.931782  4536 consensus_peers.cc:597] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:15.933192  3969 leader_election.cc:336] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:15.936344 10806 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:15.937120 10811 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:15.957918 10811 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:15.960403 10811 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:15.961175 10806 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:15.963513 10806 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:15.964278  3969 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:15.970039 10805 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:30:15.981264  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 48109.2us
I20260709 12:30:15.966732 10813 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:15.986944 10813 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:15.992612 10813 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:15.977581  3970 leader_election.cc:336] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:16.007748  3970 leader_election.cc:336] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:16.009443  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:30:16.011220 10814 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:30:16.011772 10814 raft_consensus.cc:493] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:16.012269 10814 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:30:16.008203  3969 leader_election.cc:336] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:16.020040  3969 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:16.021018 10805 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:16.022126 10805 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:16.024401 10805 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:16.026954 10812 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:30:16.032881  4537 leader_election.cc:336] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:16.033571  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 51592.3us
W20260709 12:30:16.039096  4537 leader_election.cc:336] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:16.037390  4536 consensus_peers.cc:597] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:16.047592  4536 leader_election.cc:336] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:16.049988  4536 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:30:16.056723  4537 leader_election.cc:336] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:16.067970 10806 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:30:16.069133  4536 consensus_peers.cc:597] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:16.075356  4536 leader_election.cc:336] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:16.084458  4536 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:30:16.082865  3970 leader_election.cc:336] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:16.092535 10806 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:30:16.093776  4536 leader_election.cc:336] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:16.098140 10805 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:16.103165 10805 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:30:16.104655  4027 debug-util.cc:398] Leaking SignalData structure 0x7b0800331080 after lost signal to thread 2679
I20260709 12:30:16.105608 10805 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:16.105763  4027 debug-util.cc:398] Leaking SignalData structure 0x7b0800356620 after lost signal to thread 3789
W20260709 12:30:16.107506  4027 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea5e0 after lost signal to thread 4030
W20260709 12:30:16.108876  4027 debug-util.cc:398] Leaking SignalData structure 0x7b080024df00 after lost signal to thread 4598
I20260709 12:30:16.102007 10813 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:16.114657 10813 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:16.115747  3969 consensus_peers.cc:597] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:16.126907  3969 consensus_peers.cc:597] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:16.127449  3969 leader_election.cc:336] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:16.127889  3969 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:16.102562  4536 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:16.128845 10806 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:30:16.146420 10813 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), f3cab225ecb7488386a1a19239498cfe (127.2.157.4:41095)
I20260709 12:30:16.148077  4565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "34711da9380944d2969a2bc3e203db3d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f3cab225ecb7488386a1a19239498cfe" is_pre_election: true
I20260709 12:30:16.160917 10806 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:16.161849 10806 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:16.164288 10806 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:30:16.170743  4537 leader_election.cc:336] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:16.172129 10812 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:16.172796 10812 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:16.189028 10812 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:16.190466  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 63040.7us
I20260709 12:30:16.190958 10805 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:30:16.196190  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 46793.9us
I20260709 12:30:16.089592 10814 raft_consensus.cc:515] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:16.198100 10806 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:16.205252 10806 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:16.225519 10806 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:16.226213  4536 consensus_peers.cc:597] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:16.226843  4536 consensus_peers.cc:597] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:16.235445  4537 leader_election.cc:336] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:16.221796  3970 leader_election.cc:336] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:16.239710 10814 leader_election.cc:290] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:30:16.249248  3970 leader_election.cc:336] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:16.254433  3970 leader_election.cc:336] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:16.261739  4537 leader_election.cc:336] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:16.257536  3969 leader_election.cc:336] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:16.272169  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:30:16.271008  4536 consensus_peers.cc:597] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:30:16.278911 10812 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:30:16.284724  4536 leader_election.cc:336] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:16.288654  4536 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:30:16.288106  3969 leader_election.cc:336] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:16.301170 10806 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:16.302328 10806 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:16.304744 10806 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:16.305475  3969 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:16.307091 10814 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:30:16.311050  3969 consensus_peers.cc:597] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:30:16.311559 10805 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:30:16.313505  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d" is_pre_election: true
I20260709 12:30:16.320338  3999 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 19.
I20260709 12:30:16.315850  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fdebd7b9154e47beb5e08a62175fe5" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:30:16.321244  4000 raft_consensus.cc:3060] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:30:16.329421  4000 raft_consensus.cc:2468] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 19.
W20260709 12:30:16.331568  3969 leader_election.cc:336] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:16.344830  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:16.351043 10812 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:30:16.352881  3969 consensus_peers.cc:597] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:16.359532  3969 leader_election.cc:336] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:16.361511  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:30:16.355217  4536 leader_election.cc:336] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:16.362653  3970 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:42279, user_credentials={real_user=slave}} blocked reactor thread for 44700.4us
W20260709 12:30:16.366990  3970 leader_election.cc:336] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:16.367411  4537 leader_election.cc:336] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:16.367941 10805 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:30:16.370407 10806 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:16.372577 10806 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:16.375216 10806 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:16.377337  4537 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:30:16.384176  2676 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3953)
W20260709 12:30:16.381852  3970 leader_election.cc:336] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:16.385298  3970 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, f3cab225ecb7488386a1a19239498cfe
I20260709 12:30:16.388339 10805 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:16.390710 10805 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:16.392941 10805 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:16.393543 10814 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:30:16.402065 10805 raft_consensus.cc:2749] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:30:16.420096  4536 leader_election.cc:336] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:16.421013  3969 consensus_peers.cc:597] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:16.421573  3969 consensus_peers.cc:597] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:16.423193  3969 leader_election.cc:336] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:16.423509  3969 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:30:16.424840  3970 leader_election.cc:336] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:16.433105  4537 leader_election.cc:336] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:16.433610  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:16.438232 10806 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:30:16.442763  3969 leader_election.cc:336] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:16.442857 10805 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:30:16.443310  3969 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:16.444084 10805 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:30:16.449079  3969 consensus_peers.cc:597] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:16.453816  3970 leader_election.cc:336] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:16.459187  3970 consensus_peers.cc:597] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:16.471181  3969 consensus_peers.cc:597] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:30:16.471850  3969 leader_election.cc:336] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:16.472287  4538 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:33709, user_credentials={real_user=slave}} blocked reactor thread for 49288.5us
I20260709 12:30:16.472894  3969 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:16.473289  4538 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:30:16.474690  4538 leader_election.cc:304] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:30:16.475050 10805 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:30:16.476197 10806 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:30:16.476670 10806 raft_consensus.cc:493] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting leader election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:16.476938 10815 raft_consensus.cc:2804] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:30:16.477031 10806 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:30:16.497648  4537 consensus_peers.cc:597] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:16.506541 10806 raft_consensus.cc:515] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:16.513252  4537 leader_election.cc:336] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:16.514911 10815 raft_consensus.cc:697] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 19 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:30:16.515970 10815 consensus_queue.cc:237] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:16.518350 10806 leader_election.cc:290] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 election: Requested vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:16.519809  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcafa6aa2cb54d969725d5e69f9b4a5d" candidate_uuid: "f3cab225ecb7488386a1a19239498cfe" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "34711da9380944d2969a2bc3e203db3d"
I20260709 12:30:16.520455  3998 raft_consensus.cc:3060] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:30:16.533457  3998 raft_consensus.cc:2468] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cab225ecb7488386a1a19239498cfe in term 20.
I20260709 12:30:16.547627  3754 catalog_manager.cc:5697] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 18 to 19, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 19 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:30:16.551126  4538 leader_election.cc:304] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d, f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58
I20260709 12:30:16.554100 10815 raft_consensus.cc:2804] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:30:16.554632 10815 raft_consensus.cc:697] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 20 LEADER]: Becoming Leader. State: Replica: f3cab225ecb7488386a1a19239498cfe, State: Running, Role: LEADER
I20260709 12:30:16.555614 10815 consensus_queue.cc:237] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:16.641844  3754 catalog_manager.cc:5697] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe reported cstate change: term changed from 19 to 20, leader changed from 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2) to f3cab225ecb7488386a1a19239498cfe (127.2.157.4). New cstate: current_term: 20 leader_uuid: "f3cab225ecb7488386a1a19239498cfe" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:30:16.655663  4537 consensus_peers.cc:597] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:16.704217  3970 consensus_peers.cc:597] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:16.729990  3970 consensus_peers.cc:597] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:16.745551  3970 consensus_peers.cc:597] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:16.754386  4537 consensus_peers.cc:597] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:16.852823  4537 consensus_peers.cc:597] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:16.935791  4537 consensus_peers.cc:597] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:16.942592  4537 consensus_peers.cc:597] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:16.964610  4537 consensus_peers.cc:597] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:16.976574  3970 consensus_peers.cc:597] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:16.977916  4537 consensus_peers.cc:597] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:16.994015  3970 consensus_peers.cc:597] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:16.995615  3998 raft_consensus.cc:1275] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:30:16.997241 10815 consensus_queue.cc:1048] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:30:17.020686  4537 consensus_peers.cc:597] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:17.047941  4537 consensus_peers.cc:597] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:17.067144  3970 consensus_peers.cc:597] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:17.094859  3970 consensus_peers.cc:597] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:17.104444  3970 consensus_peers.cc:597] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:17.112738  3970 consensus_peers.cc:597] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:17.134956  4537 consensus_peers.cc:597] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:17.140326  3998 raft_consensus.cc:1275] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Refusing update from remote peer f3cab225ecb7488386a1a19239498cfe: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:30:17.141793 10828 consensus_queue.cc:1048] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:30:17.154189  3970 consensus_peers.cc:597] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:17.207026  3970 consensus_peers.cc:597] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:17.290491  3970 consensus_peers.cc:597] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:17.295392  3969 consensus_peers.cc:597] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:30:17.321218  3970 consensus_peers.cc:597] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:17.356660  4537 consensus_peers.cc:597] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:17.384840  2676 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 3953)
I20260709 12:30:17.385463 10801 raft_consensus.cc:493] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:17.386111 10801 raft_consensus.cc:515] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:17.388347 10801 leader_election.cc:290] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:17.392700  3970 leader_election.cc:336] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:17.393169  3969 leader_election.cc:336] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:17.393558  3969 leader_election.cc:304] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:17.394673 10801 raft_consensus.cc:2749] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:30:17.596902  4536 consensus_peers.cc:597] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:30:17.691468  3969 consensus_peers.cc:597] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:30:17.714216 10830 raft_consensus.cc:493] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:17.714727 10830 raft_consensus.cc:515] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:17.716789 10830 leader_election.cc:290] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:17.716799  4536 consensus_peers.cc:597] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:30:17.723621  3970 leader_election.cc:336] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:17.725960  3969 leader_election.cc:336] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:17.726431  3969 leader_election.cc:304] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:17.727193 10830 raft_consensus.cc:2749] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:30:17.771231 10801 raft_consensus.cc:493] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:17.771760 10801 raft_consensus.cc:515] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:17.773618 10801 leader_election.cc:290] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:17.778996  3970 leader_election.cc:336] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:17.780074  3969 leader_election.cc:336] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:17.780561  3969 leader_election.cc:304] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:17.781318 10830 raft_consensus.cc:2749] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:30:17.782323  3969 consensus_peers.cc:597] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:30:17.786415  4536 consensus_peers.cc:597] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:30:17.803467 10828 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:17.803996 10828 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:17.805976 10828 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:17.812633  4536 leader_election.cc:336] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:17.814900  4537 leader_election.cc:336] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:17.815351  4537 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:17.816490 10828 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:30:17.863909  4536 consensus_peers.cc:597] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:30:17.890600 10801 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:17.891171 10801 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:17.893059 10801 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:17.895180 10806 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:17.895749 10806 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:17.897663 10806 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:17.899196  3969 leader_election.cc:336] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:17.900214  3970 leader_election.cc:336] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:17.900590  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:17.901260 10801 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:30:17.903801 10801 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:17.904210 10801 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:17.906107 10801 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:17.911024  3969 leader_election.cc:336] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:17.911623  3970 leader_election.cc:336] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:17.912035  3970 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:17.912721 10801 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:30:17.913718  4536 leader_election.cc:336] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:17.918109  4537 leader_election.cc:336] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:17.918850  4537 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:17.921229 10806 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:30:17.929241 10801 raft_consensus.cc:493] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:17.929739 10801 raft_consensus.cc:515] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:17.931701 10801 leader_election.cc:290] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:17.938927  3970 leader_election.cc:336] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:17.941305  3969 leader_election.cc:336] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:17.941697  3969 leader_election.cc:304] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:17.942348 10801 raft_consensus.cc:2749] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:30:17.942651 10806 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:17.943135 10806 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:17.944402  3969 consensus_peers.cc:597] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:30:17.945124 10806 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:17.952263  3969 consensus_peers.cc:597] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:30:17.952715  4536 leader_election.cc:336] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:17.954900  4537 leader_election.cc:336] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:17.955296  4537 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:17.957270 10828 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:30:17.961216 10801 raft_consensus.cc:493] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:17.961685 10801 raft_consensus.cc:515] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
W20260709 12:30:17.962425  4536 consensus_peers.cc:597] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:30:17.963862 10801 leader_election.cc:290] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:17.967324 10801 raft_consensus.cc:493] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
W20260709 12:30:17.967952  3970 leader_election.cc:336] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:17.971472  3969 leader_election.cc:336] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:17.971158 10801 raft_consensus.cc:515] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:17.971952  3969 leader_election.cc:304] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:17.972645 10830 raft_consensus.cc:2749] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:30:17.977996 10830 raft_consensus.cc:493] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:17.978524 10830 raft_consensus.cc:515] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:17.980856 10830 leader_election.cc:290] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:17.985203 10801 leader_election.cc:290] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:17.988183  3970 leader_election.cc:336] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:17.991743  3970 leader_election.cc:336] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:17.999092 10828 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:17.999677 10828 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:18.000661  3969 leader_election.cc:336] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:18.001099  3969 leader_election.cc:304] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:18.002694 10801 raft_consensus.cc:2749] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:30:18.010309  4536 leader_election.cc:336] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:18.014410 10806 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:18.014932 10806 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:18.017004 10806 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:18.021780  3969 leader_election.cc:336] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:18.022326  3969 leader_election.cc:304] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:18.024453 10805 raft_consensus.cc:2749] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:30:18.024041  4537 leader_election.cc:336] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:18.001727 10828 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:18.028851  4536 leader_election.cc:336] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:18.025939  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:18.031617 10828 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:30:18.033229  4537 leader_election.cc:336] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:18.033700  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:18.034814 10828 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:30:18.109561  3969 consensus_peers.cc:597] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:18.159837  3969 consensus_peers.cc:597] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:30:18.221486  3969 consensus_peers.cc:597] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:30:18.272092 10805 raft_consensus.cc:493] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:18.272660 10805 raft_consensus.cc:515] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:18.274850 10805 leader_election.cc:290] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:18.280222  3969 leader_election.cc:336] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:18.280758  3969 consensus_peers.cc:597] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:30:18.293458  3970 leader_election.cc:336] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:18.294041  3970 leader_election.cc:304] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:18.304196 10801 raft_consensus.cc:2749] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:30:18.313263  4536 consensus_peers.cc:597] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:30:18.337451 10805 raft_consensus.cc:493] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:18.338114 10805 raft_consensus.cc:515] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:18.340090 10805 leader_election.cc:290] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:18.340862 10828 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:18.341423 10828 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:18.349468 10828 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:18.351449 10801 raft_consensus.cc:493] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:18.351948 10801 raft_consensus.cc:515] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:18.353617 10801 leader_election.cc:290] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:18.361452  4537 leader_election.cc:336] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:18.367203  3969 leader_election.cc:336] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:18.367810  3969 leader_election.cc:336] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:18.371701  4536 leader_election.cc:336] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:18.372373  4536 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:18.374900 10828 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:30:18.379453  4536 consensus_peers.cc:597] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:30:18.406632  4536 consensus_peers.cc:597] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:30:18.416188  3970 leader_election.cc:336] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:18.416741  3970 leader_election.cc:304] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:18.417465 10801 raft_consensus.cc:2749] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:30:18.418536  3970 leader_election.cc:336] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:18.418995  3970 leader_election.cc:304] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:18.419684 10801 raft_consensus.cc:2749] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:30:18.502048  3969 consensus_peers.cc:597] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:30:18.519353  3969 consensus_peers.cc:597] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:18.545743  3969 consensus_peers.cc:597] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:30:18.566500 10828 raft_consensus.cc:493] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:18.567216 10828 raft_consensus.cc:515] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:18.579685 10828 leader_election.cc:290] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:18.582530 10805 raft_consensus.cc:493] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:18.583101 10805 raft_consensus.cc:515] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:18.585258 10805 leader_election.cc:290] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:18.612625  3969 leader_election.cc:336] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:18.618412  4537 leader_election.cc:336] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:18.631616  4536 leader_election.cc:336] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:18.634548  4536 leader_election.cc:304] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
W20260709 12:30:18.638238  4536 consensus_peers.cc:597] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:30:18.638702 10832 raft_consensus.cc:2749] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:30:18.636616  3970 leader_election.cc:336] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:18.642580  3970 leader_election.cc:304] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:18.643311 10805 raft_consensus.cc:2749] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:30:18.641817  4536 consensus_peers.cc:597] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:30:18.646507  2676 tablet_server.cc:196] TabletServer@127.2.157.2:0 shutdown complete.
W20260709 12:30:18.656740  4536 consensus_peers.cc:597] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:18.661296  3969 consensus_peers.cc:597] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:19.267019  4537 consensus_peers.cc:597] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:19.293330  3969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 607244us
W20260709 12:30:19.317231  4537 consensus_peers.cc:597] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:19.352226  4537 consensus_peers.cc:597] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:19.357483  4536 consensus_peers.cc:597] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:30:19.359057  4536 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:32843, user_credentials={real_user=slave}} blocked reactor thread for 48366.4us
I20260709 12:30:19.415740 10835 raft_consensus.cc:493] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:19.416805 10835 raft_consensus.cc:515] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:19.426285  3969 consensus_peers.cc:597] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:19.427047  3969 consensus_peers.cc:597] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:30:19.440392  4537 leader_election.cc:336] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:19.441663  4536 leader_election.cc:336] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:19.442219  4536 leader_election.cc:304] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:19.443343 10843 raft_consensus.cc:2749] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:30:19.444687 10835 leader_election.cc:290] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:19.470175  3970 consensus_peers.cc:597] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:19.471764  3970 consensus_peers.cc:597] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:19.472534  3970 consensus_peers.cc:597] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:30:19.474924 10845 raft_consensus.cc:493] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:19.475680 10845 raft_consensus.cc:515] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:19.482414 10845 leader_election.cc:290] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:19.485219  3969 leader_election.cc:336] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:19.499433  3970 leader_election.cc:336] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:19.500038  3970 leader_election.cc:304] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:19.500901 10845 raft_consensus.cc:2749] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:30:19.559886  2676 tablet_server.cc:179] TabletServer@127.2.157.3:0 shutting down...
I20260709 12:30:19.619129 10845 raft_consensus.cc:493] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:19.619815 10845 raft_consensus.cc:515] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } }
I20260709 12:30:19.629053  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:19.630369  2676 tablet_replica.cc:333] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.631742  2676 raft_consensus.cc:2243] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.632691  2676 raft_consensus.cc:2272] T fb53ea47358c4bca95e2856114bf0412 P 34711da9380944d2969a2bc3e203db3d [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:19.633487  3970 leader_election.cc:336] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:19.634352  3969 leader_election.cc:336] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:19.634768  3969 leader_election.cc:304] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34711da9380944d2969a2bc3e203db3d; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:19.636338  2676 tablet_replica.cc:333] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.637585  2676 raft_consensus.cc:2243] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.637611 10842 raft_consensus.cc:2749] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:30:19.638449  2676 raft_consensus.cc:2272] T 6017f50df9e3498d929adc22812d22cf P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.637719 10845 leader_election.cc:290] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:19.641716  2676 tablet_replica.cc:333] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.642743  2676 raft_consensus.cc:2243] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.644271  2676 raft_consensus.cc:2272] T 378a06c64b37451cbad82415b967e001 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.647342  2676 tablet_replica.cc:333] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.648244  2676 raft_consensus.cc:2243] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.649430  2676 raft_consensus.cc:2272] T 7d8564889b304f44b9b2b4ad6e5687c4 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.652648  2676 tablet_replica.cc:333] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.653517  2676 raft_consensus.cc:2243] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.654281  2676 raft_consensus.cc:2272] T 4ff60edb937844e9aaed043337660571 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.657200  2676 tablet_replica.cc:333] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.658131  2676 raft_consensus.cc:2243] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.658797  2676 raft_consensus.cc:2272] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P 34711da9380944d2969a2bc3e203db3d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.661796  2676 tablet_replica.cc:333] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.662668  2676 raft_consensus.cc:2243] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.663341  2676 raft_consensus.cc:2272] T 611a21088f764ac6bf8767713d911869 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.666087  2676 tablet_replica.cc:333] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.666923  2676 raft_consensus.cc:2243] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.668630  2676 raft_consensus.cc:2272] T 821e5786ae7e416cb9f41668b6ee4718 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.671463  2676 tablet_replica.cc:333] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.672416  2676 raft_consensus.cc:2243] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.673862  2676 raft_consensus.cc:2272] T 5149ad67f39c49a6b07934b58605690c P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.676790  2676 tablet_replica.cc:333] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.677609  2676 raft_consensus.cc:2243] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.678958  2676 raft_consensus.cc:2272] T d1e53a5bcc4f45a3a3ba300b44b04925 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.681663  2676 tablet_replica.cc:333] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.682577  2676 raft_consensus.cc:2243] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.684000  2676 raft_consensus.cc:2272] T a445f8740fa847ed9ac463915fa09725 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.686775  2676 tablet_replica.cc:333] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.687624  2676 raft_consensus.cc:2243] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.688496  2676 raft_consensus.cc:2272] T ac74d3d7308e4121b8d2bbb920bb9294 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.691670  2676 tablet_replica.cc:333] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.692482  2676 raft_consensus.cc:2243] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.693703  2676 raft_consensus.cc:2272] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.696676  2676 tablet_replica.cc:333] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
W20260709 12:30:19.696799  4537 consensus_peers.cc:597] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:19.697574  2676 raft_consensus.cc:2243] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.699074  2676 raft_consensus.cc:2272] T e10f480d05fc4f71af73fcd88b588f21 P 34711da9380944d2969a2bc3e203db3d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.701866  2676 tablet_replica.cc:333] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.702675  2676 raft_consensus.cc:2243] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.704022  2676 raft_consensus.cc:2272] T 383a24e3cada4485922ab39de63b4de9 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.706667  2676 tablet_replica.cc:333] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.707537  2676 raft_consensus.cc:2243] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.708914  2676 raft_consensus.cc:2272] T 65ec95afb9e240f29bd517e63249c8d2 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.711671  2676 tablet_replica.cc:333] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.712464  2676 raft_consensus.cc:2243] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.714133  2676 raft_consensus.cc:2272] T e9a1caee5b3c48638d8c44f6919fb5ed P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.716984  2676 tablet_replica.cc:333] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.717919  2676 raft_consensus.cc:2243] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.718789  2676 raft_consensus.cc:2272] T 3d5f24773bb44448a1cb122558f0c4c9 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.721997  2676 tablet_replica.cc:333] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.722951  2676 raft_consensus.cc:2243] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:30:19.720712  4538 consensus_peers.cc:597] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:19.723682  2676 raft_consensus.cc:2272] T d70a29fa5e29440f92c76824dcf74449 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.726442  2676 tablet_replica.cc:333] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.727232  2676 raft_consensus.cc:2243] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.728482  2676 raft_consensus.cc:2272] T dc613acf018f4e72bbca376671df9f71 P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.731101  2676 tablet_replica.cc:333] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.731896  2676 raft_consensus.cc:2243] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.732872  2676 raft_consensus.cc:2272] T 88b08017bb344d72aa432be8a7d5d03f P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.735520  2676 tablet_replica.cc:333] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.736407  2676 raft_consensus.cc:2243] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:30:19.736927  4538 consensus_peers.cc:597] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:19.737658  4538 consensus_peers.cc:597] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:19.739006  4538 consensus_peers.cc:597] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:19.737831  2676 raft_consensus.cc:2272] T ecfd004856c24015ae137dfd5fd34b2c P 34711da9380944d2969a2bc3e203db3d [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:19.739594  4538 consensus_peers.cc:597] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:19.742475  2676 tablet_replica.cc:333] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.743355  2676 raft_consensus.cc:2243] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.744086  2676 raft_consensus.cc:2272] T 1fd9ef15e49a427d989c258ac6614daa P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.746954  2676 tablet_replica.cc:333] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.747781  2676 raft_consensus.cc:2243] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.749006  2676 raft_consensus.cc:2272] T a8cb467dd69d4e7785fd70c9c63614ea P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.751845  2676 tablet_replica.cc:333] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.752712  2676 raft_consensus.cc:2243] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.753990  2676 raft_consensus.cc:2272] T 6c3cd5d9caa54ebe9ef9762ebb258852 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.756664  2676 tablet_replica.cc:333] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.757432  2676 raft_consensus.cc:2243] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.758224  2676 raft_consensus.cc:2272] T e9c4439798ed4427881ec18a55649f4b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.760946  2676 tablet_replica.cc:333] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.761752  2676 raft_consensus.cc:2243] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.762488  2676 raft_consensus.cc:2272] T 66c9e284191247a69a13f47c43baec1b P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.765121  2676 tablet_replica.cc:333] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.765939  2676 raft_consensus.cc:2243] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.766661  2676 raft_consensus.cc:2272] T 274c43c8bd05433a8c00fffabbd5b8b7 P 34711da9380944d2969a2bc3e203db3d [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:19.767390  4537 consensus_peers.cc:597] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:30:19.769344  2676 tablet_replica.cc:333] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.770325  2676 raft_consensus.cc:2243] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Raft consensus shutting down.
W20260709 12:30:19.770750  4538 consensus_peers.cc:597] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:19.771657  2676 raft_consensus.cc:2272] T 2bf4f0ff3c484df18d42d887c059c170 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.774433  2676 tablet_replica.cc:333] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.775264  2676 raft_consensus.cc:2243] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.776690  2676 raft_consensus.cc:2272] T c5bc554f69c94b9887b24097921bd77e P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.779551  2676 tablet_replica.cc:333] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.780345  2676 raft_consensus.cc:2243] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.781692  2676 raft_consensus.cc:2272] T 8d772c24bae14b138d4062798651f82f P 34711da9380944d2969a2bc3e203db3d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.784497  2676 tablet_replica.cc:333] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.785284  2676 raft_consensus.cc:2243] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.786077  2676 raft_consensus.cc:2272] T 08e2bc60b69b4f4086209185a5fe10a4 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.788926  2676 tablet_replica.cc:333] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.789762  2676 raft_consensus.cc:2243] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.790611  2676 raft_consensus.cc:2272] T 9589deb8c4b64410a1f3793a7f6f1498 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.793352  2676 tablet_replica.cc:333] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.794195  2676 raft_consensus.cc:2243] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.794963  2676 raft_consensus.cc:2272] T 20fdebd7b9154e47beb5e08a62175fe5 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.798023  2676 tablet_replica.cc:333] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.798800  2676 raft_consensus.cc:2243] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.799547  2676 raft_consensus.cc:2272] T ebb5663ff7fe4055bcad8b1fe2d00403 P 34711da9380944d2969a2bc3e203db3d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.800376 10835 raft_consensus.cc:493] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:19.801098 10835 raft_consensus.cc:515] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:19.802489  2676 tablet_replica.cc:333] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.807307  2676 raft_consensus.cc:2243] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.808729  2676 raft_consensus.cc:2272] T 95a53a95fd9f44e59c1b1615b9281948 P 34711da9380944d2969a2bc3e203db3d [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:19.810007  4537 consensus_peers.cc:597] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:30:19.811738  2676 tablet_replica.cc:333] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.812686  2676 raft_consensus.cc:2243] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.814128  2676 raft_consensus.cc:2272] T 71bbfa14190c41d4a2fa5064e97996f1 P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:19.814504  4537 consensus_peers.cc:597] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:30:19.807690 10835 leader_election.cc:290] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
I20260709 12:30:19.817165  2676 tablet_replica.cc:333] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
W20260709 12:30:19.819005  4536 leader_election.cc:336] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:19.823171  2676 raft_consensus.cc:2243] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.824220  2676 raft_consensus.cc:2272] T 4e525bb5cdfd4c23b6ca117d6d5a526d P 34711da9380944d2969a2bc3e203db3d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.827236  2676 tablet_replica.cc:333] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
W20260709 12:30:19.827525  4537 leader_election.cc:336] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:19.827999  2676 raft_consensus.cc:2243] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.828850  2676 raft_consensus.cc:2272] T 3b3145ab3db147c9a4fd5ca3a3ccc700 P 34711da9380944d2969a2bc3e203db3d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.828033  4537 leader_election.cc:304] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:19.831641  2676 tablet_replica.cc:333] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.831976 10835 raft_consensus.cc:2749] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:30:19.832314  2676 raft_consensus.cc:2243] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.835198  2676 raft_consensus.cc:2272] T 008722eae8ea40db92fea0a5f70961f3 P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:19.837447  4538 consensus_peers.cc:597] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:19.838068  2676 tablet_replica.cc:333] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.838928  2676 raft_consensus.cc:2243] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.840386  2676 raft_consensus.cc:2272] T 781f4e626c2b4af0af08871cfde2d83e P 34711da9380944d2969a2bc3e203db3d [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:19.843822  4537 consensus_peers.cc:597] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:30:19.844594  2676 tablet_replica.cc:333] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.845427  2676 raft_consensus.cc:2243] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.846549  2676 raft_consensus.cc:2272] T 415f89d9faf145eba38570ddee93ff31 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:19.846621  4538 consensus_peers.cc:597] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:19.848574  4538 consensus_peers.cc:597] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:19.849395  2676 tablet_replica.cc:333] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.850279  2676 raft_consensus.cc:2243] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.851152  2676 raft_consensus.cc:2272] T dcafa6aa2cb54d969725d5e69f9b4a5d P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:19.851652  4538 consensus_peers.cc:597] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:19.853266  2676 tablet_replica.cc:333] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.853826  2676 raft_consensus.cc:2243] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:19.854323  2676 raft_consensus.cc:2272] T 2c8fdf36221e4313b4289cb50019ec4f P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.856173  2676 tablet_replica.cc:333] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.856643  2676 raft_consensus.cc:2243] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.857820  2676 raft_consensus.cc:2272] T 455f8427897049759001979ea81adec1 P 34711da9380944d2969a2bc3e203db3d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:19.860059  2676 tablet_replica.cc:333] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d: stopping tablet replica
I20260709 12:30:19.860711  2676 raft_consensus.cc:2243] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:19.861918  2676 raft_consensus.cc:2272] T 8693e7a0624445758baf0b77c7686e0c P 34711da9380944d2969a2bc3e203db3d [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:19.861831  4537 consensus_peers.cc:597] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:19.872179  4538 consensus_peers.cc:597] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:19.879148  4537 consensus_peers.cc:597] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:19.895298  4538 consensus_peers.cc:597] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe -> Peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Couldn't send request to peer 34711da9380944d2969a2bc3e203db3d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:19.913547  4537 consensus_peers.cc:597] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:20.152511  4595 debug-util.cc:398] Leaking SignalData structure 0x7b0800253f60 after lost signal to thread 2679
W20260709 12:30:20.153790  4595 debug-util.cc:398] Leaking SignalData structure 0x7b08003ab680 after lost signal to thread 3789
W20260709 12:30:20.155203  4595 debug-util.cc:398] Leaking SignalData structure 0x7b0800383ce0 after lost signal to thread 4030
W20260709 12:30:20.156500  4595 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3440 after lost signal to thread 4598
W20260709 12:30:20.226500  4536 consensus_peers.cc:597] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:30:20.258147 10835 raft_consensus.cc:493] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:20.273650 10835 raft_consensus.cc:515] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:20.280519  4536 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111) [suppressed 553 similar messages]
I20260709 12:30:20.279680 10835 leader_election.cc:290] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:20.306780  4536 consensus_peers.cc:597] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:30:20.327298  4536 leader_election.cc:336] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:20.346771  4537 leader_election.cc:336] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:20.349397  4537 leader_election.cc:304] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:20.350634 10835 raft_consensus.cc:2749] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:30:20.365240  4537 consensus_peers.cc:597] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe -> Peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Couldn't send request to peer 073f84fcc295417f9bcc1eea29d2bb58. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:30:20.632089 10834 raft_consensus.cc:493] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:20.632746 10834 raft_consensus.cc:515] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:20.644017 10834 leader_election.cc:290] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:20.658919  4536 leader_election.cc:336] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:20.666627  4537 leader_election.cc:336] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:20.674580  4537 leader_election.cc:304] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:20.676676 10834 raft_consensus.cc:2749] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:30:20.704247  4536 consensus_peers.cc:597] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:30:20.713466 10832 raft_consensus.cc:493] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:20.714310 10832 raft_consensus.cc:515] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:20.716970 10832 leader_election.cc:290] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:20.731360  4536 leader_election.cc:336] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:20.741370  4537 leader_election.cc:336] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:20.742048  4537 leader_election.cc:304] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:20.744539 10834 raft_consensus.cc:2749] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:30:20.786706 10834 raft_consensus.cc:493] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 073f84fcc295417f9bcc1eea29d2bb58)
I20260709 12:30:20.787556 10834 raft_consensus.cc:515] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:20.788518  2676 tablet_server.cc:196] TabletServer@127.2.157.3:0 shutdown complete.
I20260709 12:30:20.796129 10834 leader_election.cc:290] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279)
W20260709 12:30:20.799273  4536 leader_election.cc:336] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:20.800007  4536 consensus_peers.cc:597] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:30:20.829051  4537 leader_election.cc:336] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:20.829638  4537 leader_election.cc:304] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:20.835336 10832 raft_consensus.cc:2749] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:30:20.875109 10834 raft_consensus.cc:493] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:30:20.875954 10834 raft_consensus.cc:515] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:20.892709  4537 leader_election.cc:336] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:20.895886 10832 raft_consensus.cc:493] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:30:20.896661 10832 raft_consensus.cc:515] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:20.899744 10832 leader_election.cc:290] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:20.900656 10835 raft_consensus.cc:493] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:30:20.902882 10835 raft_consensus.cc:515] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:20.906812 10835 leader_election.cc:290] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:20.918809 10832 raft_consensus.cc:493] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:30:20.920020 10835 raft_consensus.cc:493] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:30:20.920801 10835 raft_consensus.cc:515] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:20.923244 10834 leader_election.cc:290] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:20.923985 10832 raft_consensus.cc:515] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
W20260709 12:30:20.925549  4537 leader_election.cc:336] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
I20260709 12:30:20.928345 10835 leader_election.cc:290] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:30:20.935051  4538 leader_election.cc:336] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Network error: Client connection negotiation failed: client connection to 127.2.157.3:33709: connect: Connection refused (error 111)
I20260709 12:30:20.942203  4538 leader_election.cc:304] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:30:20.942777 10854 raft_consensus.cc:493] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:30:20.951591 10854 raft_consensus.cc:515] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:20.954246 10854 leader_election.cc:290] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:20.954795 10854 raft_consensus.cc:493] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:30:20.955359 10854 raft_consensus.cc:515] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:20.957741 10854 leader_election.cc:290] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:20.958514 10854 raft_consensus.cc:2749] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:30:20.938985 10832 leader_election.cc:290] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:20.941607 10835 raft_consensus.cc:493] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:30:20.964509 10855 raft_consensus.cc:493] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:30:20.966509 10855 raft_consensus.cc:515] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:20.969307 10855 leader_election.cc:290] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:20.970291 10835 raft_consensus.cc:515] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4eedd844c09d456ca0b3614490dd1dbb" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 32843 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:20.976303 10855 raft_consensus.cc:493] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 34711da9380944d2969a2bc3e203db3d)
I20260709 12:30:20.976936 10855 raft_consensus.cc:515] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "073f84fcc295417f9bcc1eea29d2bb58" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 42279 } } peers { permanent_uuid: "34711da9380944d2969a2bc3e203db3d" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 33709 } } peers { permanent_uuid: "f3cab225ecb7488386a1a19239498cfe" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 41095 } attrs { promote: false } }
I20260709 12:30:20.978286 10835 leader_election.cc:290] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
I20260709 12:30:20.974303  2676 tablet_server.cc:179] TabletServer@127.2.157.4:0 shutting down...
I20260709 12:30:20.979689 10855 leader_election.cc:290] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279), 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709)
W20260709 12:30:20.989647  4537 leader_election.cc:336] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:20.995355  4537 leader_election.cc:336] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 073f84fcc295417f9bcc1eea29d2bb58 (127.2.157.2:42279): Network error: Client connection negotiation failed: client connection to 127.2.157.2:42279: connect: Connection refused (error 111)
W20260709 12:30:20.998096  4538 leader_election.cc:336] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Network error: Client connection negotiation failed: client connection to 127.2.157.3:33709: connect: Connection refused (error 111)
I20260709 12:30:20.998553  4538 leader_election.cc:304] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:30:21.000149 10855 raft_consensus.cc:2749] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:30:21.001168  4538 leader_election.cc:336] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Network error: Client connection negotiation failed: client connection to 127.2.157.3:33709: connect: Connection refused (error 111)
W20260709 12:30:21.004978  4536 leader_election.cc:336] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:21.005231  4538 leader_election.cc:336] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Network error: Client connection negotiation failed: client connection to 127.2.157.3:33709: connect: Connection refused (error 111)
I20260709 12:30:21.005649  4536 leader_election.cc:304] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:21.006474 10853 raft_consensus.cc:2749] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:30:21.006670  4536 leader_election.cc:336] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:21.007171  4536 leader_election.cc:304] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:21.008123 10853 raft_consensus.cc:2749] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:30:21.009092  4536 consensus_peers.cc:597] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:30:21.005743  4538 leader_election.cc:336] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Network error: Client connection negotiation failed: client connection to 127.2.157.3:33709: connect: Connection refused (error 111)
W20260709 12:30:21.010056  4538 leader_election.cc:336] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Network error: Client connection negotiation failed: client connection to 127.2.157.3:33709: connect: Connection refused (error 111)
W20260709 12:30:21.010654  4538 leader_election.cc:336] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Network error: Client connection negotiation failed: client connection to 127.2.157.3:33709: connect: Connection refused (error 111)
I20260709 12:30:21.011076  4538 leader_election.cc:304] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
W20260709 12:30:21.013041  4536 leader_election.cc:336] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
W20260709 12:30:21.014297  4538 leader_election.cc:336] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Network error: Client connection negotiation failed: client connection to 127.2.157.3:33709: connect: Connection refused (error 111)
I20260709 12:30:21.016503 10853 raft_consensus.cc:2749] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:30:21.019681  4538 leader_election.cc:336] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Network error: Client connection negotiation failed: client connection to 127.2.157.3:33709: connect: Connection refused (error 111)
W20260709 12:30:21.020558  4538 leader_election.cc:336] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): Network error: Client connection negotiation failed: client connection to 127.2.157.3:33709: connect: Connection refused (error 111)
I20260709 12:30:21.020957  4538 leader_election.cc:304] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 073f84fcc295417f9bcc1eea29d2bb58, 34711da9380944d2969a2bc3e203db3d
I20260709 12:30:21.022596  4536 leader_election.cc:304] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:21.025156 10853 raft_consensus.cc:2749] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:30:21.025245 10855 raft_consensus.cc:2749] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:30:21.026475  4536 leader_election.cc:336] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:21.026952  4536 leader_election.cc:304] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:21.027674 10855 raft_consensus.cc:2749] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:30:21.029975  4536 leader_election.cc:336] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:21.031370  4536 leader_election.cc:304] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:21.032048 10853 raft_consensus.cc:2749] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:30:21.035143  4536 leader_election.cc:336] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111)
I20260709 12:30:21.035558  4536 leader_election.cc:304] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cab225ecb7488386a1a19239498cfe; no voters: 34711da9380944d2969a2bc3e203db3d, 4eedd844c09d456ca0b3614490dd1dbb
I20260709 12:30:21.036227 10855 raft_consensus.cc:2749] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:30:21.045866  4536 consensus_peers.cc:597] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe -> Peer 4eedd844c09d456ca0b3614490dd1dbb (127.2.157.1:32843): Couldn't send request to peer 4eedd844c09d456ca0b3614490dd1dbb. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:32843: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:30:21.056924  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:21.058023  2676 tablet_replica.cc:333] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.059358  2676 raft_consensus.cc:2243] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.060307  2676 raft_consensus.cc:2272] T 95a53a95fd9f44e59c1b1615b9281948 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.062963  2676 tablet_replica.cc:333] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.063663  2676 raft_consensus.cc:2243] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.064203  2676 raft_consensus.cc:2272] T d5c03e098f9a45cd94c52ada1bc9fa11 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.066527  2676 tablet_replica.cc:333] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.067131  2676 raft_consensus.cc:2243] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.067826  2676 raft_consensus.cc:2272] T c5bc554f69c94b9887b24097921bd77e P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.070909  2676 tablet_replica.cc:333] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.071638  2676 raft_consensus.cc:2243] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.072340  2676 raft_consensus.cc:2272] T 8d772c24bae14b138d4062798651f82f P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.074884  2676 tablet_replica.cc:333] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.075539  2676 raft_consensus.cc:2243] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.075994  2676 raft_consensus.cc:2272] T 383a24e3cada4485922ab39de63b4de9 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.078398  2676 tablet_replica.cc:333] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.078970  2676 raft_consensus.cc:2243] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.079934  2676 raft_consensus.cc:2272] T ba2105a333194a478762048de8b5853c P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.082201  2676 tablet_replica.cc:333] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.082799  2676 raft_consensus.cc:2243] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.083360  2676 raft_consensus.cc:2272] T 5149ad67f39c49a6b07934b58605690c P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.085485  2676 tablet_replica.cc:333] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.086222  2676 raft_consensus.cc:2243] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.087078  2676 raft_consensus.cc:2272] T 2cd145ac0c9d4f1fbf7e300e3d5cd972 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.089453  2676 tablet_replica.cc:333] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.090049  2676 raft_consensus.cc:2243] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.090588  2676 raft_consensus.cc:2272] T e10f480d05fc4f71af73fcd88b588f21 P f3cab225ecb7488386a1a19239498cfe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.093130  2676 tablet_replica.cc:333] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.093672  2676 raft_consensus.cc:2243] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.094586  2676 raft_consensus.cc:2272] T 6017f50df9e3498d929adc22812d22cf P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.096689  2676 tablet_replica.cc:333] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.097288  2676 raft_consensus.cc:2243] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.098186  2676 raft_consensus.cc:2272] T 611a21088f764ac6bf8767713d911869 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.100342  2676 tablet_replica.cc:333] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.100903  2676 raft_consensus.cc:2243] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.101869  2676 raft_consensus.cc:2272] T 26de30c1b5e74f05815f13d9ceea7f45 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.103960  2676 tablet_replica.cc:333] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.104583  2676 raft_consensus.cc:2243] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.105643  2676 raft_consensus.cc:2272] T 008722eae8ea40db92fea0a5f70961f3 P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.107784  2676 tablet_replica.cc:333] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.108367  2676 raft_consensus.cc:2243] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.109163  2676 raft_consensus.cc:2272] T a8cb467dd69d4e7785fd70c9c63614ea P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.111295  2676 tablet_replica.cc:333] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.111892  2676 raft_consensus.cc:2243] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.112357  2676 raft_consensus.cc:2272] T ecfd004856c24015ae137dfd5fd34b2c P f3cab225ecb7488386a1a19239498cfe [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.114537  2676 tablet_replica.cc:333] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.115049  2676 raft_consensus.cc:2243] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.115702  2676 raft_consensus.cc:2272] T 8abf2cd47e3c44d995fbbb863bf3d5ac P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.117792  2676 tablet_replica.cc:333] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.118454  2676 raft_consensus.cc:2243] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.119347  2676 raft_consensus.cc:2272] T 3d9116f60a784d21bf919694ec32bdbb P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.121436  2676 tablet_replica.cc:333] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.122013  2676 raft_consensus.cc:2243] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.123073  2676 raft_consensus.cc:2272] T 36aa23e03c114b66abce211a070a9c93 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.125227  2676 tablet_replica.cc:333] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.125748  2676 raft_consensus.cc:2243] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.126626  2676 raft_consensus.cc:2272] T 9b7d3aec426d4ef7aa5adcd0ab4c8da2 P f3cab225ecb7488386a1a19239498cfe [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.128605  2676 tablet_replica.cc:333] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.129179  2676 raft_consensus.cc:2243] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.130084  2676 raft_consensus.cc:2272] T 20fdebd7b9154e47beb5e08a62175fe5 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.132141  2676 tablet_replica.cc:333] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.132670  2676 raft_consensus.cc:2243] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.133466  2676 raft_consensus.cc:2272] T fb53ea47358c4bca95e2856114bf0412 P f3cab225ecb7488386a1a19239498cfe [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.135510  2676 tablet_replica.cc:333] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.136031  2676 raft_consensus.cc:2243] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.136855  2676 raft_consensus.cc:2272] T 3d5f24773bb44448a1cb122558f0c4c9 P f3cab225ecb7488386a1a19239498cfe [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.138770  2676 tablet_replica.cc:333] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.139286  2676 raft_consensus.cc:2243] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.140264  2676 raft_consensus.cc:2272] T dcafa6aa2cb54d969725d5e69f9b4a5d P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.142335  2676 tablet_replica.cc:333] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.142876  2676 raft_consensus.cc:2243] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.143926  2676 raft_consensus.cc:2272] T a196cfd02592426389eee8bd2a8edb36 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.146162  2676 tablet_replica.cc:333] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.146734  2676 raft_consensus.cc:2243] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.147210  2676 raft_consensus.cc:2272] T a445f8740fa847ed9ac463915fa09725 P f3cab225ecb7488386a1a19239498cfe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.149514  2676 tablet_replica.cc:333] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.150069  2676 raft_consensus.cc:2243] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.150611  2676 raft_consensus.cc:2272] T ace1274bf4f34853b37ab7a08103d367 P f3cab225ecb7488386a1a19239498cfe [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.152635  2676 tablet_replica.cc:333] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.153223  2676 raft_consensus.cc:2243] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.153757  2676 raft_consensus.cc:2272] T 812f8e58e6d54e67a0d699b41fc6815b P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.155850  2676 tablet_replica.cc:333] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.156394  2676 raft_consensus.cc:2243] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.156848  2676 raft_consensus.cc:2272] T 8693e7a0624445758baf0b77c7686e0c P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.158861  2676 tablet_replica.cc:333] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.159394  2676 raft_consensus.cc:2243] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.159951  2676 raft_consensus.cc:2272] T 455f8427897049759001979ea81adec1 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.161867  2676 tablet_replica.cc:333] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.162454  2676 raft_consensus.cc:2243] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.162890  2676 raft_consensus.cc:2272] T eadf6ff4956f47ff8a85f77d02584a0d P f3cab225ecb7488386a1a19239498cfe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.164964  2676 tablet_replica.cc:333] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.165491  2676 raft_consensus.cc:2243] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.166069  2676 raft_consensus.cc:2272] T 781f4e626c2b4af0af08871cfde2d83e P f3cab225ecb7488386a1a19239498cfe [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.167940  2676 tablet_replica.cc:333] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.168532  2676 raft_consensus.cc:2243] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.169379  2676 raft_consensus.cc:2272] T e9c4439798ed4427881ec18a55649f4b P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.171433  2676 tablet_replica.cc:333] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.171948  2676 raft_consensus.cc:2243] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.172545  2676 raft_consensus.cc:2272] T 65ec95afb9e240f29bd517e63249c8d2 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.174425  2676 tablet_replica.cc:333] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.174947  2676 raft_consensus.cc:2243] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.175467  2676 raft_consensus.cc:2272] T 9a955b1f59694973b581077ee60e7e4a P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.177412  2676 tablet_replica.cc:333] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.177963  2676 raft_consensus.cc:2243] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.178462  2676 raft_consensus.cc:2272] T 2bf4f0ff3c484df18d42d887c059c170 P f3cab225ecb7488386a1a19239498cfe [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.180624  2676 tablet_replica.cc:333] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.181138  2676 raft_consensus.cc:2243] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.181614  2676 raft_consensus.cc:2272] T 378a06c64b37451cbad82415b967e001 P f3cab225ecb7488386a1a19239498cfe [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.183531  2676 tablet_replica.cc:333] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.184046  2676 raft_consensus.cc:2243] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.184967  2676 raft_consensus.cc:2272] T 86e92801c3904600b054e99343413645 P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.186928  2676 tablet_replica.cc:333] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.187433  2676 raft_consensus.cc:2243] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:30:21.188321  2676 raft_consensus.cc:2272] T 88b08017bb344d72aa432be8a7d5d03f P f3cab225ecb7488386a1a19239498cfe [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.190191  2676 tablet_replica.cc:333] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe: stopping tablet replica
I20260709 12:30:21.190678  2676 raft_consensus.cc:2243] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:21.191203  2676 raft_consensus.cc:2272] T 7185a57fbd78466ab6ccbbbd0453c2aa P f3cab225ecb7488386a1a19239498cfe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:21.540005  2676 tablet_server.cc:196] TabletServer@127.2.157.4:0 shutdown complete.
I20260709 12:30:21.612076  2676 master.cc:562] Master@127.2.157.62:44099 shutting down...
W20260709 12:30:21.640679  3802 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:30:21.641022  3802 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:30:21.641240  3802 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:30:28.560678  3741 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.157.3:33709: connect: Connection refused (error 111) [suppressed 89 similar messages]
W20260709 12:30:28.564296  3741 catalog_manager.cc:4755] TS 34711da9380944d2969a2bc3e203db3d (127.2.157.3:33709): ChangeConfig:REMOVE_PEER RPC failed for tablet 95a53a95fd9f44e59c1b1615b9281948: Network error: Client connection negotiation failed: client connection to 127.2.157.3:33709: connect: Connection refused (error 111)
I20260709 12:30:28.632684  2676 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:28.633455  2676 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:28.633773  2676 tablet_replica.cc:333] T 00000000000000000000000000000000 P a21ae62b873f4aa28d9c28a3b1bc7936: stopping tablet replica
I20260709 12:30:28.924751  2676 master.cc:584] Master@127.2.157.62:44099 shutdown complete.
I20260709 12:30:28.968374  2676 test_util.cc:182] -----------------------------------------------
I20260709 12:30:28.968645  2676 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599939977835-2676-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (227028 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:30:28.972103  2676 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.62:39749
I20260709 12:30:28.973305  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:28.979144 10858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:28.979297 10859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:28.980667 10861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:28.982293  2676 server_base.cc:1061] running on GCE node
I20260709 12:30:28.985644  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:28.985826  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:28.986021  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600228986007 us; error 0 us; skew 500 ppm
I20260709 12:30:28.986481  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:28.988826  2676 webserver.cc:533] Webserver started at http://127.2.157.62:43615/ using document root <none> and password file <none>
I20260709 12:30:28.989300  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:28.989450  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:28.989670  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:28.990959  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/master-0-root/instance:
uuid: "fd570037dd044a17bb7315435491a898"
format_stamp: "Formatted at 2026-07-09 12:30:28 on dist-test-slave-0768"
I20260709 12:30:28.995465  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:30:28.999127 10866 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:28.999930  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:30:29.000270  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/master-0-root
uuid: "fd570037dd044a17bb7315435491a898"
format_stamp: "Formatted at 2026-07-09 12:30:28 on dist-test-slave-0768"
I20260709 12:30:29.000571  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:29.024437  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:29.025789  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:29.064571  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.62:39749
I20260709 12:30:29.064677 10917 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.62:39749 every 8 connection(s)
I20260709 12:30:29.068841 10918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.080478 10918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898: Bootstrap starting.
I20260709 12:30:29.085759 10918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:29.090292 10918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898: No bootstrap required, opened a new log
I20260709 12:30:29.092530 10918 raft_consensus.cc:359] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd570037dd044a17bb7315435491a898" member_type: VOTER }
I20260709 12:30:29.092902 10918 raft_consensus.cc:385] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:29.093194 10918 raft_consensus.cc:740] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd570037dd044a17bb7315435491a898, State: Initialized, Role: FOLLOWER
I20260709 12:30:29.093755 10918 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd570037dd044a17bb7315435491a898" member_type: VOTER }
I20260709 12:30:29.094274 10918 raft_consensus.cc:399] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:30:29.094503 10918 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:30:29.094717 10918 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:29.099140 10918 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd570037dd044a17bb7315435491a898" member_type: VOTER }
I20260709 12:30:29.099592 10918 leader_election.cc:304] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd570037dd044a17bb7315435491a898; no voters: 
I20260709 12:30:29.100677 10918 leader_election.cc:290] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:30:29.101015 10921 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:29.102535 10921 raft_consensus.cc:697] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [term 1 LEADER]: Becoming Leader. State: Replica: fd570037dd044a17bb7315435491a898, State: Running, Role: LEADER
I20260709 12:30:29.103267 10921 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd570037dd044a17bb7315435491a898" member_type: VOTER }
I20260709 12:30:29.103816 10918 sys_catalog.cc:565] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:30:29.108089 10923 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd570037dd044a17bb7315435491a898. Latest consensus state: current_term: 1 leader_uuid: "fd570037dd044a17bb7315435491a898" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd570037dd044a17bb7315435491a898" member_type: VOTER } }
I20260709 12:30:29.108804 10923 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [sys.catalog]: This master's current role is: LEADER
I20260709 12:30:29.109007 10922 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd570037dd044a17bb7315435491a898" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd570037dd044a17bb7315435491a898" member_type: VOTER } }
I20260709 12:30:29.109640 10922 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [sys.catalog]: This master's current role is: LEADER
I20260709 12:30:29.112046 10930 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:30:29.116854 10930 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:30:29.119191  2676 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:30:29.126219 10930 catalog_manager.cc:1383] Generated new cluster ID: 76bfd262c7f644168c5cbb1b143436f6
I20260709 12:30:29.126577 10930 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:30:29.145900 10930 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:30:29.147166 10930 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:30:29.158351 10930 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898: Generated new TSK 0
I20260709 12:30:29.158946 10930 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:30:29.185685  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:29.192090 10939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:29.193064 10940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:29.194345 10942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:29.195298  2676 server_base.cc:1061] running on GCE node
I20260709 12:30:29.197315  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:29.197506  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:29.197631  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600229197620 us; error 0 us; skew 500 ppm
I20260709 12:30:29.198165  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:29.221199  2676 webserver.cc:533] Webserver started at http://127.2.157.1:45353/ using document root <none> and password file <none>
I20260709 12:30:29.221943  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:29.222148  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:29.222417  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:29.223825  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/instance:
uuid: "61218d0202f44940b61185f640880574"
format_stamp: "Formatted at 2026-07-09 12:30:29 on dist-test-slave-0768"
I20260709 12:30:29.229179  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:30:29.233830 10948 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:29.234714  2676 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:30:29.235064  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-0-root
uuid: "61218d0202f44940b61185f640880574"
format_stamp: "Formatted at 2026-07-09 12:30:29 on dist-test-slave-0768"
I20260709 12:30:29.235401  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:29.250586  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:29.252084  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:29.253818  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:29.256712  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:29.256979  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:29.257299  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:29.257519  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:29.303277  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.1:42037
I20260709 12:30:29.303370 11010 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.1:42037 every 8 connection(s)
I20260709 12:30:29.310334  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:29.319095 11015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:29.320206 11016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:29.322994 11018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:29.324713 11011 heartbeater.cc:344] Connected to a master server at 127.2.157.62:39749
I20260709 12:30:29.325163 11011 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:29.325716  2676 server_base.cc:1061] running on GCE node
I20260709 12:30:29.326318 11011 heartbeater.cc:507] Master 127.2.157.62:39749 requested a full tablet report, sending...
I20260709 12:30:29.328554  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:29.328997  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:29.329267  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600229329238 us; error 0 us; skew 500 ppm
I20260709 12:30:29.329511 10883 ts_manager.cc:194] Registered new tserver with Master: 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:29.330111  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:29.332187 10883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49734
I20260709 12:30:29.333406  2676 webserver.cc:533] Webserver started at http://127.2.157.2:35329/ using document root <none> and password file <none>
I20260709 12:30:29.334116  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:29.334321  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:29.334618  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:29.335850  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/instance:
uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
format_stamp: "Formatted at 2026-07-09 12:30:29 on dist-test-slave-0768"
I20260709 12:30:29.340399  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:30:29.343997 11023 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:29.344802  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:30:29.345111  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-1-root
uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
format_stamp: "Formatted at 2026-07-09 12:30:29 on dist-test-slave-0768"
I20260709 12:30:29.345413  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:29.359536  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:29.360850  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:29.362402  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:29.364571  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:29.364801  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:29.365041  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:29.365211  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:29.408000  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.2:46695
I20260709 12:30:29.408138 11085 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.2:46695 every 8 connection(s)
I20260709 12:30:29.413028  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:29.420625 11089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:29.422375 11090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:29.423406  2676 server_base.cc:1061] running on GCE node
W20260709 12:30:29.424722 11092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:29.425961  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:29.426249  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:29.426466  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600229426449 us; error 0 us; skew 500 ppm
I20260709 12:30:29.427140  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:29.427089 11086 heartbeater.cc:344] Connected to a master server at 127.2.157.62:39749
I20260709 12:30:29.427793 11086 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:29.428580 11086 heartbeater.cc:507] Master 127.2.157.62:39749 requested a full tablet report, sending...
I20260709 12:30:29.430413  2676 webserver.cc:533] Webserver started at http://127.2.157.3:36209/ using document root <none> and password file <none>
I20260709 12:30:29.430833 10883 ts_manager.cc:194] Registered new tserver with Master: 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:29.431125  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:29.431419  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:29.431740  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:29.432806 10883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49736
I20260709 12:30:29.433476  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/instance:
uuid: "a96b33d3dcf7432e904439b5be66dee1"
format_stamp: "Formatted at 2026-07-09 12:30:29 on dist-test-slave-0768"
I20260709 12:30:29.438252  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:30:29.441792 11097 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:29.442662  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:30:29.442961  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-2-root
uuid: "a96b33d3dcf7432e904439b5be66dee1"
format_stamp: "Formatted at 2026-07-09 12:30:29 on dist-test-slave-0768"
I20260709 12:30:29.443255  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:29.469381  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:29.470719  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:29.472276  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:29.474620  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:29.474852  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:29.475095  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:29.475278  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:29.517654  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.3:44703
I20260709 12:30:29.517802 11159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.3:44703 every 8 connection(s)
I20260709 12:30:29.522787  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:29.530577 11163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:29.531461 11164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:29.533859 11166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:29.534421  2676 server_base.cc:1061] running on GCE node
I20260709 12:30:29.535739  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:29.536011  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:29.536237  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600229536222 us; error 0 us; skew 500 ppm
I20260709 12:30:29.536500 11160 heartbeater.cc:344] Connected to a master server at 127.2.157.62:39749
I20260709 12:30:29.536866  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:29.536875 11160 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:29.538200 11160 heartbeater.cc:507] Master 127.2.157.62:39749 requested a full tablet report, sending...
I20260709 12:30:29.539705  2676 webserver.cc:533] Webserver started at http://127.2.157.4:35595/ using document root <none> and password file <none>
I20260709 12:30:29.540310  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:29.540521  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:29.540414 10883 ts_manager.cc:194] Registered new tserver with Master: a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:29.540972  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:29.542122 10883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49744
I20260709 12:30:29.542315  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-3-root/instance:
uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
format_stamp: "Formatted at 2026-07-09 12:30:29 on dist-test-slave-0768"
I20260709 12:30:29.547274  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:30:29.550673 11171 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:29.551396  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:30:29.551697  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-3-root
uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
format_stamp: "Formatted at 2026-07-09 12:30:29 on dist-test-slave-0768"
I20260709 12:30:29.551985  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:29.576915  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:29.578291  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:29.579794  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:29.582966  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:29.583267  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:29.583602  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:29.583808  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:29.628387  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.4:37545
I20260709 12:30:29.628654 11233 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.4:37545 every 8 connection(s)
I20260709 12:30:29.643107 11234 heartbeater.cc:344] Connected to a master server at 127.2.157.62:39749
I20260709 12:30:29.643494 11234 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:29.644222 11234 heartbeater.cc:507] Master 127.2.157.62:39749 requested a full tablet report, sending...
I20260709 12:30:29.646440 10883 ts_manager.cc:194] Registered new tserver with Master: 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:29.646553  2676 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014947554s
I20260709 12:30:29.647953 10883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49754
I20260709 12:30:29.675176 10883 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49766:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:30:29.915990 11199 tablet_service.cc:1511] Processing CreateTablet for tablet 45c4826eccd146d3875548011ee59fd4 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:30:29.918006 11199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c4826eccd146d3875548011ee59fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.924875 11123 tablet_service.cc:1511] Processing CreateTablet for tablet c81cc846f99441b693acaebd1a63ab21 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:30:29.919870 11124 tablet_service.cc:1511] Processing CreateTablet for tablet c4f21b6512ac4704a7d26664b97dffcd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:30:29.922071 11198 tablet_service.cc:1511] Processing CreateTablet for tablet 61510ef1eced49019efc704e8fc16746 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:30:29.926680 11123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c81cc846f99441b693acaebd1a63ab21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.926993 11198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61510ef1eced49019efc704e8fc16746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.919756 11125 tablet_service.cc:1511] Processing CreateTablet for tablet 45c4826eccd146d3875548011ee59fd4 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:30:29.930100 11124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f21b6512ac4704a7d26664b97dffcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.931061 11125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c4826eccd146d3875548011ee59fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.935357 11197 tablet_service.cc:1511] Processing CreateTablet for tablet c81cc846f99441b693acaebd1a63ab21 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:30:29.936944 11197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c81cc846f99441b693acaebd1a63ab21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.944687 10973 tablet_service.cc:1511] Processing CreateTablet for tablet cdb14ded3ccc417d8d6cbe341049acec (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:30:29.945279 11196 tablet_service.cc:1511] Processing CreateTablet for tablet fd68a22c9db0420690b7299323e36893 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:30:29.946301 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb14ded3ccc417d8d6cbe341049acec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.944687 10975 tablet_service.cc:1511] Processing CreateTablet for tablet 61510ef1eced49019efc704e8fc16746 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:30:29.948342 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61510ef1eced49019efc704e8fc16746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.951149 11051 tablet_service.cc:1511] Processing CreateTablet for tablet 45c4826eccd146d3875548011ee59fd4 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:30:29.952689 11051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c4826eccd146d3875548011ee59fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.953099 10971 tablet_service.cc:1511] Processing CreateTablet for tablet ce15f9449fe54fa9a8388a7964e137d4 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:30:29.954516 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce15f9449fe54fa9a8388a7964e137d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.954650 11050 tablet_service.cc:1511] Processing CreateTablet for tablet c4f21b6512ac4704a7d26664b97dffcd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:30:29.956022 11050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f21b6512ac4704a7d26664b97dffcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.958516 10974 tablet_service.cc:1511] Processing CreateTablet for tablet c81cc846f99441b693acaebd1a63ab21 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:30:29.959144 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 61510ef1eced49019efc704e8fc16746 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:30:29.959949 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c81cc846f99441b693acaebd1a63ab21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.960523 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61510ef1eced49019efc704e8fc16746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.963203 11047 tablet_service.cc:1511] Processing CreateTablet for tablet fd68a22c9db0420690b7299323e36893 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:30:29.964716 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd68a22c9db0420690b7299323e36893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.967199 11046 tablet_service.cc:1511] Processing CreateTablet for tablet d4b07813c2dd4a5cbd0c31d8fb4fb267 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:30:29.968623 11046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4b07813c2dd4a5cbd0c31d8fb4fb267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.969558 11048 tablet_service.cc:1511] Processing CreateTablet for tablet cdb14ded3ccc417d8d6cbe341049acec (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:30:29.971544 11048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb14ded3ccc417d8d6cbe341049acec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.943054 10976 tablet_service.cc:1511] Processing CreateTablet for tablet c4f21b6512ac4704a7d26664b97dffcd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:30:29.940876 11122 tablet_service.cc:1511] Processing CreateTablet for tablet cdb14ded3ccc417d8d6cbe341049acec (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:30:29.980839 11122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb14ded3ccc417d8d6cbe341049acec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.951149 10972 tablet_service.cc:1511] Processing CreateTablet for tablet fd68a22c9db0420690b7299323e36893 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:30:29.982955 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd68a22c9db0420690b7299323e36893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.986052 11196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd68a22c9db0420690b7299323e36893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.986433 10970 tablet_service.cc:1511] Processing CreateTablet for tablet 6f518b6c3e974aa3b500f4cd12acd425 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:30:29.988303 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f518b6c3e974aa3b500f4cd12acd425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:29.990451 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f21b6512ac4704a7d26664b97dffcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.008483 11045 tablet_service.cc:1511] Processing CreateTablet for tablet 6f518b6c3e974aa3b500f4cd12acd425 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:30:30.014262 11045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f518b6c3e974aa3b500f4cd12acd425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.019433 11199 tablet_service.cc:1511] Processing CreateTablet for tablet ce15f9449fe54fa9a8388a7964e137d4 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:30:30.020840 11199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce15f9449fe54fa9a8388a7964e137d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.023756 11195 tablet_service.cc:1511] Processing CreateTablet for tablet d4b07813c2dd4a5cbd0c31d8fb4fb267 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:30:30.025259 11195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4b07813c2dd4a5cbd0c31d8fb4fb267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.026337 10969 tablet_service.cc:1511] Processing CreateTablet for tablet 233e7dc1963548a1b4309d90f787084c (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:30:30.027849 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233e7dc1963548a1b4309d90f787084c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.027531 11121 tablet_service.cc:1511] Processing CreateTablet for tablet ce15f9449fe54fa9a8388a7964e137d4 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:30:30.028903 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce15f9449fe54fa9a8388a7964e137d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.033917 11120 tablet_service.cc:1511] Processing CreateTablet for tablet d4b07813c2dd4a5cbd0c31d8fb4fb267 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:30:30.035503 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4b07813c2dd4a5cbd0c31d8fb4fb267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.038471 11119 tablet_service.cc:1511] Processing CreateTablet for tablet 6f518b6c3e974aa3b500f4cd12acd425 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:30:30.039938 11119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f518b6c3e974aa3b500f4cd12acd425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.039595 11194 tablet_service.cc:1511] Processing CreateTablet for tablet 233e7dc1963548a1b4309d90f787084c (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:30:30.040980 11194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233e7dc1963548a1b4309d90f787084c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.113266 11047 tablet_service.cc:1511] Processing CreateTablet for tablet 233e7dc1963548a1b4309d90f787084c (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
W20260709 12:30:30.114884 10931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:30.118202 11118 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff7da973fbe46b9bbf5a9c29068f675 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:30:30.127003 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233e7dc1963548a1b4309d90f787084c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.127192 11118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff7da973fbe46b9bbf5a9c29068f675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.131168 11193 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff7da973fbe46b9bbf5a9c29068f675 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:30:30.132588 11193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff7da973fbe46b9bbf5a9c29068f675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.133685 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff7da973fbe46b9bbf5a9c29068f675 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:30:30.135056 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff7da973fbe46b9bbf5a9c29068f675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.143092 11254 tablet_bootstrap.cc:492] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:30.156073 11255 tablet_bootstrap.cc:492] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:30.162014 11253 tablet_bootstrap.cc:492] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:30.143092 11256 tablet_bootstrap.cc:492] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:30.176383 11253 tablet_bootstrap.cc:654] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:30.179181 11255 tablet_bootstrap.cc:654] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:30.180109 11254 tablet_bootstrap.cc:654] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:30.214181 11051 tablet_service.cc:1511] Processing CreateTablet for tablet e793b1e1be754642bc961d9830f30c9b (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:30:30.216051 11051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e793b1e1be754642bc961d9830f30c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.228221 11256 tablet_bootstrap.cc:654] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:30.249349 11255 tablet_bootstrap.cc:492] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:30.250002 11253 tablet_bootstrap.cc:492] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:30.250051 11255 ts_tablet_manager.cc:1403] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.094s	user 0.042s	sys 0.035s
I20260709 12:30:30.254958 11255 raft_consensus.cc:359] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
W20260709 12:30:30.256340 10867 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.2.157.3:44703, user_credentials={real_user=slave}} blocked reactor thread for 44337.5us
I20260709 12:30:30.253754 11253 ts_tablet_manager.cc:1403] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.092s	user 0.019s	sys 0.035s
I20260709 12:30:30.260133 11196 tablet_service.cc:1511] Processing CreateTablet for tablet e793b1e1be754642bc961d9830f30c9b (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:30:30.261468 11196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e793b1e1be754642bc961d9830f30c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.262918 11120 tablet_service.cc:1511] Processing CreateTablet for tablet e793b1e1be754642bc961d9830f30c9b (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:30:30.263756 11255 raft_consensus.cc:385] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:30.264277 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e793b1e1be754642bc961d9830f30c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.264678 10972 tablet_service.cc:1511] Processing CreateTablet for tablet 84ac5be704e94cae97eba537ab6c9b8c (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:30:30.264154 11255 raft_consensus.cc:740] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:30.265938 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ac5be704e94cae97eba537ab6c9b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.265760 11193 tablet_service.cc:1511] Processing CreateTablet for tablet c10383d0fa134e14b6756caf02036ddd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:30:30.267241 11193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10383d0fa134e14b6756caf02036ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.266731 11255 consensus_queue.cc:260] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:30.267993 11254 tablet_bootstrap.cc:492] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:30.268487 11254 ts_tablet_manager.cc:1403] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.126s	user 0.003s	sys 0.009s
I20260709 12:30:30.262143 11253 raft_consensus.cc:359] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:30.269503 11050 tablet_service.cc:1511] Processing CreateTablet for tablet 84ac5be704e94cae97eba537ab6c9b8c (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:30:30.270128 11253 raft_consensus.cc:385] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:30.270550 11253 raft_consensus.cc:740] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:30.270838 11050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ac5be704e94cae97eba537ab6c9b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.271402 11253 consensus_queue.cc:260] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:30.271700 11254 raft_consensus.cc:359] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:30.272472 11254 raft_consensus.cc:385] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:30.273701 11119 tablet_service.cc:1511] Processing CreateTablet for tablet 84ac5be704e94cae97eba537ab6c9b8c (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:30:30.287034 11119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ac5be704e94cae97eba537ab6c9b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.278549 10974 tablet_service.cc:1511] Processing CreateTablet for tablet c10383d0fa134e14b6756caf02036ddd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:30:30.290753 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10383d0fa134e14b6756caf02036ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.284801 11047 tablet_service.cc:1511] Processing CreateTablet for tablet c10383d0fa134e14b6756caf02036ddd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:30:30.294699 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10383d0fa134e14b6756caf02036ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.300575 11122 tablet_service.cc:1511] Processing CreateTablet for tablet f6b390078e79408a91ac1f52eaa9b4cd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:30:30.302090 11122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6b390078e79408a91ac1f52eaa9b4cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.310562 11194 tablet_service.cc:1511] Processing CreateTablet for tablet f6b390078e79408a91ac1f52eaa9b4cd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:30:30.312095 11194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6b390078e79408a91ac1f52eaa9b4cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.320832 11049 tablet_service.cc:1511] Processing CreateTablet for tablet b1cd03e5c5784bc2a3f7fd16049ed3e2 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:30:30.303844 11254 raft_consensus.cc:740] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:30.323289 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1cd03e5c5784bc2a3f7fd16049ed3e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.323335 11254 consensus_queue.cc:260] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:30.324237 10975 tablet_service.cc:1511] Processing CreateTablet for tablet f6b390078e79408a91ac1f52eaa9b4cd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:30:30.335666 11011 heartbeater.cc:499] Master 127.2.157.62:39749 was elected leader, sending a full tablet report...
I20260709 12:30:30.335858 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6b390078e79408a91ac1f52eaa9b4cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.336257 11197 tablet_service.cc:1511] Processing CreateTablet for tablet b1cd03e5c5784bc2a3f7fd16049ed3e2 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:30:30.337603 11197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1cd03e5c5784bc2a3f7fd16049ed3e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.334056 11255 ts_tablet_manager.cc:1434] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.083s	user 0.044s	sys 0.022s
I20260709 12:30:30.345924 11253 ts_tablet_manager.cc:1434] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.087s	user 0.010s	sys 0.009s
I20260709 12:30:30.346818 11234 heartbeater.cc:499] Master 127.2.157.62:39749 was elected leader, sending a full tablet report...
I20260709 12:30:30.355799 11253 tablet_bootstrap.cc:492] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:30.372601 11255 tablet_bootstrap.cc:492] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:30.366945 11124 tablet_service.cc:1511] Processing CreateTablet for tablet b1cd03e5c5784bc2a3f7fd16049ed3e2 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:30:30.374051 11124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1cd03e5c5784bc2a3f7fd16049ed3e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.379061 10975 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff7a31e74574166b261914cd71d423e (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
W20260709 12:30:30.383090 11235 tablet.cc:2406] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:30:30.383644 11051 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff7a31e74574166b261914cd71d423e (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:30:30.393087 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff7a31e74574166b261914cd71d423e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.389978 11120 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff7a31e74574166b261914cd71d423e (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:30:30.397676 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff7a31e74574166b261914cd71d423e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.399251 11255 tablet_bootstrap.cc:654] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:30.404281 11253 tablet_bootstrap.cc:654] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:30.411825 11196 tablet_service.cc:1511] Processing CreateTablet for tablet 4bf709305a2b4084a73fb3108f94c828 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:30:30.412803 11254 ts_tablet_manager.cc:1434] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.144s	user 0.009s	sys 0.014s
I20260709 12:30:30.413244 11196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bf709305a2b4084a73fb3108f94c828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.403507 11051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff7a31e74574166b261914cd71d423e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.413981 11254 tablet_bootstrap.cc:492] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:30.412676 10972 tablet_service.cc:1511] Processing CreateTablet for tablet 4bf709305a2b4084a73fb3108f94c828 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:30:30.416821 11086 heartbeater.cc:499] Master 127.2.157.62:39749 was elected leader, sending a full tablet report...
I20260709 12:30:30.416561 11119 tablet_service.cc:1511] Processing CreateTablet for tablet 7befb3713bcb4d2194f4deacce467056 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:30:30.420270 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bf709305a2b4084a73fb3108f94c828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.434868 11119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7befb3713bcb4d2194f4deacce467056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.436056 11256 tablet_bootstrap.cc:492] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:30.436657 11256 ts_tablet_manager.cc:1403] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.294s	user 0.018s	sys 0.010s
I20260709 12:30:30.451362 11047 tablet_service.cc:1511] Processing CreateTablet for tablet 4bf709305a2b4084a73fb3108f94c828 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:30:30.451628 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 7befb3713bcb4d2194f4deacce467056 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:30:30.452951 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7befb3713bcb4d2194f4deacce467056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.457470 10969 tablet_service.cc:1511] Processing CreateTablet for tablet b29ac676c05840d384d97014df8fdffd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:30:30.459018 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29ac676c05840d384d97014df8fdffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.459390 11045 tablet_service.cc:1511] Processing CreateTablet for tablet 2be854f634c14923853d3907984c6ca6 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:30:30.460724 11045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be854f634c14923853d3907984c6ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.463398 11048 tablet_service.cc:1511] Processing CreateTablet for tablet b29ac676c05840d384d97014df8fdffd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:30:30.465101 11254 tablet_bootstrap.cc:654] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:30.463678 11121 tablet_service.cc:1511] Processing CreateTablet for tablet 2be854f634c14923853d3907984c6ca6 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:30:30.470463 11195 tablet_service.cc:1511] Processing CreateTablet for tablet 271e5dce93d14266abb8069bb2020135 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:30:30.492378 11195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271e5dce93d14266abb8069bb2020135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.472043 11118 tablet_service.cc:1511] Processing CreateTablet for tablet b29ac676c05840d384d97014df8fdffd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:30:30.497104 11198 tablet_service.cc:1511] Processing CreateTablet for tablet 9dff538bcd7e40a796271ede9c45aab6 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:30:30.498557 11198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dff538bcd7e40a796271ede9c45aab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.498924 10970 tablet_service.cc:1511] Processing CreateTablet for tablet 9dff538bcd7e40a796271ede9c45aab6 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:30:30.500202 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dff538bcd7e40a796271ede9c45aab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.502883 11046 tablet_service.cc:1511] Processing CreateTablet for tablet 4a25febeedeb45368dcfe60611272c19 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:30:30.492374 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be854f634c14923853d3907984c6ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.504014 11124 tablet_service.cc:1511] Processing CreateTablet for tablet 4a25febeedeb45368dcfe60611272c19 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:30:30.507685 11124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a25febeedeb45368dcfe60611272c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.508661 11199 tablet_service.cc:1511] Processing CreateTablet for tablet 4a25febeedeb45368dcfe60611272c19 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:30:30.510270 11118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29ac676c05840d384d97014df8fdffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.516238 11253 tablet_bootstrap.cc:492] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:30.518440 10971 tablet_service.cc:1511] Processing CreateTablet for tablet 657f19d4020f48ce8138638594474e13 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:30:30.519888 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657f19d4020f48ce8138638594474e13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.522058 11044 tablet_service.cc:1511] Processing CreateTablet for tablet 657f19d4020f48ce8138638594474e13 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:30:30.524310 11122 tablet_service.cc:1511] Processing CreateTablet for tablet 657f19d4020f48ce8138638594474e13 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:30:30.525699 11122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657f19d4020f48ce8138638594474e13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.528348 11192 tablet_service.cc:1511] Processing CreateTablet for tablet 3cbb858478864fdd91f8a71c7d583382 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:30:30.530762 11199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a25febeedeb45368dcfe60611272c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.472959 11048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29ac676c05840d384d97014df8fdffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.475657 11193 tablet_service.cc:1511] Processing CreateTablet for tablet 2be854f634c14923853d3907984c6ca6 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:30:30.534749 11193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be854f634c14923853d3907984c6ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.479820 11255 tablet_bootstrap.cc:492] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:30.481287 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 271e5dce93d14266abb8069bb2020135 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:30:30.538256 11255 ts_tablet_manager.cc:1403] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.010s
I20260709 12:30:30.538552 11192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cbb858478864fdd91f8a71c7d583382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.538844 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271e5dce93d14266abb8069bb2020135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.482429 11194 tablet_service.cc:1511] Processing CreateTablet for tablet 7befb3713bcb4d2194f4deacce467056 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:30:30.542251 11044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 657f19d4020f48ce8138638594474e13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.542894 11194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7befb3713bcb4d2194f4deacce467056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.544720 11160 heartbeater.cc:499] Master 127.2.157.62:39749 was elected leader, sending a full tablet report...
I20260709 12:30:30.546214 11046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a25febeedeb45368dcfe60611272c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.486629 11125 tablet_service.cc:1511] Processing CreateTablet for tablet 9dff538bcd7e40a796271ede9c45aab6 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:30:30.547895 11125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dff538bcd7e40a796271ede9c45aab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.550247 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bf709305a2b4084a73fb3108f94c828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.541570 11255 raft_consensus.cc:359] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:30.554445 11255 raft_consensus.cc:385] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:30.554834 11255 raft_consensus.cc:740] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:30.472290 11256 raft_consensus.cc:359] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:30.555790 11256 raft_consensus.cc:385] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:30.555666 11255 consensus_queue.cc:260] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:30.516906 11253 ts_tablet_manager.cc:1403] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.161s	user 0.016s	sys 0.008s
I20260709 12:30:30.556255 11256 raft_consensus.cc:740] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:30.560947 11255 ts_tablet_manager.cc:1434] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:30:30.559206 11256 consensus_queue.cc:260] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:30.586934 11254 tablet_bootstrap.cc:492] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:30.587586 11254 ts_tablet_manager.cc:1403] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.174s	user 0.008s	sys 0.015s
I20260709 12:30:30.589171 10972 tablet_service.cc:1511] Processing CreateTablet for tablet 3cbb858478864fdd91f8a71c7d583382 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:30:30.590760 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cbb858478864fdd91f8a71c7d583382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.590623 11253 raft_consensus.cc:359] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:30.591531 11253 raft_consensus.cc:385] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:30.591884 11253 raft_consensus.cc:740] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:30.569983 11050 tablet_service.cc:1511] Processing CreateTablet for tablet 271e5dce93d14266abb8069bb2020135 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:30:30.594683 11050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271e5dce93d14266abb8069bb2020135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.597649 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 3cbb858478864fdd91f8a71c7d583382 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:30:30.599196 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cbb858478864fdd91f8a71c7d583382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.605785 11253 consensus_queue.cc:260] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:30.615437 11120 tablet_service.cc:1511] Processing CreateTablet for tablet 14c29611c5d144eeacac30952bc92aed (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:30:30.616978 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c29611c5d144eeacac30952bc92aed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.621670 11253 ts_tablet_manager.cc:1434] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 12:30:30.626161 11255 tablet_bootstrap.cc:492] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:30.611737 11254 raft_consensus.cc:359] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:30.634191 11254 raft_consensus.cc:385] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:30.636270 11254 raft_consensus.cc:740] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:30.643373 11253 tablet_bootstrap.cc:492] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:30.645016 11256 ts_tablet_manager.cc:1434] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.208s	user 0.014s	sys 0.001s
I20260709 12:30:30.646190 11256 tablet_bootstrap.cc:492] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:30.657215 11255 tablet_bootstrap.cc:654] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:30.659152 11254 consensus_queue.cc:260] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:30.686921 11254 ts_tablet_manager.cc:1434] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.001s
I20260709 12:30:30.663874 11198 tablet_service.cc:1511] Processing CreateTablet for tablet 14c29611c5d144eeacac30952bc92aed (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:30:30.667659 11048 tablet_service.cc:1511] Processing CreateTablet for tablet 3594610f072a45d7bc713888fe5cb278 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:30:30.671840 11118 tablet_service.cc:1511] Processing CreateTablet for tablet 3594610f072a45d7bc713888fe5cb278 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:30:30.688567 11048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3594610f072a45d7bc713888fe5cb278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.688697 11118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3594610f072a45d7bc713888fe5cb278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.673234 11192 tablet_service.cc:1511] Processing CreateTablet for tablet 3594610f072a45d7bc713888fe5cb278 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:30:30.690735 11192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3594610f072a45d7bc713888fe5cb278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.692009 11260 raft_consensus.cc:493] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:30.692646 11260 raft_consensus.cc:515] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:30.694640 11198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c29611c5d144eeacac30952bc92aed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.695689 11260 leader_election.cc:290] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:30.666308 10969 tablet_service.cc:1511] Processing CreateTablet for tablet 14c29611c5d144eeacac30952bc92aed (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:30:30.709070 11263 raft_consensus.cc:493] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:30.723500 11263 raft_consensus.cc:515] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:30.724047 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c29611c5d144eeacac30952bc92aed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.735276 11254 tablet_bootstrap.cc:492] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:30.736760 11263 leader_election.cc:290] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:30.748486 11125 tablet_service.cc:1511] Processing CreateTablet for tablet ddbef020004b425daa18c14ea59972d7 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:30:30.750196 11256 tablet_bootstrap.cc:654] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:30.750610 11125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbef020004b425daa18c14ea59972d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.750972 11194 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb59ce189c94c75972facd422484e58 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:30:30.752471 11194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb59ce189c94c75972facd422484e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.757063 10972 tablet_service.cc:1511] Processing CreateTablet for tablet ddbef020004b425daa18c14ea59972d7 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:30:30.758553 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbef020004b425daa18c14ea59972d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.761533 11261 raft_consensus.cc:493] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:30.762094 11261 raft_consensus.cc:515] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:30.766209 11261 leader_election.cc:290] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:30.767879 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb59ce189c94c75972facd422484e58 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:30:30.769827 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb59ce189c94c75972facd422484e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.673664 11253 tablet_bootstrap.cc:654] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:30.798977 11120 tablet_service.cc:1511] Processing CreateTablet for tablet 7db9ac26d7914efdb621c400b65a0b89 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:30:30.800813 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db9ac26d7914efdb621c400b65a0b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.813539 11192 tablet_service.cc:1511] Processing CreateTablet for tablet 7db9ac26d7914efdb621c400b65a0b89 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:30:30.815119 11192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db9ac26d7914efdb621c400b65a0b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.818266 11255 tablet_bootstrap.cc:492] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:30.818151 11049 tablet_service.cc:1511] Processing CreateTablet for tablet ddbef020004b425daa18c14ea59972d7 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:30:30.818980 11255 ts_tablet_manager.cc:1403] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.257s	user 0.009s	sys 0.007s
I20260709 12:30:30.819597 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbef020004b425daa18c14ea59972d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.822688 11254 tablet_bootstrap.cc:654] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:30.823024 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce15f9449fe54fa9a8388a7964e137d4" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:30.830648 10950 leader_election.cc:343] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:30.822494 11255 raft_consensus.cc:359] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:30.831946 11255 raft_consensus.cc:385] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:30.832309 11255 raft_consensus.cc:740] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:30.833397 11255 consensus_queue.cc:260] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:30.836724 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce15f9449fe54fa9a8388a7964e137d4" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:30.837935 11260 raft_consensus.cc:493] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:30.871083 11260 raft_consensus.cc:515] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:30.873590 11260 leader_election.cc:290] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:30.848634 11253 tablet_bootstrap.cc:492] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:30.848842 11256 tablet_bootstrap.cc:492] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:30.852775 11049 tablet_service.cc:1511] Processing CreateTablet for tablet b82ae79252824afe8ff9ffcd83005eae (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:30:30.881671 11253 ts_tablet_manager.cc:1403] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.239s	user 0.011s	sys 0.010s
I20260709 12:30:30.882201 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b82ae79252824afe8ff9ffcd83005eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.845358 11254 tablet_bootstrap.cc:492] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:30.862342 11118 tablet_service.cc:1511] Processing CreateTablet for tablet b82ae79252824afe8ff9ffcd83005eae (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:30:30.883620 11118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b82ae79252824afe8ff9ffcd83005eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.859118 10972 tablet_service.cc:1511] Processing CreateTablet for tablet 7db9ac26d7914efdb621c400b65a0b89 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:30:30.866736 11192 tablet_service.cc:1511] Processing CreateTablet for tablet b82ae79252824afe8ff9ffcd83005eae (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:30:30.885574 11253 raft_consensus.cc:359] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:30.886653 11253 raft_consensus.cc:385] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:30.886703 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db9ac26d7914efdb621c400b65a0b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.886861 11192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b82ae79252824afe8ff9ffcd83005eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.887147 11253 raft_consensus.cc:740] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:30.887506 11256 ts_tablet_manager.cc:1403] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.242s	user 0.012s	sys 0.012s
I20260709 12:30:30.888093 11253 consensus_queue.cc:260] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:30.890940 11253 ts_tablet_manager.cc:1434] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:30:30.890790 11256 raft_consensus.cc:359] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:30.891606 11256 raft_consensus.cc:385] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:30.891901 11256 raft_consensus.cc:740] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:30.875025 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61510ef1eced49019efc704e8fc16746" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:30.875806 11267 raft_consensus.cc:493] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:30.875720 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b07813c2dd4a5cbd0c31d8fb4fb267" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:30.876937 11050 tablet_service.cc:1511] Processing CreateTablet for tablet fcae59975bce4cefbe8718f31534067b (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:30:30.905864 11267 raft_consensus.cc:515] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
W20260709 12:30:30.879848 10949 leader_election.cc:343] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:30.907243 11050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcae59975bce4cefbe8718f31534067b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.907119 10949 leader_election.cc:304] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:30.908879 11267 leader_election.cc:290] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
W20260709 12:30:30.910102 11175 leader_election.cc:343] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:30.911036 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61510ef1eced49019efc704e8fc16746" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:30.880630 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb14ded3ccc417d8d6cbe341049acec" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:30.866210 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b07813c2dd4a5cbd0c31d8fb4fb267" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:30.867729 10969 tablet_service.cc:1511] Processing CreateTablet for tablet fcae59975bce4cefbe8718f31534067b (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 12:30:30.912688 11024 leader_election.cc:343] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:30.914832 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcae59975bce4cefbe8718f31534067b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:30:30.918455 11025 leader_election.cc:343] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:30.918076 11256 consensus_queue.cc:260] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:30.918939 11025 leader_election.cc:304] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:30.920142 11263 raft_consensus.cc:2749] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:30.920929 11256 ts_tablet_manager.cc:1434] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
W20260709 12:30:30.921738 10949 leader_election.cc:343] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:30.922058 11256 tablet_bootstrap.cc:492] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
W20260709 12:30:30.922698 11174 leader_election.cc:343] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:30.923171 11174 leader_election.cc:304] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:30.924356 11261 raft_consensus.cc:2749] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:30.925069 11194 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad1895184d543bebeba9172c4b7f560 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:30:30.926605 11194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad1895184d543bebeba9172c4b7f560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.927502 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad1895184d543bebeba9172c4b7f560 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:30:30.928894 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad1895184d543bebeba9172c4b7f560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.931783 11253 tablet_bootstrap.cc:492] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:30.935484 11047 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad1895184d543bebeba9172c4b7f560 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:30:30.928965 11256 tablet_bootstrap.cc:654] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:30.936877 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad1895184d543bebeba9172c4b7f560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.938129 11260 raft_consensus.cc:2749] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:30.869432 11048 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb59ce189c94c75972facd422484e58 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:30:30.900112 11120 tablet_service.cc:1511] Processing CreateTablet for tablet fcae59975bce4cefbe8718f31534067b (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:30:30.902669 11254 ts_tablet_manager.cc:1403] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.168s	user 0.016s	sys 0.000s
I20260709 12:30:30.956336 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcae59975bce4cefbe8718f31534067b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.955418 11048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb59ce189c94c75972facd422484e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.964596 11045 tablet_service.cc:1511] Processing CreateTablet for tablet 0743c24d152b46b2ad08375da31705ea (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:30:30.966030 11256 tablet_bootstrap.cc:492] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:30.966709 11256 ts_tablet_manager.cc:1403] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.006s
I20260709 12:30:30.967947 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb14ded3ccc417d8d6cbe341049acec" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
W20260709 12:30:30.973124 10952 leader_election.cc:343] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:30.973620 10952 leader_election.cc:304] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61218d0202f44940b61185f640880574; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:30.976466 10972 tablet_service.cc:1511] Processing CreateTablet for tablet e572b4a12e2d41008d2b3ba98f1429fb (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:30:30.977380 11198 tablet_service.cc:1511] Processing CreateTablet for tablet e572b4a12e2d41008d2b3ba98f1429fb (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:30:30.978005 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e572b4a12e2d41008d2b3ba98f1429fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.988934 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c81cc846f99441b693acaebd1a63ab21" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:30.980458 11263 raft_consensus.cc:493] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:30.981444 11255 ts_tablet_manager.cc:1434] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.162s	user 0.003s	sys 0.009s
I20260709 12:30:30.989908 10986 raft_consensus.cc:2468] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:30.990200 11263 raft_consensus.cc:515] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:30.990963 11255 tablet_bootstrap.cc:492] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:30.992697 11045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0743c24d152b46b2ad08375da31705ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.993851 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:30.995441 11025 leader_election.cc:343] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:30.995595 11263 leader_election.cc:290] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:30.981864 11254 raft_consensus.cc:359] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:30.979059 11287 raft_consensus.cc:2749] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:30.984660 11198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e572b4a12e2d41008d2b3ba98f1429fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:30.994031 11267 raft_consensus.cc:493] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:30.997221 11267 raft_consensus.cc:515] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:30.996316 11254 raft_consensus.cc:385] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:31.000247 11100 leader_election.cc:304] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:31.000505 11254 raft_consensus.cc:740] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:31.001616 11254 consensus_queue.cc:260] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:31.010248 11254 ts_tablet_manager.cc:1434] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.001s
I20260709 12:30:31.010824 11255 tablet_bootstrap.cc:654] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:31.016111 11254 tablet_bootstrap.cc:492] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:31.014226 11267 leader_election.cc:290] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:31.016726 11267 raft_consensus.cc:2804] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:31.017155 11267 raft_consensus.cc:493] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:31.017787 11267 raft_consensus.cc:3060] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:31.017836 11263 raft_consensus.cc:493] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:31.018622 11263 raft_consensus.cc:515] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:31.028388 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
W20260709 12:30:31.032554 11026 leader_election.cc:343] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.033222 11026 leader_election.cc:304] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:31.033408 10970 tablet_service.cc:1511] Processing CreateTablet for tablet b2c03f14392f45ba8f442cfec87fd85e (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:30:31.032444 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb14ded3ccc417d8d6cbe341049acec" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:31.034540 10985 raft_consensus.cc:2468] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
I20260709 12:30:31.034920 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c03f14392f45ba8f442cfec87fd85e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.035472 11049 tablet_service.cc:1511] Processing CreateTablet for tablet b2c03f14392f45ba8f442cfec87fd85e (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:30:31.039273 11119 tablet_service.cc:1511] Processing CreateTablet for tablet b2c03f14392f45ba8f442cfec87fd85e (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:30:31.039589 11124 tablet_service.cc:1511] Processing CreateTablet for tablet 0743c24d152b46b2ad08375da31705ea (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:30:31.039701 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c4826eccd146d3875548011ee59fd4" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:31.040704 11119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c03f14392f45ba8f442cfec87fd85e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.040556 11208 raft_consensus.cc:2468] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:31.040956 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c81cc846f99441b693acaebd1a63ab21" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:31.038427 11125 tablet_service.cc:1511] Processing CreateTablet for tablet e572b4a12e2d41008d2b3ba98f1429fb (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:30:31.046779 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2c03f14392f45ba8f442cfec87fd85e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.055938 11124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0743c24d152b46b2ad08375da31705ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.062657 11192 tablet_service.cc:1511] Processing CreateTablet for tablet 0743c24d152b46b2ad08375da31705ea (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:30:31.063287 11125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e572b4a12e2d41008d2b3ba98f1429fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.064283 11192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0743c24d152b46b2ad08375da31705ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.068285 11099 leader_election.cc:304] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 
W20260709 12:30:31.069468 11099 leader_election.cc:343] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.070611 11263 leader_election.cc:290] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
W20260709 12:30:31.046453 11100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:42037, user_credentials={real_user=slave}} blocked reactor thread for 46500.7us
I20260709 12:30:31.071239 11263 raft_consensus.cc:2749] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:31.072031 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb14ded3ccc417d8d6cbe341049acec" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:31.075006 11256 raft_consensus.cc:359] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:31.076123 11256 raft_consensus.cc:385] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:31.076547 11256 raft_consensus.cc:740] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:31.079463 11289 raft_consensus.cc:2804] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:31.080091 11289 raft_consensus.cc:493] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:31.080574 11289 raft_consensus.cc:3060] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:31.073565 11024 leader_election.cc:343] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.098215 11254 tablet_bootstrap.cc:654] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:31.098512 11193 tablet_service.cc:1511] Processing CreateTablet for tablet a5c4f1fddaf1474aaf021d0b04387b4c (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 12:30:31.101146 11026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:42037, user_credentials={real_user=slave}} blocked reactor thread for 68820.6us
I20260709 12:30:31.101637 11193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c4f1fddaf1474aaf021d0b04387b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.100785 11256 consensus_queue.cc:260] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:31.114774 11261 raft_consensus.cc:493] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:31.105101 11026 leader_election.cc:304] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:31.138815 11263 raft_consensus.cc:2804] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:31.139202 11263 raft_consensus.cc:493] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:31.139503 11263 raft_consensus.cc:3060] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:31.152274 11255 tablet_bootstrap.cc:492] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:31.152906 11255 ts_tablet_manager.cc:1403] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.162s	user 0.015s	sys 0.018s
W20260709 12:30:31.149725 10931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:31.156381 11255 raft_consensus.cc:359] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:31.157191 11255 raft_consensus.cc:385] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:31.157533 11255 raft_consensus.cc:740] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:31.159332 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c4826eccd146d3875548011ee59fd4" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:31.160728 11255 consensus_queue.cc:260] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:31.164407 11255 ts_tablet_manager.cc:1434] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
W20260709 12:30:31.165455 11101 leader_election.cc:343] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.165642 11255 tablet_bootstrap.cc:492] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:31.176369 11254 tablet_bootstrap.cc:492] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:31.176983 11254 ts_tablet_manager.cc:1403] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.161s	user 0.010s	sys 0.007s
I20260709 12:30:31.184863 11255 tablet_bootstrap.cc:654] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:31.186450 11253 tablet_bootstrap.cc:654] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:31.187676 11254 raft_consensus.cc:359] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:31.188484 11254 raft_consensus.cc:385] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:31.194201 11048 tablet_service.cc:1511] Processing CreateTablet for tablet a5c4f1fddaf1474aaf021d0b04387b4c (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:30:31.195438 11124 tablet_service.cc:1511] Processing CreateTablet for tablet 4d20e41f0d4444beb8e9ad0cc6938918 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:30:31.196236 11194 tablet_service.cc:1511] Processing CreateTablet for tablet 4d20e41f0d4444beb8e9ad0cc6938918 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:30:31.196913 11124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d20e41f0d4444beb8e9ad0cc6938918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.195894 11048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c4f1fddaf1474aaf021d0b04387b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.198062 11194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d20e41f0d4444beb8e9ad0cc6938918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.199507 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 4d20e41f0d4444beb8e9ad0cc6938918 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:30:31.201122 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d20e41f0d4444beb8e9ad0cc6938918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.202008 11193 tablet_service.cc:1511] Processing CreateTablet for tablet f5fbd15f7e3c4087a97ac3fbaf7870ce (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:30:31.203421 11120 tablet_service.cc:1511] Processing CreateTablet for tablet f5fbd15f7e3c4087a97ac3fbaf7870ce (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:30:31.204896 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fbd15f7e3c4087a97ac3fbaf7870ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.204649 11045 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe8221281e348018871f179e00af23e (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:30:31.205228 10972 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe8221281e348018871f179e00af23e (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:30:31.206785 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe8221281e348018871f179e00af23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.207379 11045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe8221281e348018871f179e00af23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.207450 11118 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe8221281e348018871f179e00af23e (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:30:31.208254 11195 tablet_service.cc:1511] Processing CreateTablet for tablet c9ef516951b743ae939b2880e001d2d2 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:30:31.209074 11118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe8221281e348018871f179e00af23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.209640 11195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ef516951b743ae939b2880e001d2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.210358 11193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fbd15f7e3c4087a97ac3fbaf7870ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.212282 10971 tablet_service.cc:1511] Processing CreateTablet for tablet c9ef516951b743ae939b2880e001d2d2 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:30:31.217787 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ef516951b743ae939b2880e001d2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.217938 11050 tablet_service.cc:1511] Processing CreateTablet for tablet c9ef516951b743ae939b2880e001d2d2 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:30:31.219431 11050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ef516951b743ae939b2880e001d2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.219061 10969 tablet_service.cc:1511] Processing CreateTablet for tablet a5c4f1fddaf1474aaf021d0b04387b4c (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:30:31.220703 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c4f1fddaf1474aaf021d0b04387b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.227203 11049 tablet_service.cc:1511] Processing CreateTablet for tablet f5fbd15f7e3c4087a97ac3fbaf7870ce (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:30:31.228809 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fbd15f7e3c4087a97ac3fbaf7870ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.234534 11289 raft_consensus.cc:515] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:31.143412 11261 raft_consensus.cc:515] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:31.238054 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c4826eccd146d3875548011ee59fd4" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:31.238772 11209 raft_consensus.cc:3060] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:31.240698 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce15f9449fe54fa9a8388a7964e137d4" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:31.241400 10985 raft_consensus.cc:2468] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
W20260709 12:30:31.189193 11026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:42037, user_credentials={real_user=slave}} blocked reactor thread for 84278.3us
I20260709 12:30:31.242828 11174 leader_election.cc:304] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:31.136672 11267 raft_consensus.cc:515] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:31.188855 11254 raft_consensus.cc:740] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:31.250722 11254 consensus_queue.cc:260] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:31.252756 11199 tablet_service.cc:1511] Processing CreateTablet for tablet 0e805a87f353400daff9d7073bcfd03f (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:30:31.253800 11254 ts_tablet_manager.cc:1434] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.076s	user 0.001s	sys 0.009s
I20260709 12:30:31.255362 11254 tablet_bootstrap.cc:492] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:31.258180 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c4826eccd146d3875548011ee59fd4" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:31.266369 11199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e805a87f353400daff9d7073bcfd03f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:30:31.267309 11101 leader_election.cc:343] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.261111 11121 tablet_service.cc:1511] Processing CreateTablet for tablet 0e805a87f353400daff9d7073bcfd03f (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:30:31.268756 11121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e805a87f353400daff9d7073bcfd03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.269551 11267 leader_election.cc:290] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:31.269658 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c81cc846f99441b693acaebd1a63ab21" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:31.270458 10985 raft_consensus.cc:3060] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:31.232057 11263 raft_consensus.cc:515] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:31.272996 11263 leader_election.cc:290] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:31.273674 11263 raft_consensus.cc:493] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:31.274233 11263 raft_consensus.cc:515] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:31.275725 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb14ded3ccc417d8d6cbe341049acec" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
W20260709 12:30:31.286685 11024 leader_election.cc:343] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.277107 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c81cc846f99441b693acaebd1a63ab21" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:31.278990 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb14ded3ccc417d8d6cbe341049acec" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:31.287844 10986 raft_consensus.cc:3060] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:31.288815 11099 leader_election.cc:343] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.292539 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce15f9449fe54fa9a8388a7964e137d4" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:31.294293 11172 leader_election.cc:343] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.294865 10985 raft_consensus.cc:2468] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:31.295073 10970 tablet_service.cc:1511] Processing CreateTablet for tablet 0e805a87f353400daff9d7073bcfd03f (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:30:31.296277 11100 leader_election.cc:304] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:31.296602 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e805a87f353400daff9d7073bcfd03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.306103 11198 tablet_service.cc:1511] Processing CreateTablet for tablet aa3d5568944e4b8ea21f3e487701995f (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:30:31.306605 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 67cba067154b43f0819177986955daf5 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:30:31.279660 11289 leader_election.cc:290] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:31.307686 11198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3d5568944e4b8ea21f3e487701995f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.244086 11261 leader_election.cc:290] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:31.318709 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67cba067154b43f0819177986955daf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.327219 11120 tablet_service.cc:1511] Processing CreateTablet for tablet aa3d5568944e4b8ea21f3e487701995f (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:30:31.328747 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3d5568944e4b8ea21f3e487701995f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.330729 11263 leader_election.cc:290] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:31.331017 11048 tablet_service.cc:1511] Processing CreateTablet for tablet 67cba067154b43f0819177986955daf5 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:30:31.331763 11119 tablet_service.cc:1511] Processing CreateTablet for tablet 67cba067154b43f0819177986955daf5 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:30:31.332792 11048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67cba067154b43f0819177986955daf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.333122 11119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67cba067154b43f0819177986955daf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.332741 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61510ef1eced49019efc704e8fc16746" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:31.338814 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61510ef1eced49019efc704e8fc16746" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
W20260709 12:30:31.340533 11026 leader_election.cc:343] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.313359 11267 raft_consensus.cc:2804] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:31.307621 11047 tablet_service.cc:1511] Processing CreateTablet for tablet aa3d5568944e4b8ea21f3e487701995f (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:30:31.341063 11261 raft_consensus.cc:2804] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:31.338814 11208 raft_consensus.cc:2468] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
I20260709 12:30:31.350394 11209 raft_consensus.cc:2468] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:31.363636 11196 tablet_service.cc:1511] Processing CreateTablet for tablet d1d35cef95ba4391b35aa31a166d5036 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:30:31.364988 11196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d35cef95ba4391b35aa31a166d5036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.355309 11261 raft_consensus.cc:493] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:31.370625 11255 tablet_bootstrap.cc:492] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:31.351959 11267 raft_consensus.cc:697] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
W20260709 12:30:31.355422 11174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:42037, user_credentials={real_user=slave}} blocked reactor thread for 112690us
I20260709 12:30:31.372215 11255 ts_tablet_manager.cc:1403] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.207s	user 0.013s	sys 0.025s
I20260709 12:30:31.369280 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa3d5568944e4b8ea21f3e487701995f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.383761 11253 tablet_bootstrap.cc:492] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:31.384403 11253 ts_tablet_manager.cc:1403] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.453s	user 0.014s	sys 0.026s
I20260709 12:30:31.370436 11025 leader_election.cc:304] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:31.387459 11263 raft_consensus.cc:2804] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:31.377701 11099 leader_election.cc:304] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f
I20260709 12:30:31.388054 11263 raft_consensus.cc:493] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:31.388568 11263 raft_consensus.cc:3060] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:31.388870 11289 raft_consensus.cc:2804] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:31.389422 11289 raft_consensus.cc:697] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:31.371058 11261 raft_consensus.cc:3060] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:31.390383 11289 consensus_queue.cc:237] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:31.393064 11267 consensus_queue.cc:237] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:31.387225 11253 raft_consensus.cc:359] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:31.403971 10972 tablet_service.cc:1511] Processing CreateTablet for tablet d1d35cef95ba4391b35aa31a166d5036 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:30:31.405287 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d35cef95ba4391b35aa31a166d5036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.405386 11045 tablet_service.cc:1511] Processing CreateTablet for tablet d1d35cef95ba4391b35aa31a166d5036 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:30:31.407181 11045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d35cef95ba4391b35aa31a166d5036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.396641 11253 raft_consensus.cc:385] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:31.427605 11194 tablet_service.cc:1511] Processing CreateTablet for tablet 1a30a14e503d4acc89f1c6cf8b521e8a (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:30:31.438270 10986 raft_consensus.cc:2468] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:31.441565 11120 tablet_service.cc:1511] Processing CreateTablet for tablet 1a30a14e503d4acc89f1c6cf8b521e8a (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:30:31.429737 11194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a30a14e503d4acc89f1c6cf8b521e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.443804 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a30a14e503d4acc89f1c6cf8b521e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.424916 11253 raft_consensus.cc:740] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:31.448361 11253 consensus_queue.cc:260] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:31.458400 11254 tablet_bootstrap.cc:654] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:31.473255 11050 tablet_service.cc:1511] Processing CreateTablet for tablet 2266db22c47c4604a6ac6d5cf892fc29 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:30:31.474983 11118 tablet_service.cc:1511] Processing CreateTablet for tablet 2266db22c47c4604a6ac6d5cf892fc29 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:30:31.476290 11118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2266db22c47c4604a6ac6d5cf892fc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.448504 11026 leader_election.cc:304] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:31.479089 11290 raft_consensus.cc:2804] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:31.482606 10971 tablet_service.cc:1511] Processing CreateTablet for tablet 1a30a14e503d4acc89f1c6cf8b521e8a (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:30:31.484016 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a30a14e503d4acc89f1c6cf8b521e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.493362 11256 ts_tablet_manager.cc:1434] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.526s	user 0.020s	sys 0.018s
W20260709 12:30:31.493815 11256 ts_tablet_manager.cc:1467] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1: Tablet startup took 526ms
I20260709 12:30:31.475373 11050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2266db22c47c4604a6ac6d5cf892fc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.501618 11287 raft_consensus.cc:493] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:31.501202 10880 catalog_manager.cc:5697] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:31.503996 11287 raft_consensus.cc:515] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:31.509068 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f518b6c3e974aa3b500f4cd12acd425" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:31.510129 11195 tablet_service.cc:1511] Processing CreateTablet for tablet 2266db22c47c4604a6ac6d5cf892fc29 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 12:30:31.510560 10952 leader_election.cc:343] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.511448 11195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2266db22c47c4604a6ac6d5cf892fc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.517004 11287 leader_election.cc:290] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:31.518553 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f518b6c3e974aa3b500f4cd12acd425" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:31.520092 10949 leader_election.cc:343] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.520527 10949 leader_election.cc:304] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61218d0202f44940b61185f640880574; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:31.498879 11255 raft_consensus.cc:359] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:31.523031 11255 raft_consensus.cc:385] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:31.523368 11255 raft_consensus.cc:740] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:31.524174 11255 consensus_queue.cc:260] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:31.526105 11261 raft_consensus.cc:515] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:31.526937 11287 raft_consensus.cc:2749] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:31.535181 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce15f9449fe54fa9a8388a7964e137d4" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:31.536659 11254 tablet_bootstrap.cc:492] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:31.537226 11254 ts_tablet_manager.cc:1403] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.282s	user 0.020s	sys 0.019s
W20260709 12:30:31.537336 11172 leader_election.cc:343] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.539428 11263 raft_consensus.cc:515] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:31.540565 11254 raft_consensus.cc:359] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:31.541301 11254 raft_consensus.cc:385] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:31.541590 11254 raft_consensus.cc:740] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:31.502970 11289 raft_consensus.cc:493] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:31.546751 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61510ef1eced49019efc704e8fc16746" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
W20260709 12:30:31.548290 11026 leader_election.cc:343] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.549243 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61510ef1eced49019efc704e8fc16746" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:31.550065 11209 raft_consensus.cc:3060] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:31.541699 11263 leader_election.cc:290] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:31.565147 11255 ts_tablet_manager.cc:1434] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.170s	user 0.003s	sys 0.006s
I20260709 12:30:31.570729 11289 raft_consensus.cc:515] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:31.562512 11253 ts_tablet_manager.cc:1434] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.178s	user 0.006s	sys 0.003s
I20260709 12:30:31.578378 10969 tablet_service.cc:1511] Processing CreateTablet for tablet 5cac7da440174c7296f12f2879a05582 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:30:31.579339 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce15f9449fe54fa9a8388a7964e137d4" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:31.585666 10986 raft_consensus.cc:3060] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:31.586097 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cac7da440174c7296f12f2879a05582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.586426 11261 leader_election.cc:290] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:31.587139 11254 consensus_queue.cc:260] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:31.589480 11254 ts_tablet_manager.cc:1434] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
W20260709 12:30:31.494185 11256 ts_tablet_manager.cc:1469] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1: Trace:
0709 12:30:30.116377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:30:30.116609 (+   232us) service_pool.cc:224] Handling call
0709 12:30:30.126555 (+  9946us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:30:30.126688 (+   133us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:30:30.153846 (+ 27158us) tablet_metadata.cc:665] Metadata flushed
0709 12:30:30.160345 (+  6499us) tablet_replica.cc:206] Creating consensus instance
0709 12:30:30.160824 (+   479us) inbound_call.cc:177] Queueing success response
0709 12:30:30.921658 (+760834us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:30:30.967086 (+ 45428us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:30:30.967686 (+   600us) tablet_replica.cc:261] Starting instrumentation
0709 12:30:30.968353 (+   667us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":133605,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"tablet-open.queue_time_us":760913,"thread_start_us":261227,"threads_started":1}
I20260709 12:30:31.580281 11255 tablet_bootstrap.cc:492] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:31.601325 11119 tablet_service.cc:1511] Processing CreateTablet for tablet 5cac7da440174c7296f12f2879a05582 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:30:31.602826 11119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cac7da440174c7296f12f2879a05582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.570523 11290 raft_consensus.cc:697] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:31.607807 11290 consensus_queue.cc:237] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:31.609157 11048 tablet_service.cc:1511] Processing CreateTablet for tablet 5cac7da440174c7296f12f2879a05582 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:30:31.610924 11048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cac7da440174c7296f12f2879a05582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.596405 11256 tablet_bootstrap.cc:492] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:31.596454 11253 tablet_bootstrap.cc:492] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:31.601634 10986 raft_consensus.cc:2468] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:31.612396 11255 tablet_bootstrap.cc:654] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:31.618745 11174 leader_election.cc:304] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:31.621167 11261 raft_consensus.cc:2804] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:31.622951 11261 raft_consensus.cc:697] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:31.623989 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7da973fbe46b9bbf5a9c29068f675" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:31.624209 11261 consensus_queue.cc:237] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
W20260709 12:30:31.625715 11099 leader_election.cc:343] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.627972 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7da973fbe46b9bbf5a9c29068f675" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:31.629940 11194 tablet_service.cc:1511] Processing CreateTablet for tablet ef715190ad3b417aa8cb7dba1f2853b6 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:30:31.631305 11194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef715190ad3b417aa8cb7dba1f2853b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.634642 11209 raft_consensus.cc:2468] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:31.635349 11120 tablet_service.cc:1511] Processing CreateTablet for tablet 1d248b07c05b4adfb5ea2ebbc75aa249 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:30:31.636536 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d248b07c05b4adfb5ea2ebbc75aa249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.636210 11025 leader_election.cc:304] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:31.638193 11300 raft_consensus.cc:2804] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:31.639113 11263 raft_consensus.cc:493] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:31.639945 11263 raft_consensus.cc:515] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:31.643719 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:31.644572 11254 tablet_bootstrap.cc:492] T 45c4826eccd146d3875548011ee59fd4 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
W20260709 12:30:31.645370 11026 leader_election.cc:343] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.648352 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:31.649818 10986 raft_consensus.cc:2468] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
W20260709 12:30:31.650583 11024 leader_election.cc:343] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.656878 11293 raft_consensus.cc:493] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:31.656563 11100 leader_election.cc:304] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:31.656560 11024 leader_election.cc:304] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:31.658691 11267 raft_consensus.cc:2804] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:31.655444 11263 leader_election.cc:290] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:31.662552 11263 raft_consensus.cc:2749] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:31.660992 11267 raft_consensus.cc:493] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:31.664214 11267 raft_consensus.cc:3060] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:31.664064 11045 tablet_service.cc:1511] Processing CreateTablet for tablet ef715190ad3b417aa8cb7dba1f2853b6 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:30:31.655617 11289 leader_election.cc:290] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:31.660992 10969 tablet_service.cc:1511] Processing CreateTablet for tablet ef715190ad3b417aa8cb7dba1f2853b6 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:30:31.686007 11300 raft_consensus.cc:697] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:31.688657 11047 tablet_service.cc:1511] Processing CreateTablet for tablet 016a8f4a4c534fffa13dbf6e764c5fd1 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:30:31.688374 11300 consensus_queue.cc:237] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:31.657393 11293 raft_consensus.cc:515] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:31.690985 10970 tablet_service.cc:1511] Processing CreateTablet for tablet 1d248b07c05b4adfb5ea2ebbc75aa249 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:30:31.692337 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d248b07c05b4adfb5ea2ebbc75aa249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.693140 11293 leader_election.cc:290] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:31.697609 11256 tablet_bootstrap.cc:654] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:31.715273 11045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef715190ad3b417aa8cb7dba1f2853b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.722498 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef715190ad3b417aa8cb7dba1f2853b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.723277 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b07813c2dd4a5cbd0c31d8fb4fb267" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:31.746435 11253 tablet_bootstrap.cc:654] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:31.727314 11193 tablet_service.cc:1511] Processing CreateTablet for tablet 1d248b07c05b4adfb5ea2ebbc75aa249 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:30:31.749285 11193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d248b07c05b4adfb5ea2ebbc75aa249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.730451 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016a8f4a4c534fffa13dbf6e764c5fd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.752964 11254 tablet_bootstrap.cc:654] T 45c4826eccd146d3875548011ee59fd4 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:31.732420 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b07813c2dd4a5cbd0c31d8fb4fb267" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:31.754889 11061 raft_consensus.cc:2468] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:31.722873 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 226a387f2768431dac93d7610fee3655 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:30:31.755963 10882 catalog_manager.cc:5697] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 1 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:31.756479 11267 raft_consensus.cc:515] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:31.757181 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226a387f2768431dac93d7610fee3655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.762419 11120 tablet_service.cc:1511] Processing CreateTablet for tablet 016a8f4a4c534fffa13dbf6e764c5fd1 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:30:31.764549 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016a8f4a4c534fffa13dbf6e764c5fd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.727396 11196 tablet_service.cc:1511] Processing CreateTablet for tablet 016a8f4a4c534fffa13dbf6e764c5fd1 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 12:30:31.747782 11172 leader_election.cc:343] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.746348 10881 catalog_manager.cc:5697] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 1 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:31.777753 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 226a387f2768431dac93d7610fee3655 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:30:31.779035 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7da973fbe46b9bbf5a9c29068f675" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:31.779366 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226a387f2768431dac93d7610fee3655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.779752 10986 raft_consensus.cc:3060] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:31.782588 11196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016a8f4a4c534fffa13dbf6e764c5fd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.786861 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7da973fbe46b9bbf5a9c29068f675" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:31.787968 10986 raft_consensus.cc:2468] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:31.789276 11100 leader_election.cc:304] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:31.790325 11289 raft_consensus.cc:2804] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:31.799350 11175 leader_election.cc:304] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:31.792191 11267 leader_election.cc:290] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:31.821719 11261 raft_consensus.cc:2804] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:31.831163 11261 raft_consensus.cc:493] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:31.831714 11261 raft_consensus.cc:3060] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:31.832314 11255 tablet_bootstrap.cc:492] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:31.800935 11289 raft_consensus.cc:697] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:31.832914 11255 ts_tablet_manager.cc:1403] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.257s	user 0.041s	sys 0.062s
I20260709 12:30:31.833834 11289 consensus_queue.cc:237] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
W20260709 12:30:31.821979 11175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 53913.2us
W20260709 12:30:31.812727 11099 leader_election.cc:343] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.836946 11255 raft_consensus.cc:359] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:31.838116 11255 raft_consensus.cc:385] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:31.838539 11255 raft_consensus.cc:740] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:31.839473 11255 consensus_queue.cc:260] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:31.841946 11255 ts_tablet_manager.cc:1434] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:30:31.843197 11255 tablet_bootstrap.cc:492] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:31.846145 11119 tablet_service.cc:1511] Processing CreateTablet for tablet 226a387f2768431dac93d7610fee3655 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:30:31.848037 11119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226a387f2768431dac93d7610fee3655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.812402 11195 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8af63f7be04dffb88a232a6d6f4c9e (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:30:31.859982 11195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8af63f7be04dffb88a232a6d6f4c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.860577 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8af63f7be04dffb88a232a6d6f4c9e (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:30:31.861490 11254 tablet_bootstrap.cc:492] T 45c4826eccd146d3875548011ee59fd4 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:31.861856 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8af63f7be04dffb88a232a6d6f4c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.862185 11254 ts_tablet_manager.cc:1403] T 45c4826eccd146d3875548011ee59fd4 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.218s	user 0.039s	sys 0.026s
I20260709 12:30:31.863770 11253 tablet_bootstrap.cc:492] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:31.871562 11253 ts_tablet_manager.cc:1403] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.275s	user 0.024s	sys 0.002s
I20260709 12:30:31.873340 11050 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8af63f7be04dffb88a232a6d6f4c9e (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:30:31.874577 11255 tablet_bootstrap.cc:654] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:31.874850 11050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8af63f7be04dffb88a232a6d6f4c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.866171 11267 consensus_queue.cc:1048] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:30:31.879410 11256 tablet_bootstrap.cc:492] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:31.879964 11256 ts_tablet_manager.cc:1403] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.284s	user 0.019s	sys 0.012s
I20260709 12:30:31.886859 11261 raft_consensus.cc:515] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:31.889293 11261 leader_election.cc:290] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:31.890169 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b07813c2dd4a5cbd0c31d8fb4fb267" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:31.890833 11061 raft_consensus.cc:3060] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:31.890861 11120 tablet_service.cc:1511] Processing CreateTablet for tablet 7a18a4e559724b479491cb39b42c0ce6 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:30:31.892263 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a18a4e559724b479491cb39b42c0ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.893005 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b07813c2dd4a5cbd0c31d8fb4fb267" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
W20260709 12:30:31.894564 11172 leader_election.cc:343] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:31.895741 11253 raft_consensus.cc:359] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:31.896514 11253 raft_consensus.cc:385] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:31.896842 11253 raft_consensus.cc:740] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:31.899456 11256 raft_consensus.cc:359] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:31.900286 11256 raft_consensus.cc:385] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:31.900629 11256 raft_consensus.cc:740] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:31.902242 10969 tablet_service.cc:1511] Processing CreateTablet for tablet 7a18a4e559724b479491cb39b42c0ce6 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:30:31.902784 11194 tablet_service.cc:1511] Processing CreateTablet for tablet 7a18a4e559724b479491cb39b42c0ce6 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:30:31.903788 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a18a4e559724b479491cb39b42c0ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.904018 11194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a18a4e559724b479491cb39b42c0ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.904610 11046 tablet_service.cc:1511] Processing CreateTablet for tablet 8646b7e0b1ba4757a267d2e57601e24b (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:30:31.906210 11046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8646b7e0b1ba4757a267d2e57601e24b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.897675 11253 consensus_queue.cc:260] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:31.918424 11061 raft_consensus.cc:2468] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:31.919948 11175 leader_election.cc:304] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:31.924487 11118 tablet_service.cc:1511] Processing CreateTablet for tablet 8646b7e0b1ba4757a267d2e57601e24b (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:30:31.925987 11118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8646b7e0b1ba4757a267d2e57601e24b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.927505 10970 tablet_service.cc:1511] Processing CreateTablet for tablet 45b83d519688476d84ef90b668ca9efd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:30:31.928896 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45b83d519688476d84ef90b668ca9efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.930133 11261 raft_consensus.cc:2804] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:31.930775 11261 raft_consensus.cc:697] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:31.931636 11261 consensus_queue.cc:237] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:31.935688 11193 tablet_service.cc:1511] Processing CreateTablet for tablet 8646b7e0b1ba4757a267d2e57601e24b (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:30:31.901445 11256 consensus_queue.cc:260] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:31.920344 11253 ts_tablet_manager.cc:1434] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 12:30:31.961692 11253 tablet_bootstrap.cc:492] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:31.950621 11254 raft_consensus.cc:359] T 45c4826eccd146d3875548011ee59fd4 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:31.953646 11255 tablet_bootstrap.cc:492] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:31.955745 11049 tablet_service.cc:1511] Processing CreateTablet for tablet 45b83d519688476d84ef90b668ca9efd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:30:31.953500 11267 consensus_queue.cc:1048] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:30:31.956673 11209 raft_consensus.cc:3060] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:31.974912 11193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8646b7e0b1ba4757a267d2e57601e24b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.969839 11049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45b83d519688476d84ef90b668ca9efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.980636 11119 tablet_service.cc:1511] Processing CreateTablet for tablet a6980a48384841e9a62db7f664aa7b0f (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:30:31.969043 11255 ts_tablet_manager.cc:1403] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.126s	user 0.017s	sys 0.007s
I20260709 12:30:31.983000 11047 tablet_service.cc:1511] Processing CreateTablet for tablet 25dd54445c4b4d1ca4f230aea7f2f3d5 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:30:31.984439 11047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25dd54445c4b4d1ca4f230aea7f2f3d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.985306 11255 raft_consensus.cc:359] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:31.986214 11255 raft_consensus.cc:385] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:31.986547 11255 raft_consensus.cc:740] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:31.987344 11255 consensus_queue.cc:260] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:31.971051 11120 tablet_service.cc:1511] Processing CreateTablet for tablet 45b83d519688476d84ef90b668ca9efd (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:30:31.990051 11119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6980a48384841e9a62db7f664aa7b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.968497 10969 tablet_service.cc:1511] Processing CreateTablet for tablet 25dd54445c4b4d1ca4f230aea7f2f3d5 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:30:31.992066 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25dd54445c4b4d1ca4f230aea7f2f3d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.969980 11254 raft_consensus.cc:385] T 45c4826eccd146d3875548011ee59fd4 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:31.993288 11254 raft_consensus.cc:740] T 45c4826eccd146d3875548011ee59fd4 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:31.994205 11254 consensus_queue.cc:260] T 45c4826eccd146d3875548011ee59fd4 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:31.972281 11194 tablet_service.cc:1511] Processing CreateTablet for tablet 25dd54445c4b4d1ca4f230aea7f2f3d5 (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:30:31.995868 11194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25dd54445c4b4d1ca4f230aea7f2f3d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.999939 11120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45b83d519688476d84ef90b668ca9efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:32.009070 10974 tablet_service.cc:1511] Processing CreateTablet for tablet a6980a48384841e9a62db7f664aa7b0f (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:30:32.009626 11196 tablet_service.cc:1511] Processing CreateTablet for tablet a6980a48384841e9a62db7f664aa7b0f (DEFAULT_TABLE table=test-workload [id=838f36af0393484eaeb19cfeb3247c27]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:30:32.010492 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6980a48384841e9a62db7f664aa7b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:32.011076 11196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6980a48384841e9a62db7f664aa7b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:31.996475 11253 tablet_bootstrap.cc:654] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:31.998737 11255 ts_tablet_manager.cc:1434] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.017s	user 0.000s	sys 0.008s
I20260709 12:30:32.025282 11318 consensus_queue.cc:1048] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:32.039112 11261 raft_consensus.cc:493] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.062258 11254 ts_tablet_manager.cc:1434] T 45c4826eccd146d3875548011ee59fd4 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.180s	user 0.008s	sys 0.000s
I20260709 12:30:32.063530 11254 tablet_bootstrap.cc:492] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:32.066416 11301 raft_consensus.cc:493] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.067200 11301 raft_consensus.cc:515] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.073089 11254 tablet_bootstrap.cc:654] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.059743 11256 ts_tablet_manager.cc:1434] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.179s	user 0.020s	sys 0.023s
I20260709 12:30:32.093022 11255 tablet_bootstrap.cc:492] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:32.102788 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233e7dc1963548a1b4309d90f787084c" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:32.110469 10950 leader_election.cc:343] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.113166 11256 tablet_bootstrap.cc:492] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:32.113550 11301 leader_election.cc:290] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:32.113695 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233e7dc1963548a1b4309d90f787084c" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
W20260709 12:30:32.119837 10952 leader_election.cc:343] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.120365 10952 leader_election.cc:304] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61218d0202f44940b61185f640880574; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:32.122710 11061 raft_consensus.cc:3060] T 45c4826eccd146d3875548011ee59fd4 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.078325 11261 raft_consensus.cc:515] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.124161 11301 raft_consensus.cc:2749] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:32.132937 11261 leader_election.cc:290] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:32.133610 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c81cc846f99441b693acaebd1a63ab21" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:32.139367 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c81cc846f99441b693acaebd1a63ab21" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:32.142719 11172 leader_election.cc:304] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:32.146027 11293 raft_consensus.cc:2749] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:32.159436 11134 raft_consensus.cc:3060] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.179863 11255 tablet_bootstrap.cc:654] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.180155 11253 tablet_bootstrap.cc:492] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:32.180980 11253 ts_tablet_manager.cc:1403] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.220s	user 0.011s	sys 0.014s
W20260709 12:30:32.187860 11024 consensus_peers.cc:597] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Couldn't send request to peer a96b33d3dcf7432e904439b5be66dee1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:32.191747 11293 consensus_queue.cc:1048] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:32.196729 11253 raft_consensus.cc:359] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.201953 11300 consensus_queue.cc:1048] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:32.201086 11253 raft_consensus.cc:385] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.207641 11253 raft_consensus.cc:740] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.220687 11255 tablet_bootstrap.cc:492] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:32.213313 11253 consensus_queue.cc:260] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.221264 11255 ts_tablet_manager.cc:1403] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.161s	user 0.014s	sys 0.005s
I20260709 12:30:32.223201 11253 ts_tablet_manager.cc:1434] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 12:30:32.224327 11255 raft_consensus.cc:359] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.225121 11255 raft_consensus.cc:385] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.225436 11255 raft_consensus.cc:740] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.226236 11255 consensus_queue.cc:260] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.224375 11253 tablet_bootstrap.cc:492] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:32.231235 11261 consensus_queue.cc:1048] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:30:32.232324 11254 tablet_bootstrap.cc:492] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:32.240545 11254 ts_tablet_manager.cc:1403] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.177s	user 0.035s	sys 0.029s
I20260709 12:30:32.232497 11256 tablet_bootstrap.cc:654] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.235268 11267 consensus_queue.cc:1048] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:30:32.233944 11255 ts_tablet_manager.cc:1434] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
W20260709 12:30:32.236259 10931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:32.229835 10882 catalog_manager.cc:5697] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:32.249382 11255 tablet_bootstrap.cc:492] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:32.247887 11254 raft_consensus.cc:359] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.250519 11254 raft_consensus.cc:385] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.250880 11254 raft_consensus.cc:740] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.252934 10984 raft_consensus.cc:3060] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.236167 11253 tablet_bootstrap.cc:654] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.258774 11301 raft_consensus.cc:493] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.259384 11301 raft_consensus.cc:515] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.260757 11255 tablet_bootstrap.cc:654] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.262429 11301 leader_election.cc:290] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:32.263506 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:32.264571 11060 raft_consensus.cc:2468] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:32.266182 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:32.268567 10950 leader_election.cc:343] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.270463 10952 leader_election.cc:304] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:32.271863 11300 consensus_queue.cc:1048] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:32.273415 10882 catalog_manager.cc:5697] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:32.274850 11301 raft_consensus.cc:2804] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:32.275445 11301 raft_consensus.cc:493] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:32.275897 11301 raft_consensus.cc:3060] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.278290 11254 consensus_queue.cc:260] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.298893 11254 ts_tablet_manager.cc:1434] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.058s	user 0.011s	sys 0.000s
I20260709 12:30:32.300097 11254 tablet_bootstrap.cc:492] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
W20260709 12:30:32.301977 11099 consensus_peers.cc:597] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Couldn't send request to peer 85f856f4709042d9b3ce1348bdfb2ad5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:32.303217 11341 consensus_queue.cc:1048] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:30:32.311319 11320 raft_consensus.cc:493] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f856f4709042d9b3ce1348bdfb2ad5)
I20260709 12:30:32.312143 11320 raft_consensus.cc:515] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:32.315613 11254 tablet_bootstrap.cc:654] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.323081 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce15f9449fe54fa9a8388a7964e137d4" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:32.333710 11320 leader_election.cc:290] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:32.335945 11254 tablet_bootstrap.cc:492] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:32.336513 11254 ts_tablet_manager.cc:1403] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.003s
I20260709 12:30:32.338006 11256 tablet_bootstrap.cc:492] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:32.337466 10880 catalog_manager.cc:5697] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 1 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:32.338768 11256 ts_tablet_manager.cc:1403] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.226s	user 0.024s	sys 0.000s
I20260709 12:30:32.339617 11254 raft_consensus.cc:359] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.340359 11254 raft_consensus.cc:385] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.340647 11254 raft_consensus.cc:740] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.341391 11254 consensus_queue.cc:260] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.343454 11256 raft_consensus.cc:359] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.344343 11256 raft_consensus.cc:385] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.344821 11256 raft_consensus.cc:740] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.345997 11256 consensus_queue.cc:260] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.348764 11256 ts_tablet_manager.cc:1434] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:30:32.335682 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce15f9449fe54fa9a8388a7964e137d4" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:32.355306 11100 leader_election.cc:304] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:32.362208 11267 raft_consensus.cc:2749] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:32.396575 11254 ts_tablet_manager.cc:1434] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.060s	user 0.023s	sys 0.029s
I20260709 12:30:32.397758 11254 tablet_bootstrap.cc:492] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:32.401461 11255 tablet_bootstrap.cc:492] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:32.402096 11255 ts_tablet_manager.cc:1403] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.153s	user 0.013s	sys 0.014s
I20260709 12:30:32.404568 11256 tablet_bootstrap.cc:492] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:32.405220 11254 tablet_bootstrap.cc:654] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
W20260709 12:30:32.408587 11172 consensus_peers.cc:597] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Couldn't send request to peer a96b33d3dcf7432e904439b5be66dee1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:32.410740 10881 catalog_manager.cc:5697] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 1 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:32.416203 11320 consensus_queue.cc:1048] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:32.424011 11255 raft_consensus.cc:359] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.424811 11255 raft_consensus.cc:385] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.425113 11255 raft_consensus.cc:740] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.425843 11255 consensus_queue.cc:260] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.375841 11301 raft_consensus.cc:515] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.430927 11255 ts_tablet_manager.cc:1434] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:30:32.432240 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
W20260709 12:30:32.434139 10950 leader_election.cc:343] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.438053 11253 tablet_bootstrap.cc:492] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:32.438694 11253 ts_tablet_manager.cc:1403] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.215s	user 0.027s	sys 0.016s
I20260709 12:30:32.439807 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:32.440513 11060 raft_consensus.cc:3060] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.432031 11255 tablet_bootstrap.cc:492] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:32.449388 11060 raft_consensus.cc:2468] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:32.450886 10952 leader_election.cc:304] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:32.452184 11343 raft_consensus.cc:2804] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:32.452764 11343 raft_consensus.cc:697] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:32.453750 11343 consensus_queue.cc:237] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.457818 11301 leader_election.cc:290] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:32.462944 11256 tablet_bootstrap.cc:654] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.457095 11253 raft_consensus.cc:359] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:32.467782 11253 raft_consensus.cc:385] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.468142 11253 raft_consensus.cc:740] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.472498 11256 tablet_bootstrap.cc:492] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:32.476811 11256 ts_tablet_manager.cc:1403] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.004s
I20260709 12:30:32.480865 11256 raft_consensus.cc:359] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.481945 11256 raft_consensus.cc:385] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.482378 11256 raft_consensus.cc:740] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.483530 11256 consensus_queue.cc:260] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.488058 11256 ts_tablet_manager.cc:1434] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:30:32.489151 11256 tablet_bootstrap.cc:492] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:32.490885 10883 catalog_manager.cc:5697] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:32.491886 11293 consensus_queue.cc:1048] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:32.496147 11256 tablet_bootstrap.cc:654] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.498427 11255 tablet_bootstrap.cc:654] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.470160 11253 consensus_queue.cc:260] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:32.503629 11253 ts_tablet_manager.cc:1434] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.001s
I20260709 12:30:32.504702 11253 tablet_bootstrap.cc:492] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:32.513809 11255 tablet_bootstrap.cc:492] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:32.514422 11255 ts_tablet_manager.cc:1403] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.002s
I20260709 12:30:32.517558 11255 raft_consensus.cc:359] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.518371 11255 raft_consensus.cc:385] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.518699 11255 raft_consensus.cc:740] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.521217 11253 tablet_bootstrap.cc:654] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.522439 11255 consensus_queue.cc:260] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.524899 11255 ts_tablet_manager.cc:1434] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:30:32.526328 11255 tablet_bootstrap.cc:492] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:32.532351 11254 tablet_bootstrap.cc:492] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:32.532979 11254 ts_tablet_manager.cc:1403] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.135s	user 0.015s	sys 0.044s
I20260709 12:30:32.533061 11255 tablet_bootstrap.cc:654] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.535817 11254 raft_consensus.cc:359] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.536521 11254 raft_consensus.cc:385] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.536808 11254 raft_consensus.cc:740] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.537585 11254 consensus_queue.cc:260] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.539788 11254 ts_tablet_manager.cc:1434] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:30:32.540940 11254 tablet_bootstrap.cc:492] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:32.550396 11256 tablet_bootstrap.cc:492] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:32.551390 11256 ts_tablet_manager.cc:1403] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.024s
I20260709 12:30:32.553581 11253 tablet_bootstrap.cc:492] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:32.554141 11253 ts_tablet_manager.cc:1403] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.008s
I20260709 12:30:32.554251 11267 raft_consensus.cc:493] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.554803 11267 raft_consensus.cc:515] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.557140 11267 leader_election.cc:290] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:32.557953 11343 raft_consensus.cc:493] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.558495 11343 raft_consensus.cc:515] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.559083 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f518b6c3e974aa3b500f4cd12acd425" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:32.559808 10986 raft_consensus.cc:2468] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:32.560959 11343 leader_election.cc:290] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:32.561179 11254 tablet_bootstrap.cc:654] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.561997 11100 leader_election.cc:304] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:32.563099 11319 raft_consensus.cc:2804] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:32.563481 11319 raft_consensus.cc:493] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:32.563853 11319 raft_consensus.cc:3060] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.554697 11256 raft_consensus.cc:359] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.564342 11256 raft_consensus.cc:385] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.564754 11256 raft_consensus.cc:740] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.557121 11253 raft_consensus.cc:359] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.565519 11256 consensus_queue.cc:260] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.566004 11253 raft_consensus.cc:385] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.566723 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:32.567028 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f518b6c3e974aa3b500f4cd12acd425" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:32.567548 11060 raft_consensus.cc:2468] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:32.566437 11253 raft_consensus.cc:740] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
W20260709 12:30:32.568797 11101 leader_election.cc:343] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.569171 11253 consensus_queue.cc:260] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.570010 10952 leader_election.cc:304] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:32.571069 11343 raft_consensus.cc:2804] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:32.571545 11343 raft_consensus.cc:493] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:32.571949 11343 raft_consensus.cc:3060] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.566319 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:32.578742 11300 raft_consensus.cc:493] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.579419 11300 raft_consensus.cc:515] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.585613 11253 ts_tablet_manager.cc:1434] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.004s
I20260709 12:30:32.587651 11256 ts_tablet_manager.cc:1434] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.036s	user 0.010s	sys 0.004s
I20260709 12:30:32.588587 11253 tablet_bootstrap.cc:492] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
W20260709 12:30:32.589144 10949 leader_election.cc:343] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.596027 11300 leader_election.cc:290] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:32.596333 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10383d0fa134e14b6756caf02036ddd" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:32.598039 11025 leader_election.cc:343] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.599143 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10383d0fa134e14b6756caf02036ddd" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:32.599588 11253 tablet_bootstrap.cc:654] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.600219 11319 raft_consensus.cc:515] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
W20260709 12:30:32.600838 11026 leader_election.cc:343] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.601420 11026 leader_election.cc:304] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:32.603194 11300 raft_consensus.cc:2749] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:32.604630 11293 raft_consensus.cc:493] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.605057 11293 raft_consensus.cc:515] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:32.605329 11343 raft_consensus.cc:515] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.607438 11293 leader_election.cc:290] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:32.607705 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f518b6c3e974aa3b500f4cd12acd425" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:32.608134 11255 tablet_bootstrap.cc:492] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:32.587337 11254 tablet_bootstrap.cc:492] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:32.608817 11255 ts_tablet_manager.cc:1403] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.009s
I20260709 12:30:32.609010 11254 ts_tablet_manager.cc:1403] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.004s
I20260709 12:30:32.608376 10986 raft_consensus.cc:3060] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.609264 11319 leader_election.cc:290] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:32.613721 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7da973fbe46b9bbf5a9c29068f675" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:32.616770 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
W20260709 12:30:32.617995 10949 leader_election.cc:343] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.621009 11253 tablet_bootstrap.cc:492] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:32.606684 11256 tablet_bootstrap.cc:492] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:32.610642 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f518b6c3e974aa3b500f4cd12acd425" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:32.621538 11253 ts_tablet_manager.cc:1403] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.003s
I20260709 12:30:32.610620 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7da973fbe46b9bbf5a9c29068f675" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:32.622387 10986 raft_consensus.cc:2468] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:32.623574 11100 leader_election.cc:304] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
W20260709 12:30:32.624353 11101 leader_election.cc:343] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.624519 11253 raft_consensus.cc:359] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:32.625452 11253 raft_consensus.cc:385] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.612219 11255 raft_consensus.cc:359] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:32.625988 11253 raft_consensus.cc:740] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.626082 11255 raft_consensus.cc:385] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.626396 11255 raft_consensus.cc:740] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.609227 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:32.627276 11060 raft_consensus.cc:3060] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.627002 11253 consensus_queue.cc:260] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:32.627774 11174 leader_election.cc:304] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:32.629174 11253 ts_tablet_manager.cc:1434] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:30:32.629320 11293 raft_consensus.cc:2749] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:32.625428 11319 raft_consensus.cc:2804] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:32.611268 11343 leader_election.cc:290] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:32.630522 11253 tablet_bootstrap.cc:492] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:32.630292 11254 raft_consensus.cc:359] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.627013 11255 consensus_queue.cc:260] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:32.632016 11254 raft_consensus.cc:385] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.632351 11254 raft_consensus.cc:740] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.633028 11255 ts_tablet_manager.cc:1434] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:30:32.633270 11254 consensus_queue.cc:260] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.634105 11255 tablet_bootstrap.cc:492] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:32.636705 11256 tablet_bootstrap.cc:654] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.638152 11319 raft_consensus.cc:697] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:32.639112 11319 consensus_queue.cc:237] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.640906 11255 tablet_bootstrap.cc:654] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.645692 11267 raft_consensus.cc:493] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.646970 11267 raft_consensus.cc:515] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.648941 11060 raft_consensus.cc:2468] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:32.650007 11267 leader_election.cc:290] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:32.650768 10952 leader_election.cc:304] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:32.651202 11254 ts_tablet_manager.cc:1434] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:30:32.655920 11253 tablet_bootstrap.cc:654] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.656569 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb14ded3ccc417d8d6cbe341049acec" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:32.657915 11256 tablet_bootstrap.cc:492] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:32.658399 11256 ts_tablet_manager.cc:1403] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.007s
I20260709 12:30:32.659747 11343 raft_consensus.cc:2804] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:32.660332 11343 raft_consensus.cc:697] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:32.661196 11343 consensus_queue.cc:237] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.662174 11254 tablet_bootstrap.cc:492] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:32.662271 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb14ded3ccc417d8d6cbe341049acec" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:32.666720 11101 leader_election.cc:304] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:32.667989 11267 raft_consensus.cc:2749] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:32.671754 11254 tablet_bootstrap.cc:654] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.672976 11255 tablet_bootstrap.cc:492] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:32.673482 11255 ts_tablet_manager.cc:1403] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.001s
I20260709 12:30:32.673659 10883 catalog_manager.cc:5697] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:32.678094 11253 tablet_bootstrap.cc:492] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:32.678572 11253 ts_tablet_manager.cc:1403] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.006s
I20260709 12:30:32.678468 11256 raft_consensus.cc:359] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.679382 11256 raft_consensus.cc:385] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.679719 11256 raft_consensus.cc:740] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.680534 11256 consensus_queue.cc:260] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.681416 11253 raft_consensus.cc:359] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.682343 11253 raft_consensus.cc:385] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.682698 11253 raft_consensus.cc:740] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.682925 11256 ts_tablet_manager.cc:1434] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:30:32.683027 11261 raft_consensus.cc:493] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.683336 11253 consensus_queue.cc:260] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.683784 11261 raft_consensus.cc:515] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.684453 11256 tablet_bootstrap.cc:492] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:32.685249 11255 raft_consensus.cc:359] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.685808 11261 leader_election.cc:290] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:32.686080 11255 raft_consensus.cc:385] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.686412 11255 raft_consensus.cc:740] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.687101 11255 consensus_queue.cc:260] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.687651 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233e7dc1963548a1b4309d90f787084c" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:32.687829 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233e7dc1963548a1b4309d90f787084c" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:32.688405 10986 raft_consensus.cc:2468] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:32.688506 11060 raft_consensus.cc:2468] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:32.689594 11255 ts_tablet_manager.cc:1434] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:30:32.689946 11174 leader_election.cc:304] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:32.685185 10881 catalog_manager.cc:5697] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:32.690757 11255 tablet_bootstrap.cc:492] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:32.691879 11256 tablet_bootstrap.cc:654] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.693651 11254 tablet_bootstrap.cc:492] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:32.694193 11254 ts_tablet_manager.cc:1403] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.002s
I20260709 12:30:32.697420 11255 tablet_bootstrap.cc:654] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.697027 11254 raft_consensus.cc:359] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.698288 11293 raft_consensus.cc:2804] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:32.697814 11254 raft_consensus.cc:385] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.698715 11293 raft_consensus.cc:493] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:32.698757 11254 raft_consensus.cc:740] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.699201 11293 raft_consensus.cc:3060] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.699613 11254 consensus_queue.cc:260] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.710072 11293 raft_consensus.cc:515] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.712198 11293 leader_election.cc:290] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:32.713266 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233e7dc1963548a1b4309d90f787084c" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:32.713853 11060 raft_consensus.cc:3060] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.714035 11253 ts_tablet_manager.cc:1434] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:30:32.715014 11253 tablet_bootstrap.cc:492] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:32.718441 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233e7dc1963548a1b4309d90f787084c" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:32.719270 10986 raft_consensus.cc:3060] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.721046 11253 tablet_bootstrap.cc:654] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.722975 11254 ts_tablet_manager.cc:1434] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:30:32.723980 11254 tablet_bootstrap.cc:492] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:32.737406 11343 raft_consensus.cc:493] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.738171 11343 raft_consensus.cc:515] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.740376 11343 leader_election.cc:290] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:32.742389 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10383d0fa134e14b6756caf02036ddd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:32.743088 11061 raft_consensus.cc:2468] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:32.743609 11254 tablet_bootstrap.cc:654] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.744954 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10383d0fa134e14b6756caf02036ddd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:32.746327 10952 leader_election.cc:304] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:32.747638 11300 raft_consensus.cc:493] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:30:32.747733 10950 leader_election.cc:343] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.748224 11300 raft_consensus.cc:515] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.748842 11343 raft_consensus.cc:2804] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:32.749004 11293 raft_consensus.cc:493] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.749712 11293 raft_consensus.cc:515] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.749420 11343 raft_consensus.cc:493] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:32.751158 11343 raft_consensus.cc:3060] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.751888 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e793b1e1be754642bc961d9830f30c9b" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:32.752612 11208 raft_consensus.cc:2468] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
I20260709 12:30:32.752853 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:32.753190 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:32.753324 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e793b1e1be754642bc961d9830f30c9b" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:32.748363 11060 raft_consensus.cc:2468] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:32.754069 11025 leader_election.cc:304] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:32.754890 11135 raft_consensus.cc:3060] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.754963 11341 raft_consensus.cc:2804] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:32.755734 11341 raft_consensus.cc:493] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:32.755844 11293 leader_election.cc:290] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:32.756135 11341 raft_consensus.cc:3060] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.751055 11300 leader_election.cc:290] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
W20260709 12:30:32.757597 11024 leader_election.cc:343] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.759341 11256 tablet_bootstrap.cc:492] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:32.755031 11175 leader_election.cc:304] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:32.754112 11061 raft_consensus.cc:2393] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f856f4709042d9b3ce1348bdfb2ad5 in current term 1: Already voted for candidate 61218d0202f44940b61185f640880574 in this term.
I20260709 12:30:32.765205 11293 raft_consensus.cc:2804] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:32.763243 11134 raft_consensus.cc:3060] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.766173 11256 ts_tablet_manager.cc:1403] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.082s	user 0.028s	sys 0.020s
I20260709 12:30:32.766395 11175 leader_election.cc:304] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:32.765712 11341 raft_consensus.cc:515] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.767769 11334 raft_consensus.cc:3060] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.764518 11343 raft_consensus.cc:515] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.769758 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e793b1e1be754642bc961d9830f30c9b" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:32.771054 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10383d0fa134e14b6756caf02036ddd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
W20260709 12:30:32.771267 11024 leader_election.cc:343] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:32.772466 10950 leader_election.cc:343] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.765743 11293 raft_consensus.cc:697] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:32.775075 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10383d0fa134e14b6756caf02036ddd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:32.774827 11293 consensus_queue.cc:237] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.775380 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e793b1e1be754642bc961d9830f30c9b" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:32.775697 11061 raft_consensus.cc:3060] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.775951 11334 raft_consensus.cc:2749] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:32.776132 11208 raft_consensus.cc:3060] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.778461 10986 raft_consensus.cc:2468] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:32.783628 11343 leader_election.cc:290] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:32.783628 11341 leader_election.cc:290] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:32.787164 11254 tablet_bootstrap.cc:492] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:32.787490 11253 tablet_bootstrap.cc:492] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:32.787663 11254 ts_tablet_manager.cc:1403] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.002s
I20260709 12:30:32.787977 11253 ts_tablet_manager.cc:1403] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.010s
I20260709 12:30:32.787910 11256 raft_consensus.cc:359] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.788825 11256 raft_consensus.cc:385] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.789119 11256 raft_consensus.cc:740] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.788374 11061 raft_consensus.cc:2468] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:32.791971 10952 leader_election.cc:304] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:32.792059 11253 raft_consensus.cc:359] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.792778 11253 raft_consensus.cc:385] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.790341 11256 consensus_queue.cc:260] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.792822 11343 raft_consensus.cc:2804] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:32.793190 11253 raft_consensus.cc:740] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.793941 11343 raft_consensus.cc:697] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:32.792934 11254 raft_consensus.cc:359] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.794932 11256 ts_tablet_manager.cc:1434] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:30:32.795322 11254 raft_consensus.cc:385] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.795006 11343 consensus_queue.cc:237] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.795650 11254 raft_consensus.cc:740] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.795492 11253 consensus_queue.cc:260] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.796234 11256 tablet_bootstrap.cc:492] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:32.798319 11253 ts_tablet_manager.cc:1434] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:30:32.799312 11253 tablet_bootstrap.cc:492] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:32.798092 11254 consensus_queue.cc:260] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.805389 11208 raft_consensus.cc:2468] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:32.806787 11025 leader_election.cc:304] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:32.811738 11254 ts_tablet_manager.cc:1434] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.003s
I20260709 12:30:32.813235 11254 tablet_bootstrap.cc:492] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:32.813799 11300 raft_consensus.cc:2804] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:32.814410 11300 raft_consensus.cc:697] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:32.815327 11300 consensus_queue.cc:237] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.813235 10883 catalog_manager.cc:5697] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 1 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:32.825349 11255 tablet_bootstrap.cc:492] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:32.825870 11255 ts_tablet_manager.cc:1403] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.135s	user 0.016s	sys 0.018s
I20260709 12:30:32.827946 11254 tablet_bootstrap.cc:654] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.828886 10882 catalog_manager.cc:5697] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:32.834308 11341 raft_consensus.cc:493] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.836759 11341 raft_consensus.cc:515] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.838850 11341 leader_election.cc:290] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:32.840363 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f518b6c3e974aa3b500f4cd12acd425" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:32.841187 10986 raft_consensus.cc:2393] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03cdbc3ec1ef4354bd6ec49958026f5f in current term 1: Already voted for candidate a96b33d3dcf7432e904439b5be66dee1 in this term.
I20260709 12:30:32.841192 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f518b6c3e974aa3b500f4cd12acd425" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:32.845266 11024 leader_election.cc:304] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:32.845734 11343 consensus_queue.cc:1048] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:32.847067 11349 raft_consensus.cc:3060] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.848686 11208 raft_consensus.cc:3060] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.850039 11253 tablet_bootstrap.cc:654] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.855774 10883 catalog_manager.cc:5697] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 1 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:32.865963 11343 raft_consensus.cc:493] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.866320 11341 raft_consensus.cc:493] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.866561 11343 raft_consensus.cc:515] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:32.866824 11341 raft_consensus.cc:515] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.868804 11341 leader_election.cc:290] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:32.870249 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ac5be704e94cae97eba537ab6c9b8c" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:32.870404 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ac5be704e94cae97eba537ab6c9b8c" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:32.870950 10986 raft_consensus.cc:2468] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
I20260709 12:30:32.871186 11256 tablet_bootstrap.cc:654] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.871088 11133 raft_consensus.cc:2468] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
I20260709 12:30:32.868804 11343 leader_election.cc:290] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:32.872115 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6b390078e79408a91ac1f52eaa9b4cd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:32.872736 11024 leader_election.cc:304] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:32.875126 11341 raft_consensus.cc:2804] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:32.865583 11349 raft_consensus.cc:2749] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:32.873605 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6b390078e79408a91ac1f52eaa9b4cd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:32.876092 10949 leader_election.cc:343] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.883805 11209 raft_consensus.cc:2468] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:32.885661 10950 leader_election.cc:304] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:32.875562 11341 raft_consensus.cc:493] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:32.886974 11341 raft_consensus.cc:3060] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.887238 11343 raft_consensus.cc:2804] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:32.887801 11343 raft_consensus.cc:493] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:32.888230 11343 raft_consensus.cc:3060] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.892539 11255 raft_consensus.cc:359] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.895974 11255 raft_consensus.cc:385] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.896620 11255 raft_consensus.cc:740] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.900112 11255 consensus_queue.cc:260] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:32.913620 11255 ts_tablet_manager.cc:1434] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.000s
I20260709 12:30:32.914657 11255 tablet_bootstrap.cc:492] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:32.914192 11300 raft_consensus.cc:493] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:32.919987 11300 raft_consensus.cc:515] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.920876 11254 tablet_bootstrap.cc:492] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:32.921969 11254 ts_tablet_manager.cc:1403] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.011s
I20260709 12:30:32.923425 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1cd03e5c5784bc2a3f7fd16049ed3e2" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:32.924520 11341 raft_consensus.cc:515] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.924844 11254 raft_consensus.cc:359] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
W20260709 12:30:32.925514 11025 leader_election.cc:343] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.926788 11341 leader_election.cc:290] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:32.926890 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1cd03e5c5784bc2a3f7fd16049ed3e2" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:32.927415 11343 raft_consensus.cc:515] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:32.928443 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ac5be704e94cae97eba537ab6c9b8c" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:32.928961 10986 raft_consensus.cc:3060] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:32.929330 11024 leader_election.cc:343] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.929812 11024 leader_election.cc:304] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:32.930827 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6b390078e79408a91ac1f52eaa9b4cd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:32.930994 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6b390078e79408a91ac1f52eaa9b4cd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:32.931478 11207 raft_consensus.cc:3060] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.931120 11343 leader_election.cc:290] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:32.934329 11343 consensus_queue.cc:1048] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:32.936288 10986 raft_consensus.cc:2468] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:32.937109 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ac5be704e94cae97eba537ab6c9b8c" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:32.937740 11134 raft_consensus.cc:3060] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:32.939052 11026 leader_election.cc:304] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:32.939870 11349 raft_consensus.cc:2749] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:32.940521 11349 raft_consensus.cc:2804] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:32.941030 11349 raft_consensus.cc:697] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
W20260709 12:30:32.942196 10949 leader_election.cc:343] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:32.941864 11349 consensus_queue.cc:237] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.925547 11254 raft_consensus.cc:385] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.944283 11300 leader_election.cc:290] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:32.943115 11254 raft_consensus.cc:740] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.950206 11254 consensus_queue.cc:260] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.940518 11255 tablet_bootstrap.cc:654] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.953125 11207 raft_consensus.cc:2468] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:32.955857 11254 ts_tablet_manager.cc:1434] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:30:32.960573 11254 tablet_bootstrap.cc:492] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:32.962334 11255 tablet_bootstrap.cc:492] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:32.962942 11255 ts_tablet_manager.cc:1403] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.000s
I20260709 12:30:32.962659 10950 leader_election.cc:304] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:32.968431 11343 raft_consensus.cc:2804] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:32.969156 11343 raft_consensus.cc:697] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:32.969419 11253 tablet_bootstrap.cc:492] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:32.970083 11253 ts_tablet_manager.cc:1403] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.171s	user 0.016s	sys 0.011s
I20260709 12:30:32.970082 11343 consensus_queue.cc:237] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:32.973380 11254 tablet_bootstrap.cc:654] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:32.974972 11255 raft_consensus.cc:359] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.975667 11255 raft_consensus.cc:385] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.975958 11255 raft_consensus.cc:740] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.958544 11256 tablet_bootstrap.cc:492] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:32.978322 11256 ts_tablet_manager.cc:1403] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.182s	user 0.010s	sys 0.017s
I20260709 12:30:32.981796 11256 raft_consensus.cc:359] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.982744 11256 raft_consensus.cc:385] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.983084 11256 raft_consensus.cc:740] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.984206 11253 raft_consensus.cc:359] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.985112 11253 raft_consensus.cc:385] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.985461 11253 raft_consensus.cc:740] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.981647 10881 catalog_manager.cc:5697] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 1 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:32.989161 11256 consensus_queue.cc:260] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.986487 11255 consensus_queue.cc:260] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.988209 11253 consensus_queue.cc:260] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:32.991087 11254 tablet_bootstrap.cc:492] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:32.991641 11254 ts_tablet_manager.cc:1403] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.008s
I20260709 12:30:32.992439 11253 ts_tablet_manager.cc:1434] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:30:32.993528 11253 tablet_bootstrap.cc:492] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:32.994755 11254 raft_consensus.cc:359] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:32.995529 11254 raft_consensus.cc:385] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:32.995829 11254 raft_consensus.cc:740] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:32.992430 11255 ts_tablet_manager.cc:1434] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 12:30:32.998729 11255 tablet_bootstrap.cc:492] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:32.996785 11254 consensus_queue.cc:260] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.001364 11254 ts_tablet_manager.cc:1434] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:30:33.002621 11254 tablet_bootstrap.cc:492] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:33.011358 11256 ts_tablet_manager.cc:1434] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:30:32.988920 11134 raft_consensus.cc:2468] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:33.017282 11256 tablet_bootstrap.cc:492] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:33.027082 11255 tablet_bootstrap.cc:654] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.029989 11254 tablet_bootstrap.cc:654] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.030004 10883 catalog_manager.cc:5697] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:33.032102 11256 tablet_bootstrap.cc:654] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.034638 11253 tablet_bootstrap.cc:654] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.044891 11254 tablet_bootstrap.cc:492] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:33.045379 11255 tablet_bootstrap.cc:492] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:33.045583 11254 ts_tablet_manager.cc:1403] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.018s
I20260709 12:30:33.045928 11255 ts_tablet_manager.cc:1403] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.001s
I20260709 12:30:33.054159 11255 raft_consensus.cc:359] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.055382 11255 raft_consensus.cc:385] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.055644 11255 raft_consensus.cc:740] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.062340 11254 raft_consensus.cc:359] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.063059 11253 tablet_bootstrap.cc:492] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:33.063153 11254 raft_consensus.cc:385] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.063604 11254 raft_consensus.cc:740] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.063752 11253 ts_tablet_manager.cc:1403] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.005s
I20260709 12:30:33.056329 11255 consensus_queue.cc:260] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.066895 11255 ts_tablet_manager.cc:1434] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:30:33.067867 11255 tablet_bootstrap.cc:492] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:33.068823 11253 raft_consensus.cc:359] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:33.069598 11253 raft_consensus.cc:385] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.069792 11254 consensus_queue.cc:260] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.070530 11256 tablet_bootstrap.cc:492] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:33.071039 11256 ts_tablet_manager.cc:1403] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.000s
I20260709 12:30:33.072152 11254 ts_tablet_manager.cc:1434] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:30:33.073415 11254 tablet_bootstrap.cc:492] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:33.073932 11256 raft_consensus.cc:359] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.074395 11255 tablet_bootstrap.cc:654] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.074707 11256 raft_consensus.cc:385] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.075033 11256 raft_consensus.cc:740] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.075693 11253 raft_consensus.cc:740] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.076673 11253 consensus_queue.cc:260] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:33.079345 11253 ts_tablet_manager.cc:1434] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:30:33.079605 11267 raft_consensus.cc:493] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.080142 11267 raft_consensus.cc:515] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.081967 11253 tablet_bootstrap.cc:492] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:33.082648 11267 leader_election.cc:290] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:33.084314 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:33.084906 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:33.085809 11061 raft_consensus.cc:2393] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a96b33d3dcf7432e904439b5be66dee1 in current term 1: Already voted for candidate 61218d0202f44940b61185f640880574 in this term.
I20260709 12:30:33.090590 11101 leader_election.cc:304] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:33.091838 11319 consensus_queue.cc:1048] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:33.093237 11253 tablet_bootstrap.cc:654] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.093364 11319 raft_consensus.cc:3060] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.080056 11256 consensus_queue.cc:260] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.101313 11256 ts_tablet_manager.cc:1434] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:30:33.108894 11254 tablet_bootstrap.cc:654] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.111340 11343 consensus_queue.cc:1048] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:33.111645 11319 raft_consensus.cc:2749] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:33.117815 11256 tablet_bootstrap.cc:492] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:33.118525 11319 raft_consensus.cc:493] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.118752 11343 raft_consensus.cc:493] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.119560 11343 raft_consensus.cc:515] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.123945 11343 leader_election.cc:290] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:33.119087 11319 raft_consensus.cc:515] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.125756 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7a31e74574166b261914cd71d423e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:33.126600 11059 raft_consensus.cc:2468] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:33.128890 11256 tablet_bootstrap.cc:654] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.128700 10952 leader_election.cc:304] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:33.129041 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1cd03e5c5784bc2a3f7fd16049ed3e2" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:33.131168 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7a31e74574166b261914cd71d423e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:33.129773 11208 raft_consensus.cc:2468] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
W20260709 12:30:33.132658 10949 leader_election.cc:343] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.133214 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1cd03e5c5784bc2a3f7fd16049ed3e2" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:33.131125 11255 tablet_bootstrap.cc:492] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:33.133908 11059 raft_consensus.cc:2468] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:33.134298 11255 ts_tablet_manager.cc:1403] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.030s
I20260709 12:30:33.133977 11099 leader_election.cc:304] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:33.134802 11343 raft_consensus.cc:2804] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:33.135115 11318 consensus_queue.cc:1048] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:33.135888 11319 leader_election.cc:290] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:33.135425 11343 raft_consensus.cc:493] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:33.137063 11343 raft_consensus.cc:3060] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.139698 11349 raft_consensus.cc:493] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.140245 11349 raft_consensus.cc:515] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.144260 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657f19d4020f48ce8138638594474e13" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:33.145009 11256 tablet_bootstrap.cc:492] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:33.145658 11256 ts_tablet_manager.cc:1403] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.028s	user 0.003s	sys 0.010s
I20260709 12:30:33.145691 11349 leader_election.cc:290] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:33.147248 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657f19d4020f48ce8138638594474e13" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:33.147941 10986 raft_consensus.cc:2468] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
I20260709 12:30:33.148734 11255 raft_consensus.cc:359] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.136622 11319 raft_consensus.cc:2804] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:33.149508 11255 raft_consensus.cc:385] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.149657 11319 raft_consensus.cc:493] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:33.149937 11255 raft_consensus.cc:740] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
W20260709 12:30:33.149345 11024 leader_election.cc:343] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.150331 11319 raft_consensus.cc:3060] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.150971 11026 leader_election.cc:304] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:33.152097 11255 consensus_queue.cc:260] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.154333 11340 raft_consensus.cc:493] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.154815 11340 raft_consensus.cc:515] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:33.149277 11256 raft_consensus.cc:359] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:33.155900 11256 raft_consensus.cc:385] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.156200 11256 raft_consensus.cc:740] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.158483 11256 consensus_queue.cc:260] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:33.159739 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf709305a2b4084a73fb3108f94c828" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:33.160678 11208 raft_consensus.cc:2468] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:33.160846 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf709305a2b4084a73fb3108f94c828" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:33.161733 11256 ts_tablet_manager.cc:1434] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
W20260709 12:30:33.162444 10952 leader_election.cc:343] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.162840 11256 tablet_bootstrap.cc:492] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:33.163237 10950 leader_election.cc:304] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f
I20260709 12:30:33.164227 11301 raft_consensus.cc:2804] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:33.164680 11254 tablet_bootstrap.cc:492] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:33.164623 11301 raft_consensus.cc:493] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:33.162465 11340 leader_election.cc:290] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:33.165190 11301 raft_consensus.cc:3060] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.162483 11349 raft_consensus.cc:2804] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:33.166527 11349 raft_consensus.cc:493] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:33.166896 11349 raft_consensus.cc:3060] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.168859 11293 raft_consensus.cc:493] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.169567 11293 raft_consensus.cc:515] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:33.157025 11343 raft_consensus.cc:515] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.170784 11334 consensus_queue.cc:1048] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:33.172923 11293 leader_election.cc:290] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:33.173856 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7a31e74574166b261914cd71d423e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:33.174134 11343 leader_election.cc:290] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:33.175072 11256 tablet_bootstrap.cc:654] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.175338 11255 ts_tablet_manager.cc:1434] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
W20260709 12:30:33.175525 10949 leader_election.cc:343] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.176456 11255 tablet_bootstrap.cc:492] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:33.177395 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7a31e74574166b261914cd71d423e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:33.178074 11059 raft_consensus.cc:3060] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.182173 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10383d0fa134e14b6756caf02036ddd" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:33.183293 11058 raft_consensus.cc:2393] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f856f4709042d9b3ce1348bdfb2ad5 in current term 1: Already voted for candidate 61218d0202f44940b61185f640880574 in this term.
I20260709 12:30:33.186748 11254 ts_tablet_manager.cc:1403] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.114s	user 0.003s	sys 0.012s
I20260709 12:30:33.190971 11255 tablet_bootstrap.cc:654] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.184597 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10383d0fa134e14b6756caf02036ddd" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:33.213297 11254 raft_consensus.cc:359] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.214618 11254 raft_consensus.cc:385] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.215077 11254 raft_consensus.cc:740] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.216255 11254 consensus_queue.cc:260] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.218421 11254 ts_tablet_manager.cc:1434] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:30:33.219637 11254 tablet_bootstrap.cc:492] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:33.232425 11174 leader_election.cc:304] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:33.235836 11293 raft_consensus.cc:3060] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.237491 11253 tablet_bootstrap.cc:492] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:33.238126 11253 ts_tablet_manager.cc:1403] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.156s	user 0.025s	sys 0.008s
I20260709 12:30:33.240329 11341 consensus_queue.cc:1048] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:33.241333 11253 raft_consensus.cc:359] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:33.243186 11253 raft_consensus.cc:385] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.243453 11253 raft_consensus.cc:740] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.241952 11059 raft_consensus.cc:2468] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:33.249549 11349 raft_consensus.cc:515] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.252003 11349 leader_election.cc:290] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:33.254793 11254 tablet_bootstrap.cc:654] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.255018 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657f19d4020f48ce8138638594474e13" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:33.255707 10986 raft_consensus.cc:3060] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.259135 11253 consensus_queue.cc:260] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:33.266198 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "657f19d4020f48ce8138638594474e13" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:33.270777 11301 raft_consensus.cc:515] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:33.271310 11255 tablet_bootstrap.cc:492] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:33.271986 11255 ts_tablet_manager.cc:1403] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.096s	user 0.026s	sys 0.000s
I20260709 12:30:33.275480 11255 raft_consensus.cc:359] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:33.278764 11255 raft_consensus.cc:385] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.277437 11319 raft_consensus.cc:515] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.279224 11255 raft_consensus.cc:740] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.281327 11256 tablet_bootstrap.cc:492] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:33.282073 11256 ts_tablet_manager.cc:1403] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.002s
I20260709 12:30:33.280181 11255 consensus_queue.cc:260] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:33.290959 11255 ts_tablet_manager.cc:1434] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:30:33.292714 11253 ts_tablet_manager.cc:1434] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.009s
I20260709 12:30:33.288483 11293 raft_consensus.cc:2749] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:30:33.292737 11024 leader_election.cc:343] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.303115 11256 raft_consensus.cc:359] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.303882 11256 raft_consensus.cc:385] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.304309 11256 raft_consensus.cc:740] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.305661 11256 consensus_queue.cc:260] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.293025 10952 leader_election.cc:304] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:33.307941 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1cd03e5c5784bc2a3f7fd16049ed3e2" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:33.308548 11207 raft_consensus.cc:3060] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.309692 11256 ts_tablet_manager.cc:1434] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:30:33.310771 11256 tablet_bootstrap.cc:492] T 657f19d4020f48ce8138638594474e13 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:33.295311 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf709305a2b4084a73fb3108f94c828" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:33.303869 11253 tablet_bootstrap.cc:492] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:33.317719 10986 raft_consensus.cc:2468] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:33.323155 11318 raft_consensus.cc:493] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.326879 11255 tablet_bootstrap.cc:492] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:33.299719 11301 leader_election.cc:290] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:33.329090 11318 raft_consensus.cc:515] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.325497 11401 raft_consensus.cc:2804] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:33.330176 11401 raft_consensus.cc:697] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:33.330967 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf709305a2b4084a73fb3108f94c828" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:33.331184 11401 consensus_queue.cc:237] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.331873 11318 leader_election.cc:290] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:33.332190 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1cd03e5c5784bc2a3f7fd16049ed3e2" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:33.332942 11059 raft_consensus.cc:3060] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.334491 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e793b1e1be754642bc961d9830f30c9b" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:33.335506 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e793b1e1be754642bc961d9830f30c9b" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:33.336964 11256 tablet_bootstrap.cc:654] T 657f19d4020f48ce8138638594474e13 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.338887 11135 raft_consensus.cc:3060] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.327812 11207 raft_consensus.cc:2468] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:33.341871 11099 leader_election.cc:304] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:33.343400 11099 leader_election.cc:304] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:33.327695 11209 raft_consensus.cc:3060] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:33.333083 10952 leader_election.cc:343] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.349839 11320 raft_consensus.cc:2804] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:33.350373 11059 raft_consensus.cc:2468] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:33.350394 11320 raft_consensus.cc:697] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:33.351526 11320 consensus_queue.cc:237] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.362905 11401 consensus_queue.cc:1048] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:33.365810 11026 leader_election.cc:304] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:33.367195 11341 raft_consensus.cc:2804] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:33.367733 11341 raft_consensus.cc:697] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:33.368647 11341 consensus_queue.cc:237] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.311937 11319 leader_election.cc:290] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:33.375008 11267 raft_consensus.cc:493] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.388020 11267 raft_consensus.cc:515] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.390594 11267 leader_election.cc:290] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:33.393342 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7a31e74574166b261914cd71d423e" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:33.405057 11319 raft_consensus.cc:493] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.405694 11319 raft_consensus.cc:515] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:33.408082 11319 leader_election.cc:290] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
W20260709 12:30:33.411811 10931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:33.424420 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6b390078e79408a91ac1f52eaa9b4cd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:33.425486 11208 raft_consensus.cc:2393] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a96b33d3dcf7432e904439b5be66dee1 in current term 1: Already voted for candidate 61218d0202f44940b61185f640880574 in this term.
I20260709 12:30:33.387473 11255 tablet_bootstrap.cc:654] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.429252 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6b390078e79408a91ac1f52eaa9b4cd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:33.428239 11318 raft_consensus.cc:2749] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:33.434119 11340 consensus_queue.cc:1048] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:33.437105 11100 leader_election.cc:304] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:33.438526 11405 consensus_queue.cc:1048] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:33.444144 11253 tablet_bootstrap.cc:654] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.399523 11209 raft_consensus.cc:2468] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:33.444890 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7a31e74574166b261914cd71d423e" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:33.455022 11254 tablet_bootstrap.cc:492] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:33.455611 11254 ts_tablet_manager.cc:1403] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.236s	user 0.018s	sys 0.006s
I20260709 12:30:33.457510 11300 consensus_queue.cc:1048] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:33.445655 11401 consensus_queue.cc:1048] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:30:33.459713 10882 catalog_manager.cc:5697] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:33.467677 11301 consensus_queue.cc:1048] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:30:33.468310 11409 log.cc:927] Time spent T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:30:33.446419 11318 raft_consensus.cc:3060] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.478622 11350 raft_consensus.cc:493] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.479032 10950 leader_election.cc:304] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f
I20260709 12:30:33.479230 11350 raft_consensus.cc:515] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.473202 11301 raft_consensus.cc:493] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.480033 11401 raft_consensus.cc:2804] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:33.481587 11254 raft_consensus.cc:359] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.487937 11254 raft_consensus.cc:385] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.488337 11254 raft_consensus.cc:740] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.485358 11059 raft_consensus.cc:2393] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a96b33d3dcf7432e904439b5be66dee1 in current term 1: Already voted for candidate 61218d0202f44940b61185f640880574 in this term.
I20260709 12:30:33.476279 11349 consensus_queue.cc:1048] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:30:33.486654 11401 raft_consensus.cc:697] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:33.481776 11341 consensus_queue.cc:1048] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:30:33.486181 11301 raft_consensus.cc:515] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:33.516043 11254 consensus_queue.cc:260] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.532366 11343 raft_consensus.cc:493] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.533202 11343 raft_consensus.cc:515] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.535771 11343 leader_election.cc:290] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:33.544641 11401 consensus_queue.cc:237] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:33.546744 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29ac676c05840d384d97014df8fdffd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:33.547451 11058 raft_consensus.cc:2468] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:33.551393 10952 leader_election.cc:304] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:33.552249 11350 leader_election.cc:290] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:33.552481 11340 raft_consensus.cc:2804] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:33.555667 11256 tablet_bootstrap.cc:492] T 657f19d4020f48ce8138638594474e13 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:33.556156 11256 ts_tablet_manager.cc:1403] T 657f19d4020f48ce8138638594474e13 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.246s	user 0.030s	sys 0.054s
I20260709 12:30:33.553015 11340 raft_consensus.cc:493] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:33.588861 11253 tablet_bootstrap.cc:492] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:33.589555 11253 ts_tablet_manager.cc:1403] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.287s	user 0.014s	sys 0.013s
I20260709 12:30:33.586843 11340 raft_consensus.cc:3060] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.604394 11254 ts_tablet_manager.cc:1434] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.148s	user 0.023s	sys 0.027s
I20260709 12:30:33.605679 11254 tablet_bootstrap.cc:492] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:33.607784 11255 tablet_bootstrap.cc:492] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:33.608263 11255 ts_tablet_manager.cc:1403] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.282s	user 0.013s	sys 0.013s
I20260709 12:30:33.627862 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befb3713bcb4d2194f4deacce467056" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:33.629487 10950 leader_election.cc:343] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.630405 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29ac676c05840d384d97014df8fdffd" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:33.632728 11254 tablet_bootstrap.cc:654] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.632941 11256 raft_consensus.cc:359] T 657f19d4020f48ce8138638594474e13 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.635133 11340 raft_consensus.cc:515] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.606208 11301 leader_election.cc:290] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:33.633687 11256 raft_consensus.cc:385] T 657f19d4020f48ce8138638594474e13 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.637640 11256 raft_consensus.cc:740] T 657f19d4020f48ce8138638594474e13 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.607299 11101 leader_election.cc:304] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:33.641498 11256 consensus_queue.cc:260] T 657f19d4020f48ce8138638594474e13 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.661763 11256 ts_tablet_manager.cc:1434] T 657f19d4020f48ce8138638594474e13 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.000s
I20260709 12:30:33.665423 10983 raft_consensus.cc:2393] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03cdbc3ec1ef4354bd6ec49958026f5f in current term 1: Already voted for candidate 61218d0202f44940b61185f640880574 in this term.
I20260709 12:30:33.674949 11256 tablet_bootstrap.cc:492] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
W20260709 12:30:33.667477 11101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 64283.2us
I20260709 12:30:33.671803 11416 raft_consensus.cc:493] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:30:33.668727 11422 log.cc:927] Time spent T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:30:33.673034 11340 leader_election.cc:290] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:33.668947 11406 raft_consensus.cc:493] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.710278 11253 raft_consensus.cc:359] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.711257 11253 raft_consensus.cc:385] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.711602 11253 raft_consensus.cc:740] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.669768 11424 raft_consensus.cc:3060] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.674095 11318 raft_consensus.cc:2749] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:33.669584 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29ac676c05840d384d97014df8fdffd" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:33.715971 11406 raft_consensus.cc:515] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:33.718626 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29ac676c05840d384d97014df8fdffd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:33.719301 11060 raft_consensus.cc:3060] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.723747 11254 tablet_bootstrap.cc:492] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:33.724579 11254 ts_tablet_manager.cc:1403] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.119s	user 0.025s	sys 0.021s
I20260709 12:30:33.724733 11253 consensus_queue.cc:260] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.723289 11419 raft_consensus.cc:493] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.730043 11253 ts_tablet_manager.cc:1434] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.140s	user 0.012s	sys 0.003s
I20260709 12:30:33.736653 11406 leader_election.cc:290] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:33.738199 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:33.740180 11256 tablet_bootstrap.cc:654] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
W20260709 12:30:33.741340 11024 leader_election.cc:343] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:33.742313 11421 log.cc:927] Time spent T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1: Append to log took a long time: real 0.118s	user 0.001s	sys 0.003s
I20260709 12:30:33.743583 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:33.744469 11174 leader_election.cc:343] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:33.745158 11172 leader_election.cc:343] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.745595 11172 leader_election.cc:304] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:33.746469 11406 raft_consensus.cc:2749] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:33.752791 11253 tablet_bootstrap.cc:492] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:33.753052 11255 raft_consensus.cc:359] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:33.753789 11255 raft_consensus.cc:385] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.754271 11255 raft_consensus.cc:740] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.754889 11255 consensus_queue.cc:260] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:33.727751 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29ac676c05840d384d97014df8fdffd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:33.756737 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29ac676c05840d384d97014df8fdffd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:33.757521 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befb3713bcb4d2194f4deacce467056" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:33.709451 11416 raft_consensus.cc:515] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.756345 11424 raft_consensus.cc:2749] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:30:33.765780 10949 leader_election.cc:343] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.766440 11416 leader_election.cc:290] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:33.767019 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a25febeedeb45368dcfe60611272c19" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:33.760134 11318 consensus_queue.cc:1048] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:33.768231 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a25febeedeb45368dcfe60611272c19" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:33.728645 11419 raft_consensus.cc:515] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.768796 11209 raft_consensus.cc:2468] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
W20260709 12:30:33.769999 11024 leader_election.cc:343] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.770495 11419 leader_election.cc:290] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
W20260709 12:30:33.770867 10949 leader_election.cc:343] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.771715 11343 consensus_queue.cc:1048] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:33.772305 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be854f634c14923853d3907984c6ca6" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:33.773094 11025 leader_election.cc:304] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:33.774853 11416 raft_consensus.cc:2804] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:33.775223 11416 raft_consensus.cc:493] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:33.775406 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be854f634c14923853d3907984c6ca6" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:33.775568 11416 raft_consensus.cc:3060] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:33.776427 11024 leader_election.cc:343] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.777959 11135 raft_consensus.cc:3060] T 657f19d4020f48ce8138638594474e13 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.761118 10881 catalog_manager.cc:5697] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
W20260709 12:30:33.786863 11025 leader_election.cc:343] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.787382 11025 leader_election.cc:304] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:33.737532 10879 catalog_manager.cc:5697] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 1 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:33.789548 11419 raft_consensus.cc:2749] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:30:33.790910 10949 leader_election.cc:343] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.791420 10949 leader_election.cc:304] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:33.791769 11026 leader_election.cc:304] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:33.792179 11401 raft_consensus.cc:2749] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:33.793257 11253 tablet_bootstrap.cc:654] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.794478 11401 consensus_queue.cc:1048] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:33.795701 11254 raft_consensus.cc:359] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:33.796384 11254 raft_consensus.cc:385] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.796639 11254 raft_consensus.cc:740] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.797283 11254 consensus_queue.cc:260] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:33.799988 11254 ts_tablet_manager.cc:1434] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.075s	user 0.003s	sys 0.003s
I20260709 12:30:33.800961 11254 tablet_bootstrap.cc:492] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:33.808207 11254 tablet_bootstrap.cc:654] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.815538 11255 ts_tablet_manager.cc:1434] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.207s	user 0.006s	sys 0.006s
I20260709 12:30:33.816614 11255 tablet_bootstrap.cc:492] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:33.820632 11416 raft_consensus.cc:515] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.828171 11060 raft_consensus.cc:2468] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:33.833494 11419 raft_consensus.cc:2749] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:33.833763 11401 consensus_queue.cc:1048] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:33.838496 10952 leader_election.cc:304] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:33.840732 11255 tablet_bootstrap.cc:654] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.841346 10883 catalog_manager.cc:5697] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:33.849052 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a25febeedeb45368dcfe60611272c19" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:33.848591 11401 raft_consensus.cc:2804] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:30:33.859501 11024 leader_election.cc:343] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.863516 11256 tablet_bootstrap.cc:492] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:33.864022 11256 ts_tablet_manager.cc:1403] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.189s	user 0.007s	sys 0.012s
I20260709 12:30:33.864981 11401 raft_consensus.cc:697] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:33.871724 11419 raft_consensus.cc:493] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.872677 11401 consensus_queue.cc:237] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:33.873262 11419 raft_consensus.cc:515] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:33.873910 11254 tablet_bootstrap.cc:492] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:33.874588 11254 ts_tablet_manager.cc:1403] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.074s	user 0.018s	sys 0.004s
I20260709 12:30:33.875403 11419 leader_election.cc:290] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:33.876130 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf709305a2b4084a73fb3108f94c828" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:33.876917 11207 raft_consensus.cc:2393] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03cdbc3ec1ef4354bd6ec49958026f5f in current term 1: Already voted for candidate 61218d0202f44940b61185f640880574 in this term.
I20260709 12:30:33.876693 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a25febeedeb45368dcfe60611272c19" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:33.870353 11416 leader_election.cc:290] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:33.887220 11208 raft_consensus.cc:3060] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.897696 11427 raft_consensus.cc:493] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.898311 11427 raft_consensus.cc:515] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:33.897250 11254 raft_consensus.cc:359] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:33.901543 11254 raft_consensus.cc:385] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.901943 11254 raft_consensus.cc:740] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.887333 11424 consensus_queue.cc:1048] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:30:33.905176 11253 tablet_bootstrap.cc:492] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:33.905752 11253 ts_tablet_manager.cc:1403] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.009s
I20260709 12:30:33.892536 11416 consensus_queue.cc:1048] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:30:33.911932 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf709305a2b4084a73fb3108f94c828" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:33.911302 11419 consensus_queue.cc:1048] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:30:33.913061 11254 consensus_queue.cc:260] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:33.920604 11026 leader_election.cc:304] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:33.922869 11427 leader_election.cc:290] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:33.924839 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:33.925323 11254 ts_tablet_manager.cc:1434] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:30:33.925526 11207 raft_consensus.cc:2468] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:33.926298 11254 tablet_bootstrap.cc:492] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:33.928727 11208 raft_consensus.cc:2468] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:33.930110 11341 raft_consensus.cc:3060] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.930900 11025 leader_election.cc:304] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:33.929586 10950 leader_election.cc:304] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:33.933923 11343 raft_consensus.cc:2804] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:33.934058 11350 raft_consensus.cc:2804] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:33.934327 11343 raft_consensus.cc:493] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:33.934810 11343 raft_consensus.cc:3060] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.934836 11350 raft_consensus.cc:697] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:33.936282 11350 consensus_queue.cc:237] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:33.947024 11253 raft_consensus.cc:359] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:33.949343 11253 raft_consensus.cc:385] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.949746 11253 raft_consensus.cc:740] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.950625 11253 consensus_queue.cc:260] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:33.948508 11343 raft_consensus.cc:515] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:33.954607 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:33.955288 11254 tablet_bootstrap.cc:654] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
W20260709 12:30:33.956171 10949 leader_election.cc:343] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.957561 11343 leader_election.cc:290] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:33.963161 11253 ts_tablet_manager.cc:1434] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.002s
I20260709 12:30:33.965062 11253 tablet_bootstrap.cc:492] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:33.982110 11253 tablet_bootstrap.cc:654] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:33.923511 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:33.991899 10949 leader_election.cc:343] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:33.993264 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:33.994213 11208 raft_consensus.cc:3060] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.004208 11208 raft_consensus.cc:2468] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:34.007230 10950 leader_election.cc:304] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:34.009862 11343 raft_consensus.cc:2804] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:34.009564 11256 raft_consensus.cc:359] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.010645 11343 raft_consensus.cc:697] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:34.011667 11343 consensus_queue.cc:237] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.010661 11256 raft_consensus.cc:385] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.014678 11256 raft_consensus.cc:740] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.016798 11256 consensus_queue.cc:260] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.021761 11341 raft_consensus.cc:2749] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:34.025599 11256 ts_tablet_manager.cc:1434] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.161s	user 0.008s	sys 0.000s
I20260709 12:30:34.026953 11256 tablet_bootstrap.cc:492] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:34.036216 11255 tablet_bootstrap.cc:492] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:34.036978 11255 ts_tablet_manager.cc:1403] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.221s	user 0.032s	sys 0.032s
I20260709 12:30:34.041326 11255 raft_consensus.cc:359] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.042415 11255 raft_consensus.cc:385] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.042706 11255 raft_consensus.cc:740] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.043586 11255 consensus_queue.cc:260] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.046047 11255 ts_tablet_manager.cc:1434] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.002s
I20260709 12:30:34.053406 11255 tablet_bootstrap.cc:492] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:34.062614 11255 tablet_bootstrap.cc:654] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.075090 10882 catalog_manager.cc:5697] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 1 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:34.076118 11255 tablet_bootstrap.cc:492] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:34.076678 11255 ts_tablet_manager.cc:1403] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.003s
I20260709 12:30:34.079677 11255 raft_consensus.cc:359] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.080415 11255 raft_consensus.cc:385] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.080709 11255 raft_consensus.cc:740] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.081384 11255 consensus_queue.cc:260] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.083158 11343 raft_consensus.cc:493] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.083724 11343 raft_consensus.cc:515] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.084479 11256 tablet_bootstrap.cc:654] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.087694 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e5dce93d14266abb8069bb2020135" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:34.088454 11060 raft_consensus.cc:2468] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:34.089859 10952 leader_election.cc:304] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:34.091058 11427 raft_consensus.cc:2804] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:34.091456 11427 raft_consensus.cc:493] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:34.091816 11427 raft_consensus.cc:3060] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.100828 11255 ts_tablet_manager.cc:1434] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:30:34.099745 11343 leader_election.cc:290] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:34.101998 11255 tablet_bootstrap.cc:492] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:34.108425 11254 tablet_bootstrap.cc:492] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:34.108933 11254 ts_tablet_manager.cc:1403] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.183s	user 0.012s	sys 0.008s
I20260709 12:30:34.111723 11253 tablet_bootstrap.cc:492] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:34.112251 11253 ts_tablet_manager.cc:1403] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.147s	user 0.006s	sys 0.016s
I20260709 12:30:34.115272 11253 raft_consensus.cc:359] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.113533 10881 catalog_manager.cc:5697] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:34.117280 11253 raft_consensus.cc:385] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.117686 11253 raft_consensus.cc:740] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.118398 10881 catalog_manager.cc:5697] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:34.116822 11427 raft_consensus.cc:515] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.119781 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e5dce93d14266abb8069bb2020135" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:34.121809 11427 leader_election.cc:290] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:34.123031 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e5dce93d14266abb8069bb2020135" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:34.123809 11253 consensus_queue.cc:260] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.124318 11255 tablet_bootstrap.cc:654] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.124851 11060 raft_consensus.cc:3060] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.127561 11208 raft_consensus.cc:2468] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:34.133554 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e5dce93d14266abb8069bb2020135" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:34.136545 11060 raft_consensus.cc:2468] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:34.138619 10952 leader_election.cc:304] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:34.140676 11254 raft_consensus.cc:359] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.141451 11254 raft_consensus.cc:385] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.141764 11254 raft_consensus.cc:740] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.142189 11343 consensus_queue.cc:1048] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:34.142549 11254 consensus_queue.cc:260] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.144928 11254 ts_tablet_manager.cc:1434] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 12:30:34.145619 11256 tablet_bootstrap.cc:492] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:34.146333 11256 ts_tablet_manager.cc:1403] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.012s
I20260709 12:30:34.149355 11256 raft_consensus.cc:359] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.150130 11256 raft_consensus.cc:385] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.150413 11256 raft_consensus.cc:740] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.151095 11256 consensus_queue.cc:260] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.146317 11254 tablet_bootstrap.cc:492] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:34.153342 11256 ts_tablet_manager.cc:1434] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:30:34.157629 11256 tablet_bootstrap.cc:492] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:34.171231 11253 ts_tablet_manager.cc:1434] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.001s
I20260709 12:30:34.171300 11254 tablet_bootstrap.cc:654] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.172574 11253 tablet_bootstrap.cc:492] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:34.160616 11401 raft_consensus.cc:2804] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:34.174037 11401 raft_consensus.cc:697] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:34.190486 11256 tablet_bootstrap.cc:654] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.195318 11401 consensus_queue.cc:237] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.198505 11343 consensus_queue.cc:1048] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:30:34.207844 11253 tablet_bootstrap.cc:654] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.219359 11318 raft_consensus.cc:493] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.220218 11318 raft_consensus.cc:515] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.223798 11404 raft_consensus.cc:493] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.224545 11404 raft_consensus.cc:515] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.224710 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29ac676c05840d384d97014df8fdffd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:34.227528 11404 leader_election.cc:290] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:34.229327 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cbb858478864fdd91f8a71c7d583382" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:34.230432 11059 raft_consensus.cc:2468] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:34.232461 11175 leader_election.cc:304] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:34.233364 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cbb858478864fdd91f8a71c7d583382" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:34.233651 11318 leader_election.cc:290] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:34.234246 11404 raft_consensus.cc:2804] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:34.234194 11424 raft_consensus.cc:493] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.234846 11404 raft_consensus.cc:493] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:34.235237 11404 raft_consensus.cc:3060] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.234964 11424 raft_consensus.cc:515] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.237131 11424 leader_election.cc:290] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:34.234156 10983 raft_consensus.cc:2468] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:34.238441 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a25febeedeb45368dcfe60611272c19" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:34.234354 11255 tablet_bootstrap.cc:492] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:34.239390 11255 ts_tablet_manager.cc:1403] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.138s	user 0.026s	sys 0.036s
I20260709 12:30:34.241539 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29ac676c05840d384d97014df8fdffd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:34.242094 11255 raft_consensus.cc:359] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.242470 11059 raft_consensus.cc:2393] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a96b33d3dcf7432e904439b5be66dee1 in current term 1: Already voted for candidate 61218d0202f44940b61185f640880574 in this term.
I20260709 12:30:34.242818 11255 raft_consensus.cc:385] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.244984 11255 raft_consensus.cc:740] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.245837 11255 consensus_queue.cc:260] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.248407 11255 ts_tablet_manager.cc:1434] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:30:34.249399 11255 tablet_bootstrap.cc:492] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:34.252478 11101 leader_election.cc:304] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:34.257243 11418 raft_consensus.cc:3060] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.257217 11255 tablet_bootstrap.cc:654] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.242684 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a25febeedeb45368dcfe60611272c19" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:34.263077 11209 raft_consensus.cc:2393] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a96b33d3dcf7432e904439b5be66dee1 in current term 1: Already voted for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in this term.
I20260709 12:30:34.272509 11099 leader_election.cc:304] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:34.274083 11318 raft_consensus.cc:3060] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.285133 11253 tablet_bootstrap.cc:492] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:34.285838 11253 ts_tablet_manager.cc:1403] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.001s
I20260709 12:30:34.300221 11418 raft_consensus.cc:2749] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:34.289434 11253 raft_consensus.cc:359] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.301783 11253 raft_consensus.cc:385] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.302250 11253 raft_consensus.cc:740] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.303380 11253 consensus_queue.cc:260] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.305716 11253 ts_tablet_manager.cc:1434] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:30:34.308494 11254 tablet_bootstrap.cc:492] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:34.316421 11256 tablet_bootstrap.cc:492] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:34.316637 11404 raft_consensus.cc:515] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.317770 11254 ts_tablet_manager.cc:1403] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.172s	user 0.034s	sys 0.033s
I20260709 12:30:34.317806 11256 ts_tablet_manager.cc:1403] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.160s	user 0.020s	sys 0.025s
I20260709 12:30:34.316113 11318 raft_consensus.cc:2749] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:34.319921 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cbb858478864fdd91f8a71c7d583382" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:34.320544 10983 raft_consensus.cc:3060] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.320990 11254 raft_consensus.cc:359] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.322743 11254 raft_consensus.cc:385] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.328262 11254 raft_consensus.cc:740] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.329020 11254 consensus_queue.cc:260] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.331390 11254 ts_tablet_manager.cc:1434] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:30:34.321928 11256 raft_consensus.cc:359] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.331846 11256 raft_consensus.cc:385] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.331976 10983 raft_consensus.cc:2468] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:34.332213 11256 raft_consensus.cc:740] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.334448 11255 tablet_bootstrap.cc:492] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:34.334153 11256 consensus_queue.cc:260] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.334966 11255 ts_tablet_manager.cc:1403] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.024s
I20260709 12:30:34.336380 11256 ts_tablet_manager.cc:1434] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:30:34.337430 11256 tablet_bootstrap.cc:492] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:34.327948 11253 tablet_bootstrap.cc:492] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:34.338110 11255 raft_consensus.cc:359] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.338860 11255 raft_consensus.cc:385] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.339145 11255 raft_consensus.cc:740] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.340227 11255 consensus_queue.cc:260] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.343127 11255 ts_tablet_manager.cc:1434] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:30:34.345183 11255 tablet_bootstrap.cc:492] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:34.333309 11254 tablet_bootstrap.cc:492] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:34.347414 10883 catalog_manager.cc:5697] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:34.348101 11174 leader_election.cc:304] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:34.348913 11406 raft_consensus.cc:2804] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:34.349381 11406 raft_consensus.cc:697] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:34.350241 11406 consensus_queue.cc:237] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.351300 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cbb858478864fdd91f8a71c7d583382" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:34.351951 11061 raft_consensus.cc:3060] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.346412 11404 leader_election.cc:290] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:34.358786 11253 tablet_bootstrap.cc:654] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.359511 11256 tablet_bootstrap.cc:654] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.364949 11350 consensus_queue.cc:1048] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:34.384338 11255 tablet_bootstrap.cc:654] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.387683 11061 raft_consensus.cc:2468] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:34.391602 11254 tablet_bootstrap.cc:654] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.403427 10881 catalog_manager.cc:5697] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 1 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:34.409081 11301 consensus_queue.cc:1048] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:34.410199 11350 consensus_queue.cc:1048] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:34.409092 11256 tablet_bootstrap.cc:492] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:34.415371 11256 ts_tablet_manager.cc:1403] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.007s
I20260709 12:30:34.416265 11255 tablet_bootstrap.cc:492] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:34.418123 11256 raft_consensus.cc:359] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.418848 11256 raft_consensus.cc:385] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.419118 11256 raft_consensus.cc:740] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.419771 11256 consensus_queue.cc:260] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.421196 11255 ts_tablet_manager.cc:1403] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.008s
I20260709 12:30:34.424345 11256 ts_tablet_manager.cc:1434] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:30:34.425334 11256 tablet_bootstrap.cc:492] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:34.433075 11256 tablet_bootstrap.cc:654] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.424098 11255 raft_consensus.cc:359] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.438125 11255 raft_consensus.cc:385] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.438448 11255 raft_consensus.cc:740] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.442703 11301 consensus_queue.cc:1048] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:34.445779 11256 tablet_bootstrap.cc:492] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:34.446326 11256 ts_tablet_manager.cc:1403] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 12:30:34.449422 11256 raft_consensus.cc:359] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.450342 11256 raft_consensus.cc:385] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.450692 11256 raft_consensus.cc:740] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.453838 11254 tablet_bootstrap.cc:492] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:34.454483 11254 ts_tablet_manager.cc:1403] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.121s	user 0.014s	sys 0.004s
I20260709 12:30:34.454581 11255 consensus_queue.cc:260] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.455533 11256 consensus_queue.cc:260] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.458482 11255 ts_tablet_manager.cc:1434] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 12:30:34.459463 11255 tablet_bootstrap.cc:492] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:34.461211 11254 raft_consensus.cc:359] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.461860 11254 raft_consensus.cc:385] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.463802 11254 raft_consensus.cc:740] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.463502 11256 ts_tablet_manager.cc:1434] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:30:34.465278 11256 tablet_bootstrap.cc:492] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:34.470122 11254 consensus_queue.cc:260] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.471099 11424 raft_consensus.cc:493] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.471628 11424 raft_consensus.cc:515] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.472267 11254 ts_tablet_manager.cc:1434] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.003s
I20260709 12:30:34.473201 11254 tablet_bootstrap.cc:492] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:34.476601 11424 leader_election.cc:290] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:34.477222 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be854f634c14923853d3907984c6ca6" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:34.477726 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be854f634c14923853d3907984c6ca6" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:34.477990 11060 raft_consensus.cc:2468] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:34.478468 11209 raft_consensus.cc:2468] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:34.478782 11256 tablet_bootstrap.cc:654] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.479866 11101 leader_election.cc:304] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:34.482223 11424 raft_consensus.cc:2804] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:34.483340 11427 consensus_queue.cc:1048] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:34.484560 11254 tablet_bootstrap.cc:654] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.483753 11424 raft_consensus.cc:493] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:34.485610 11424 raft_consensus.cc:3060] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.492385 11253 tablet_bootstrap.cc:492] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:34.492964 11253 ts_tablet_manager.cc:1403] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.165s	user 0.013s	sys 0.000s
I20260709 12:30:34.496383 11254 tablet_bootstrap.cc:492] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
W20260709 12:30:34.496496 10931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:34.497643 11418 raft_consensus.cc:493] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.498225 11418 raft_consensus.cc:515] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.497008 11254 ts_tablet_manager.cc:1403] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.004s
I20260709 12:30:34.500613 11418 leader_election.cc:290] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:34.500370 11253 raft_consensus.cc:359] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.501160 11253 raft_consensus.cc:385] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.501466 11253 raft_consensus.cc:740] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.503257 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594610f072a45d7bc713888fe5cb278" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:34.503993 11060 raft_consensus.cc:2468] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:34.503561 11253 consensus_queue.cc:260] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.505455 11101 leader_election.cc:304] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:34.506505 11253 ts_tablet_manager.cc:1434] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:30:34.507093 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594610f072a45d7bc713888fe5cb278" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:34.515648 11318 raft_consensus.cc:2804] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:34.516062 11318 raft_consensus.cc:493] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:34.516662 11318 raft_consensus.cc:3060] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.515666 11253 tablet_bootstrap.cc:492] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:34.510610 11255 tablet_bootstrap.cc:654] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.516031 11209 raft_consensus.cc:2468] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:34.529271 11256 tablet_bootstrap.cc:492] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:34.529847 11256 ts_tablet_manager.cc:1403] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.008s
I20260709 12:30:34.532632 11256 raft_consensus.cc:359] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.533282 11256 raft_consensus.cc:385] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.533579 11256 raft_consensus.cc:740] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.501694 11254 raft_consensus.cc:359] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.534068 11254 raft_consensus.cc:385] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.534341 11254 raft_consensus.cc:740] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.534300 11256 consensus_queue.cc:260] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.535151 11254 consensus_queue.cc:260] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
W20260709 12:30:34.535521 10949 consensus_peers.cc:597] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 -> Peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Couldn't send request to peer a96b33d3dcf7432e904439b5be66dee1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:34.533753 11318 raft_consensus.cc:515] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.538601 11253 tablet_bootstrap.cc:654] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.539417 11318 leader_election.cc:290] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:34.540421 11254 ts_tablet_manager.cc:1434] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.002s
I20260709 12:30:34.541409 11254 tablet_bootstrap.cc:492] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:34.544313 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594610f072a45d7bc713888fe5cb278" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:34.545117 11209 raft_consensus.cc:3060] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.548031 11256 ts_tablet_manager.cc:1434] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.003s
I20260709 12:30:34.549052 11256 tablet_bootstrap.cc:492] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:34.548928 11424 raft_consensus.cc:515] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.552718 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594610f072a45d7bc713888fe5cb278" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:34.553373 11061 raft_consensus.cc:3060] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.559602 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be854f634c14923853d3907984c6ca6" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:34.560340 11060 raft_consensus.cc:3060] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.560324 11209 raft_consensus.cc:2468] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:34.561684 11061 raft_consensus.cc:2468] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:34.562954 11254 tablet_bootstrap.cc:654] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.565871 11253 tablet_bootstrap.cc:492] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:34.566578 11253 ts_tablet_manager.cc:1403] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.005s
I20260709 12:30:34.568885 11101 leader_election.cc:304] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:34.569931 11473 raft_consensus.cc:2804] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:34.570614 11473 raft_consensus.cc:697] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:34.573351 11473 consensus_queue.cc:237] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.578511 11424 leader_election.cc:290] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:34.579142 11060 raft_consensus.cc:2468] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:34.580459 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be854f634c14923853d3907984c6ca6" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:34.589682 11208 raft_consensus.cc:3060] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.582052 11254 tablet_bootstrap.cc:492] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:34.582964 11253 raft_consensus.cc:359] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.588030 11256 tablet_bootstrap.cc:654] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.592891 11253 raft_consensus.cc:385] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.593183 11253 raft_consensus.cc:740] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.593955 11253 consensus_queue.cc:260] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.597275 11253 ts_tablet_manager.cc:1434] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:30:34.598476 11253 tablet_bootstrap.cc:492] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:34.600914 11208 raft_consensus.cc:2468] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:34.601903 11101 leader_election.cc:304] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:34.602203 11254 ts_tablet_manager.cc:1403] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.001s
I20260709 12:30:34.606413 11253 tablet_bootstrap.cc:654] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.606297 11254 raft_consensus.cc:359] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.607592 11254 raft_consensus.cc:385] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.607977 11254 raft_consensus.cc:740] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.609364 11255 tablet_bootstrap.cc:492] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:34.608951 11254 consensus_queue.cc:260] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.609934 11255 ts_tablet_manager.cc:1403] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.151s	user 0.018s	sys 0.011s
I20260709 12:30:34.611204 11318 raft_consensus.cc:2804] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:34.612902 11318 raft_consensus.cc:697] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:34.613791 11318 consensus_queue.cc:237] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.614641 11256 tablet_bootstrap.cc:492] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:34.614943 11424 raft_consensus.cc:493] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.615155 11256 ts_tablet_manager.cc:1403] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.000s
I20260709 12:30:34.615551 11424 raft_consensus.cc:515] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.616082 11254 ts_tablet_manager.cc:1434] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:30:34.622962 11424 leader_election.cc:290] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:34.624251 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:34.624509 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:34.625095 11255 raft_consensus.cc:359] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.625844 11255 raft_consensus.cc:385] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.625978 11099 leader_election.cc:304] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:34.626219 11255 raft_consensus.cc:740] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.627465 11253 tablet_bootstrap.cc:492] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:34.627092 11255 consensus_queue.cc:260] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.627960 11253 ts_tablet_manager.cc:1403] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 12:30:34.628752 11424 raft_consensus.cc:2749] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:34.631007 11253 raft_consensus.cc:359] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.631762 11253 raft_consensus.cc:385] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.632051 11253 raft_consensus.cc:740] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.632473 11254 tablet_bootstrap.cc:492] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:34.632637 11256 raft_consensus.cc:359] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.633355 11256 raft_consensus.cc:385] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.633631 11256 raft_consensus.cc:740] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.634413 11256 consensus_queue.cc:260] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.636669 11256 ts_tablet_manager.cc:1434] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:30:34.637230 11253 consensus_queue.cc:260] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.637605 11256 tablet_bootstrap.cc:492] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:34.639652 11253 ts_tablet_manager.cc:1434] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:30:34.640146 11254 tablet_bootstrap.cc:654] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.640592 11253 tablet_bootstrap.cc:492] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:34.647233 11253 tablet_bootstrap.cc:654] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.647233 11256 tablet_bootstrap.cc:654] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.652062 11255 ts_tablet_manager.cc:1434] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:30:34.660642 11255 tablet_bootstrap.cc:492] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:34.666064 11427 raft_consensus.cc:493] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.657230 10881 catalog_manager.cc:5697] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:34.666831 11427 raft_consensus.cc:515] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.667649 11208 raft_consensus.cc:3060] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.668622 10881 catalog_manager.cc:5697] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:34.678086 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb59ce189c94c75972facd422484e58" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:34.679487 11427 leader_election.cc:290] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:34.680706 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb59ce189c94c75972facd422484e58" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
W20260709 12:30:34.681859 10950 leader_election.cc:343] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:34.682413 11256 tablet_bootstrap.cc:492] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
W20260709 12:30:34.682479 10952 leader_election.cc:343] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:34.683023 11256 ts_tablet_manager.cc:1403] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.004s
I20260709 12:30:34.683104 10952 leader_election.cc:304] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61218d0202f44940b61185f640880574; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:34.684481 11427 raft_consensus.cc:2749] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:34.686595 11256 raft_consensus.cc:359] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.687346 11256 raft_consensus.cc:385] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.687592 11256 raft_consensus.cc:740] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.688261 11256 consensus_queue.cc:260] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.690058 11256 ts_tablet_manager.cc:1434] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:30:34.691115 11256 tablet_bootstrap.cc:492] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:34.691933 11406 raft_consensus.cc:493] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.692445 11406 raft_consensus.cc:515] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.693259 11253 tablet_bootstrap.cc:492] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:34.693728 11253 ts_tablet_manager.cc:1403] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.005s
I20260709 12:30:34.694609 11406 leader_election.cc:290] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:34.696512 11253 raft_consensus.cc:359] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.697150 11253 raft_consensus.cc:385] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.697414 11253 raft_consensus.cc:740] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.697566 11254 tablet_bootstrap.cc:492] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:34.697930 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c29611c5d144eeacac30952bc92aed" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:34.698164 11254 ts_tablet_manager.cc:1403] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.081s	user 0.029s	sys 0.021s
I20260709 12:30:34.698675 11132 raft_consensus.cc:2468] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:34.701099 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c29611c5d144eeacac30952bc92aed" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:34.701363 11256 tablet_bootstrap.cc:654] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.701318 11254 raft_consensus.cc:359] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.701853 10983 raft_consensus.cc:2468] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:34.702330 11254 raft_consensus.cc:385] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.702644 11254 raft_consensus.cc:740] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.702590 11253 consensus_queue.cc:260] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.704238 11174 leader_election.cc:304] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:34.703866 11427 consensus_queue.cc:1048] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:30:34.707944 11255 tablet_bootstrap.cc:654] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.714008 11406 raft_consensus.cc:2804] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:34.714463 11406 raft_consensus.cc:493] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:34.714834 11406 raft_consensus.cc:3060] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.708778 11253 ts_tablet_manager.cc:1434] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:30:34.703648 11254 consensus_queue.cc:260] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.719816 11253 tablet_bootstrap.cc:492] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:34.720803 11254 ts_tablet_manager.cc:1434] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:30:34.722249 11254 tablet_bootstrap.cc:492] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:34.733498 11254 tablet_bootstrap.cc:654] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.735404 11253 tablet_bootstrap.cc:654] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.736390 11256 tablet_bootstrap.cc:492] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:34.736897 11256 ts_tablet_manager.cc:1403] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.046s	user 0.024s	sys 0.011s
I20260709 12:30:34.739769 11256 raft_consensus.cc:359] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.739904 11255 tablet_bootstrap.cc:492] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:34.741070 11255 ts_tablet_manager.cc:1403] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.000s
I20260709 12:30:34.742470 11318 raft_consensus.cc:493] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.740430 11256 raft_consensus.cc:385] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.743075 11256 raft_consensus.cc:740] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.742969 11318 raft_consensus.cc:515] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.743942 11256 consensus_queue.cc:260] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.746470 11256 ts_tablet_manager.cc:1434] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:30:34.747077 11318 leader_election.cc:290] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:34.747404 11256 tablet_bootstrap.cc:492] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:34.747519 11254 tablet_bootstrap.cc:492] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:34.747418 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befb3713bcb4d2194f4deacce467056" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:34.748266 11254 ts_tablet_manager.cc:1403] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.007s
I20260709 12:30:34.748392 10983 raft_consensus.cc:2468] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:34.750404 11255 raft_consensus.cc:359] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.751191 11255 raft_consensus.cc:385] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.751205 11254 raft_consensus.cc:359] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.751569 11255 raft_consensus.cc:740] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.752067 11254 raft_consensus.cc:385] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.752455 11254 raft_consensus.cc:740] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.752668 11255 consensus_queue.cc:260] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.754514 11256 tablet_bootstrap.cc:654] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.755686 11255 ts_tablet_manager.cc:1434] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:30:34.755851 11100 leader_election.cc:304] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:34.756837 11318 raft_consensus.cc:2804] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:34.757225 11318 raft_consensus.cc:493] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:34.757601 11318 raft_consensus.cc:3060] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.753345 11254 consensus_queue.cc:260] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.758980 11253 tablet_bootstrap.cc:492] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:34.759440 11253 ts_tablet_manager.cc:1403] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.001s
I20260709 12:30:34.759809 11254 ts_tablet_manager.cc:1434] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:30:34.760849 11254 tablet_bootstrap.cc:492] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:34.762225 11253 raft_consensus.cc:359] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.762904 11253 raft_consensus.cc:385] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.763156 11253 raft_consensus.cc:740] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.763830 11427 raft_consensus.cc:493] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.764446 11427 raft_consensus.cc:515] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.767169 11427 leader_election.cc:290] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:34.769690 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbef020004b425daa18c14ea59972d7" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:34.769987 11424 raft_consensus.cc:493] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.770454 11060 raft_consensus.cc:2468] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:34.770501 11424 raft_consensus.cc:515] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.772921 11424 leader_election.cc:290] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:34.774961 11350 raft_consensus.cc:493] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.775509 11350 raft_consensus.cc:515] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.778538 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befb3713bcb4d2194f4deacce467056" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:34.779582 11208 raft_consensus.cc:2468] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:34.782389 11350 leader_election.cc:290] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:34.783406 10952 leader_election.cc:304] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:34.784839 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0743c24d152b46b2ad08375da31705ea" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:34.785907 11343 raft_consensus.cc:2804] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:34.786305 11343 raft_consensus.cc:493] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:34.786571 11473 raft_consensus.cc:493] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.787421 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db9ac26d7914efdb621c400b65a0b89" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:34.787252 11473 raft_consensus.cc:515] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.786659 11343 raft_consensus.cc:3060] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.728664 11406 raft_consensus.cc:515] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.790177 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db9ac26d7914efdb621c400b65a0b89" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:34.793711 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0743c24d152b46b2ad08375da31705ea" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:34.794394 10986 raft_consensus.cc:2468] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
W20260709 12:30:34.795508 11025 leader_election.cc:343] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:34.795830 11100 leader_election.cc:304] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:34.791944 11318 raft_consensus.cc:515] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.789317 11404 raft_consensus.cc:493] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:34.797026 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbef020004b425daa18c14ea59972d7" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:34.797312 11404 raft_consensus.cc:515] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:34.793641 11255 tablet_bootstrap.cc:492] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:34.829159 11253 consensus_queue.cc:260] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:34.838634 11405 consensus_queue.cc:1048] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:34.834075 11207 raft_consensus.cc:2468] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:34.836803 11427 consensus_queue.cc:1048] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:30:34.834522 11132 raft_consensus.cc:2468] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:34.834887 11424 raft_consensus.cc:2804] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:34.846685 11424 raft_consensus.cc:493] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:34.847059 11424 raft_consensus.cc:3060] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.859417 11256 tablet_bootstrap.cc:492] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:34.860107 11256 ts_tablet_manager.cc:1403] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.113s	user 0.020s	sys 0.017s
W20260709 12:30:34.833678 11024 leader_election.cc:343] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:34.862208 11024 leader_election.cc:304] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:34.862277 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbef020004b425daa18c14ea59972d7" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:34.863286 11350 raft_consensus.cc:2749] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:30:34.864296 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:44703, user_credentials={real_user=slave}} blocked reactor thread for 55223.7us
I20260709 12:30:34.864007 11256 raft_consensus.cc:359] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.865101 11256 raft_consensus.cc:385] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:34.865432 11256 raft_consensus.cc:740] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:34.871773 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbef020004b425daa18c14ea59972d7" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:34.872437 11061 raft_consensus.cc:2468] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:34.873657 11101 leader_election.cc:304] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:34.868300 11256 consensus_queue.cc:260] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:34.882616 11253 ts_tablet_manager.cc:1434] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.123s	user 0.015s	sys 0.012s
I20260709 12:30:34.892076 11253 tablet_bootstrap.cc:492] T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:34.878693 11473 leader_election.cc:290] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
W20260709 12:30:34.895612 11174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:42037, user_credentials={real_user=slave}} blocked reactor thread for 88882.2us
I20260709 12:30:34.897966 11492 raft_consensus.cc:2804] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:34.898561 11492 raft_consensus.cc:493] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:34.899039 11492 raft_consensus.cc:3060] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.899298 11490 consensus_queue.cc:1048] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:34.901975 11254 tablet_bootstrap.cc:654] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.869129 11343 raft_consensus.cc:515] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.913333 11404 leader_election.cc:290] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:34.913897 10986 raft_consensus.cc:2393] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a96b33d3dcf7432e904439b5be66dee1 in current term 1: Already voted for candidate 61218d0202f44940b61185f640880574 in this term.
I20260709 12:30:34.916898 11406 leader_election.cc:290] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:34.919490 11256 ts_tablet_manager.cc:1434] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.020s
I20260709 12:30:34.920687 11256 tablet_bootstrap.cc:492] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:34.921135 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db9ac26d7914efdb621c400b65a0b89" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:34.922178 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befb3713bcb4d2194f4deacce467056" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:34.924892 10984 raft_consensus.cc:3060] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.929678 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befb3713bcb4d2194f4deacce467056" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:34.930430 11208 raft_consensus.cc:3060] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:34.918256 11318 leader_election.cc:290] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:34.937147 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db9ac26d7914efdb621c400b65a0b89" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:34.937989 10986 raft_consensus.cc:2468] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:34.979094 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c29611c5d144eeacac30952bc92aed" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:34.979918 11133 raft_consensus.cc:3060] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:34.981117 11101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 46785.8us
I20260709 12:30:34.982285 11343 leader_election.cc:290] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:34.983660 11255 tablet_bootstrap.cc:654] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:34.987691 11253 tablet_bootstrap.cc:654] T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
W20260709 12:30:34.988591 11026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:42037, user_credentials={real_user=slave}} blocked reactor thread for 46476.4us
I20260709 12:30:35.005995 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbef020004b425daa18c14ea59972d7" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:35.006755 11060 raft_consensus.cc:3060] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.008143 11492 raft_consensus.cc:515] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:34.979811 11174 leader_election.cc:304] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:34.998623 11416 raft_consensus.cc:493] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:35.013816 11416 raft_consensus.cc:515] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.015375 10984 raft_consensus.cc:2468] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:35.015981 11416 leader_election.cc:290] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:35.015837 11492 leader_election.cc:290] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:34.999241 11300 raft_consensus.cc:493] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:35.020035 11490 raft_consensus.cc:2804] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:35.022409 11300 raft_consensus.cc:515] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:35.038728 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcae59975bce4cefbe8718f31534067b" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:35.040740 11024 leader_election.cc:343] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:35.041478 11255 tablet_bootstrap.cc:492] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:35.042052 11255 ts_tablet_manager.cc:1403] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.249s	user 0.025s	sys 0.007s
I20260709 12:30:35.032173 11490 raft_consensus.cc:493] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:35.043380 11256 tablet_bootstrap.cc:654] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.033629 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c29611c5d144eeacac30952bc92aed" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:35.047474 10983 raft_consensus.cc:3060] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.048110 11133 raft_consensus.cc:2468] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:35.049567 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbef020004b425daa18c14ea59972d7" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:35.036033 11424 raft_consensus.cc:515] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:35.052011 11300 leader_election.cc:290] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:35.052618 11424 leader_election.cc:290] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:35.056003 11132 raft_consensus.cc:2393] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f856f4709042d9b3ce1348bdfb2ad5 in current term 1: Already voted for candidate a96b33d3dcf7432e904439b5be66dee1 in this term.
I20260709 12:30:35.057333 11060 raft_consensus.cc:2468] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:35.058177 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b82ae79252824afe8ff9ffcd83005eae" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:35.058648 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbef020004b425daa18c14ea59972d7" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:35.059448 10986 raft_consensus.cc:2393] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a96b33d3dcf7432e904439b5be66dee1 in current term 1: Already voted for candidate 61218d0202f44940b61185f640880574 in this term.
I20260709 12:30:35.059937 11100 leader_election.cc:304] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:35.061293 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db9ac26d7914efdb621c400b65a0b89" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:35.061594 10952 leader_election.cc:304] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:35.062040 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db9ac26d7914efdb621c400b65a0b89" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:35.062866 11318 raft_consensus.cc:2804] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:35.063094 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcae59975bce4cefbe8718f31534067b" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:35.064101 11318 raft_consensus.cc:697] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
W20260709 12:30:35.064406 11026 leader_election.cc:343] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:35.064860 11026 leader_election.cc:304] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:35.065011 11318 consensus_queue.cc:237] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:35.066067 11416 raft_consensus.cc:2749] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:35.067171 11427 raft_consensus.cc:2804] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:35.067745 11427 raft_consensus.cc:697] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:35.067538 11255 raft_consensus.cc:359] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.062006 10982 raft_consensus.cc:3060] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.068305 11255 raft_consensus.cc:385] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.068928 11101 leader_election.cc:304] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:35.068692 11427 consensus_queue.cc:237] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.069407 11172 leader_election.cc:304] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:35.069746 11418 raft_consensus.cc:2749] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:30:35.071705 11253 tablet_bootstrap.cc:492] T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:35.072078 11491 raft_consensus.cc:2804] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:35.072659 11491 raft_consensus.cc:697] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:35.073351 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbef020004b425daa18c14ea59972d7" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:35.073467 11491 consensus_queue.cc:237] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:35.074338 11132 raft_consensus.cc:2393] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61218d0202f44940b61185f640880574 in current term 1: Already voted for candidate a96b33d3dcf7432e904439b5be66dee1 in this term.
I20260709 12:30:35.076663 10982 raft_consensus.cc:2468] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:35.072268 11253 ts_tablet_manager.cc:1403] T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.185s	user 0.015s	sys 0.012s
I20260709 12:30:35.068709 11255 raft_consensus.cc:740] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.082412 11255 consensus_queue.cc:260] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
W20260709 12:30:35.066788 11025 leader_election.cc:343] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:35.045003 11490 raft_consensus.cc:3060] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.093299 11100 leader_election.cc:304] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:35.093456 11416 raft_consensus.cc:493] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:35.094449 11416 raft_consensus.cc:515] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.097219 11255 ts_tablet_manager.cc:1434] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 12:30:35.100896 11255 tablet_bootstrap.cc:492] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:35.097249 11424 raft_consensus.cc:2804] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:35.105911 11424 raft_consensus.cc:697] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:35.106761 11416 leader_election.cc:290] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:35.106859 11424 consensus_queue.cc:237] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:35.109012 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c03f14392f45ba8f442cfec87fd85e" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:35.109371 10983 raft_consensus.cc:2468] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
W20260709 12:30:35.110350 11026 leader_election.cc:343] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:35.109061 10882 catalog_manager.cc:5697] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:35.113811 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b82ae79252824afe8ff9ffcd83005eae" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:35.114522 11132 raft_consensus.cc:2468] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
I20260709 12:30:35.124836 11255 tablet_bootstrap.cc:654] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.099628 11208 raft_consensus.cc:2468] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:35.135807 11254 tablet_bootstrap.cc:492] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:35.136632 11254 ts_tablet_manager.cc:1403] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.376s	user 0.018s	sys 0.014s
I20260709 12:30:35.156121 11024 leader_election.cc:304] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:35.158823 11496 raft_consensus.cc:2804] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:35.158562 11493 consensus_queue.cc:1048] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:35.159305 11496 raft_consensus.cc:493] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:35.159710 11496 raft_consensus.cc:3060] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.166692 11133 raft_consensus.cc:3060] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.178476 11406 raft_consensus.cc:493] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:35.179057 11406 raft_consensus.cc:515] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.181506 11406 leader_election.cc:290] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:35.185752 11254 raft_consensus.cc:359] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.190913 11253 raft_consensus.cc:359] T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:35.191239 11254 raft_consensus.cc:385] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.191826 11253 raft_consensus.cc:385] T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.191912 11254 raft_consensus.cc:740] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.192224 11253 raft_consensus.cc:740] T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.193089 11254 consensus_queue.cc:260] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.193089 11253 consensus_queue.cc:260] T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:35.197077 11254 ts_tablet_manager.cc:1434] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.002s
I20260709 12:30:35.197284 11253 ts_tablet_manager.cc:1434] T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.116s	user 0.006s	sys 0.001s
I20260709 12:30:35.200366 11253 tablet_bootstrap.cc:492] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:35.203716 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb59ce189c94c75972facd422484e58" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:35.204442 11061 raft_consensus.cc:2468] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:35.204452 11343 raft_consensus.cc:493] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:35.205129 11343 raft_consensus.cc:515] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:35.207299 11343 leader_election.cc:290] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:35.209309 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e572b4a12e2d41008d2b3ba98f1429fb" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:35.209985 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c03f14392f45ba8f442cfec87fd85e" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:35.210932 10950 leader_election.cc:343] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:35.212723 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb59ce189c94c75972facd422484e58" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:35.213263 11424 consensus_queue.cc:1048] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:35.215059 11318 consensus_queue.cc:1048] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:35.217917 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e572b4a12e2d41008d2b3ba98f1429fb" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:35.219581 10949 leader_election.cc:343] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:35.221088 10881 catalog_manager.cc:5697] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 1 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:35.221045 11254 tablet_bootstrap.cc:492] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:35.213369 10984 raft_consensus.cc:2468] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:35.220045 10949 leader_election.cc:304] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:35.251451 11175 leader_election.cc:304] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:35.223976 11490 raft_consensus.cc:515] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
W20260709 12:30:35.243980 11024 leader_election.cc:343] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:35.268652 11256 tablet_bootstrap.cc:492] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:35.269203 11256 ts_tablet_manager.cc:1403] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.349s	user 0.014s	sys 0.011s
W20260709 12:30:35.282182 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:44703, user_credentials={real_user=slave}} blocked reactor thread for 62633.8us
I20260709 12:30:35.282815 11318 consensus_queue.cc:1048] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:35.284758 11401 raft_consensus.cc:2749] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:35.285831 11491 raft_consensus.cc:2804] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:35.286381 11491 raft_consensus.cc:493] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:35.286810 11491 raft_consensus.cc:3060] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.308650 11253 tablet_bootstrap.cc:654] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.322813 11256 raft_consensus.cc:359] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:35.323802 11256 raft_consensus.cc:385] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.321058 11206 raft_consensus.cc:2393] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a96b33d3dcf7432e904439b5be66dee1 in current term 1: Already voted for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in this term.
I20260709 12:30:35.328230 11490 leader_election.cc:290] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:35.329316 11254 tablet_bootstrap.cc:654] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.330421 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db9ac26d7914efdb621c400b65a0b89" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:35.330835 11255 tablet_bootstrap.cc:492] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:35.331312 11255 ts_tablet_manager.cc:1403] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.231s	user 0.018s	sys 0.017s
I20260709 12:30:35.324151 11256 raft_consensus.cc:740] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.267684 11496 raft_consensus.cc:515] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:35.307425 11024 leader_election.cc:304] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:35.333029 11256 consensus_queue.cc:260] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
W20260709 12:30:35.340709 11506 log.cc:927] Time spent T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:30:35.342317 11255 raft_consensus.cc:359] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.343753 11255 raft_consensus.cc:385] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:30:35.352474 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:44703, user_credentials={real_user=slave}} blocked reactor thread for 109036us
I20260709 12:30:35.352880 11416 raft_consensus.cc:2749] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:35.372907 11256 ts_tablet_manager.cc:1434] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.002s
I20260709 12:30:35.373950 11256 tablet_bootstrap.cc:492] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:35.344086 11255 raft_consensus.cc:740] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.383982 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b82ae79252824afe8ff9ffcd83005eae" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:35.384660 11209 raft_consensus.cc:3060] T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.388769 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db9ac26d7914efdb621c400b65a0b89" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:35.389660 10984 raft_consensus.cc:2393] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f856f4709042d9b3ce1348bdfb2ad5 in current term 1: Already voted for candidate a96b33d3dcf7432e904439b5be66dee1 in this term.
I20260709 12:30:35.395941 11496 leader_election.cc:290] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:35.379055 11255 consensus_queue.cc:260] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.399026 11174 leader_election.cc:304] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:35.400220 11405 raft_consensus.cc:2749] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:30:35.400529 11256 tablet_bootstrap.cc:654] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.403237 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b82ae79252824afe8ff9ffcd83005eae" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:35.404131 11133 raft_consensus.cc:3060] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.407580 11418 raft_consensus.cc:493] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:35.408090 11418 raft_consensus.cc:515] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:35.408370 11209 raft_consensus.cc:2468] T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:35.409554 11025 leader_election.cc:304] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:35.411583 11255 ts_tablet_manager.cc:1434] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.001s
I20260709 12:30:35.412402 11418 leader_election.cc:290] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
W20260709 12:30:35.412959 10952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 65842.5us
I20260709 12:30:35.413574 11255 tablet_bootstrap.cc:492] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:35.413517 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0743c24d152b46b2ad08375da31705ea" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:35.414853 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0743c24d152b46b2ad08375da31705ea" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
W20260709 12:30:35.415344 11099 leader_election.cc:343] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:35.415508 11059 raft_consensus.cc:2468] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:35.416023 10882 catalog_manager.cc:5697] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:35.417124 11101 leader_election.cc:304] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:35.418797 11418 raft_consensus.cc:2804] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:35.411315 11300 raft_consensus.cc:2804] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:35.417785 10882 catalog_manager.cc:5697] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:35.419363 11418 raft_consensus.cc:493] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:35.412452 11491 raft_consensus.cc:515] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.435971 11255 tablet_bootstrap.cc:654] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.438180 11254 tablet_bootstrap.cc:492] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:35.444877 11254 ts_tablet_manager.cc:1403] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.224s	user 0.017s	sys 0.009s
I20260709 12:30:35.425333 11300 raft_consensus.cc:697] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:35.440344 11253 tablet_bootstrap.cc:492] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:35.431959 11418 raft_consensus.cc:3060] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.446168 11253 ts_tablet_manager.cc:1403] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.247s	user 0.014s	sys 0.007s
I20260709 12:30:35.453248 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb59ce189c94c75972facd422484e58" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:35.454085 10984 raft_consensus.cc:3060] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.454691 11300 consensus_queue.cc:237] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:35.457422 11133 raft_consensus.cc:2468] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:35.461374 11254 raft_consensus.cc:359] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.462484 11254 raft_consensus.cc:385] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.462745 11254 raft_consensus.cc:740] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.463618 11254 consensus_queue.cc:260] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.466543 11254 ts_tablet_manager.cc:1434] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:30:35.445842 11491 leader_election.cc:290] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:35.470747 10984 raft_consensus.cc:2468] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:35.472559 11418 raft_consensus.cc:515] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:35.450397 11401 raft_consensus.cc:493] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:35.474738 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb59ce189c94c75972facd422484e58" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:35.477654 11174 leader_election.cc:304] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:35.482522 11405 raft_consensus.cc:2804] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:35.483075 11405 raft_consensus.cc:697] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:35.483932 11405 consensus_queue.cc:237] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.485630 11491 consensus_queue.cc:1048] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:35.494376 11496 raft_consensus.cc:493] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:35.494565 11427 consensus_queue.cc:1048] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:35.495189 11496 raft_consensus.cc:515] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.499634 11427 consensus_queue.cc:1048] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:35.500764 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1895184d543bebeba9172c4b7f560" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:35.502574 11025 leader_election.cc:343] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:35.507995 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0743c24d152b46b2ad08375da31705ea" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:35.508721 11056 raft_consensus.cc:3060] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.510120 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1895184d543bebeba9172c4b7f560" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:35.510865 10982 raft_consensus.cc:2468] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
I20260709 12:30:35.512296 11026 leader_election.cc:304] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:35.513242 11416 raft_consensus.cc:2804] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:35.513666 11416 raft_consensus.cc:493] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:35.514079 11416 raft_consensus.cc:3060] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.516525 11493 consensus_queue.cc:1048] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:35.523408 11254 tablet_bootstrap.cc:492] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:35.478860 11060 raft_consensus.cc:3060] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.513684 11496 leader_election.cc:290] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:35.551674 11253 raft_consensus.cc:359] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.553591 11253 raft_consensus.cc:385] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.553951 11253 raft_consensus.cc:740] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.537434 11418 leader_election.cc:290] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:35.476969 11401 raft_consensus.cc:515] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.557379 11253 consensus_queue.cc:260] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.566181 11254 tablet_bootstrap.cc:654] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.572945 11253 ts_tablet_manager.cc:1434] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.000s
I20260709 12:30:35.603636 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0743c24d152b46b2ad08375da31705ea" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
W20260709 12:30:35.605283 11099 leader_election.cc:343] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:35.619403 11256 tablet_bootstrap.cc:492] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:35.619921 11256 ts_tablet_manager.cc:1403] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.246s	user 0.022s	sys 0.009s
I20260709 12:30:35.636497 11416 raft_consensus.cc:515] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.641083 11255 tablet_bootstrap.cc:492] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:35.642848 11255 ts_tablet_manager.cc:1403] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.229s	user 0.027s	sys 0.037s
I20260709 12:30:35.648799 10879 catalog_manager.cc:5697] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 1 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:35.648865 11256 raft_consensus.cc:359] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.653196 11256 raft_consensus.cc:385] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.653463 11256 raft_consensus.cc:740] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.654341 11060 raft_consensus.cc:2468] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:35.654265 11256 consensus_queue.cc:260] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.656337 11416 leader_election.cc:290] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:35.656932 11256 ts_tablet_manager.cc:1434] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:30:35.658843 11256 tablet_bootstrap.cc:492] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:35.659392 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1895184d543bebeba9172c4b7f560" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:35.660514 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1895184d543bebeba9172c4b7f560" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:35.661152 10984 raft_consensus.cc:3060] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.663043 11255 raft_consensus.cc:359] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.660481 11253 tablet_bootstrap.cc:492] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
W20260709 12:30:35.664188 11025 leader_election.cc:343] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:35.665236 11424 consensus_queue.cc:1048] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:35.650997 11056 raft_consensus.cc:2468] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:35.666884 11255 raft_consensus.cc:385] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.667260 11255 raft_consensus.cc:740] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.667897 11255 consensus_queue.cc:260] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.674302 11401 leader_election.cc:290] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
W20260709 12:30:35.677572 11522 log.cc:927] Time spent T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:30:35.685772 11254 tablet_bootstrap.cc:492] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:35.686376 11254 ts_tablet_manager.cc:1403] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.204s	user 0.009s	sys 0.006s
I20260709 12:30:35.686880 11256 tablet_bootstrap.cc:654] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.687964 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcae59975bce4cefbe8718f31534067b" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:35.688691 11132 raft_consensus.cc:2468] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:35.694306 11254 raft_consensus.cc:359] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.696684 11254 raft_consensus.cc:385] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.696993 11254 raft_consensus.cc:740] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.698077 11254 consensus_queue.cc:260] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.699942 11254 ts_tablet_manager.cc:1434] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:30:35.700954 11254 tablet_bootstrap.cc:492] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
W20260709 12:30:35.691332 10931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:35.706552 11101 leader_election.cc:304] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:35.709834 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcae59975bce4cefbe8718f31534067b" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:35.710673 11493 consensus_queue.cc:1048] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:35.712642 11493 raft_consensus.cc:2804] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:35.713117 11493 raft_consensus.cc:697] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:35.713967 11493 consensus_queue.cc:237] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:35.708069 10949 leader_election.cc:304] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:35.715758 11513 raft_consensus.cc:2804] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:35.716215 11513 raft_consensus.cc:493] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:35.716591 11513 raft_consensus.cc:3060] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.710695 11056 raft_consensus.cc:2468] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:35.708724 10879 catalog_manager.cc:5697] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 1 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:35.718709 11318 consensus_queue.cc:1048] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:35.719219 11253 tablet_bootstrap.cc:654] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.724668 10984 raft_consensus.cc:2468] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:35.725397 11254 tablet_bootstrap.cc:654] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.707907 11255 ts_tablet_manager.cc:1434] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 12:30:35.726563 11255 tablet_bootstrap.cc:492] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:35.737510 11026 leader_election.cc:304] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
W20260709 12:30:35.740769 11172 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:44703, user_credentials={real_user=slave}} blocked reactor thread for 47319.2us
I20260709 12:30:35.741585 11531 raft_consensus.cc:2804] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:35.742192 11531 raft_consensus.cc:697] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:35.743112 11531 consensus_queue.cc:237] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.751134 11406 raft_consensus.cc:493] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:35.751731 11406 raft_consensus.cc:515] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.755371 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c4f1fddaf1474aaf021d0b04387b4c" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:35.756070 11255 tablet_bootstrap.cc:654] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
W20260709 12:30:35.757781 11174 leader_election.cc:343] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:35.761523 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c4f1fddaf1474aaf021d0b04387b4c" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:35.762290 11056 raft_consensus.cc:2468] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:35.763945 11175 leader_election.cc:304] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:35.765199 11513 raft_consensus.cc:515] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.766772 11405 raft_consensus.cc:2804] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:35.767309 11405 raft_consensus.cc:493] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:35.767908 11405 raft_consensus.cc:3060] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.773391 11406 leader_election.cc:290] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:35.777503 11490 consensus_queue.cc:1048] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:35.777859 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcae59975bce4cefbe8718f31534067b" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:35.778492 11134 raft_consensus.cc:3060] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.786331 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcae59975bce4cefbe8718f31534067b" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:35.787215 11056 raft_consensus.cc:3060] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.797434 11513 leader_election.cc:290] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:35.800891 11253 tablet_bootstrap.cc:492] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:35.801442 11253 ts_tablet_manager.cc:1403] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.142s	user 0.014s	sys 0.002s
I20260709 12:30:35.803189 11254 tablet_bootstrap.cc:492] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:35.804028 11254 ts_tablet_manager.cc:1403] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.103s	user 0.011s	sys 0.006s
I20260709 12:30:35.808298 11254 raft_consensus.cc:359] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.809167 11254 raft_consensus.cc:385] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.813818 11254 raft_consensus.cc:740] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.820848 11056 raft_consensus.cc:2468] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:35.809624 11134 raft_consensus.cc:2468] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:35.825695 11255 tablet_bootstrap.cc:492] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:35.825816 10949 leader_election.cc:304] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:35.826244 11255 ts_tablet_manager.cc:1403] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.100s	user 0.013s	sys 0.000s
I20260709 12:30:35.827373 11401 raft_consensus.cc:2804] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:35.828015 11401 raft_consensus.cc:697] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:35.829001 11401 consensus_queue.cc:237] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.821609 11254 consensus_queue.cc:260] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.804541 11253 raft_consensus.cc:359] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.834149 11254 ts_tablet_manager.cc:1434] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:30:35.834383 11253 raft_consensus.cc:385] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.834755 11253 raft_consensus.cc:740] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.823769 11405 raft_consensus.cc:515] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.835485 11253 consensus_queue.cc:260] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.838264 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c4f1fddaf1474aaf021d0b04387b4c" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:35.839169 11255 raft_consensus.cc:359] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
W20260709 12:30:35.839752 11174 leader_election.cc:343] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:35.838165 10879 catalog_manager.cc:5697] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 1 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:35.843775 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c4f1fddaf1474aaf021d0b04387b4c" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:35.844436 11061 raft_consensus.cc:3060] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:35.844893 11253 ts_tablet_manager.cc:1434] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.004s
I20260709 12:30:35.845818 11253 tablet_bootstrap.cc:492] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:35.839859 11255 raft_consensus.cc:385] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.847782 11255 raft_consensus.cc:740] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.848507 11255 consensus_queue.cc:260] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:35.850449 11255 ts_tablet_manager.cc:1434] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:30:35.852984 11255 tablet_bootstrap.cc:492] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:35.853482 11254 tablet_bootstrap.cc:492] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:35.853176 11061 raft_consensus.cc:2468] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:35.860428 11175 leader_election.cc:304] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:35.861622 11406 raft_consensus.cc:2804] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:35.862264 11406 raft_consensus.cc:697] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:35.863150 11406 consensus_queue.cc:237] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.866005 11253 tablet_bootstrap.cc:654] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.866127 10883 catalog_manager.cc:5697] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:35.868786 11405 leader_election.cc:290] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:35.871032 11255 tablet_bootstrap.cc:654] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.878250 11253 tablet_bootstrap.cc:492] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:35.878722 11253 ts_tablet_manager.cc:1403] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:30:35.884377 11254 tablet_bootstrap.cc:654] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.887120 11253 raft_consensus.cc:359] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:35.887795 11253 raft_consensus.cc:385] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.888080 11253 raft_consensus.cc:740] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.888720 11253 consensus_queue.cc:260] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:35.892953 11253 ts_tablet_manager.cc:1434] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:30:35.893903 11253 tablet_bootstrap.cc:492] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:35.899857 10881 catalog_manager.cc:5697] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:35.901723 11254 tablet_bootstrap.cc:492] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:35.902323 11254 ts_tablet_manager.cc:1403] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.000s
I20260709 12:30:35.901775 11256 tablet_bootstrap.cc:492] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:35.906073 11256 ts_tablet_manager.cc:1403] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.247s	user 0.029s	sys 0.021s
I20260709 12:30:35.908574 11256 raft_consensus.cc:359] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:35.909236 11256 raft_consensus.cc:385] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.909590 11256 raft_consensus.cc:740] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.910082 11253 tablet_bootstrap.cc:654] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.910418 11256 consensus_queue.cc:260] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:35.905094 11254 raft_consensus.cc:359] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.922376 11254 raft_consensus.cc:385] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.922758 11254 raft_consensus.cc:740] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.923517 11254 consensus_queue.cc:260] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.925084 11255 tablet_bootstrap.cc:492] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:35.924441 10883 catalog_manager.cc:5697] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 1 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:35.925613 11255 ts_tablet_manager.cc:1403] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.005s
I20260709 12:30:35.926117 11256 ts_tablet_manager.cc:1434] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:30:35.927125 11256 tablet_bootstrap.cc:492] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:35.932718 11255 raft_consensus.cc:359] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.933421 11255 raft_consensus.cc:385] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.933683 11255 raft_consensus.cc:740] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.934217 11256 tablet_bootstrap.cc:654] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.934357 11255 consensus_queue.cc:260] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:35.936985 11255 ts_tablet_manager.cc:1434] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:30:35.937984 11255 tablet_bootstrap.cc:492] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:35.938239 11253 tablet_bootstrap.cc:492] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:35.939082 11253 ts_tablet_manager.cc:1403] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.004s
I20260709 12:30:35.941682 11253 raft_consensus.cc:359] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:35.942332 11253 raft_consensus.cc:385] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:35.942591 11253 raft_consensus.cc:740] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:35.925807 11254 ts_tablet_manager.cc:1434] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 12:30:35.953991 11416 consensus_queue.cc:1048] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:35.943238 11253 consensus_queue.cc:260] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:35.966748 11253 ts_tablet_manager.cc:1434] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:30:35.967708 11253 tablet_bootstrap.cc:492] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:35.970371 11254 tablet_bootstrap.cc:492] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:35.972267 11318 raft_consensus.cc:493] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:35.972851 11318 raft_consensus.cc:515] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:35.975301 11318 leader_election.cc:290] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:35.976408 11255 tablet_bootstrap.cc:654] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.977757 11254 tablet_bootstrap.cc:654] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:35.978509 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fbd15f7e3c4087a97ac3fbaf7870ce" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:35.983386 11253 tablet_bootstrap.cc:654] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
W20260709 12:30:35.984645 11101 leader_election.cc:343] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:35.992501 11406 consensus_queue.cc:1048] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:35.998982 11401 raft_consensus.cc:493] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:35.999812 11401 raft_consensus.cc:515] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:36.011458 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fbd15f7e3c4087a97ac3fbaf7870ce" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:36.016314 11099 leader_election.cc:343] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:36.017026 11099 leader_election.cc:304] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:36.022550 11493 raft_consensus.cc:2749] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:36.053057 11405 consensus_queue.cc:1048] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:36.064384 11490 raft_consensus.cc:493] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:36.064857 11528 raft_consensus.cc:493] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:36.064992 11490 raft_consensus.cc:515] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:36.065507 11528 raft_consensus.cc:515] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:36.067484 11490 leader_election.cc:290] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:36.069621 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe8221281e348018871f179e00af23e" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:36.070649 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e572b4a12e2d41008d2b3ba98f1429fb" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:36.072453 11024 leader_election.cc:343] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:36.073149 11528 leader_election.cc:290] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:36.074990 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe8221281e348018871f179e00af23e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:36.076040 11061 raft_consensus.cc:2468] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:36.078202 10952 leader_election.cc:304] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:36.081270 11401 leader_election.cc:290] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:36.081832 11401 raft_consensus.cc:2804] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:36.082217 11401 raft_consensus.cc:493] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:36.082578 11401 raft_consensus.cc:3060] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:36.085573 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e572b4a12e2d41008d2b3ba98f1429fb" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:36.086655 10983 raft_consensus.cc:2468] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
W20260709 12:30:36.093225 11172 leader_election.cc:343] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:36.096472 11174 leader_election.cc:304] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:36.098268 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe8221281e348018871f179e00af23e" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:36.107707 11490 raft_consensus.cc:2804] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:36.108536 11490 raft_consensus.cc:493] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:36.109138 11490 raft_consensus.cc:3060] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:36.116362 11416 consensus_queue.cc:1048] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:36.119197 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe8221281e348018871f179e00af23e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:36.140261 10949 leader_election.cc:343] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:36.159380 11301 raft_consensus.cc:493] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:36.160328 11301 raft_consensus.cc:515] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:36.161628 11343 raft_consensus.cc:493] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:36.162292 11343 raft_consensus.cc:515] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:36.164613 11343 leader_election.cc:290] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:36.164741 11491 raft_consensus.cc:493] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:36.165423 11491 raft_consensus.cc:515] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:36.166731 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ef516951b743ae939b2880e001d2d2" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:36.167981 11405 raft_consensus.cc:493] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:30:36.168378 10950 leader_election.cc:343] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:36.168534 11405 raft_consensus.cc:515] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:36.169251 11416 raft_consensus.cc:493] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:36.169764 11416 raft_consensus.cc:515] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:36.170933 11405 leader_election.cc:290] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:36.172084 11416 leader_election.cc:290] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:36.174391 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d20e41f0d4444beb8e9ad0cc6938918" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:36.175305 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ef516951b743ae939b2880e001d2d2" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:36.176004 10985 raft_consensus.cc:2468] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
I20260709 12:30:36.176309 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1895184d543bebeba9172c4b7f560" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:36.177188 10983 raft_consensus.cc:2393] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f856f4709042d9b3ce1348bdfb2ad5 in current term 1: Already voted for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in this term.
I20260709 12:30:36.177425 11026 leader_election.cc:304] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:36.178411 11416 raft_consensus.cc:2804] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:30:36.178546 11174 leader_election.cc:343] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:36.178855 11416 raft_consensus.cc:493] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:36.179298 11416 raft_consensus.cc:3060] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:36.180836 11301 leader_election.cc:290] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:36.182274 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1895184d543bebeba9172c4b7f560" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:36.183955 11175 leader_election.cc:304] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:36.185329 11405 raft_consensus.cc:3060] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:36.186507 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ef516951b743ae939b2880e001d2d2" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:36.187971 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c03f14392f45ba8f442cfec87fd85e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:36.188663 11056 raft_consensus.cc:2468] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:36.189851 11491 leader_election.cc:290] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:36.190389 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ef516951b743ae939b2880e001d2d2" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:36.190871 10952 leader_election.cc:304] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
W20260709 12:30:36.192198 11025 leader_election.cc:343] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:36.193369 11343 raft_consensus.cc:2804] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:36.193866 11343 raft_consensus.cc:493] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:36.194286 11343 raft_consensus.cc:3060] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:36.208287 11405 raft_consensus.cc:2749] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:36.212036 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d20e41f0d4444beb8e9ad0cc6938918" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:36.211815 11416 raft_consensus.cc:515] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:36.214895 11059 raft_consensus.cc:2393] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61218d0202f44940b61185f640880574 in current term 1: Already voted for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in this term.
I20260709 12:30:36.220669 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ef516951b743ae939b2880e001d2d2" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
W20260709 12:30:36.222124 11025 leader_election.cc:343] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:36.222820 10952 leader_election.cc:304] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61218d0202f44940b61185f640880574; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:36.224009 11301 raft_consensus.cc:3060] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:36.227414 11416 leader_election.cc:290] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:36.230347 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ef516951b743ae939b2880e001d2d2" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
W20260709 12:30:36.238111 11172 leader_election.cc:343] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:36.238793 11172 leader_election.cc:304] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:36.241976 11491 raft_consensus.cc:2749] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:36.244958 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c03f14392f45ba8f442cfec87fd85e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:36.246114 11256 tablet_bootstrap.cc:492] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:36.246688 11256 ts_tablet_manager.cc:1403] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.320s	user 0.019s	sys 0.025s
W20260709 12:30:36.249449 10949 leader_election.cc:343] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:36.263927 11531 consensus_queue.cc:1048] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:36.308391 11531 consensus_queue.cc:1048] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:30:36.338912 11099 consensus_peers.cc:597] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 -> Peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Couldn't send request to peer 85f856f4709042d9b3ce1348bdfb2ad5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:36.348549 10952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 125818us
W20260709 12:30:36.350791 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:44703, user_credentials={real_user=slave}} blocked reactor thread for 101356us
I20260709 12:30:36.368235 11256 raft_consensus.cc:359] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:36.377481 11343 raft_consensus.cc:515] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:36.378525 11256 raft_consensus.cc:385] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:36.383106 11256 raft_consensus.cc:740] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:36.384272 11256 consensus_queue.cc:260] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:36.397225 11343 leader_election.cc:290] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:36.382200 11301 raft_consensus.cc:2749] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:36.386657 11401 raft_consensus.cc:515] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:36.445550 11418 consensus_queue.cc:1048] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 12:30:36.498026 10982 raft_consensus.cc:2393] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03cdbc3ec1ef4354bd6ec49958026f5f in current term 1: Already voted for candidate 61218d0202f44940b61185f640880574 in this term.
I20260709 12:30:36.508610 11253 tablet_bootstrap.cc:492] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:36.509265 11253 ts_tablet_manager.cc:1403] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.542s	user 0.066s	sys 0.148s
I20260709 12:30:36.482365 11490 raft_consensus.cc:515] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:36.522516 11255 tablet_bootstrap.cc:492] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
W20260709 12:30:36.522800 11254 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.135s	sys 0.159s
I20260709 12:30:36.523054 11255 ts_tablet_manager.cc:1403] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.585s	user 0.079s	sys 0.140s
W20260709 12:30:36.525439 11557 log.cc:927] Time spent T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:30:36.527559 11253 raft_consensus.cc:359] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:36.528400 11253 raft_consensus.cc:385] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:36.528678 11253 raft_consensus.cc:740] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
W20260709 12:30:36.523099 11254 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.135s	sys 0.159s
W20260709 12:30:36.534143 11558 log.cc:927] Time spent T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:30:36.536273 11401 leader_election.cc:290] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:36.529407 11253 consensus_queue.cc:260] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
W20260709 12:30:36.514217 11552 log.cc:927] Time spent T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:30:36.542369 11254 tablet_bootstrap.cc:492] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:36.542907 11254 ts_tablet_manager.cc:1403] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.573s	user 0.143s	sys 0.160s
I20260709 12:30:36.546689 11253 ts_tablet_manager.cc:1434] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:30:36.552982 11256 ts_tablet_manager.cc:1434] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.306s	user 0.030s	sys 0.007s
I20260709 12:30:36.555503 11256 tablet_bootstrap.cc:492] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:36.553247 11255 raft_consensus.cc:359] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:36.558362 11255 raft_consensus.cc:385] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:36.558704 11255 raft_consensus.cc:740] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
W20260709 12:30:36.540377 11101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 128658us
I20260709 12:30:36.563500 11255 consensus_queue.cc:260] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
W20260709 12:30:36.564163 11556 log.cc:927] Time spent T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:30:36.564430 11254 raft_consensus.cc:359] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:36.565239 11254 raft_consensus.cc:385] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:36.565235 11255 ts_tablet_manager.cc:1434] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.042s	user 0.002s	sys 0.004s
I20260709 12:30:36.567615 11255 tablet_bootstrap.cc:492] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:36.565292 11253 tablet_bootstrap.cc:492] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:36.565608 11254 raft_consensus.cc:740] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:36.574656 11254 consensus_queue.cc:260] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:36.580336 11254 ts_tablet_manager.cc:1434] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
I20260709 12:30:36.582274 11254 tablet_bootstrap.cc:492] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:36.582741 11405 raft_consensus.cc:493] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:36.590184 11026 leader_election.cc:304] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:36.590273 11405 raft_consensus.cc:515] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:36.593919 11528 raft_consensus.cc:3060] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:36.595156 11301 consensus_queue.cc:1048] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:36.596603 11490 leader_election.cc:290] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:36.596823 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c03f14392f45ba8f442cfec87fd85e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:36.597426 11059 raft_consensus.cc:3060] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:36.597604 11405 leader_election.cc:290] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:36.598745 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ef516951b743ae939b2880e001d2d2" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:36.599445 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe8221281e348018871f179e00af23e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:36.603001 11528 raft_consensus.cc:2749] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:36.603896 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ef516951b743ae939b2880e001d2d2" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:36.641466 11059 raft_consensus.cc:2468] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:36.644194 11061 raft_consensus.cc:2393] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f856f4709042d9b3ce1348bdfb2ad5 in current term 1: Already voted for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in this term.
I20260709 12:30:36.650985 10983 raft_consensus.cc:2468] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:36.656860 11026 leader_election.cc:304] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:36.658605 10952 leader_election.cc:304] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:36.659914 11562 raft_consensus.cc:2804] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:36.636617 11405 consensus_queue.cc:1048] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:30:36.661320 11562 raft_consensus.cc:697] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:36.661864 11254 tablet_bootstrap.cc:654] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:36.654831 11255 tablet_bootstrap.cc:654] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:36.669004 11562 consensus_queue.cc:237] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:36.669943 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e572b4a12e2d41008d2b3ba98f1429fb" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
W20260709 12:30:36.665825 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:37545, user_credentials={real_user=slave}} blocked reactor thread for 59979.7us
I20260709 12:30:36.685712 11528 raft_consensus.cc:2804] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:36.686398 11528 raft_consensus.cc:697] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
W20260709 12:30:36.681591 11174 consensus_peers.cc:597] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:36.687328 11528 consensus_queue.cc:237] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:36.691349 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e572b4a12e2d41008d2b3ba98f1429fb" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
W20260709 12:30:36.683969 11172 leader_election.cc:343] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:36.692065 10982 raft_consensus.cc:3060] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:36.691718 11253 tablet_bootstrap.cc:654] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:36.698249 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c03f14392f45ba8f442cfec87fd85e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:36.698904 11134 raft_consensus.cc:3060] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:36.706806 11175 leader_election.cc:304] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:36.728636 11254 tablet_bootstrap.cc:492] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:36.729264 11254 ts_tablet_manager.cc:1403] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.148s	user 0.015s	sys 0.004s
I20260709 12:30:36.737795 11254 raft_consensus.cc:359] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:36.738639 11254 raft_consensus.cc:385] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:36.738947 11254 raft_consensus.cc:740] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:36.739626 11254 consensus_queue.cc:260] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:36.741947 11254 ts_tablet_manager.cc:1434] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 12:30:36.742925 11254 tablet_bootstrap.cc:492] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:36.743052 11256 tablet_bootstrap.cc:654] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:36.753305 11134 raft_consensus.cc:2468] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:36.754114 11562 consensus_queue.cc:1048] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:36.722007 11405 raft_consensus.cc:3060] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:36.755592 11254 tablet_bootstrap.cc:654] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:36.757162 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe8221281e348018871f179e00af23e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:36.715117 11056 raft_consensus.cc:2468] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:36.773783 10879 catalog_manager.cc:5697] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:36.781075 11562 raft_consensus.cc:493] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:36.781795 11562 raft_consensus.cc:515] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:36.787145 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d35cef95ba4391b35aa31a166d5036" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
W20260709 12:30:36.788527 10949 leader_election.cc:343] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:36.794051 10952 leader_election.cc:343] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:36.767793 10982 raft_consensus.cc:2468] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:36.794837 11562 leader_election.cc:290] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:36.798404 11174 leader_election.cc:304] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:36.799077 11405 raft_consensus.cc:2749] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:36.811671 11256 tablet_bootstrap.cc:492] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:36.812223 11256 ts_tablet_manager.cc:1403] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.257s	user 0.010s	sys 0.011s
I20260709 12:30:36.814736 11256 raft_consensus.cc:359] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:36.815287 11256 raft_consensus.cc:385] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:36.815518 11256 raft_consensus.cc:740] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:36.816162 11256 consensus_queue.cc:260] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:36.824278 11491 raft_consensus.cc:2804] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:36.824868 11491 raft_consensus.cc:697] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:36.835018 11256 ts_tablet_manager.cc:1434] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:30:36.825712 11491 consensus_queue.cc:237] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:36.841511 11256 tablet_bootstrap.cc:492] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:36.847683 11255 tablet_bootstrap.cc:492] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:36.848212 11255 ts_tablet_manager.cc:1403] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.281s	user 0.019s	sys 0.019s
I20260709 12:30:36.846648 11418 raft_consensus.cc:493] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:36.881657 11256 tablet_bootstrap.cc:654] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:36.885123 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d35cef95ba4391b35aa31a166d5036" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:36.891572 10952 leader_election.cc:304] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:36.893365 11563 raft_consensus.cc:2804] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:36.893867 11563 raft_consensus.cc:697] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:36.900454 11253 tablet_bootstrap.cc:492] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:36.901016 11253 ts_tablet_manager.cc:1403] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.341s	user 0.008s	sys 0.007s
I20260709 12:30:36.869912 11418 raft_consensus.cc:515] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:36.918072 11255 raft_consensus.cc:359] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:36.918881 11255 raft_consensus.cc:385] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:36.919159 11255 raft_consensus.cc:740] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:36.919838 11255 consensus_queue.cc:260] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:36.924340 11253 raft_consensus.cc:359] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:36.925045 11253 raft_consensus.cc:385] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:36.925323 11253 raft_consensus.cc:740] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:36.925477 11418 leader_election.cc:290] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:36.926885 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e572b4a12e2d41008d2b3ba98f1429fb" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:36.927974 10984 raft_consensus.cc:2393] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a96b33d3dcf7432e904439b5be66dee1 in current term 1: Already voted for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in this term.
I20260709 12:30:36.894793 11563 consensus_queue.cc:237] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:36.934072 11255 ts_tablet_manager.cc:1434] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.000s
I20260709 12:30:36.935449 11255 tablet_bootstrap.cc:492] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574: Bootstrap starting.
W20260709 12:30:36.945139 10950 leader_election.cc:343] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:36.945866 10950 leader_election.cc:304] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61218d0202f44940b61185f640880574; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:36.950881 11513 raft_consensus.cc:2749] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:36.964015 11254 tablet_bootstrap.cc:492] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:36.964664 11254 ts_tablet_manager.cc:1403] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.222s	user 0.009s	sys 0.011s
I20260709 12:30:36.965682 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e572b4a12e2d41008d2b3ba98f1429fb" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:36.972775 11254 raft_consensus.cc:359] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:36.973217 11099 leader_election.cc:304] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:36.973598 11254 raft_consensus.cc:385] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:36.973935 11254 raft_consensus.cc:740] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:36.974891 11564 raft_consensus.cc:3060] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:36.975832 11586 log.cc:927] Time spent T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:30:36.974629 11254 consensus_queue.cc:260] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:36.978690 11253 consensus_queue.cc:260] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:36.983611 11254 ts_tablet_manager.cc:1434] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:30:36.985270 11253 ts_tablet_manager.cc:1434] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.084s	user 0.002s	sys 0.005s
I20260709 12:30:36.996665 11254 tablet_bootstrap.cc:492] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:36.999466 11416 raft_consensus.cc:493] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:37.003837 11578 raft_consensus.cc:493] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:37.004370 11578 raft_consensus.cc:515] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:37.000087 11416 raft_consensus.cc:515] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:37.007606 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cba067154b43f0819177986955daf5" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:37.008396 11578 leader_election.cc:290] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:37.008770 11416 leader_election.cc:290] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:37.013777 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d35cef95ba4391b35aa31a166d5036" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:37.014444 10984 raft_consensus.cc:2468] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
W20260709 12:30:37.016763 11026 leader_election.cc:343] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.017021 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d35cef95ba4391b35aa31a166d5036" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:37.018549 11025 leader_election.cc:343] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.019536 11255 tablet_bootstrap.cc:654] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.023829 11026 leader_election.cc:304] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:37.027907 11253 tablet_bootstrap.cc:492] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:37.025645 11416 raft_consensus.cc:2804] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:37.025684 11564 raft_consensus.cc:2749] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:37.041051 11254 tablet_bootstrap.cc:654] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.042673 10984 raft_consensus.cc:3060] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.052425 11253 tablet_bootstrap.cc:654] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.032912 11416 raft_consensus.cc:493] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:37.054474 11416 raft_consensus.cc:3060] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.081188 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cba067154b43f0819177986955daf5" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:37.084946 11567 raft_consensus.cc:493] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:37.085510 11567 raft_consensus.cc:515] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.092777 11528 consensus_queue.cc:1048] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:37.099743 11567 leader_election.cc:290] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:37.099802 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fbd15f7e3c4087a97ac3fbaf7870ce" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:37.101467 11025 leader_election.cc:343] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.103436 11255 tablet_bootstrap.cc:492] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:37.104033 11255 ts_tablet_manager.cc:1403] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.169s	user 0.017s	sys 0.011s
I20260709 12:30:37.106974 11255 raft_consensus.cc:359] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:37.107579 11255 raft_consensus.cc:385] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.107820 11255 raft_consensus.cc:740] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.112514 11255 consensus_queue.cc:260] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:37.114635 10882 catalog_manager.cc:5697] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 1 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:37.116374 11562 consensus_queue.cc:1048] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:37.127514 11255 ts_tablet_manager.cc:1434] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:30:37.128937 11255 tablet_bootstrap.cc:492] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:37.133769 11256 tablet_bootstrap.cc:492] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:37.134323 11256 ts_tablet_manager.cc:1403] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.298s	user 0.012s	sys 0.005s
I20260709 12:30:37.134935 11254 tablet_bootstrap.cc:492] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:37.135493 11254 ts_tablet_manager.cc:1403] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.139s	user 0.017s	sys 0.011s
I20260709 12:30:37.137797 11256 raft_consensus.cc:359] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:37.156900 11256 raft_consensus.cc:385] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.157248 11256 raft_consensus.cc:740] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.158129 11256 consensus_queue.cc:260] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:37.146926 11573 consensus_queue.cc:1048] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:30:37.138257 11254 raft_consensus.cc:359] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.176182 11254 raft_consensus.cc:385] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.149540 10883 catalog_manager.cc:5697] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 1 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } }
W20260709 12:30:37.176949 10931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:37.177630 11256 ts_tablet_manager.cc:1434] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.003s
W20260709 12:30:37.155392 11024 leader_election.cc:343] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.179245 11024 leader_election.cc:304] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:37.180029 11573 raft_consensus.cc:2749] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:37.182142 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fbd15f7e3c4087a97ac3fbaf7870ce" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:37.182819 11134 raft_consensus.cc:2468] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
I20260709 12:30:37.176504 11254 raft_consensus.cc:740] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.185060 11256 tablet_bootstrap.cc:492] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:37.186163 11254 consensus_queue.cc:260] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.195828 11255 tablet_bootstrap.cc:654] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.197639 11562 consensus_queue.cc:1048] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:37.151968 11416 raft_consensus.cc:515] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:37.205788 11255 tablet_bootstrap.cc:492] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:37.206432 11255 ts_tablet_manager.cc:1403] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.003s
I20260709 12:30:37.206427 11254 ts_tablet_manager.cc:1434] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.003s
I20260709 12:30:37.208710 11254 tablet_bootstrap.cc:492] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:37.208771 11568 raft_consensus.cc:493] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:37.209401 11568 raft_consensus.cc:515] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.210250 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d35cef95ba4391b35aa31a166d5036" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:37.211925 11568 leader_election.cc:290] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:37.214592 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e805a87f353400daff9d7073bcfd03f" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:37.215361 11254 tablet_bootstrap.cc:654] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
W20260709 12:30:37.216414 11172 leader_election.cc:343] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.219909 11416 leader_election.cc:290] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
W20260709 12:30:37.222653 11025 leader_election.cc:343] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.222901 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e805a87f353400daff9d7073bcfd03f" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:37.221233 10882 catalog_manager.cc:5697] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:37.235826 11253 tablet_bootstrap.cc:492] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:37.241350 11253 ts_tablet_manager.cc:1403] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.238s	user 0.011s	sys 0.007s
W20260709 12:30:37.242165 11174 leader_election.cc:343] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.245302 11174 leader_election.cc:304] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:37.246189 11256 tablet_bootstrap.cc:654] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.246974 11405 raft_consensus.cc:2749] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:37.238031 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d35cef95ba4391b35aa31a166d5036" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:37.248350 10984 raft_consensus.cc:3060] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.248785 11024 leader_election.cc:304] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:37.249130 11416 raft_consensus.cc:493] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:37.249727 11416 raft_consensus.cc:515] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.251786 11578 raft_consensus.cc:2804] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:37.252242 11578 raft_consensus.cc:493] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:37.252616 11578 raft_consensus.cc:3060] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.254442 11416 leader_election.cc:290] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:37.252969 11255 raft_consensus.cc:359] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.262205 11255 raft_consensus.cc:385] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.262519 11255 raft_consensus.cc:740] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.263190 11255 consensus_queue.cc:260] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.265694 11255 ts_tablet_manager.cc:1434] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:30:37.265919 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d5568944e4b8ea21f3e487701995f" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:37.266729 11255 tablet_bootstrap.cc:492] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:37.266552 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d5568944e4b8ea21f3e487701995f" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:37.270257 11025 leader_election.cc:343] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.270642 11578 raft_consensus.cc:515] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
W20260709 12:30:37.271613 11024 leader_election.cc:343] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.272074 11024 leader_election.cc:304] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:37.272776 11578 leader_election.cc:290] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:37.275408 10984 raft_consensus.cc:2468] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:37.274339 11253 raft_consensus.cc:359] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.276319 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fbd15f7e3c4087a97ac3fbaf7870ce" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:37.276790 11253 raft_consensus.cc:385] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.277076 11253 raft_consensus.cc:740] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.277788 11253 consensus_queue.cc:260] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.278252 11255 tablet_bootstrap.cc:654] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.279173 11416 raft_consensus.cc:2749] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:37.280073 11253 ts_tablet_manager.cc:1434] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.003s
I20260709 12:30:37.280215 11026 leader_election.cc:304] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:37.281152 11253 tablet_bootstrap.cc:492] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
W20260709 12:30:37.282101 11025 leader_election.cc:343] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.284519 11528 raft_consensus.cc:2804] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:37.285691 11528 raft_consensus.cc:697] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:37.286579 11528 consensus_queue.cc:237] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:37.289403 11253 tablet_bootstrap.cc:654] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.299274 11254 tablet_bootstrap.cc:492] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:37.299752 11254 ts_tablet_manager.cc:1403] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.002s
I20260709 12:30:37.302978 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fbd15f7e3c4087a97ac3fbaf7870ce" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:37.303602 11133 raft_consensus.cc:3060] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.310315 11254 raft_consensus.cc:359] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.313428 11254 raft_consensus.cc:385] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.313751 11254 raft_consensus.cc:740] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.315295 11254 consensus_queue.cc:260] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.317764 11254 ts_tablet_manager.cc:1434] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:30:37.318259 11256 tablet_bootstrap.cc:492] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:37.324154 11256 ts_tablet_manager.cc:1403] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.001s
I20260709 12:30:37.327441 11256 raft_consensus.cc:359] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.328145 11256 raft_consensus.cc:385] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.328464 11256 raft_consensus.cc:740] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.329160 11256 consensus_queue.cc:260] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.330169 11133 raft_consensus.cc:2468] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:37.318729 11254 tablet_bootstrap.cc:492] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:37.336475 10883 catalog_manager.cc:5697] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 1 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:37.344373 11256 ts_tablet_manager.cc:1434] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:30:37.347740 11256 tablet_bootstrap.cc:492] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:37.348748 11024 leader_election.cc:304] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:37.350293 11578 raft_consensus.cc:2804] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:37.350966 11578 raft_consensus.cc:697] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:37.351773 11578 consensus_queue.cc:237] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.364068 11255 tablet_bootstrap.cc:492] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:37.364578 11255 ts_tablet_manager.cc:1403] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.001s
I20260709 12:30:37.367336 11255 raft_consensus.cc:359] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.368067 11255 raft_consensus.cc:385] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.370565 11254 tablet_bootstrap.cc:654] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.368348 11255 raft_consensus.cc:740] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.378051 11255 consensus_queue.cc:260] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.381287 11253 tablet_bootstrap.cc:492] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:37.381827 11253 ts_tablet_manager.cc:1403] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.000s
I20260709 12:30:37.382835 11256 tablet_bootstrap.cc:654] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.384780 11253 raft_consensus.cc:359] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.385509 11253 raft_consensus.cc:385] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.396932 11255 ts_tablet_manager.cc:1434] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:30:37.385818 11253 raft_consensus.cc:740] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.398303 11253 consensus_queue.cc:260] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.399909 11254 tablet_bootstrap.cc:492] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:37.400461 11254 ts_tablet_manager.cc:1403] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.003s
I20260709 12:30:37.402237 11256 tablet_bootstrap.cc:492] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:37.405676 11405 consensus_queue.cc:1048] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:37.406131 11256 ts_tablet_manager.cc:1403] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.010s
I20260709 12:30:37.406913 10881 catalog_manager.cc:5697] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 1 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:37.411015 11255 tablet_bootstrap.cc:492] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:37.403810 11254 raft_consensus.cc:359] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:37.419358 11254 raft_consensus.cc:385] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.419734 11254 raft_consensus.cc:740] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.420006 11253 ts_tablet_manager.cc:1434] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:30:37.420542 11254 consensus_queue.cc:260] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:37.423219 11254 ts_tablet_manager.cc:1434] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:30:37.421047 11253 tablet_bootstrap.cc:492] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:37.418604 11256 raft_consensus.cc:359] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.430805 11256 raft_consensus.cc:385] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.431011 11253 tablet_bootstrap.cc:654] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.431219 11256 raft_consensus.cc:740] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.432174 11256 consensus_queue.cc:260] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.424197 11254 tablet_bootstrap.cc:492] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:37.435671 11568 consensus_queue.cc:1048] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:37.438551 11256 ts_tablet_manager.cc:1434] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:30:37.439327 11133 raft_consensus.cc:3060] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.439538 11256 tablet_bootstrap.cc:492] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:37.440064 11255 tablet_bootstrap.cc:654] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.447853 11254 tablet_bootstrap.cc:654] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.454661 11256 tablet_bootstrap.cc:654] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.469204 11253 tablet_bootstrap.cc:492] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:37.469849 11253 ts_tablet_manager.cc:1403] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.006s
I20260709 12:30:37.487411 11562 consensus_queue.cc:1048] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:37.489559 11416 raft_consensus.cc:493] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:37.490178 11416 raft_consensus.cc:515] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:37.491360 11253 raft_consensus.cc:359] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.492137 11253 raft_consensus.cc:385] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.492430 11253 raft_consensus.cc:740] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.493366 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:37.495659 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
W20260709 12:30:37.497591 11026 leader_election.cc:343] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.502449 11256 tablet_bootstrap.cc:492] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:37.503008 11256 ts_tablet_manager.cc:1403] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.064s	user 0.022s	sys 0.000s
I20260709 12:30:37.503338 11255 tablet_bootstrap.cc:492] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:37.503898 11255 ts_tablet_manager.cc:1403] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.009s
I20260709 12:30:37.493177 11253 consensus_queue.cc:260] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.507094 11253 ts_tablet_manager.cc:1434] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.004s
I20260709 12:30:37.508112 11253 tablet_bootstrap.cc:492] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:37.512161 11560 raft_consensus.cc:493] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:37.517757 11560 raft_consensus.cc:515] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
W20260709 12:30:37.518324 11025 leader_election.cc:343] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.518850 11025 leader_election.cc:304] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:37.519780 11528 raft_consensus.cc:2749] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:37.520180 11560 leader_election.cc:290] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:37.521673 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e805a87f353400daff9d7073bcfd03f" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:37.512073 11416 leader_election.cc:290] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
W20260709 12:30:37.523118 11100 leader_election.cc:343] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.527832 11563 consensus_queue.cc:1048] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:37.528159 11256 raft_consensus.cc:359] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.528891 11256 raft_consensus.cc:385] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.529227 11256 raft_consensus.cc:740] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.529706 11253 tablet_bootstrap.cc:654] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.532745 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e805a87f353400daff9d7073bcfd03f" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:37.539866 11563 raft_consensus.cc:493] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:37.540426 11563 raft_consensus.cc:515] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:37.546411 11256 consensus_queue.cc:260] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.533557 11208 raft_consensus.cc:2468] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:37.554103 11099 leader_election.cc:304] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:37.554275 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cba067154b43f0819177986955daf5" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:37.554967 11060 raft_consensus.cc:2468] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:37.556571 11563 leader_election.cc:290] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:37.556630 10952 leader_election.cc:304] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:37.559759 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cba067154b43f0819177986955daf5" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:37.556718 11418 raft_consensus.cc:2804] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:37.566900 11418 raft_consensus.cc:493] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:37.567350 11418 raft_consensus.cc:3060] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.570628 11559 raft_consensus.cc:2804] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:37.571115 11559 raft_consensus.cc:493] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:37.570842 11255 raft_consensus.cc:359] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.571496 11559 raft_consensus.cc:3060] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.571673 11255 raft_consensus.cc:385] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.572021 11255 raft_consensus.cc:740] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
W20260709 12:30:37.572881 10949 leader_election.cc:343] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.580571 11256 ts_tablet_manager.cc:1434] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.077s	user 0.011s	sys 0.000s
I20260709 12:30:37.581450 11256 tablet_bootstrap.cc:492] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:37.592236 11254 tablet_bootstrap.cc:492] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:37.592767 11254 ts_tablet_manager.cc:1403] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.169s	user 0.012s	sys 0.045s
I20260709 12:30:37.573410 11255 consensus_queue.cc:260] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.599038 11405 raft_consensus.cc:493] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:37.609939 11255 ts_tablet_manager.cc:1434] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.106s	user 0.007s	sys 0.001s
I20260709 12:30:37.610229 11405 raft_consensus.cc:515] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.659761 11255 tablet_bootstrap.cc:492] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:37.665663 11493 raft_consensus.cc:493] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:37.666306 11493 raft_consensus.cc:515] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.670258 11493 leader_election.cc:290] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:37.671087 11513 raft_consensus.cc:493] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:37.671172 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d20e41f0d4444beb8e9ad0cc6938918" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:37.671758 11513 raft_consensus.cc:515] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.672075 11207 raft_consensus.cc:2468] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:37.671963 11254 raft_consensus.cc:359] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:37.672977 11254 raft_consensus.cc:385] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.673666 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d20e41f0d4444beb8e9ad0cc6938918" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:37.679060 10982 raft_consensus.cc:2468] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:37.680522 11100 leader_election.cc:304] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:37.676627 11255 tablet_bootstrap.cc:654] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.683220 11254 raft_consensus.cc:740] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.686510 11254 consensus_queue.cc:260] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:37.694166 11256 tablet_bootstrap.cc:654] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.696417 11254 ts_tablet_manager.cc:1434] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.103s	user 0.009s	sys 0.024s
I20260709 12:30:37.688262 11493 raft_consensus.cc:2804] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:37.687655 11405 leader_election.cc:290] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:37.717832 11418 raft_consensus.cc:515] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.718703 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d5568944e4b8ea21f3e487701995f" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:37.719434 11060 raft_consensus.cc:2468] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:37.720315 11418 leader_election.cc:290] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:37.721359 11175 leader_election.cc:304] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:37.722302 11405 raft_consensus.cc:2804] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:37.722723 11405 raft_consensus.cc:493] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:37.723088 11405 raft_consensus.cc:3060] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.727622 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e805a87f353400daff9d7073bcfd03f" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:37.728284 10985 raft_consensus.cc:3060] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.735137 11254 tablet_bootstrap.cc:492] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:37.708189 11493 raft_consensus.cc:493] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:37.714953 11207 raft_consensus.cc:3060] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.725371 11559 raft_consensus.cc:515] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:37.744230 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d5568944e4b8ea21f3e487701995f" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:37.750710 11134 raft_consensus.cc:2468] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:37.754310 11416 raft_consensus.cc:493] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:37.754933 11416 raft_consensus.cc:515] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.748340 11253 tablet_bootstrap.cc:492] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:37.757531 11253 ts_tablet_manager.cc:1403] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.250s	user 0.019s	sys 0.003s
I20260709 12:30:37.758742 11416 leader_election.cc:290] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:37.761598 11513 leader_election.cc:290] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:37.765370 11253 raft_consensus.cc:359] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.766089 11253 raft_consensus.cc:385] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.766356 11253 raft_consensus.cc:740] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.767023 11253 consensus_queue.cc:260] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.742874 11493 raft_consensus.cc:3060] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.768163 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e805a87f353400daff9d7073bcfd03f" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:37.768852 11209 raft_consensus.cc:3060] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.773747 11568 raft_consensus.cc:493] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:37.775241 11568 raft_consensus.cc:515] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.777348 11568 leader_election.cc:290] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:37.783420 11254 tablet_bootstrap.cc:654] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.781589 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fbd15f7e3c4087a97ac3fbaf7870ce" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:37.784786 11134 raft_consensus.cc:2393] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f856f4709042d9b3ce1348bdfb2ad5 in current term 1: Already voted for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in this term.
I20260709 12:30:37.785815 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e805a87f353400daff9d7073bcfd03f" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:37.798103 10985 raft_consensus.cc:2468] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:37.800387 11255 tablet_bootstrap.cc:492] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:37.801100 11255 ts_tablet_manager.cc:1403] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.142s	user 0.019s	sys 0.001s
I20260709 12:30:37.802021 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2266db22c47c4604a6ac6d5cf892fc29" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:37.804967 11024 leader_election.cc:343] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.805430 11559 leader_election.cc:290] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:37.809583 11100 leader_election.cc:304] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:37.807505 11416 consensus_queue.cc:1048] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:30:37.818599 11513 raft_consensus.cc:493] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:37.819015 11493 raft_consensus.cc:515] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.819248 11513 raft_consensus.cc:515] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.822474 11255 raft_consensus.cc:359] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:37.823331 11255 raft_consensus.cc:385] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:37.823628 11255 raft_consensus.cc:740] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:37.824375 11255 consensus_queue.cc:260] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:37.827061 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cba067154b43f0819177986955daf5" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:37.827767 11059 raft_consensus.cc:3060] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.828204 11255 ts_tablet_manager.cc:1434] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.002s
I20260709 12:30:37.828356 11513 leader_election.cc:290] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:37.829367 11255 tablet_bootstrap.cc:492] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:37.844858 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d20e41f0d4444beb8e9ad0cc6938918" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:37.842247 11634 raft_consensus.cc:2804] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:37.842257 11493 leader_election.cc:290] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:37.856806 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d20e41f0d4444beb8e9ad0cc6938918" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:37.857460 11208 raft_consensus.cc:3060] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.860963 11253 ts_tablet_manager.cc:1434] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.103s	user 0.039s	sys 0.012s
I20260709 12:30:37.852278 10984 raft_consensus.cc:3060] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.863415 11253 tablet_bootstrap.cc:492] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:37.870263 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fbd15f7e3c4087a97ac3fbaf7870ce" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:37.871318 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e805a87f353400daff9d7073bcfd03f" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:37.872201 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cba067154b43f0819177986955daf5" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:37.877003 11208 raft_consensus.cc:2468] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:37.862131 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a30a14e503d4acc89f1c6cf8b521e8a" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:37.885170 11175 leader_election.cc:304] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:37.886444 11630 raft_consensus.cc:3060] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.901180 11255 tablet_bootstrap.cc:654] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.904026 11405 raft_consensus.cc:515] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.890184 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a30a14e503d4acc89f1c6cf8b521e8a" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:37.908535 11405 leader_election.cc:290] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:37.916553 11578 consensus_queue.cc:1048] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:37.916993 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d5568944e4b8ea21f3e487701995f" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:37.917629 11135 raft_consensus.cc:3060] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.893692 11206 raft_consensus.cc:2468] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
W20260709 12:30:37.918418 10949 leader_election.cc:343] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:37.920272 10949 leader_election.cc:343] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:37.920455 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa3d5568944e4b8ea21f3e487701995f" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:37.921090 11060 raft_consensus.cc:3060] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.901993 11099 leader_election.cc:304] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:37.923190 10950 leader_election.cc:304] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:37.924404 11562 raft_consensus.cc:2804] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:37.924674 11493 raft_consensus.cc:2804] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:37.924842 11562 raft_consensus.cc:493] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:37.925295 11493 raft_consensus.cc:697] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:37.925379 11562 raft_consensus.cc:3060] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:37.926189 11493 consensus_queue.cc:237] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:37.926723 11630 raft_consensus.cc:2749] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:37.931105 10984 raft_consensus.cc:2468] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:37.918459 11209 raft_consensus.cc:2468] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:37.944365 11060 raft_consensus.cc:2468] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:37.945760 11175 leader_election.cc:304] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:37.949321 11405 raft_consensus.cc:2804] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:37.949869 11405 raft_consensus.cc:697] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:37.950832 11405 consensus_queue.cc:237] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:37.925683 11059 raft_consensus.cc:2468] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:37.972934 11256 tablet_bootstrap.cc:492] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:37.973559 11256 ts_tablet_manager.cc:1403] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.392s	user 0.022s	sys 0.033s
I20260709 12:30:37.972012 11634 raft_consensus.cc:697] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:37.990557 11135 raft_consensus.cc:2468] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:38.001426 11253 tablet_bootstrap.cc:654] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:37.984112 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2266db22c47c4604a6ac6d5cf892fc29" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:38.005764 11025 consensus_peers.cc:597] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Couldn't send request to peer 85f856f4709042d9b3ce1348bdfb2ad5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:38.017292 11254 tablet_bootstrap.cc:492] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:37.983196 10952 leader_election.cc:304] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: a96b33d3dcf7432e904439b5be66dee1
W20260709 12:30:38.021353 10952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 44672.4us
I20260709 12:30:38.022197 11513 raft_consensus.cc:2804] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:38.022818 11513 raft_consensus.cc:697] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:38.023785 11513 consensus_queue.cc:237] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.025822 11254 ts_tablet_manager.cc:1403] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.291s	user 0.009s	sys 0.027s
I20260709 12:30:38.042187 11578 consensus_queue.cc:1048] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:38.051352 11254 raft_consensus.cc:359] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:38.052047 11254 raft_consensus.cc:385] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.052327 11254 raft_consensus.cc:740] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.053002 11254 consensus_queue.cc:260] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
W20260709 12:30:38.067597 11025 leader_election.cc:343] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:38.068275 11025 leader_election.cc:304] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:38.074684 11255 tablet_bootstrap.cc:492] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:38.075280 11255 ts_tablet_manager.cc:1403] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.246s	user 0.019s	sys 0.019s
I20260709 12:30:38.077733 11416 raft_consensus.cc:2749] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:38.078137 11562 raft_consensus.cc:515] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:38.079852 11255 raft_consensus.cc:359] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.080643 11255 raft_consensus.cc:385] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.081089 11255 raft_consensus.cc:740] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.081977 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a30a14e503d4acc89f1c6cf8b521e8a" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:38.081955 11255 consensus_queue.cc:260] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.085093 11255 ts_tablet_manager.cc:1434] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:30:38.086185 11255 tablet_bootstrap.cc:492] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:38.088780 11254 ts_tablet_manager.cc:1434] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 12:30:38.090075 11254 tablet_bootstrap.cc:492] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:38.100136 11406 raft_consensus.cc:493] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a96b33d3dcf7432e904439b5be66dee1)
I20260709 12:30:38.100759 11406 raft_consensus.cc:515] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:38.031864 11634 consensus_queue.cc:237] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:38.130263 11578 raft_consensus.cc:493] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:38.147218 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a30a14e503d4acc89f1c6cf8b521e8a" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:38.147979 11207 raft_consensus.cc:3060] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:38.148375 11253 tablet_bootstrap.cc:492] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:38.149133 11253 ts_tablet_manager.cc:1403] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.287s	user 0.014s	sys 0.000s
I20260709 12:30:38.134594 11562 leader_election.cc:290] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:38.141530 11578 raft_consensus.cc:515] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.154350 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0743c24d152b46b2ad08375da31705ea" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:38.162389 11256 raft_consensus.cc:359] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:38.169953 11254 tablet_bootstrap.cc:654] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.169056 11256 raft_consensus.cc:385] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.170419 11256 raft_consensus.cc:740] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.170982 11578 leader_election.cc:290] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:38.171367 11256 consensus_queue.cc:260] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:38.173816 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cac7da440174c7296f12f2879a05582" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:38.174561 10985 raft_consensus.cc:2468] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
I20260709 12:30:38.176011 11026 leader_election.cc:304] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:38.176919 11573 raft_consensus.cc:2804] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:38.177327 11573 raft_consensus.cc:493] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:38.177702 11573 raft_consensus.cc:3060] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:38.183269 11135 raft_consensus.cc:3060] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:38.184541 11573 raft_consensus.cc:515] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.187515 10881 catalog_manager.cc:5697] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:38.188297 11207 raft_consensus.cc:2468] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:38.190335 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0743c24d152b46b2ad08375da31705ea" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:38.195448 10950 leader_election.cc:304] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:38.196359 11626 raft_consensus.cc:2804] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:38.196862 11626 raft_consensus.cc:697] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:38.197708 11626 consensus_queue.cc:237] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:38.199302 11172 leader_election.cc:304] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:38.209025 10883 catalog_manager.cc:5697] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 1 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:38.160668 11406 leader_election.cc:290] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:38.215636 11253 raft_consensus.cc:359] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:38.218811 11253 raft_consensus.cc:385] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.219165 11253 raft_consensus.cc:740] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.188572 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cac7da440174c7296f12f2879a05582" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:38.227283 11256 ts_tablet_manager.cc:1434] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.253s	user 0.009s	sys 0.004s
I20260709 12:30:38.220971 11253 consensus_queue.cc:260] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:38.235363 11256 tablet_bootstrap.cc:492] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:38.214658 11630 raft_consensus.cc:2749] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:38.242798 11253 ts_tablet_manager.cc:1434] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.001s
I20260709 12:30:38.239933 11627 raft_consensus.cc:493] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:30:38.247285 11024 leader_election.cc:343] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:38.253345 10931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:38.259816 11255 tablet_bootstrap.cc:654] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.247063 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cac7da440174c7296f12f2879a05582" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:38.272207 10982 raft_consensus.cc:3060] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:38.263314 11253 tablet_bootstrap.cc:492] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:38.259210 11573 leader_election.cc:290] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:38.269284 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cac7da440174c7296f12f2879a05582" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:38.270954 11135 raft_consensus.cc:2468] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:38.279886 11256 tablet_bootstrap.cc:654] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.258335 11627 raft_consensus.cc:515] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.282639 10949 leader_election.cc:304] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:38.287081 10882 catalog_manager.cc:5697] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:38.294580 11559 raft_consensus.cc:2749] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:38.303998 11627 leader_election.cc:290] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:38.307432 11208 raft_consensus.cc:3060] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:38.313625 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
W20260709 12:30:38.315737 10952 leader_election.cc:343] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:38.317916 11024 leader_election.cc:343] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:38.322062 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:38.324198 10949 leader_election.cc:343] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:38.324728 10949 leader_election.cc:304] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61218d0202f44940b61185f640880574; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:38.326220 11627 raft_consensus.cc:2749] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:38.337479 10982 raft_consensus.cc:2468] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:38.349071 11254 tablet_bootstrap.cc:492] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:38.349797 11254 ts_tablet_manager.cc:1403] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.260s	user 0.016s	sys 0.012s
I20260709 12:30:38.353091 11254 raft_consensus.cc:359] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.353996 11254 raft_consensus.cc:385] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.354342 11254 raft_consensus.cc:740] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.355472 11254 consensus_queue.cc:260] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.358551 11254 ts_tablet_manager.cc:1434] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:30:38.358697 11026 leader_election.cc:304] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:38.359849 11416 raft_consensus.cc:2804] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:38.360339 11416 raft_consensus.cc:697] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:38.360816 11254 tablet_bootstrap.cc:492] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:38.361234 11416 consensus_queue.cc:237] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.372234 11253 tablet_bootstrap.cc:654] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.376668 11254 tablet_bootstrap.cc:654] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.383260 11648 raft_consensus.cc:493] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:38.383857 11648 raft_consensus.cc:515] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.387076 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:38.387807 10982 raft_consensus.cc:2468] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
I20260709 12:30:38.389292 11026 leader_election.cc:304] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:38.390388 11578 raft_consensus.cc:2804] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:38.391135 11578 raft_consensus.cc:493] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:38.391644 11578 raft_consensus.cc:3060] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:38.399514 11255 tablet_bootstrap.cc:492] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:38.400274 11255 ts_tablet_manager.cc:1403] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.314s	user 0.044s	sys 0.013s
I20260709 12:30:38.396696 11648 leader_election.cc:290] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:38.411389 11255 raft_consensus.cc:359] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:38.412081 11255 raft_consensus.cc:385] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.412350 11255 raft_consensus.cc:740] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.418875 11578 raft_consensus.cc:515] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.420121 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:38.429430 11256 tablet_bootstrap.cc:492] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:38.430034 11256 ts_tablet_manager.cc:1403] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.195s	user 0.020s	sys 0.017s
W20260709 12:30:38.431363 11024 leader_election.cc:343] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:38.433046 11256 raft_consensus.cc:359] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.434207 11256 raft_consensus.cc:385] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.434521 11256 raft_consensus.cc:740] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.435426 11256 consensus_queue.cc:260] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.422348 11578 leader_election.cc:290] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:38.436514 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:38.437147 10982 raft_consensus.cc:3060] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:38.438272 11256 ts_tablet_manager.cc:1434] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:30:38.439431 11256 tablet_bootstrap.cc:492] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:38.440418 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
W20260709 12:30:38.441748 11024 leader_election.cc:343] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:38.444900 10982 raft_consensus.cc:2468] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:38.446141 11026 leader_election.cc:304] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:38.445426 11255 consensus_queue.cc:260] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:38.447356 11416 raft_consensus.cc:2804] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:38.448725 11416 raft_consensus.cc:697] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:38.449563 11416 consensus_queue.cc:237] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.450433 11256 tablet_bootstrap.cc:654] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.471616 11254 tablet_bootstrap.cc:492] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:38.472200 11254 ts_tablet_manager.cc:1403] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.113s	user 0.010s	sys 0.006s
I20260709 12:30:38.475688 11255 ts_tablet_manager.cc:1434] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.001s
I20260709 12:30:38.477109 11255 tablet_bootstrap.cc:492] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:38.490823 10881 catalog_manager.cc:5697] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 1 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:38.499914 11254 raft_consensus.cc:359] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.500840 11254 raft_consensus.cc:385] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.501181 11254 raft_consensus.cc:740] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.503052 11255 tablet_bootstrap.cc:654] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.502599 11254 consensus_queue.cc:260] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.505045 11254 ts_tablet_manager.cc:1434] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:30:38.506206 11254 tablet_bootstrap.cc:492] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:38.508375 11253 tablet_bootstrap.cc:492] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:38.508947 11253 ts_tablet_manager.cc:1403] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.246s	user 0.032s	sys 0.033s
I20260709 12:30:38.510871 11256 tablet_bootstrap.cc:492] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:38.511477 11256 ts_tablet_manager.cc:1403] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.022s
I20260709 12:30:38.511976 11253 raft_consensus.cc:359] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:38.512771 11253 raft_consensus.cc:385] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.513054 11253 raft_consensus.cc:740] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.514251 11253 consensus_queue.cc:260] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:38.514601 11256 raft_consensus.cc:359] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:38.515353 11256 raft_consensus.cc:385] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.514767 10882 catalog_manager.cc:5697] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:38.515664 11256 raft_consensus.cc:740] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.516522 11256 consensus_queue.cc:260] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:38.527216 11256 ts_tablet_manager.cc:1434] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:30:38.527391 11405 consensus_queue.cc:1048] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:38.528333 11256 tablet_bootstrap.cc:492] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:38.528765 10883 catalog_manager.cc:5697] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 1 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:38.532543 11578 raft_consensus.cc:493] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:38.533068 11578 raft_consensus.cc:515] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:38.536465 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016a8f4a4c534fffa13dbf6e764c5fd1" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:38.537209 11634 consensus_queue.cc:1048] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:30:38.538293 11025 leader_election.cc:343] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:38.539819 11256 tablet_bootstrap.cc:654] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.542829 11578 leader_election.cc:290] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:38.544517 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016a8f4a4c534fffa13dbf6e764c5fd1" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:38.546450 11024 leader_election.cc:343] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:38.547017 11024 leader_election.cc:304] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:38.548267 11578 raft_consensus.cc:2749] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:38.544482 11253 ts_tablet_manager.cc:1434] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 12:30:38.552424 11253 tablet_bootstrap.cc:492] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:38.574455 11256 tablet_bootstrap.cc:492] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:38.577294 10879 catalog_manager.cc:5697] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:38.583500 11637 consensus_queue.cc:1048] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:38.593521 11256 ts_tablet_manager.cc:1403] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.008s
I20260709 12:30:38.594813 11578 raft_consensus.cc:493] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:38.595510 11578 raft_consensus.cc:515] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.596410 11256 raft_consensus.cc:359] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:38.597096 11256 raft_consensus.cc:385] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.597364 11256 raft_consensus.cc:740] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.598690 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45b83d519688476d84ef90b668ca9efd" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
W20260709 12:30:38.600705 11026 leader_election.cc:343] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:38.602288 11637 consensus_queue.cc:1048] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:38.604010 11631 consensus_queue.cc:1048] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:38.619304 11513 consensus_queue.cc:1048] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:38.601117 11256 consensus_queue.cc:260] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:38.622205 11256 ts_tablet_manager.cc:1434] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.002s
I20260709 12:30:38.623088 11256 tablet_bootstrap.cc:492] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:38.629413 11256 tablet_bootstrap.cc:654] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.632856 11493 raft_consensus.cc:493] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:38.633140 11135 raft_consensus.cc:3060] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:38.635357 11578 leader_election.cc:290] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:38.637728 11134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45b83d519688476d84ef90b668ca9efd" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:38.640399 11024 leader_election.cc:343] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:38.640831 11024 leader_election.cc:304] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:38.641933 11416 raft_consensus.cc:2749] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:38.642139 11256 tablet_bootstrap.cc:492] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:38.642763 11256 ts_tablet_manager.cc:1403] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:30:38.633811 11493 raft_consensus.cc:515] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:38.645375 11256 raft_consensus.cc:359] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.647519 11256 raft_consensus.cc:385] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.647871 11256 raft_consensus.cc:740] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.648782 11256 consensus_queue.cc:260] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:38.651172 11256 ts_tablet_manager.cc:1434] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:30:38.665227 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2266db22c47c4604a6ac6d5cf892fc29" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:38.685034 11256 tablet_bootstrap.cc:492] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:38.662808 11637 consensus_queue.cc:1048] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:30:38.650203 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2266db22c47c4604a6ac6d5cf892fc29" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:38.687153 11061 raft_consensus.cc:2468] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:38.660754 11631 raft_consensus.cc:493] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:38.688247 11631 raft_consensus.cc:515] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:38.690219 11209 raft_consensus.cc:2468] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:38.690460 11631 leader_election.cc:290] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:38.693439 11256 tablet_bootstrap.cc:654] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.694636 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2266db22c47c4604a6ac6d5cf892fc29" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:38.695331 11058 raft_consensus.cc:2468] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:38.649694 11493 leader_election.cc:290] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:38.696235 11101 leader_election.cc:304] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:38.698288 11175 leader_election.cc:304] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:38.699545 11637 raft_consensus.cc:2804] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:38.700073 11491 raft_consensus.cc:2804] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:38.700135 11637 raft_consensus.cc:493] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:38.700650 11491 raft_consensus.cc:493] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:38.700819 11637 raft_consensus.cc:3060] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:38.701071 11491 raft_consensus.cc:3060] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:38.707650 11255 tablet_bootstrap.cc:492] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:38.708173 11255 ts_tablet_manager.cc:1403] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.231s	user 0.056s	sys 0.059s
I20260709 12:30:38.709599 11254 tablet_bootstrap.cc:654] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.710907 11491 raft_consensus.cc:515] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:38.711001 11255 raft_consensus.cc:359] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:38.711889 11255 raft_consensus.cc:385] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.712181 11255 raft_consensus.cc:740] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.713625 11491 leader_election.cc:290] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:38.713851 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2266db22c47c4604a6ac6d5cf892fc29" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:38.714610 11058 raft_consensus.cc:3060] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:38.718048 11254 tablet_bootstrap.cc:492] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:38.718185 11513 consensus_queue.cc:1048] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:38.718737 11254 ts_tablet_manager.cc:1403] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.213s	user 0.012s	sys 0.001s
I20260709 12:30:38.712858 11255 consensus_queue.cc:260] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:38.724819 11255 ts_tablet_manager.cc:1434] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:30:38.725868 11255 tablet_bootstrap.cc:492] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:38.728188 11058 raft_consensus.cc:2468] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:38.730080 11256 tablet_bootstrap.cc:492] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:38.730598 11256 ts_tablet_manager.cc:1403] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.000s
I20260709 12:30:38.733518 11256 raft_consensus.cc:359] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:38.734076 11175 leader_election.cc:304] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:38.734418 11256 raft_consensus.cc:385] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.734702 11256 raft_consensus.cc:740] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.735340 11256 consensus_queue.cc:260] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:38.735926 11255 tablet_bootstrap.cc:654] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.737409 11256 ts_tablet_manager.cc:1434] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:30:38.721581 11254 raft_consensus.cc:359] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:38.738399 11254 raft_consensus.cc:385] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.738692 11254 raft_consensus.cc:740] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.739136 11559 consensus_queue.cc:1048] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:38.739380 11254 consensus_queue.cc:260] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:38.741559 11254 ts_tablet_manager.cc:1434] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 12:30:38.741801 11513 raft_consensus.cc:493] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:38.742563 11254 tablet_bootstrap.cc:492] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:38.742303 11513 raft_consensus.cc:515] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:38.744375 11513 leader_election.cc:290] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:38.746316 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:38.748420 10950 leader_election.cc:343] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:38.749389 11405 raft_consensus.cc:2804] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:38.750432 11256 tablet_bootstrap.cc:492] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:38.750341 11405 raft_consensus.cc:697] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:38.764372 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:38.765201 11058 raft_consensus.cc:2468] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:38.766206 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2266db22c47c4604a6ac6d5cf892fc29" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:38.768678 10952 leader_election.cc:304] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:38.768781 11637 raft_consensus.cc:515] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:38.770506 11131 raft_consensus.cc:2393] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f856f4709042d9b3ce1348bdfb2ad5 in current term 1: Already voted for candidate a96b33d3dcf7432e904439b5be66dee1 in this term.
I20260709 12:30:38.773139 11637 leader_election.cc:290] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:38.773612 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2266db22c47c4604a6ac6d5cf892fc29" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:38.775022 11130 raft_consensus.cc:2393] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f856f4709042d9b3ce1348bdfb2ad5 in current term 1: Already voted for candidate a96b33d3dcf7432e904439b5be66dee1 in this term.
I20260709 12:30:38.778438 11405 consensus_queue.cc:237] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:38.780647 11254 tablet_bootstrap.cc:654] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.782200 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2266db22c47c4604a6ac6d5cf892fc29" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:38.782964 11060 raft_consensus.cc:2393] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a96b33d3dcf7432e904439b5be66dee1 in current term 1: Already voted for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in this term.
I20260709 12:30:38.786573 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2266db22c47c4604a6ac6d5cf892fc29" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:38.787071 11256 tablet_bootstrap.cc:654] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.785506 11253 tablet_bootstrap.cc:700] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent opening tablet: real 0.110s	user 0.001s	sys 0.001s
I20260709 12:30:38.796379 11099 leader_election.cc:304] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:38.799232 11253 tablet_bootstrap.cc:654] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.803023 11634 raft_consensus.cc:2749] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:30:38.788688 11559 raft_consensus.cc:2804] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:38.806227 11559 raft_consensus.cc:493] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:38.806588 11559 raft_consensus.cc:3060] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:38.814944 11255 tablet_bootstrap.cc:492] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:38.815469 11255 ts_tablet_manager.cc:1403] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.026s
I20260709 12:30:38.838438 11562 raft_consensus.cc:493] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:38.839054 11562 raft_consensus.cc:515] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:38.852474 11578 consensus_queue.cc:1048] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:30:38.857807 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d248b07c05b4adfb5ea2ebbc75aa249" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:38.861510 11133 raft_consensus.cc:2468] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:38.862761 11255 raft_consensus.cc:359] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:38.863754 11255 raft_consensus.cc:385] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.864248 11255 raft_consensus.cc:740] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.867973 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d248b07c05b4adfb5ea2ebbc75aa249" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:38.870290 10950 leader_election.cc:343] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:38.871172 10949 leader_election.cc:304] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:38.866474 11255 consensus_queue.cc:260] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:38.863724 11562 leader_election.cc:290] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:38.890166 11255 ts_tablet_manager.cc:1434] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.002s
I20260709 12:30:38.891539 11255 tablet_bootstrap.cc:492] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:38.874639 11513 raft_consensus.cc:2804] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:38.913848 10882 catalog_manager.cc:5697] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 1 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:38.932608 11562 consensus_queue.cc:1048] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:38.940127 11559 raft_consensus.cc:515] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:38.910955 11513 raft_consensus.cc:493] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:38.970124 11513 raft_consensus.cc:3060] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:38.976737 11255 tablet_bootstrap.cc:654] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.989822 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
W20260709 12:30:38.992647 10950 leader_election.cc:343] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:39.007292 11256 tablet_bootstrap.cc:492] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:39.007886 11256 ts_tablet_manager.cc:1403] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.258s	user 0.009s	sys 0.010s
I20260709 12:30:39.012508 11254 tablet_bootstrap.cc:492] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:39.013207 11254 ts_tablet_manager.cc:1403] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.271s	user 0.014s	sys 0.032s
I20260709 12:30:38.999954 11559 leader_election.cc:290] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:38.997660 11513 raft_consensus.cc:515] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:39.022214 11493 raft_consensus.cc:493] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:39.024814 11256 raft_consensus.cc:359] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:39.036533 11256 raft_consensus.cc:385] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.036890 11256 raft_consensus.cc:740] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
W20260709 12:30:39.039018 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:44703, user_credentials={real_user=slave}} blocked reactor thread for 87043.8us
I20260709 12:30:39.037602 11256 consensus_queue.cc:260] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:39.046849 11254 raft_consensus.cc:359] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:39.047823 11254 raft_consensus.cc:385] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.048198 11254 raft_consensus.cc:740] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.048642 11513 leader_election.cc:290] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:39.048943 11254 consensus_queue.cc:260] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
W20260709 12:30:39.038369 11100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:42037, user_credentials={real_user=slave}} blocked reactor thread for 53886.1us
I20260709 12:30:39.086709 11256 ts_tablet_manager.cc:1434] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.002s
I20260709 12:30:39.087826 11256 tablet_bootstrap.cc:492] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:39.092561 11254 ts_tablet_manager.cc:1434] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.001s
I20260709 12:30:39.103039 11253 tablet_bootstrap.cc:492] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:39.103664 11253 ts_tablet_manager.cc:1403] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.552s	user 0.020s	sys 0.068s
I20260709 12:30:39.105759 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:39.106436 11060 raft_consensus.cc:3060] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.039042 11493 raft_consensus.cc:515] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:39.115327 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d248b07c05b4adfb5ea2ebbc75aa249" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:39.120893 11254 tablet_bootstrap.cc:492] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f: Bootstrap starting.
I20260709 12:30:39.124877 11256 tablet_bootstrap.cc:654] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.139657 11254 tablet_bootstrap.cc:654] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.141064 11060 raft_consensus.cc:2468] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:39.136588 11135 raft_consensus.cc:3060] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.218818 11255 tablet_bootstrap.cc:492] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:39.219532 11255 ts_tablet_manager.cc:1403] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.328s	user 0.026s	sys 0.038s
I20260709 12:30:39.205278 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d248b07c05b4adfb5ea2ebbc75aa249" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
W20260709 12:30:39.269543 11101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 125547us
I20260709 12:30:39.264343 11578 raft_consensus.cc:493] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:39.270627 11694 raft_consensus.cc:493] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:39.276482 11131 raft_consensus.cc:3060] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.291067 11689 raft_consensus.cc:493] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:39.294430 11689 raft_consensus.cc:515] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:39.296561 11689 leader_election.cc:290] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:39.313655 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8af63f7be04dffb88a232a6d6f4c9e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:39.315706 11493 leader_election.cc:290] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:39.297827 11694 raft_consensus.cc:515] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:39.318058 11694 leader_election.cc:290] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:39.329600 11255 raft_consensus.cc:359] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:39.330440 11255 raft_consensus.cc:385] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.330797 11255 raft_consensus.cc:740] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.331665 11255 consensus_queue.cc:260] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:39.333837 11253 raft_consensus.cc:359] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:39.334664 11253 raft_consensus.cc:385] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.335005 11253 raft_consensus.cc:740] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.335148 11255 ts_tablet_manager.cc:1434] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.115s	user 0.008s	sys 0.007s
I20260709 12:30:39.336602 11255 tablet_bootstrap.cc:492] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:39.335820 11253 consensus_queue.cc:260] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:39.338155 10952 leader_election.cc:304] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:39.286465 11578 raft_consensus.cc:515] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:39.347487 11255 tablet_bootstrap.cc:654] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.372611 11256 tablet_bootstrap.cc:492] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:39.373274 11256 ts_tablet_manager.cc:1403] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.286s	user 0.026s	sys 0.016s
I20260709 12:30:39.377615 11253 ts_tablet_manager.cc:1434] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.274s	user 0.008s	sys 0.000s
I20260709 12:30:39.379492 11253 tablet_bootstrap.cc:492] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:39.352939 11562 raft_consensus.cc:2804] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:39.395068 11254 tablet_bootstrap.cc:492] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f: No bootstrap required, opened a new log
I20260709 12:30:39.395668 11254 ts_tablet_manager.cc:1403] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent bootstrapping tablet: real 0.275s	user 0.017s	sys 0.013s
I20260709 12:30:39.401127 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016a8f4a4c534fffa13dbf6e764c5fd1" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:39.402617 11253 tablet_bootstrap.cc:654] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.402405 11256 raft_consensus.cc:359] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:39.403123 11256 raft_consensus.cc:385] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.403406 11256 raft_consensus.cc:740] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.404127 11256 consensus_queue.cc:260] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:39.417445 11256 ts_tablet_manager.cc:1434] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.003s
I20260709 12:30:39.418614 11254 raft_consensus.cc:359] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:39.419591 11254 raft_consensus.cc:385] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.419988 11254 raft_consensus.cc:740] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.420871 11254 consensus_queue.cc:260] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:39.421904 11578 leader_election.cc:290] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:39.394358 11562 raft_consensus.cc:697] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:39.422873 11254 ts_tablet_manager.cc:1434] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:30:39.422943 11256 tablet_bootstrap.cc:492] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:39.423152 11562 consensus_queue.cc:237] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:39.430266 11253 tablet_bootstrap.cc:492] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:39.430797 11253 ts_tablet_manager.cc:1403] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.011s
I20260709 12:30:39.499490 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cac7da440174c7296f12f2879a05582" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
W20260709 12:30:39.517925 11099 leader_election.cc:343] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:39.523440 10950 leader_election.cc:343] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:39.525242 10950 leader_election.cc:343] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:39.542479 11127 raft_consensus.cc:3060] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.564478 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cac7da440174c7296f12f2879a05582" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:39.569263 11255 tablet_bootstrap.cc:492] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:39.571511 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25dd54445c4b4d1ca4f230aea7f2f3d5" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:39.572618 11255 ts_tablet_manager.cc:1403] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.236s	user 0.019s	sys 0.007s
I20260709 12:30:39.576370 11256 tablet_bootstrap.cc:654] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.579982 11253 raft_consensus.cc:359] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:39.583326 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016a8f4a4c534fffa13dbf6e764c5fd1" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:39.581130 11253 raft_consensus.cc:385] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.584436 11053 raft_consensus.cc:2468] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:39.592590 11253 raft_consensus.cc:740] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.602829 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25dd54445c4b4d1ca4f230aea7f2f3d5" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:39.611111 11058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8af63f7be04dffb88a232a6d6f4c9e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:39.613013 11058 raft_consensus.cc:2468] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
W20260709 12:30:39.616178 10931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:39.623108 11687 raft_consensus.cc:493] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:39.624044 11687 raft_consensus.cc:515] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:39.630501 11131 raft_consensus.cc:2468] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
W20260709 12:30:39.645179 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:37545, user_credentials={real_user=slave}} blocked reactor thread for 88669.1us
W20260709 12:30:39.648520 11099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:37545, user_credentials={real_user=slave}} blocked reactor thread for 51095.7us
I20260709 12:30:39.655084 11101 leader_election.cc:304] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:39.643926 11690 raft_consensus.cc:493] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:39.700122 11690 raft_consensus.cc:515] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:39.667451 11687 leader_election.cc:290] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:39.673368 11711 consensus_queue.cc:1048] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:39.703310 11690 leader_election.cc:290] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
W20260709 12:30:39.685683 11025 leader_election.cc:343] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:39.675761 11416 raft_consensus.cc:493] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:30:39.643942 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:44703, user_credentials={real_user=slave}} blocked reactor thread for 55609.3us
I20260709 12:30:39.676093 11708 raft_consensus.cc:493] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:30:39.676152 10952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 45142.2us
I20260709 12:30:39.679976 11648 consensus_queue.cc:1048] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:39.691658 11634 raft_consensus.cc:2749] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:39.695020 11101 leader_election.cc:304] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
W20260709 12:30:39.706683 10950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:37545, user_credentials={real_user=slave}} blocked reactor thread for 71856.8us
I20260709 12:30:39.704963 11416 raft_consensus.cc:515] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:39.602247 11255 raft_consensus.cc:359] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:39.710690 11255 raft_consensus.cc:385] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.711971 11255 raft_consensus.cc:740] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.711436 11253 consensus_queue.cc:260] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:39.715443 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18a4e559724b479491cb39b42c0ce6" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:39.731036 11255 consensus_queue.cc:260] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:39.738364 11635 raft_consensus.cc:2804] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:39.739066 11635 raft_consensus.cc:493] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:39.715735 11708 raft_consensus.cc:515] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:39.737358 10983 raft_consensus.cc:2468] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 0.
I20260709 12:30:39.742058 11635 raft_consensus.cc:3060] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.746978 10952 leader_election.cc:304] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:39.748317 11573 consensus_queue.cc:1048] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:30:39.757406 11694 raft_consensus.cc:493] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:39.761281 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18a4e559724b479491cb39b42c0ce6" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:39.767935 10985 raft_consensus.cc:2468] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
W20260709 12:30:39.770476 11099 leader_election.cc:343] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:39.772603 11255 ts_tablet_manager.cc:1434] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.199s	user 0.005s	sys 0.005s
I20260709 12:30:39.775729 11100 leader_election.cc:304] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:39.776523 11708 leader_election.cc:290] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:39.778594 11253 ts_tablet_manager.cc:1434] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.216s	user 0.007s	sys 0.005s
I20260709 12:30:39.772076 11694 raft_consensus.cc:515] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:39.785210 11721 raft_consensus.cc:2804] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:39.785717 11721 raft_consensus.cc:493] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:39.786183 11721 raft_consensus.cc:3060] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.788386 11709 consensus_queue.cc:1048] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:39.790025 11694 leader_election.cc:290] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:39.791877 11253 tablet_bootstrap.cc:492] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:39.792081 11255 tablet_bootstrap.cc:492] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574: Bootstrap starting.
W20260709 12:30:39.794006 11101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 99149.2us
I20260709 12:30:39.794309 11724 raft_consensus.cc:2804] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:39.794854 11724 raft_consensus.cc:493] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:39.795250 11724 raft_consensus.cc:3060] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.781721 11416 leader_election.cc:290] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:39.800752 11204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18a4e559724b479491cb39b42c0ce6" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:39.802253 10952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 64347.1us
I20260709 12:30:39.805384 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:39.806417 11057 raft_consensus.cc:2393] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f856f4709042d9b3ce1348bdfb2ad5 in current term 1: Already voted for candidate 61218d0202f44940b61185f640880574 in this term.
I20260709 12:30:39.811450 10949 leader_election.cc:304] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:39.812336 11635 raft_consensus.cc:515] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:39.812978 11405 consensus_queue.cc:1048] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:39.813109 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8646b7e0b1ba4757a267d2e57601e24b" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:39.819165 11686 raft_consensus.cc:2804] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:39.820058 11686 raft_consensus.cc:697] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:39.821033 11686 consensus_queue.cc:237] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
W20260709 12:30:39.822820 11024 leader_election.cc:343] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:39.843672 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:39.844650 10986 raft_consensus.cc:2468] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:39.845248 11256 tablet_bootstrap.cc:492] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:39.845999 11256 ts_tablet_manager.cc:1403] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.423s	user 0.029s	sys 0.028s
I20260709 12:30:39.852078 11721 raft_consensus.cc:515] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
W20260709 12:30:39.856120 10950 leader_election.cc:343] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:39.866221 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18a4e559724b479491cb39b42c0ce6" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:39.872907 11100 leader_election.cc:304] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:39.879592 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8646b7e0b1ba4757a267d2e57601e24b" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
W20260709 12:30:39.883394 11025 leader_election.cc:343] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:39.886194 11204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8af63f7be04dffb88a232a6d6f4c9e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:39.886253 11253 tablet_bootstrap.cc:654] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
W20260709 12:30:39.890882 10950 leader_election.cc:343] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:39.887604 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
W20260709 12:30:39.898274 10949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:44703, user_credentials={real_user=slave}} blocked reactor thread for 86898us
I20260709 12:30:39.885563 11721 leader_election.cc:290] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:39.903764 11694 raft_consensus.cc:2804] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:39.907879 11694 raft_consensus.cc:493] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 03cdbc3ec1ef4354bd6ec49958026f5f)
I20260709 12:30:39.908401 11694 raft_consensus.cc:3060] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:39.908738 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:39.885571 11025 leader_election.cc:304] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:39.912763 11416 raft_consensus.cc:2749] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:39.849606 11256 raft_consensus.cc:359] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:39.915155 11256 raft_consensus.cc:385] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.915426 11256 raft_consensus.cc:740] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.927636 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8af63f7be04dffb88a232a6d6f4c9e" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:39.928364 11057 raft_consensus.cc:3060] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.935724 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016a8f4a4c534fffa13dbf6e764c5fd1" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:39.936409 11060 raft_consensus.cc:3060] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:39.938355 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.4:37545, user_credentials={real_user=slave}} blocked reactor thread for 55013.5us
I20260709 12:30:39.940433 11174 leader_election.cc:304] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:39.942692 11405 raft_consensus.cc:3060] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.944710 11255 tablet_bootstrap.cc:654] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.946432 11635 leader_election.cc:290] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:39.955655 11256 consensus_queue.cc:260] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:39.972102 11204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016a8f4a4c534fffa13dbf6e764c5fd1" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:39.972827 11204 raft_consensus.cc:3060] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.988271 11026 leader_election.cc:304] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:39.989470 11256 ts_tablet_manager.cc:1434] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.143s	user 0.007s	sys 0.001s
I20260709 12:30:39.990396 11709 raft_consensus.cc:2804] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:39.990911 11256 tablet_bootstrap.cc:492] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:39.990934 11709 raft_consensus.cc:493] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:39.991852 11709 raft_consensus.cc:3060] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.008754 11057 raft_consensus.cc:2468] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:40.010062 10952 leader_election.cc:304] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:40.011240 11626 raft_consensus.cc:2804] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:40.011763 11626 raft_consensus.cc:697] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:40.012702 11626 consensus_queue.cc:237] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
W20260709 12:30:40.048635 11728 log.cc:927] Time spent T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:30:40.056578 11709 raft_consensus.cc:515] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:40.059628 11060 raft_consensus.cc:2468] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:40.065747 11694 raft_consensus.cc:515] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:40.067162 11133 raft_consensus.cc:1240] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Rejecting Update request from peer 03cdbc3ec1ef4354bd6ec49958026f5f for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:40.071985 11694 leader_election.cc:290] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:40.075069 11416 consensus_queue.cc:1059] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:30:40.074523 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:40.094632 11101 leader_election.cc:304] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:40.095708 11694 raft_consensus.cc:2804] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:40.096254 11694 raft_consensus.cc:697] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:40.097231 11694 consensus_queue.cc:237] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:40.121508 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25dd54445c4b4d1ca4f230aea7f2f3d5" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:40.099021 11724 raft_consensus.cc:515] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.123034 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:40.124696 11255 tablet_bootstrap.cc:492] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:40.126189 11255 ts_tablet_manager.cc:1403] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.334s	user 0.019s	sys 0.003s
I20260709 12:30:40.113673 11709 leader_election.cc:290] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:40.128095 11101 leader_election.cc:304] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:40.131837 11253 tablet_bootstrap.cc:492] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:40.132328 11253 ts_tablet_manager.cc:1403] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.341s	user 0.017s	sys 0.008s
I20260709 12:30:40.130750 11635 raft_consensus.cc:2749] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:40.144974 11578 raft_consensus.cc:3055] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:30:40.144251 11025 leader_election.cc:343] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:40.146912 11129 raft_consensus.cc:2393] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61218d0202f44940b61185f640880574 in current term 1: Already voted for candidate a96b33d3dcf7432e904439b5be66dee1 in this term.
I20260709 12:30:40.157181 11724 leader_election.cc:290] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:40.159519 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18a4e559724b479491cb39b42c0ce6" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:40.149026 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25dd54445c4b4d1ca4f230aea7f2f3d5" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:40.180007 10985 raft_consensus.cc:3060] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.180138 10983 raft_consensus.cc:3060] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.161056 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a18a4e559724b479491cb39b42c0ce6" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:40.161515 11256 tablet_bootstrap.cc:654] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:40.171336 11705 consensus_queue.cc:1048] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:30:40.173797 11405 raft_consensus.cc:2749] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:40.175755 11204 raft_consensus.cc:2468] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:40.189821 10949 leader_election.cc:304] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:40.186887 10882 catalog_manager.cc:5697] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
W20260709 12:30:40.186101 11099 leader_election.cc:343] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:40.151959 11578 raft_consensus.cc:740] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:40.194708 11255 raft_consensus.cc:359] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.201740 11719 consensus_queue.cc:1048] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:40.168125 11253 raft_consensus.cc:359] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.208323 10882 catalog_manager.cc:5697] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:40.201794 10983 raft_consensus.cc:2468] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:40.207468 11253 raft_consensus.cc:385] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:40.212206 11253 raft_consensus.cc:740] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:40.213124 11026 leader_election.cc:304] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:40.218286 11416 raft_consensus.cc:2804] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:40.218632 10985 raft_consensus.cc:2468] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:40.218777 11416 raft_consensus.cc:697] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:40.219238 11705 raft_consensus.cc:2749] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:40.213004 11253 consensus_queue.cc:260] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.213692 11255 raft_consensus.cc:385] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:40.220137 11255 raft_consensus.cc:740] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:40.219810 11416 consensus_queue.cc:237] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:40.222273 11255 consensus_queue.cc:260] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.226500 11253 ts_tablet_manager.cc:1434] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.001s
I20260709 12:30:40.228315 11100 leader_election.cc:304] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:40.227557 11255 ts_tablet_manager.cc:1434] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.101s	user 0.004s	sys 0.003s
I20260709 12:30:40.230060 11724 raft_consensus.cc:2804] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:40.220970 11578 consensus_queue.cc:260] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:40.232811 11578 raft_consensus.cc:3060] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:40.233078 11256 tablet_bootstrap.cc:492] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:40.233237 11724 raft_consensus.cc:697] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:40.233736 11256 ts_tablet_manager.cc:1403] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.243s	user 0.017s	sys 0.002s
I20260709 12:30:40.234323 11724 consensus_queue.cc:237] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.236567 11256 raft_consensus.cc:359] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.237282 11256 raft_consensus.cc:385] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:40.237553 11256 raft_consensus.cc:740] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:40.252933 11255 tablet_bootstrap.cc:492] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:40.253356 11253 tablet_bootstrap.cc:492] T 7a18a4e559724b479491cb39b42c0ce6 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:40.297601 11253 tablet_bootstrap.cc:654] T 7a18a4e559724b479491cb39b42c0ce6 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:40.302109 11256 consensus_queue.cc:260] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.311712 11256 ts_tablet_manager.cc:1434] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.000s
I20260709 12:30:40.313401 11256 tablet_bootstrap.cc:492] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1: Bootstrap starting.
I20260709 12:30:40.314706 11255 tablet_bootstrap.cc:654] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:40.325758 11256 tablet_bootstrap.cc:654] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:40.344918 11209 raft_consensus.cc:3060] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.362357 11255 tablet_bootstrap.cc:492] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574: No bootstrap required, opened a new log
I20260709 12:30:40.362980 11255 ts_tablet_manager.cc:1403] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.000s
I20260709 12:30:40.363359 11687 consensus_queue.cc:1048] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:40.365980 11255 raft_consensus.cc:359] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:40.366719 11255 raft_consensus.cc:385] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:40.366986 11255 raft_consensus.cc:740] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:40.367722 11255 consensus_queue.cc:260] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:40.370015 11255 ts_tablet_manager.cc:1434] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:30:40.382491 11253 tablet_bootstrap.cc:492] T 7a18a4e559724b479491cb39b42c0ce6 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:40.383248 11253 ts_tablet_manager.cc:1403] T 7a18a4e559724b479491cb39b42c0ce6 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.131s	user 0.037s	sys 0.017s
I20260709 12:30:40.388685 11253 raft_consensus.cc:359] T 7a18a4e559724b479491cb39b42c0ce6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.389371 11253 raft_consensus.cc:385] T 7a18a4e559724b479491cb39b42c0ce6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:40.389652 11253 raft_consensus.cc:740] T 7a18a4e559724b479491cb39b42c0ce6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:40.390734 11253 consensus_queue.cc:260] T 7a18a4e559724b479491cb39b42c0ce6 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.395684 11253 ts_tablet_manager.cc:1434] T 7a18a4e559724b479491cb39b42c0ce6 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:30:40.397289 11253 tablet_bootstrap.cc:492] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:40.393455 10883 catalog_manager.cc:5697] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 0 to 1, leader changed from <none> to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 1 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:40.405591 11253 tablet_bootstrap.cc:654] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:40.412966 11694 raft_consensus.cc:493] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:40.413710 11694 raft_consensus.cc:515] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:40.416441 11694 leader_election.cc:290] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:40.417623 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45b83d519688476d84ef90b668ca9efd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:40.418396 11059 raft_consensus.cc:2468] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:40.419462 11101 leader_election.cc:304] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:40.421319 11694 raft_consensus.cc:2804] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:40.421416 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45b83d519688476d84ef90b668ca9efd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:40.421733 11694 raft_consensus.cc:493] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:40.422127 11694 raft_consensus.cc:3060] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.422183 10986 raft_consensus.cc:2468] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 0.
I20260709 12:30:40.427688 11253 tablet_bootstrap.cc:492] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:40.428395 11253 ts_tablet_manager.cc:1403] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.001s
I20260709 12:30:40.433705 11694 raft_consensus.cc:515] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:40.435964 11253 raft_consensus.cc:359] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:40.436657 11253 raft_consensus.cc:385] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:40.436901 11253 raft_consensus.cc:740] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:40.437673 11253 consensus_queue.cc:260] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:40.447993 11253 ts_tablet_manager.cc:1434] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:30:40.449430 11253 tablet_bootstrap.cc:492] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:40.453732 11694 leader_election.cc:290] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:40.454810 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45b83d519688476d84ef90b668ca9efd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:40.455499 11057 raft_consensus.cc:3060] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.461531 11253 tablet_bootstrap.cc:654] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:40.461683 11721 consensus_queue.cc:1048] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:40.467981 11057 raft_consensus.cc:2468] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:40.469552 11101 leader_election.cc:304] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:40.470461 11694 raft_consensus.cc:2804] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:40.470942 11694 raft_consensus.cc:697] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:40.471616 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45b83d519688476d84ef90b668ca9efd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:40.471767 11694 consensus_queue.cc:237] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:40.472366 10983 raft_consensus.cc:3060] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.483492 11253 tablet_bootstrap.cc:492] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:40.484040 11253 ts_tablet_manager.cc:1403] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.000s
W20260709 12:30:40.488790 10950 consensus_peers.cc:597] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 -> Peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Couldn't send request to peer 85f856f4709042d9b3ce1348bdfb2ad5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:40.490097 10882 catalog_manager.cc:5697] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:40.503423 11253 raft_consensus.cc:359] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:40.510573 11719 consensus_queue.cc:1048] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:40.504236 11253 raft_consensus.cc:385] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:40.512233 11253 raft_consensus.cc:740] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:40.516999 11253 consensus_queue.cc:260] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:40.520037 10983 raft_consensus.cc:2468] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:40.522047 11705 raft_consensus.cc:493] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:40.522526 11705 raft_consensus.cc:515] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.520306 11256 tablet_bootstrap.cc:492] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1: No bootstrap required, opened a new log
I20260709 12:30:40.524335 11256 ts_tablet_manager.cc:1403] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1: Time spent bootstrapping tablet: real 0.211s	user 0.040s	sys 0.057s
I20260709 12:30:40.524732 11705 leader_election.cc:290] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:40.531157 11694 consensus_queue.cc:1048] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:40.531965 11253 ts_tablet_manager.cc:1434] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 12:30:40.533099 11253 tablet_bootstrap.cc:492] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:40.533324 11256 raft_consensus.cc:359] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:40.534147 11256 raft_consensus.cc:385] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:40.534428 11256 raft_consensus.cc:740] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Initialized, Role: FOLLOWER
I20260709 12:30:40.535424 11256 consensus_queue.cc:260] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:40.537735 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6980a48384841e9a62db7f664aa7b0f" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:40.538568 11129 raft_consensus.cc:2468] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 0.
I20260709 12:30:40.541040 11253 tablet_bootstrap.cc:654] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:40.543464 11256 ts_tablet_manager.cc:1434] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:30:40.546329 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6980a48384841e9a62db7f664aa7b0f" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:40.543306 10949 leader_election.cc:304] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:40.551546 11719 raft_consensus.cc:2804] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:40.552062 11719 raft_consensus.cc:493] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:40.552495 11719 raft_consensus.cc:3060] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:40.553982 10950 leader_election.cc:343] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:40.573295 10879 catalog_manager.cc:5697] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:40.594220 11719 raft_consensus.cc:515] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.598973 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6980a48384841e9a62db7f664aa7b0f" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
W20260709 12:30:40.600332 10950 leader_election.cc:343] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:40.600850 11719 leader_election.cc:290] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:40.604423 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6980a48384841e9a62db7f664aa7b0f" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:40.605106 11253 tablet_bootstrap.cc:492] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:40.605700 11253 ts_tablet_manager.cc:1403] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.073s	user 0.022s	sys 0.023s
I20260709 12:30:40.607523 11135 raft_consensus.cc:3060] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.608361 11253 raft_consensus.cc:359] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:40.609038 11253 raft_consensus.cc:385] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:40.609297 11253 raft_consensus.cc:740] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:40.610122 11253 consensus_queue.cc:260] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:40.612372 11253 ts_tablet_manager.cc:1434] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:30:40.613372 11253 tablet_bootstrap.cc:492] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5: Bootstrap starting.
I20260709 12:30:40.619235 11253 tablet_bootstrap.cc:654] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:40.621563 11209 raft_consensus.cc:3060] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.621955 11135 raft_consensus.cc:2468] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 1.
I20260709 12:30:40.624091 10949 leader_election.cc:304] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:40.625756 11719 raft_consensus.cc:2804] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:40.626366 11719 raft_consensus.cc:697] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:40.627345 11719 consensus_queue.cc:237] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.639245 11635 consensus_queue.cc:1048] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:40.650422 11648 consensus_queue.cc:1048] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:40.654027 11635 consensus_queue.cc:1048] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:40.658110 11253 tablet_bootstrap.cc:492] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5: No bootstrap required, opened a new log
I20260709 12:30:40.658733 11253 ts_tablet_manager.cc:1403] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.023s
I20260709 12:30:40.662201 11253 raft_consensus.cc:359] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.663179 11253 raft_consensus.cc:385] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:40.663551 11253 raft_consensus.cc:740] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Initialized, Role: FOLLOWER
I20260709 12:30:40.664588 11253 consensus_queue.cc:260] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:40.667021 11253 ts_tablet_manager.cc:1434] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:30:40.675698 11204 raft_consensus.cc:3060] T 7a18a4e559724b479491cb39b42c0ce6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.692672 11405 raft_consensus.cc:493] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:40.693328 11405 raft_consensus.cc:515] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:40.708003 11635 consensus_queue.cc:1048] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:40.716650 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8646b7e0b1ba4757a267d2e57601e24b" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:40.717463 11057 raft_consensus.cc:2468] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:40.725970 11175 leader_election.cc:304] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:40.727408 11708 raft_consensus.cc:2804] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:40.727895 11708 raft_consensus.cc:493] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:40.728310 11708 raft_consensus.cc:3060] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.732000 11405 leader_election.cc:290] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:40.733120 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8646b7e0b1ba4757a267d2e57601e24b" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:40.733825 11135 raft_consensus.cc:2468] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 0.
I20260709 12:30:40.735831 11578 consensus_queue.cc:1048] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:40.742662 11708 raft_consensus.cc:515] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:40.745343 11708 leader_election.cc:290] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:40.747522 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8646b7e0b1ba4757a267d2e57601e24b" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:40.748296 11135 raft_consensus.cc:3060] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.756999 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8646b7e0b1ba4757a267d2e57601e24b" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
W20260709 12:30:40.757858 10931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:40.757745 11057 raft_consensus.cc:3060] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.759181 10879 catalog_manager.cc:5697] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } }
I20260709 12:30:40.760910 10879 catalog_manager.cc:5697] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:40.766170 11135 raft_consensus.cc:2468] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:40.768666 11172 leader_election.cc:304] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:40.769579 11708 raft_consensus.cc:2804] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:40.770094 11708 raft_consensus.cc:697] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:40.770920 11708 consensus_queue.cc:237] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:40.774559 10882 catalog_manager.cc:5697] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:40.776678 11057 raft_consensus.cc:2468] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:40.797461 10879 catalog_manager.cc:5697] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 1 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:40.958834 11206 raft_consensus.cc:3060] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:41.005509 11635 consensus_queue.cc:1048] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:41.022360 11724 consensus_queue.cc:1048] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:41.060287 11206 raft_consensus.cc:3060] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:41.070101 11705 consensus_queue.cc:1048] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:41.087725 11687 consensus_queue.cc:1048] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:41.192960 11405 consensus_queue.cc:1048] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:41.204072 11775 consensus_queue.cc:1048] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:41.642848 11416 raft_consensus.cc:493] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:41.643374 11416 raft_consensus.cc:515] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:41.644934 11416 leader_election.cc:290] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:41.645928 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:41.646171 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:41.646715 11135 raft_consensus.cc:2468] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 2.
I20260709 12:30:41.647750 11024 leader_election.cc:304] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:41.648453 11416 raft_consensus.cc:2804] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:41.648761 11416 raft_consensus.cc:493] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:41.649075 11416 raft_consensus.cc:3060] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:41.654651 11416 raft_consensus.cc:515] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:41.656060 11416 leader_election.cc:290] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 3 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:41.656703 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:41.656951 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:41.657517 11135 raft_consensus.cc:3060] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:41.661652 11135 raft_consensus.cc:2468] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 3.
I20260709 12:30:41.662557 11024 leader_election.cc:304] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:41.663236 11416 raft_consensus.cc:2804] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:41.663720 11416 raft_consensus.cc:697] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:41.664455 11416 consensus_queue.cc:237] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:41.673574 10880 catalog_manager.cc:5697] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:41.728962 11687 raft_consensus.cc:493] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 03cdbc3ec1ef4354bd6ec49958026f5f)
I20260709 12:30:41.729396 11687 raft_consensus.cc:515] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:41.731065 11687 leader_election.cc:290] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:41.731777 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:41.732034 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:41.732929 11135 raft_consensus.cc:2368] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61218d0202f44940b61185f640880574 for earlier term 2. Current term is 3.
I20260709 12:30:41.734052 10949 leader_election.cc:400] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703) with higher term. Message: Invalid argument: T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61218d0202f44940b61185f640880574 for earlier term 2. Current term is 3.
I20260709 12:30:41.734318 10949 leader_election.cc:403] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:30:41.734813 11687 raft_consensus.cc:3060] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:30:41.740078 11687 raft_consensus.cc:2749] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703) with higher term. Message: Invalid argument: T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61218d0202f44940b61185f640880574 for earlier term 2. Current term is 3.
I20260709 12:30:41.998715  2676 tablet_server.cc:179] TabletServer@127.2.157.1:0 shutting down...
W20260709 12:30:42.020660 11174 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:30:42.030405 11174 consensus_peers.cc:597] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:42.034322 11174 consensus_peers.cc:597] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:42.048925 11100 consensus_peers.cc:597] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:42.057662 11100 consensus_peers.cc:597] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:42.059679  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:42.060678  2676 tablet_replica.cc:333] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.061755  2676 raft_consensus.cc:2243] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.062354  2676 raft_consensus.cc:2272] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.065256  2676 tablet_replica.cc:333] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.066082  2676 raft_consensus.cc:2243] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.066561  2676 raft_consensus.cc:2272] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.068987  2676 tablet_replica.cc:333] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.069643  2676 raft_consensus.cc:2243] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.070411  2676 raft_consensus.cc:2272] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.073153  2676 tablet_replica.cc:333] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.073982  2676 raft_consensus.cc:2243] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.074961  2676 raft_consensus.cc:2272] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.077849  2676 tablet_replica.cc:333] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.079540  2676 raft_consensus.cc:2243] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.080559  2676 raft_consensus.cc:2272] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.083379  2676 tablet_replica.cc:333] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.084344  2676 raft_consensus.cc:2243] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.084908  2676 raft_consensus.cc:2272] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.087306  2676 tablet_replica.cc:333] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.088080  2676 raft_consensus.cc:2243] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.088608  2676 raft_consensus.cc:2272] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.089241 11135 raft_consensus.cc:1275] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 3 FOLLOWER]: Refusing update from remote peer 03cdbc3ec1ef4354bd6ec49958026f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:42.090459 11648 consensus_queue.cc:1048] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:42.091148  2676 tablet_replica.cc:333] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.092041  2676 raft_consensus.cc:2243] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.092988  2676 raft_consensus.cc:2272] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.095886  2676 tablet_replica.cc:333] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.096637  2676 raft_consensus.cc:2243] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.097123  2676 raft_consensus.cc:2272] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.099809  2676 tablet_replica.cc:333] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.100589  2676 raft_consensus.cc:2243] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.101171  2676 raft_consensus.cc:2272] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.103958  2676 tablet_replica.cc:333] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.104718  2676 raft_consensus.cc:2243] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.105307  2676 raft_consensus.cc:2272] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.110265  2676 tablet_replica.cc:333] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.111088  2676 raft_consensus.cc:2243] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.111729  2676 raft_consensus.cc:2272] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.114900  2676 tablet_replica.cc:333] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574: stopping tablet replica
W20260709 12:30:42.118506 11174 consensus_peers.cc:597] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:42.118844 11026 consensus_peers.cc:597] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:42.115746  2676 raft_consensus.cc:2243] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.122483  2676 raft_consensus.cc:2272] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.125728  2676 tablet_replica.cc:333] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.126556  2676 raft_consensus.cc:2243] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.127727  2676 raft_consensus.cc:2272] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.130857  2676 tablet_replica.cc:333] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.131654  2676 raft_consensus.cc:2243] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.132718  2676 raft_consensus.cc:2272] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.135156  2676 tablet_replica.cc:333] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.135886  2676 raft_consensus.cc:2243] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.136720  2676 raft_consensus.cc:2272] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:42.136747 11100 consensus_peers.cc:597] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:42.139417  2676 tablet_replica.cc:333] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.140061  2676 raft_consensus.cc:2243] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.140525  2676 raft_consensus.cc:2272] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:42.140842 11026 consensus_peers.cc:597] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:42.143095  2676 tablet_replica.cc:333] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.144007  2676 raft_consensus.cc:2243] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.144680  2676 raft_consensus.cc:2272] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.147405  2676 tablet_replica.cc:333] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.148008  2676 raft_consensus.cc:2243] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.148840  2676 raft_consensus.cc:2272] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.151033  2676 tablet_replica.cc:333] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.151638  2676 raft_consensus.cc:2243] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.152460  2676 raft_consensus.cc:2272] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.154779  2676 tablet_replica.cc:333] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.155380  2676 raft_consensus.cc:2243] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.155844  2676 raft_consensus.cc:2272] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.158493  2676 tablet_replica.cc:333] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.159447  2676 raft_consensus.cc:2243] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.159996  2676 raft_consensus.cc:2272] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.162547  2676 tablet_replica.cc:333] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.163128  2676 raft_consensus.cc:2243] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.163535  2676 raft_consensus.cc:2272] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.165560  2676 tablet_replica.cc:333] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.166239  2676 raft_consensus.cc:2243] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.167116  2676 raft_consensus.cc:2272] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.169435  2676 tablet_replica.cc:333] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.170076  2676 raft_consensus.cc:2243] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.170897  2676 raft_consensus.cc:2272] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.173429  2676 tablet_replica.cc:333] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.174226  2676 raft_consensus.cc:2243] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.175344  2676 raft_consensus.cc:2272] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.178668  2676 tablet_replica.cc:333] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.179543  2676 raft_consensus.cc:2243] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.180084  2676 raft_consensus.cc:2272] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.182597  2676 tablet_replica.cc:333] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.183902  2676 raft_consensus.cc:2243] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.185014  2676 raft_consensus.cc:2272] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.188117  2676 tablet_replica.cc:333] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.188771  2676 raft_consensus.cc:2243] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.189260  2676 raft_consensus.cc:2272] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.191378  2676 tablet_replica.cc:333] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.192073  2676 raft_consensus.cc:2243] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.192970  2676 raft_consensus.cc:2272] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.195984  2676 tablet_replica.cc:333] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.196664  2676 raft_consensus.cc:2243] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.197081  2676 raft_consensus.cc:2272] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.199534  2676 tablet_replica.cc:333] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.200405  2676 raft_consensus.cc:2243] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.201503  2676 raft_consensus.cc:2272] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.204013  2676 tablet_replica.cc:333] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.204589  2676 raft_consensus.cc:2243] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.205039  2676 raft_consensus.cc:2272] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.207336  2676 tablet_replica.cc:333] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.207887  2676 raft_consensus.cc:2243] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.208740  2676 raft_consensus.cc:2272] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.211082  2676 tablet_replica.cc:333] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.211673  2676 raft_consensus.cc:2243] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.212261  2676 raft_consensus.cc:2272] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.214484  2676 tablet_replica.cc:333] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.215204  2676 raft_consensus.cc:2243] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.215641  2676 raft_consensus.cc:2272] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.217495  2676 tablet_replica.cc:333] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.218185  2676 raft_consensus.cc:2243] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.218688  2676 raft_consensus.cc:2272] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.221282  2676 tablet_replica.cc:333] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.222102  2676 raft_consensus.cc:2243] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.223131  2676 raft_consensus.cc:2272] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.226109  2676 tablet_replica.cc:333] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.226851  2676 raft_consensus.cc:2243] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.227427  2676 raft_consensus.cc:2272] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:42.228883 11100 consensus_peers.cc:597] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:42.229033 11174 consensus_peers.cc:597] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:42.230090  2676 tablet_replica.cc:333] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.230952  2676 raft_consensus.cc:2243] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.231489  2676 raft_consensus.cc:2272] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.234539  2676 tablet_replica.cc:333] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.235244  2676 raft_consensus.cc:2243] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.235698  2676 raft_consensus.cc:2272] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.237957  2676 tablet_replica.cc:333] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.238505  2676 raft_consensus.cc:2243] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.239317  2676 raft_consensus.cc:2272] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.241475  2676 tablet_replica.cc:333] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.242057  2676 raft_consensus.cc:2243] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.242498  2676 raft_consensus.cc:2272] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.244654  2676 tablet_replica.cc:333] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.245260  2676 raft_consensus.cc:2243] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:42.246207  2676 raft_consensus.cc:2272] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:42.248508  2676 tablet_replica.cc:333] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574: stopping tablet replica
I20260709 12:30:42.249053  2676 raft_consensus.cc:2243] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:42.249542  2676 raft_consensus.cc:2272] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:42.252738 11026 consensus_peers.cc:597] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:42.253769 11100 consensus_peers.cc:597] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:42.266971 11100 consensus_peers.cc:597] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:42.269038 11174 consensus_peers.cc:597] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:42.283039 11026 consensus_peers.cc:597] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:42.298622 11026 consensus_peers.cc:597] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:42.333144  2676 tablet_server.cc:196] TabletServer@127.2.157.1:0 shutdown complete.
W20260709 12:30:42.349146 11026 consensus_peers.cc:597] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:42.360179 11174 consensus_peers.cc:597] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:42.378993 11026 consensus_peers.cc:597] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:42.403767 11026 consensus_peers.cc:597] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:42.419792  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:42.427281 11793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:42.428208 11792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:42.429203  2676 server_base.cc:1061] running on GCE node
W20260709 12:30:42.431908 11795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:42.434792  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:42.435204  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:42.435518  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600242435495 us; error 0 us; skew 500 ppm
I20260709 12:30:42.436420  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 12:30:42.445550 11100 consensus_peers.cc:597] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:42.450004  2676 webserver.cc:533] Webserver started at http://127.2.157.1:45353/ using document root <none> and password file <none>
I20260709 12:30:42.450907  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:42.451197  2676 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 12:30:42.455437 11174 consensus_peers.cc:597] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:42.456054  2676 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.001s
W20260709 12:30:42.462649 11026 consensus_peers.cc:597] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:42.466706 11802 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:42.467650  2676 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 12:30:42.468027  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-0-root
uuid: "61218d0202f44940b61185f640880574"
format_stamp: "Formatted at 2026-07-09 12:30:29 on dist-test-slave-0768"
I20260709 12:30:42.468384  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599939977835-2676-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:30:42.479324 11100 consensus_peers.cc:597] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:42.483383  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:42.484959  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:42.487685  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:42.492416 11810 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:30:42.511531 11100 consensus_peers.cc:597] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:42.517110 11026 consensus_peers.cc:597] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:42.733673  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:30:42.734124  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.243s	user 0.007s	sys 0.003s
I20260709 12:30:42.734433  2676 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:30:42.738981 11810 tablet_bootstrap.cc:492] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:42.751121 11810 tablet_bootstrap.cc:492] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:42.752092 11810 tablet_bootstrap.cc:492] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:42.752761 11810 ts_tablet_manager.cc:1403] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:30:42.755342 11810 raft_consensus.cc:359] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:42.756006 11810 raft_consensus.cc:740] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.756692 11810 consensus_queue.cc:260] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:42.762172 11810 ts_tablet_manager.cc:1434] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:30:42.763072 11810 tablet_bootstrap.cc:492] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:42.826285 11810 tablet_bootstrap.cc:492] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:42.828094 11810 tablet_bootstrap.cc:492] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:42.828765 11810 ts_tablet_manager.cc:1403] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.066s	user 0.031s	sys 0.031s
I20260709 12:30:42.831911 11810 raft_consensus.cc:359] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:42.832500 11810 raft_consensus.cc:740] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.833382 11810 consensus_queue.cc:260] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:42.835238 11810 ts_tablet_manager.cc:1434] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:30:42.836012 11810 tablet_bootstrap.cc:492] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:42.861471 11810 tablet_bootstrap.cc:492] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:42.862402 11810 tablet_bootstrap.cc:492] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:42.862998 11810 ts_tablet_manager.cc:1403] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.002s
I20260709 12:30:42.865440 11810 raft_consensus.cc:359] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:42.866137 11810 raft_consensus.cc:740] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.866822 11810 consensus_queue.cc:260] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:42.868973 11810 ts_tablet_manager.cc:1434] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 12:30:42.869746 11810 tablet_bootstrap.cc:492] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:42.894742 11810 tablet_bootstrap.cc:492] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:42.895823 11810 tablet_bootstrap.cc:492] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:42.896672 11810 ts_tablet_manager.cc:1403] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.015s
I20260709 12:30:42.899168 11810 raft_consensus.cc:359] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:42.899873 11810 raft_consensus.cc:740] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.900655 11810 consensus_queue.cc:260] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:42.902720 11810 ts_tablet_manager.cc:1434] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:30:42.903501 11810 tablet_bootstrap.cc:492] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:42.955145 11810 tablet_bootstrap.cc:492] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:42.956094 11810 tablet_bootstrap.cc:492] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:42.956714 11810 ts_tablet_manager.cc:1403] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.021s
I20260709 12:30:42.958951 11810 raft_consensus.cc:359] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:42.959421 11810 raft_consensus.cc:740] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.960080 11810 consensus_queue.cc:260] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:42.961493 11810 ts_tablet_manager.cc:1434] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:30:42.962169 11810 tablet_bootstrap.cc:492] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:42.976372 11810 tablet_bootstrap.cc:492] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:42.977283 11810 tablet_bootstrap.cc:492] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:42.977936 11810 ts_tablet_manager.cc:1403] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.001s
I20260709 12:30:42.980260 11810 raft_consensus.cc:359] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:42.980903 11810 raft_consensus.cc:740] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.981509 11810 consensus_queue.cc:260] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:42.983062 11810 ts_tablet_manager.cc:1434] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:30:42.983827 11810 tablet_bootstrap.cc:492] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:42.996750 11810 tablet_bootstrap.cc:492] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:42.997466 11810 tablet_bootstrap.cc:492] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:42.998036 11810 ts_tablet_manager.cc:1403] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.014s	user 0.014s	sys 0.000s
I20260709 12:30:42.999902 11810 raft_consensus.cc:359] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.000378 11810 raft_consensus.cc:740] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:43.000900 11810 consensus_queue.cc:260] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.002573 11810 ts_tablet_manager.cc:1434] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:30:43.003207 11810 tablet_bootstrap.cc:492] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:43.015475 11810 tablet_bootstrap.cc:492] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:43.016203 11810 tablet_bootstrap.cc:492] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:43.016736 11810 ts_tablet_manager.cc:1403] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:30:43.018548 11810 raft_consensus.cc:359] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:43.019047 11810 raft_consensus.cc:740] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:43.019605 11810 consensus_queue.cc:260] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } }
I20260709 12:30:43.020996 11810 ts_tablet_manager.cc:1434] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:30:43.021579 11810 tablet_bootstrap.cc:492] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:43.032246 11810 tablet_bootstrap.cc:492] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:43.032949 11810 tablet_bootstrap.cc:492] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:43.033463 11810 ts_tablet_manager.cc:1403] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:30:43.035281 11810 raft_consensus.cc:359] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.035804 11810 raft_consensus.cc:740] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:43.036417 11810 consensus_queue.cc:260] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.038455 11810 ts_tablet_manager.cc:1434] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:30:43.039278 11810 tablet_bootstrap.cc:492] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:43.053004 11810 tablet_bootstrap.cc:492] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:43.053928 11810 tablet_bootstrap.cc:492] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:43.054569 11810 ts_tablet_manager.cc:1403] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 12:30:43.056994 11810 raft_consensus.cc:359] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.057667 11810 raft_consensus.cc:740] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:43.058310 11810 consensus_queue.cc:260] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.060249 11810 ts_tablet_manager.cc:1434] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:30:43.061022 11810 tablet_bootstrap.cc:492] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:43.064617  2676 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:30:43.064921  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.330s	user 0.221s	sys 0.012s
I20260709 12:30:43.076463 11810 tablet_bootstrap.cc:492] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:43.077673 11810 tablet_bootstrap.cc:492] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:43.078510 11810 ts_tablet_manager.cc:1403] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:30:43.081826 11810 raft_consensus.cc:359] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:43.082867 11810 raft_consensus.cc:740] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:43.083811 11810 consensus_queue.cc:260] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:43.086273 11810 ts_tablet_manager.cc:1434] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:30:43.087234 11810 tablet_bootstrap.cc:492] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:43.105934 11694 raft_consensus.cc:493] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.106537 11694 raft_consensus.cc:515] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:43.106905 11810 tablet_bootstrap.cc:492] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:43.108187 11810 tablet_bootstrap.cc:492] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:43.108529 11694 leader_election.cc:290] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.109035 11810 ts_tablet_manager.cc:1403] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.001s
I20260709 12:30:43.111121 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6b390078e79408a91ac1f52eaa9b4cd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:43.112255 11810 raft_consensus.cc:359] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.112987 11810 raft_consensus.cc:740] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:43.113742 11810 consensus_queue.cc:260] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
W20260709 12:30:43.114535 11100 leader_election.cc:336] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111)
I20260709 12:30:43.115129 11100 leader_election.cc:304] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:43.115671 11810 ts_tablet_manager.cc:1434] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:30:43.116546 11810 tablet_bootstrap.cc:492] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:43.116737 11694 raft_consensus.cc:2749] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:43.134810 11810 tablet_bootstrap.cc:492] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:43.135829 11810 tablet_bootstrap.cc:492] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:43.136507 11810 ts_tablet_manager.cc:1403] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 12:30:43.139346 11810 raft_consensus.cc:359] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:43.140026 11810 raft_consensus.cc:740] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:43.140865 11810 consensus_queue.cc:260] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:43.143136 11810 ts_tablet_manager.cc:1434] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:30:43.143957 11810 tablet_bootstrap.cc:492] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:43.159096 11810 tablet_bootstrap.cc:492] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:43.159943 11810 tablet_bootstrap.cc:492] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:43.160652 11810 ts_tablet_manager.cc:1403] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.006s
I20260709 12:30:43.161017  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.1:42037
I20260709 12:30:43.161181 11885 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.1:42037 every 8 connection(s)
I20260709 12:30:43.162858 11810 raft_consensus.cc:359] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.163444 11810 raft_consensus.cc:740] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:43.164129 11810 consensus_queue.cc:260] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.166395 11810 ts_tablet_manager.cc:1434] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.002s
I20260709 12:30:43.167238 11810 tablet_bootstrap.cc:492] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:43.181917 11781 raft_consensus.cc:493] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.182786 11781 raft_consensus.cc:515] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:43.190142 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d248b07c05b4adfb5ea2ebbc75aa249" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:43.198966 11694 raft_consensus.cc:493] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.199689 11694 raft_consensus.cc:515] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:43.201913 11690 raft_consensus.cc:493] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.202672 11690 raft_consensus.cc:515] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:43.207731 11690 leader_election.cc:290] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.235119 11807 raft_consensus.cc:493] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.253439 11807 raft_consensus.cc:515] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.257630 11807 leader_election.cc:290] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.258548 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6980a48384841e9a62db7f664aa7b0f" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:43.261222 11694 leader_election.cc:290] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.204674 11781 leader_election.cc:290] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.273322 11783 raft_consensus.cc:493] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.276968 11783 raft_consensus.cc:515] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.280030 11783 leader_election.cc:290] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.263716 11813 raft_consensus.cc:493] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.285218 11813 raft_consensus.cc:515] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.270172 11811 raft_consensus.cc:493] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.289722 11811 raft_consensus.cc:515] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.292678 11811 leader_election.cc:290] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:43.260107 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe8221281e348018871f179e00af23e" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:43.303117 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:43.306384 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:43.323338 11694 raft_consensus.cc:493] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.324393 11648 raft_consensus.cc:493] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.342303 11648 raft_consensus.cc:515] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.344883 11816 raft_consensus.cc:493] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.345961 11816 raft_consensus.cc:515] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.341504 11694 raft_consensus.cc:515] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.331337 11813 leader_election.cc:290] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.350363 11813 raft_consensus.cc:493] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.351058 11813 raft_consensus.cc:515] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.398447 11807 raft_consensus.cc:493] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.400183 11807 raft_consensus.cc:515] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.401254 11813 leader_election.cc:290] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.401773 11892 raft_consensus.cc:493] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.402415 11694 leader_election.cc:290] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.353894 11781 raft_consensus.cc:493] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.365842 11810 tablet_bootstrap.cc:492] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:43.402351 11892 raft_consensus.cc:515] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.404126 11816 leader_election.cc:290] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.405086 11810 tablet_bootstrap.cc:492] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:43.379577 11798 raft_consensus.cc:493] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
W20260709 12:30:43.398361 11099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:37545, user_credentials={real_user=slave}} blocked reactor thread for 156508us
I20260709 12:30:43.407879 11810 ts_tablet_manager.cc:1403] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.241s	user 0.061s	sys 0.090s
I20260709 12:30:43.407801 11892 leader_election.cc:290] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.411494 11810 raft_consensus.cc:359] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.412240 11810 raft_consensus.cc:740] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:43.413077 11810 consensus_queue.cc:260] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.414944 11810 ts_tablet_manager.cc:1434] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:30:43.415148 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d248b07c05b4adfb5ea2ebbc75aa249" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:43.415766 11209 raft_consensus.cc:2468] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:43.399439 11648 leader_election.cc:290] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:43.415853 11810 tablet_bootstrap.cc:492] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:43.416564 11798 raft_consensus.cc:515] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:43.404348 11781 raft_consensus.cc:515] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.418852 11886 heartbeater.cc:344] Connected to a master server at 127.2.157.62:39749
I20260709 12:30:43.419432 11886 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:43.420608 11886 heartbeater.cc:507] Master 127.2.157.62:39749 requested a full tablet report, sending...
I20260709 12:30:43.422889 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6980a48384841e9a62db7f664aa7b0f" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.402451 11807 leader_election.cc:290] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.425406 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe8221281e348018871f179e00af23e" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.426937 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d248b07c05b4adfb5ea2ebbc75aa249" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.428452 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbef020004b425daa18c14ea59972d7" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.430172 11816 raft_consensus.cc:493] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.430747 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cba067154b43f0819177986955daf5" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.430747 11816 raft_consensus.cc:515] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.432665 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7a31e74574166b261914cd71d423e" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.433223 11816 leader_election.cc:290] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.433586 11851 raft_consensus.cc:2468] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:43.440412 11816 raft_consensus.cc:493] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.448339 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6980a48384841e9a62db7f664aa7b0f" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:43.449318 11135 raft_consensus.cc:2468] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:43.449606 11648 raft_consensus.cc:493] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.450333 11648 raft_consensus.cc:515] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.451261 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d248b07c05b4adfb5ea2ebbc75aa249" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.446326 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29ac676c05840d384d97014df8fdffd" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:43.452558 11648 leader_election.cc:290] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:43.452718 11129 raft_consensus.cc:2468] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:43.456904 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf709305a2b4084a73fb3108f94c828" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.457144 11816 raft_consensus.cc:515] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.459079 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10383d0fa134e14b6756caf02036ddd" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.459614 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10383d0fa134e14b6756caf02036ddd" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:43.460213 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8af63f7be04dffb88a232a6d6f4c9e" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:43.461099 11024 leader_election.cc:304] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:43.461755 11783 raft_consensus.cc:493] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.461961 11054 raft_consensus.cc:2468] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:43.460302 11059 raft_consensus.cc:2468] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:43.440945 11099 leader_election.cc:304] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:43.459734 11816 leader_election.cc:290] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.462333 11783 raft_consensus.cc:515] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.466599 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c03f14392f45ba8f442cfec87fd85e" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:43.420574 11781 leader_election.cc:290] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.473275 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8af63f7be04dffb88a232a6d6f4c9e" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.473125 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cba067154b43f0819177986955daf5" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:43.471194 11172 leader_election.cc:304] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:43.468674 11901 raft_consensus.cc:493] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.437809 11798 leader_election.cc:290] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.480741 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29ac676c05840d384d97014df8fdffd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.468643 11783 leader_election.cc:290] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.481478 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf709305a2b4084a73fb3108f94c828" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:43.481597 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbef020004b425daa18c14ea59972d7" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:43.482350 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:43.482653 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.483047 11059 raft_consensus.cc:2468] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:43.483330 11855 raft_consensus.cc:2468] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:43.482373 11057 raft_consensus.cc:2468] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:43.487334 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6980a48384841e9a62db7f664aa7b0f" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.488525 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.489187 11855 raft_consensus.cc:2468] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:43.463960 11648 raft_consensus.cc:493] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.485409 11175 leader_election.cc:304] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:43.495666 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29ac676c05840d384d97014df8fdffd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:43.471735 11816 raft_consensus.cc:493] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.499706 11101 leader_election.cc:304] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:43.503670 11694 raft_consensus.cc:2804] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.490180 11648 raft_consensus.cc:515] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.507005 11694 raft_consensus.cc:493] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.501689 11811 raft_consensus.cc:493] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.508947 11811 raft_consensus.cc:515] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.509665 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7a31e74574166b261914cd71d423e" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:43.511113 11811 leader_election.cc:290] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:43.512154 11648 leader_election.cc:290] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:43.514993 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe8221281e348018871f179e00af23e" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:43.508363 11694 raft_consensus.cc:3060] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.515959 11135 raft_consensus.cc:2468] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:43.495010 11798 raft_consensus.cc:2804] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.517669 11024 leader_election.cc:304] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:43.518250 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcae59975bce4cefbe8718f31534067b" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:43.518867 11783 raft_consensus.cc:2804] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.519380 11783 raft_consensus.cc:493] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.519860 11783 raft_consensus.cc:3060] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.520916 10881 ts_manager.cc:194] Re-registered known tserver with Master: 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.523473 11899 raft_consensus.cc:2804] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.523933 11899 raft_consensus.cc:493] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.524293 11899 raft_consensus.cc:3060] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.525507 11648 raft_consensus.cc:493] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.526094 11648 raft_consensus.cc:515] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.492954 11901 raft_consensus.cc:515] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:43.522817 11781 raft_consensus.cc:2804] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.528378 11781 raft_consensus.cc:493] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.528765 11781 raft_consensus.cc:3060] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.528921 11648 leader_election.cc:290] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:43.529160 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cba067154b43f0819177986955daf5" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:43.507129 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
W20260709 12:30:43.539405 11174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:42037, user_credentials={real_user=slave}} blocked reactor thread for 54141us
I20260709 12:30:43.542007 11903 raft_consensus.cc:493] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.542634 11903 raft_consensus.cc:515] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
W20260709 12:30:43.545065 11174 leader_election.cc:343] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.544919 11894 raft_consensus.cc:493] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.517774 11798 raft_consensus.cc:493] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.546541 11174 leader_election.cc:304] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:43.507261 11816 raft_consensus.cc:515] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.529790 11129 raft_consensus.cc:2468] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:43.556309 11816 leader_election.cc:290] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.556490 11807 raft_consensus.cc:493] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.556854 11893 raft_consensus.cc:2804] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.557972 11900 raft_consensus.cc:493] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.559425 11894 raft_consensus.cc:515] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.547873 11798 raft_consensus.cc:3060] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.565527 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.567996 11204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:43.544920 11903 leader_election.cc:290] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.569710 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.569264 11899 raft_consensus.cc:515] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
W20260709 12:30:43.570478 11175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 85163.8us
I20260709 12:30:43.572371 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29ac676c05840d384d97014df8fdffd" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.594858 11024 leader_election.cc:304] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:43.573870 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.574570 11850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe8221281e348018871f179e00af23e" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.582917 11694 raft_consensus.cc:515] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.602620 11694 leader_election.cc:290] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.602962 11899 leader_election.cc:290] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.603464 11813 raft_consensus.cc:493] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.604056 11813 raft_consensus.cc:515] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
W20260709 12:30:43.593051 11099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:37545, user_credentials={real_user=slave}} blocked reactor thread for 102108us
W20260709 12:30:43.595961 11100 leader_election.cc:343] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.573128 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c03f14392f45ba8f442cfec87fd85e" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.592044 11816 raft_consensus.cc:2749] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:43.605105 11100 leader_election.cc:304] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:43.540627 11057 raft_consensus.cc:2468] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:43.606163 11204 raft_consensus.cc:2468] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
W20260709 12:30:43.606594 11100 leader_election.cc:343] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.604323 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:43.599967 11852 raft_consensus.cc:2468] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:43.607653 11694 raft_consensus.cc:2749] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:43.607116 11100 leader_election.cc:304] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:43.600770 11859 raft_consensus.cc:2468] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:43.592173 11893 raft_consensus.cc:493] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
W20260709 12:30:43.610411 11100 leader_election.cc:343] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:43.618810 11100 leader_election.cc:343] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.618888 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d248b07c05b4adfb5ea2ebbc75aa249" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:43.619714 11209 raft_consensus.cc:3060] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.619655 11100 leader_election.cc:304] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
W20260709 12:30:43.621273 11174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:42037, user_credentials={real_user=slave}} blocked reactor thread for 76241.8us
I20260709 12:30:43.626952 11694 raft_consensus.cc:493] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.610450 11892 raft_consensus.cc:493] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.627300 11209 raft_consensus.cc:2468] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 2.
I20260709 12:30:43.610352 11899 raft_consensus.cc:2749] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:43.627967 11694 raft_consensus.cc:515] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.596069 11900 raft_consensus.cc:515] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:43.594056 11807 raft_consensus.cc:515] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.626513 11895 raft_consensus.cc:2804] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.644690 11810 tablet_bootstrap.cc:492] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:43.630935 11099 leader_election.cc:304] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:43.619320 11893 raft_consensus.cc:3060] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.629755 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6b390078e79408a91ac1f52eaa9b4cd" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:43.635488 11904 raft_consensus.cc:2749] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:43.635356 11783 raft_consensus.cc:515] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.635921 11813 leader_election.cc:290] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.612915 11054 raft_consensus.cc:3060] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.661870 11912 raft_consensus.cc:493] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.662488 11912 raft_consensus.cc:515] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.662815 11894 leader_election.cc:290] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.639278 11892 raft_consensus.cc:515] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:43.664671 11912 leader_election.cc:290] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:43.665465 11892 leader_election.cc:290] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.637614 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:43.599247 11856 raft_consensus.cc:2468] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
W20260709 12:30:43.630410 11174 leader_election.cc:343] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.623920 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcae59975bce4cefbe8718f31534067b" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.626148 11901 leader_election.cc:290] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.636336 11175 leader_election.cc:304] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:43.661307 11783 leader_election.cc:290] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:43.668339 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a30a14e503d4acc89f1c6cf8b521e8a" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:43.670141 11206 raft_consensus.cc:2468] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:43.670614 11129 raft_consensus.cc:2468] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:43.676819 11900 leader_election.cc:290] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.677781 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cba067154b43f0819177986955daf5" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.672298 11694 leader_election.cc:290] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.669134 11690 raft_consensus.cc:2804] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:43.678784 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe8221281e348018871f179e00af23e" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:43.679086 11690 raft_consensus.cc:697] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:43.679579 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbef020004b425daa18c14ea59972d7" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.679947 11690 consensus_queue.cc:237] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
W20260709 12:30:43.680951 11026 leader_election.cc:343] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:43.682181 11026 leader_election.cc:343] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.643169 11895 raft_consensus.cc:493] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.683346 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e5dce93d14266abb8069bb2020135" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.683754 11895 raft_consensus.cc:3060] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.684141 11851 raft_consensus.cc:2468] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:43.683388 11807 leader_election.cc:290] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.686331 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c03f14392f45ba8f442cfec87fd85e" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:43.687000 11060 raft_consensus.cc:2468] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:43.688169 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcae59975bce4cefbe8718f31534067b" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:43.688191 11101 leader_election.cc:304] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:43.688984 11057 raft_consensus.cc:2468] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:43.689280 11807 raft_consensus.cc:2804] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.689666 11807 raft_consensus.cc:493] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.690047 11807 raft_consensus.cc:3060] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:30:43.690145 11174 leader_election.cc:343] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:43.690277 11175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 63471.8us
I20260709 12:30:43.690320 11907 raft_consensus.cc:493] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.691210 11175 leader_election.cc:304] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:43.691341 11907 raft_consensus.cc:515] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:43.691823 11101 leader_election.cc:304] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:43.692431 11175 leader_election.cc:304] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:43.692669 11694 raft_consensus.cc:2804] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:30:43.692961 11174 leader_election.cc:343] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.693243 11901 raft_consensus.cc:2804] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.690445 11816 raft_consensus.cc:2804] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.693791 11901 raft_consensus.cc:493] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.693967 11816 raft_consensus.cc:493] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.694317 11901 raft_consensus.cc:3060] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.694510 11910 raft_consensus.cc:2804] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.695003 11910 raft_consensus.cc:493] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.695350 11910 raft_consensus.cc:3060] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:30:43.693873 11174 leader_election.cc:343] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.675309 11810 tablet_bootstrap.cc:492] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:43.694435 11816 raft_consensus.cc:3060] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.697841 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:43.698225 11810 ts_tablet_manager.cc:1403] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.283s	user 0.028s	sys 0.008s
I20260709 12:30:43.698534 11060 raft_consensus.cc:2468] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:43.693010 11694 raft_consensus.cc:493] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.699510 11694 raft_consensus.cc:3060] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.693418 11907 leader_election.cc:290] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.701058 11810 raft_consensus.cc:359] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.703799 11810 raft_consensus.cc:740] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:43.708369 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
W20260709 12:30:43.709161 11100 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:42037, user_credentials={real_user=slave}} blocked reactor thread for 90419.4us
W20260709 12:30:43.710134 11100 leader_election.cc:343] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.710531 11100 leader_election.cc:304] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:43.709053 11135 raft_consensus.cc:2468] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
W20260709 12:30:43.711194 11026 leader_election.cc:343] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.711611 11026 leader_election.cc:304] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:43.711618 11100 leader_election.cc:304] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f
I20260709 12:30:43.709978 11810 consensus_queue.cc:260] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.706506 11172 leader_election.cc:304] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 
W20260709 12:30:43.713220 11100 leader_election.cc:343] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.710711 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e5dce93d14266abb8069bb2020135" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" is_pre_election: true
I20260709 12:30:43.715564 11813 raft_consensus.cc:2804] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.717115 11057 raft_consensus.cc:2468] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:43.717290 11813 raft_consensus.cc:493] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.717870 11813 raft_consensus.cc:3060] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.715874 11892 raft_consensus.cc:2749] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:43.730784 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.730938 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a30a14e503d4acc89f1c6cf8b521e8a" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.731294 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6b390078e79408a91ac1f52eaa9b4cd" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.731524 11858 raft_consensus.cc:2468] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:43.734221 11810 ts_tablet_manager.cc:1434] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
W20260709 12:30:43.737516 11174 leader_election.cc:343] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.760341 11810 tablet_bootstrap.cc:492] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:43.716531 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a30a14e503d4acc89f1c6cf8b521e8a" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:43.733155 11026 leader_election.cc:304] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:43.703563 11781 raft_consensus.cc:515] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.727397 11901 raft_consensus.cc:515] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.761817 11135 raft_consensus.cc:2468] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:43.764005 11783 raft_consensus.cc:2804] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.766394 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e5dce93d14266abb8069bb2020135" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.770040 11854 raft_consensus.cc:2468] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:43.770974 11781 leader_election.cc:290] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.765302 11798 raft_consensus.cc:515] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:43.771064 11895 raft_consensus.cc:515] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.772962 11798 leader_election.cc:290] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.774061 11694 raft_consensus.cc:515] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.774331 11175 leader_election.cc:304] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:43.775527 11798 raft_consensus.cc:2804] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.775833 11694 leader_election.cc:290] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.776201 11175 leader_election.cc:304] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:43.777575 11900 raft_consensus.cc:2804] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.778056 11900 raft_consensus.cc:493] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.778417 11900 raft_consensus.cc:3060] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.779022 10881 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51898
I20260709 12:30:43.767558 11026 leader_election.cc:304] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:43.769407 11783 raft_consensus.cc:493] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
W20260709 12:30:43.777624 11025 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:37545, user_credentials={real_user=slave}} blocked reactor thread for 154523us
I20260709 12:30:43.783398 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e5dce93d14266abb8069bb2020135" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" is_pre_election: true
I20260709 12:30:43.737185 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.785027 11783 raft_consensus.cc:3060] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.788424 11054 raft_consensus.cc:2468] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 2.
I20260709 12:30:43.790292 11101 leader_election.cc:304] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:43.791149 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcae59975bce4cefbe8718f31534067b" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:43.791752 11057 raft_consensus.cc:3060] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.795564 11910 raft_consensus.cc:515] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.796720 11886 heartbeater.cc:499] Master 127.2.157.62:39749 was elected leader, sending a full tablet report...
I20260709 12:30:43.797995 11893 raft_consensus.cc:515] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.801151 11059 raft_consensus.cc:2393] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a96b33d3dcf7432e904439b5be66dee1 in current term 2: Already voted for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in this term.
I20260709 12:30:43.775911 11798 raft_consensus.cc:493] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.804615 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe8221281e348018871f179e00af23e" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:43.804104 11807 raft_consensus.cc:515] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.805311 11131 raft_consensus.cc:3060] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.807044 11807 leader_election.cc:290] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.799995 11899 raft_consensus.cc:2804] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:43.804874 11101 leader_election.cc:304] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:43.799919 11895 leader_election.cc:290] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:43.808367 11813 raft_consensus.cc:515] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.809343 11906 raft_consensus.cc:2764] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:30:43.809801 11912 raft_consensus.cc:493] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.804913 11798 raft_consensus.cc:3060] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.797739 11910 leader_election.cc:290] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.814100 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbef020004b425daa18c14ea59972d7" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:43.836198 11912 raft_consensus.cc:515] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.817854 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:43.819123 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcae59975bce4cefbe8718f31534067b" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.818794 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.842696 11858 raft_consensus.cc:2468] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 1.
I20260709 12:30:43.818288 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d248b07c05b4adfb5ea2ebbc75aa249" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:43.843516 11813 leader_election.cc:290] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.821375 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c03f14392f45ba8f442cfec87fd85e" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.820984 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a30a14e503d4acc89f1c6cf8b521e8a" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:43.824662 11900 raft_consensus.cc:515] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.826117 11855 raft_consensus.cc:2468] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 1.
I20260709 12:30:43.827003 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcae59975bce4cefbe8718f31534067b" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:43.839792 11129 raft_consensus.cc:2468] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 1.
I20260709 12:30:43.739619 11911 raft_consensus.cc:2804] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.848456 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7a31e74574166b261914cd71d423e" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:43.847625 11911 raft_consensus.cc:493] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.828234 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c03f14392f45ba8f442cfec87fd85e" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:43.849529 11911 raft_consensus.cc:3060] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.827029 10881 catalog_manager.cc:5697] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 2 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:43.828197 11057 raft_consensus.cc:2468] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 2.
I20260709 12:30:43.851542 11798 raft_consensus.cc:515] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:43.832939 11899 raft_consensus.cc:697] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:43.853684 11798 leader_election.cc:290] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.853402 11899 consensus_queue.cc:237] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:43.855132 11209 raft_consensus.cc:2393] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03cdbc3ec1ef4354bd6ec49958026f5f in current term 2: Already voted for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in this term.
I20260709 12:30:43.819603 11816 raft_consensus.cc:515] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
W20260709 12:30:43.838716 11172 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:44703, user_credentials={real_user=slave}} blocked reactor thread for 132280us
I20260709 12:30:43.857075 11900 leader_election.cc:290] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.714887 11811 raft_consensus.cc:2749] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:43.840965 11854 raft_consensus.cc:3060] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.842154 11912 leader_election.cc:290] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:43.829401 11131 raft_consensus.cc:2468] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 2.
I20260709 12:30:43.779024 11901 leader_election.cc:290] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:43.846462 11100 leader_election.cc:304] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:43.835798 11893 leader_election.cc:290] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
W20260709 12:30:43.831583 11026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:42037, user_credentials={real_user=slave}} blocked reactor thread for 44625.2us
W20260709 12:30:43.836913 11175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 59624.9us
I20260709 12:30:43.834965 11694 raft_consensus.cc:3060] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.836126 11783 raft_consensus.cc:515] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
W20260709 12:30:43.862731 11100 leader_election.cc:343] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:43.866544 11100 leader_election.cc:343] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.866832 11100 leader_election.cc:304] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5
W20260709 12:30:43.867650 11100 leader_election.cc:343] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:43.868196 11100 leader_election.cc:343] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:43.868819 11100 leader_election.cc:343] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.849092 11852 raft_consensus.cc:3060] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.865145 11026 leader_election.cc:304] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:43.863081 11807 raft_consensus.cc:2804] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.869549 11813 raft_consensus.cc:2749] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:43.872475 11811 raft_consensus.cc:2804] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.871640 11807 raft_consensus.cc:493] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.880867 11172 leader_election.cc:304] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:43.888337 11694 raft_consensus.cc:2749] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:43.883801 11807 raft_consensus.cc:3060] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.882972 11811 raft_consensus.cc:493] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.883968 11816 leader_election.cc:290] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
W20260709 12:30:43.896631 11100 leader_election.cc:343] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:43.902727 11174 leader_election.cc:343] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.899639 11057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8af63f7be04dffb88a232a6d6f4c9e" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:43.902019 11060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7a31e74574166b261914cd71d423e" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:43.902005 11101 leader_election.cc:304] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:43.913420 11060 raft_consensus.cc:3060] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.913151 11057 raft_consensus.cc:3060] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.898140 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:43.914386 11208 raft_consensus.cc:2393] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 03cdbc3ec1ef4354bd6ec49958026f5f in current term 2: Already voted for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in this term.
I20260709 12:30:43.888829 11172 leader_election.cc:304] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:43.898178 11059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:43.899020 11061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2c03f14392f45ba8f442cfec87fd85e" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:43.916848 11061 raft_consensus.cc:3060] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.906250 11024 leader_election.cc:304] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
W20260709 12:30:43.894258 11026 leader_election.cc:343] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:43.899263 11811 raft_consensus.cc:3060] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.921990 11648 raft_consensus.cc:2804] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.922392 11648 raft_consensus.cc:493] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.922752 11648 raft_consensus.cc:3060] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.925228 11057 raft_consensus.cc:2468] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 2.
I20260709 12:30:43.927256 11024 leader_election.cc:304] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:43.931167 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29ac676c05840d384d97014df8fdffd" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:43.888453 11798 raft_consensus.cc:2804] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:43.904502 11053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:43.905598 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10383d0fa134e14b6756caf02036ddd" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:43.932917 11175 leader_election.cc:304] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:43.908979 11783 leader_election.cc:290] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:43.899462 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf709305a2b4084a73fb3108f94c828" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:43.946790 11054 raft_consensus.cc:3060] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.904855 11052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e5dce93d14266abb8069bb2020135" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:43.947511 11052 raft_consensus.cc:3060] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.950119 11905 raft_consensus.cc:2804] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:43.955467 11060 raft_consensus.cc:2468] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 2.
I20260709 12:30:43.957360 11101 leader_election.cc:304] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:43.908751 11854 raft_consensus.cc:2468] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 2.
I20260709 12:30:43.903788 11852 raft_consensus.cc:2468] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 2.
I20260709 12:30:43.943770 11056 raft_consensus.cc:3060] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.943645 11133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7a31e74574166b261914cd71d423e" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1" is_pre_election: true
I20260709 12:30:43.934594 11909 raft_consensus.cc:2804] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:43.959031 11916 raft_consensus.cc:2804] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:43.958434 11135 raft_consensus.cc:2468] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 2.
W20260709 12:30:43.960685 11026 leader_election.cc:343] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:44.007582 11026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.1:42037, user_credentials={real_user=slave}} blocked reactor thread for 46924.4us
W20260709 12:30:44.008307 11026 leader_election.cc:343] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:44.009214 11026 leader_election.cc:304] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:43.916834 11131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6980a48384841e9a62db7f664aa7b0f" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:43.940797 11798 raft_consensus.cc:493] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:43.992614 11053 raft_consensus.cc:2393] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f856f4709042d9b3ce1348bdfb2ad5 in current term 2: Already voted for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in this term.
I20260709 12:30:43.994814 11129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cba067154b43f0819177986955daf5" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:44.005762 11061 raft_consensus.cc:2468] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 2.
I20260709 12:30:43.940289 11906 raft_consensus.cc:2804] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:30:44.020081 11026 leader_election.cc:343] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:44.027570 11906 raft_consensus.cc:697] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:44.030640 11026 leader_election.cc:304] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:44.019236 11131 raft_consensus.cc:3060] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:44.031561 11914 raft_consensus.cc:2749] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:44.031342 11911 raft_consensus.cc:515] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:44.031172 11906 consensus_queue.cc:237] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:44.019481 11798 raft_consensus.cc:3060] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:44.034608 11911 leader_election.cc:290] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:44.011430 11024 leader_election.cc:304] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:44.041821 11914 raft_consensus.cc:2804] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:44.042588 11914 raft_consensus.cc:697] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:44.043520 11914 consensus_queue.cc:237] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
W20260709 12:30:44.046422 11172 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:44703, user_credentials={real_user=slave}} blocked reactor thread for 103207us
I20260709 12:30:43.992614 11919 raft_consensus.cc:2804] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:44.036237 11807 raft_consensus.cc:515] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
W20260709 12:30:44.065307 11099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:37545, user_credentials={real_user=slave}} blocked reactor thread for 129272us
I20260709 12:30:44.067708 11905 raft_consensus.cc:697] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:44.069044 11905 consensus_queue.cc:237] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:44.077000 11810 tablet_bootstrap.cc:492] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:44.051857 11919 raft_consensus.cc:493] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:44.085389 11810 tablet_bootstrap.cc:492] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:44.051551 11129 raft_consensus.cc:3060] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:44.084431 11919 raft_consensus.cc:3060] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:44.086406 11810 ts_tablet_manager.cc:1403] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.326s	user 0.018s	sys 0.012s
I20260709 12:30:44.055773 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6980a48384841e9a62db7f664aa7b0f" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.105192 11916 raft_consensus.cc:697] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:44.107642 11054 raft_consensus.cc:2468] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 2.
I20260709 12:30:44.109651 11860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8af63f7be04dffb88a232a6d6f4c9e" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.086804 11131 raft_consensus.cc:2468] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 2.
I20260709 12:30:44.111291 11052 raft_consensus.cc:2468] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 2.
I20260709 12:30:44.111720 11807 leader_election.cc:290] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:44.112453 11810 raft_consensus.cc:359] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:44.135846 11810 raft_consensus.cc:740] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:44.135557 11893 raft_consensus.cc:2764] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:30:44.129727 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6b390078e79408a91ac1f52eaa9b4cd" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:44.137730 11130 raft_consensus.cc:3060] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:44.115785 11101 leader_election.cc:304] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:44.118624 11916 consensus_queue.cc:237] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
W20260709 12:30:44.123560 11174 leader_election.cc:343] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:44.150394 11174 leader_election.cc:343] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:44.123970 11859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e5dce93d14266abb8069bb2020135" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.125257 11798 raft_consensus.cc:515] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:44.127471 11811 raft_consensus.cc:515] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:44.130658 11648 raft_consensus.cc:515] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:44.132220 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c10383d0fa134e14b6756caf02036ddd" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.134030 11852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6b390078e79408a91ac1f52eaa9b4cd" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.146062 11810 consensus_queue.cc:260] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:44.148442 11175 leader_election.cc:304] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
W20260709 12:30:44.224611 11099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:37545, user_credentials={real_user=slave}} blocked reactor thread for 76695.6us
I20260709 12:30:44.158198 11859 raft_consensus.cc:3060] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:30:44.259599 11024 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:44703, user_credentials={real_user=slave}} blocked reactor thread for 104602us
I20260709 12:30:44.153609 11904 raft_consensus.cc:2804] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:44.261643 11059 raft_consensus.cc:2393] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f856f4709042d9b3ce1348bdfb2ad5 in current term 2: Already voted for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in this term.
W20260709 12:30:44.263149 11175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 114809us
I20260709 12:30:44.271548 11175 leader_election.cc:304] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:44.274631 11810 ts_tablet_manager.cc:1434] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.185s	user 0.007s	sys 0.011s
I20260709 12:30:44.275671 11810 tablet_bootstrap.cc:492] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:44.276767 11900 raft_consensus.cc:2804] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:30:44.279516 11174 leader_election.cc:343] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:44.274392 11056 raft_consensus.cc:2468] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 2.
I20260709 12:30:44.286260 11900 raft_consensus.cc:697] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:44.287700 11900 consensus_queue.cc:237] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:44.291843 11648 leader_election.cc:290] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Requested vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:44.296415 11924 raft_consensus.cc:2804] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:44.297284 11924 raft_consensus.cc:697] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:44.298529 11924 consensus_queue.cc:237] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:44.300890 11130 raft_consensus.cc:2468] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 2.
I20260709 12:30:44.304930 11811 leader_election.cc:290] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:44.313593 11798 leader_election.cc:290] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:44.256764 11909 raft_consensus.cc:697] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:44.323565 11208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:44.324456 11208 raft_consensus.cc:2393] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 03cdbc3ec1ef4354bd6ec49958026f5f in current term 2: Already voted for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in this term.
W20260709 12:30:44.311638 11921 log.cc:927] Time spent T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 12:30:44.336432 11919 raft_consensus.cc:515] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:44.338701 11919 leader_election.cc:290] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
I20260709 12:30:44.342022 11854 raft_consensus.cc:1275] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Refusing update from remote peer a96b33d3dcf7432e904439b5be66dee1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.343098 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67cba067154b43f0819177986955daf5" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.355163 11172 leader_election.cc:304] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:44.359045 11909 consensus_queue.cc:237] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
W20260709 12:30:44.362936 11172 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:44703, user_credentials={real_user=slave}} blocked reactor thread for 233558us
I20260709 12:30:44.370431 11204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:44.370544 11855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "a96b33d3dcf7432e904439b5be66dee1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.371299 11855 raft_consensus.cc:3060] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:44.372776 11854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.373476 11854 raft_consensus.cc:3060] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:44.327780 11129 raft_consensus.cc:2468] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 2.
I20260709 12:30:44.375355 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29ac676c05840d384d97014df8fdffd" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.375787 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a30a14e503d4acc89f1c6cf8b521e8a" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:44.376376 11130 raft_consensus.cc:3060] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:44.376528 11858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.377169 11858 raft_consensus.cc:3060] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:44.378258 11850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7a31e74574166b261914cd71d423e" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574" is_pre_election: true
I20260709 12:30:44.379091 11850 raft_consensus.cc:2393] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 03cdbc3ec1ef4354bd6ec49958026f5f in current term 2: Already voted for candidate a96b33d3dcf7432e904439b5be66dee1 in this term.
I20260709 12:30:44.379891 11850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbef020004b425daa18c14ea59972d7" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.378281 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:44.381845 11126 raft_consensus.cc:2393] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f856f4709042d9b3ce1348bdfb2ad5 in current term 2: Already voted for candidate a96b33d3dcf7432e904439b5be66dee1 in this term.
I20260709 12:30:44.371301 11204 raft_consensus.cc:2393] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a96b33d3dcf7432e904439b5be66dee1 in current term 2: Already voted for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in this term.
I20260709 12:30:44.390528 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.391794 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dff538bcd7e40a796271ede9c45aab6" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.392334 11918 raft_consensus.cc:2804] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:44.392894 11918 raft_consensus.cc:697] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:44.392998 11851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a30a14e503d4acc89f1c6cf8b521e8a" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.393771 11918 consensus_queue.cc:237] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
W20260709 12:30:44.397671 11174 leader_election.cc:343] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:44.401199 11204 raft_consensus.cc:1275] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Refusing update from remote peer a96b33d3dcf7432e904439b5be66dee1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.402006 11856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef715190ad3b417aa8cb7dba1f2853b6" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.406342 11857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bf709305a2b4084a73fb3108f94c828" candidate_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "61218d0202f44940b61185f640880574"
I20260709 12:30:44.408663 11172 leader_election.cc:304] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:44.410264 11130 raft_consensus.cc:2468] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 2.
I20260709 12:30:44.412503 11172 leader_election.cc:304] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:44.425310 11855 raft_consensus.cc:2468] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a96b33d3dcf7432e904439b5be66dee1 in term 2.
I20260709 12:30:44.409158 10879 catalog_manager.cc:5697] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 2 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
W20260709 12:30:44.426362 11101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 111411us
W20260709 12:30:44.430701 11174 leader_election.cc:343] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:44.436290 11904 raft_consensus.cc:697] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:44.441984 11172 leader_election.cc:304] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5, a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:44.427505 11907 raft_consensus.cc:2804] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:44.442216 11174 leader_election.cc:304] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:44.427312 11816 raft_consensus.cc:2749] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:44.450949 11052 raft_consensus.cc:1275] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Refusing update from remote peer a96b33d3dcf7432e904439b5be66dee1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.437292 11904 consensus_queue.cc:237] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:44.455740 11940 consensus_queue.cc:1048] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 12:30:44.463773 11100 consensus_peers.cc:597] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:44.464332 11026 leader_election.cc:343] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:44.466058 11174 leader_election.cc:343] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:44.446175 11910 raft_consensus.cc:2804] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:44.468863 11175 leader_election.cc:304] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:44.471148 11813 consensus_queue.cc:1048] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.447902 11903 raft_consensus.cc:2749] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:44.477176 11100 leader_election.cc:304] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
W20260709 12:30:44.478806 11026 leader_election.cc:343] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:44.482528 11026 leader_election.cc:343] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:44.483636 11910 raft_consensus.cc:697] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:44.484910 11910 consensus_queue.cc:237] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:44.487280 11024 leader_election.cc:304] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:44.490816 11858 raft_consensus.cc:2468] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 2.
I20260709 12:30:44.496717 11130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbef020004b425daa18c14ea59972d7" candidate_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:44.506340 11130 raft_consensus.cc:3060] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:44.507531 11941 raft_consensus.cc:2804] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:44.491588 11816 raft_consensus.cc:2804] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:44.508723 11816 raft_consensus.cc:697] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:44.509760 11942 raft_consensus.cc:2804] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:44.510396 11942 raft_consensus.cc:697] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:44.467319 11907 raft_consensus.cc:697] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 LEADER]: Becoming Leader. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:44.511323 11942 consensus_queue.cc:237] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:44.511744 11907 consensus_queue.cc:237] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:44.508129 11941 raft_consensus.cc:697] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Becoming Leader. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:44.528652 11175 leader_election.cc:304] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:44.534868 11810 tablet_bootstrap.cc:492] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:44.535480 11135 raft_consensus.cc:1275] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 03cdbc3ec1ef4354bd6ec49958026f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.509662 11816 consensus_queue.cc:237] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:44.538900 11798 raft_consensus.cc:2749] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:44.553442 11810 tablet_bootstrap.cc:492] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:44.554243 11810 ts_tablet_manager.cc:1403] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.279s	user 0.027s	sys 0.044s
I20260709 12:30:44.556943 11810 raft_consensus.cc:359] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:44.557760 11810 raft_consensus.cc:740] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:44.558504 11810 consensus_queue.cc:260] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:44.571368 11810 ts_tablet_manager.cc:1434] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:30:44.573688 11810 tablet_bootstrap.cc:492] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:44.575274 11940 consensus_queue.cc:1048] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.551622 11859 raft_consensus.cc:2468] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f856f4709042d9b3ce1348bdfb2ad5 in term 2.
I20260709 12:30:44.546824 11894 consensus_queue.cc:1048] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:30:44.590305 11129 raft_consensus.cc:1275] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 03cdbc3ec1ef4354bd6ec49958026f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.591660 11941 consensus_queue.cc:237] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:44.594123 11914 consensus_queue.cc:1048] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:30:44.598737 11175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 68401.4us
W20260709 12:30:44.643867 11175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:46695, user_credentials={real_user=slave}} blocked reactor thread for 44166.2us
W20260709 12:30:44.646013 11099 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.4:37545, user_credentials={real_user=slave}} blocked reactor thread for 44663.1us
W20260709 12:30:44.654587 11174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:42037, user_credentials={real_user=slave}} blocked reactor thread for 55854.3us
W20260709 12:30:44.679268 11934 log.cc:927] Time spent T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f: Append to log took a long time: real 0.349s	user 0.003s	sys 0.001s
I20260709 12:30:44.681083 11026 leader_election.cc:304] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
W20260709 12:30:44.684770 11026 consensus_peers.cc:597] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:44.696086 11130 raft_consensus.cc:2468] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 2.
I20260709 12:30:44.698275 11024 leader_election.cc:304] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, a96b33d3dcf7432e904439b5be66dee1; no voters: 61218d0202f44940b61185f640880574
I20260709 12:30:44.688476 11912 raft_consensus.cc:2804] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:44.719558 11855 raft_consensus.cc:3060] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:30:44.724673 11945 log.cc:927] Time spent T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:30:44.728406 11059 raft_consensus.cc:1275] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Refusing update from remote peer 85f856f4709042d9b3ce1348bdfb2ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.733342 11024 leader_election.cc:304] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:44.711439 11894 raft_consensus.cc:2804] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:44.710816 11912 raft_consensus.cc:697] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:44.736030 11901 consensus_queue.cc:1048] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:30:44.749172 11912 consensus_queue.cc:237] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:44.753003 11913 raft_consensus.cc:2749] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:44.754448 11894 raft_consensus.cc:697] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:44.755497 11894 consensus_queue.cc:237] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
W20260709 12:30:44.756281 11026 consensus_peers.cc:597] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:44.756943 11026 consensus_peers.cc:597] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:44.766819 11854 raft_consensus.cc:2468] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03cdbc3ec1ef4354bd6ec49958026f5f in term 2.
I20260709 12:30:44.769651 11026 leader_election.cc:304] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 85f856f4709042d9b3ce1348bdfb2ad5
I20260709 12:30:44.770838 11895 raft_consensus.cc:2804] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:44.771337 11895 raft_consensus.cc:697] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Becoming Leader. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:44.772126 11895 consensus_queue.cc:237] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:44.787065 11810 tablet_bootstrap.cc:492] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:44.788467 11855 raft_consensus.cc:1275] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Refusing update from remote peer 85f856f4709042d9b3ce1348bdfb2ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:30:44.796398 11174 consensus_peers.cc:597] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:44.808907 11901 consensus_queue.cc:1048] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:30:44.828994 11810 tablet_bootstrap.cc:492] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:44.830708 11810 ts_tablet_manager.cc:1403] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.257s	user 0.019s	sys 0.002s
I20260709 12:30:44.824453 11052 raft_consensus.cc:1275] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Refusing update from remote peer a96b33d3dcf7432e904439b5be66dee1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.870318 11810 raft_consensus.cc:359] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:44.873782 11810 raft_consensus.cc:740] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:44.919209 11810 consensus_queue.cc:260] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:44.969451 11810 ts_tablet_manager.cc:1434] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.138s	user 0.011s	sys 0.000s
I20260709 12:30:44.951494 10881 catalog_manager.cc:5697] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 2 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:44.974982 10881 catalog_manager.cc:5697] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 2 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:44.977152 11810 tablet_bootstrap.cc:492] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:44.977705 10881 catalog_manager.cc:5697] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 2 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:44.983089 10881 catalog_manager.cc:5697] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 2 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } }
I20260709 12:30:44.986446 10881 catalog_manager.cc:5697] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 2 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:44.987996 10881 catalog_manager.cc:5697] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3). New cstate: current_term: 2 leader_uuid: "a96b33d3dcf7432e904439b5be66dee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: HEALTHY } } }
W20260709 12:30:45.021097 11966 log.cc:927] Time spent T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f: Append to log took a long time: real 0.096s	user 0.001s	sys 0.001s
W20260709 12:30:45.022933 11174 consensus_peers.cc:597] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:45.032658 11026 consensus_peers.cc:597] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:45.035761 11100 consensus_peers.cc:597] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:45.046475 11100 consensus_peers.cc:597] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:45.061106 11174 consensus_peers.cc:597] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:45.063356 11852 raft_consensus.cc:1275] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Refusing update from remote peer a96b33d3dcf7432e904439b5be66dee1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.070994 11933 consensus_queue.cc:1048] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:45.076428 11859 raft_consensus.cc:3060] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:30:45.082904 11100 consensus_peers.cc:597] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:45.087136 11810 tablet_bootstrap.cc:492] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.093060 11810 tablet_bootstrap.cc:492] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.093751 11810 ts_tablet_manager.cc:1403] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.123s	user 0.038s	sys 0.014s
I20260709 12:30:45.096637 11810 raft_consensus.cc:359] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:45.097504 11810 raft_consensus.cc:740] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:45.098299 11810 consensus_queue.cc:260] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:45.091858 11859 raft_consensus.cc:1275] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Refusing update from remote peer a96b33d3dcf7432e904439b5be66dee1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.102695 11810 ts_tablet_manager.cc:1434] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:30:45.103804 11810 tablet_bootstrap.cc:492] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:45.107779 11933 consensus_queue.cc:1048] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:45.110678 11056 raft_consensus.cc:1275] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Refusing update from remote peer a96b33d3dcf7432e904439b5be66dee1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.112972 11940 consensus_queue.cc:1048] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:30:45.117338 11026 consensus_peers.cc:597] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:45.120651 11130 raft_consensus.cc:1275] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 85f856f4709042d9b3ce1348bdfb2ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.122490 11126 raft_consensus.cc:1275] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 85f856f4709042d9b3ce1348bdfb2ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.128332 11855 raft_consensus.cc:1275] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Refusing update from remote peer a96b33d3dcf7432e904439b5be66dee1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.125370 11933 consensus_queue.cc:1048] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:30:45.136823 11915 consensus_queue.cc:1048] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:30:45.139483 11100 consensus_peers.cc:597] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:45.177937 11810 tablet_bootstrap.cc:492] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.179021 11810 tablet_bootstrap.cc:492] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.179747 11810 ts_tablet_manager.cc:1403] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.076s	user 0.025s	sys 0.037s
I20260709 12:30:45.185626 10882 catalog_manager.cc:5697] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 2 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:45.189087 11810 raft_consensus.cc:359] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:45.189849 11810 raft_consensus.cc:740] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:45.192696 11810 consensus_queue.cc:260] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:45.197589 11810 ts_tablet_manager.cc:1434] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 12:30:45.198452 11810 tablet_bootstrap.cc:492] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:45.200394 11133 raft_consensus.cc:1275] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 03cdbc3ec1ef4354bd6ec49958026f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.206272 11206 raft_consensus.cc:1275] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Refusing update from remote peer 03cdbc3ec1ef4354bd6ec49958026f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.208433 11894 consensus_queue.cc:1048] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:30:45.214148 11100 consensus_peers.cc:597] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:45.218371 11100 consensus_peers.cc:597] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:45.218791 11918 consensus_queue.cc:1048] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:45.222052 11919 consensus_queue.cc:1048] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:45.235610 11131 raft_consensus.cc:1275] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 85f856f4709042d9b3ce1348bdfb2ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.236529 11854 raft_consensus.cc:1275] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Refusing update from remote peer 03cdbc3ec1ef4354bd6ec49958026f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.240898 11894 consensus_queue.cc:1048] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:30:45.247510 11174 consensus_peers.cc:597] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:45.249017 11174 consensus_peers.cc:597] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:45.249770 11174 consensus_peers.cc:597] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:45.251945 11174 consensus_peers.cc:597] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:45.261190 10879 catalog_manager.cc:5697] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 2 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:45.263976 10879 catalog_manager.cc:5697] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 2 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:45.266256 10879 catalog_manager.cc:5697] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 2 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } }
W20260709 12:30:45.285673 11026 consensus_peers.cc:597] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:45.294348 11207 raft_consensus.cc:1275] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Refusing update from remote peer 03cdbc3ec1ef4354bd6ec49958026f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:30:45.384815 11026 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.1:42037, user_credentials={real_user=slave}} blocked reactor thread for 99239.7us
I20260709 12:30:45.387583 10879 catalog_manager.cc:5697] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2). New cstate: current_term: 2 leader_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:45.388916 11895 consensus_queue.cc:1048] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:45.317422 11056 raft_consensus.cc:1275] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Refusing update from remote peer 85f856f4709042d9b3ce1348bdfb2ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.348654 11203 raft_consensus.cc:1275] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Refusing update from remote peer a96b33d3dcf7432e904439b5be66dee1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.358707 11059 raft_consensus.cc:1275] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Refusing update from remote peer 85f856f4709042d9b3ce1348bdfb2ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.363879 11054 raft_consensus.cc:1275] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Refusing update from remote peer a96b33d3dcf7432e904439b5be66dee1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.398850 11933 consensus_queue.cc:1048] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:45.414055 11859 raft_consensus.cc:1275] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Refusing update from remote peer 03cdbc3ec1ef4354bd6ec49958026f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.415563 11893 consensus_queue.cc:1048] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:45.438685 11783 consensus_queue.cc:1048] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:45.452270 11924 consensus_queue.cc:1048] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:45.460170 11919 consensus_queue.cc:1048] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:45.465420 11919 consensus_queue.cc:1048] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:45.491261 11810 tablet_bootstrap.cc:492] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.492327 11810 tablet_bootstrap.cc:492] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.493016 11810 ts_tablet_manager.cc:1403] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.295s	user 0.064s	sys 0.149s
I20260709 12:30:45.495702 11810 raft_consensus.cc:359] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:45.496439 11810 raft_consensus.cc:740] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
W20260709 12:30:45.497004 11026 consensus_peers.cc:597] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:45.497203 11810 consensus_queue.cc:260] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
W20260709 12:30:45.497722 11026 consensus_peers.cc:597] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:45.499624 11810 ts_tablet_manager.cc:1434] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:30:45.500427 11810 tablet_bootstrap.cc:492] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:45.504004 11129 raft_consensus.cc:1275] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 03cdbc3ec1ef4354bd6ec49958026f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.512516 11056 raft_consensus.cc:1275] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Refusing update from remote peer 85f856f4709042d9b3ce1348bdfb2ad5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:45.522581 11810 tablet_bootstrap.cc:492] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.523589 11810 tablet_bootstrap.cc:492] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.524416 11810 ts_tablet_manager.cc:1403] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.009s
I20260709 12:30:45.526651 11895 consensus_queue.cc:1048] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:45.527601 11810 raft_consensus.cc:359] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:45.528568 11810 raft_consensus.cc:740] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:45.529599 11810 consensus_queue.cc:260] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:45.532440 11810 ts_tablet_manager.cc:1434] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:30:45.533475 11810 tablet_bootstrap.cc:492] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:45.535852 11919 consensus_queue.cc:1048] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:45.537894 11933 consensus_queue.cc:1048] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:30:45.547621 11026 consensus_peers.cc:597] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:45.595523 11810 tablet_bootstrap.cc:492] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.606014 11810 tablet_bootstrap.cc:492] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.607596 11810 ts_tablet_manager.cc:1403] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.000s
I20260709 12:30:45.611159 11810 raft_consensus.cc:359] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:45.630582 11810 raft_consensus.cc:740] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:45.631830 11810 consensus_queue.cc:260] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:45.643818 11810 ts_tablet_manager.cc:1434] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:30:45.644659 11810 tablet_bootstrap.cc:492] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:45.677683 10881 catalog_manager.cc:5697] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 2 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } }
I20260709 12:30:45.697932 11810 tablet_bootstrap.cc:492] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.697593 10879 catalog_manager.cc:5697] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 2 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } }
I20260709 12:30:45.698802 11810 tablet_bootstrap.cc:492] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.699411 11810 ts_tablet_manager.cc:1403] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.007s
I20260709 12:30:45.699790 10879 catalog_manager.cc:5697] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 2 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } }
I20260709 12:30:45.700932 10879 catalog_manager.cc:5697] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 2 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } }
I20260709 12:30:45.701509 11810 raft_consensus.cc:359] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:45.702194 11810 raft_consensus.cc:740] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:45.702831 11810 consensus_queue.cc:260] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:45.704835 11810 ts_tablet_manager.cc:1434] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:30:45.705540 11810 tablet_bootstrap.cc:492] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:45.725461 10880 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51898 (request call id 2) took 1412 ms. Trace:
I20260709 12:30:45.726006 10880 rpcz_store.cc:276] 0709 12:30:44.313321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:30:44.313467 (+   146us) service_pool.cc:224] Handling call
0709 12:30:44.812715 (+499248us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540069bc54. stack: 00007fe04eeb8343 00007fe04eeb8240 00007fe04e8471d4 00007fe058585304 00007fe058585299 00007fe051f41090 00007fe051fdff3a 00007fe057d95e9c 00007fe057e9404e 00007fe0563552a4 00007fe056355232 00007fe056355161 00007fe0563550dc 00007fe056354392 00007fe05031248c 00007fe0503118c6
0709 12:30:45.725360 (+912645us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31420,"reported_tablets":45,"spinlock_wait_cycles":492572928}
I20260709 12:30:45.737526 11810 tablet_bootstrap.cc:492] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.738715 11810 tablet_bootstrap.cc:492] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.739476 11810 ts_tablet_manager.cc:1403] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.007s
I20260709 12:30:45.742202 11810 raft_consensus.cc:359] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:45.741745 10882 catalog_manager.cc:5697] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 2 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:45.743047 11810 raft_consensus.cc:740] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:45.743773 11810 consensus_queue.cc:260] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:45.744168 10882 catalog_manager.cc:5697] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 reported cstate change: term changed from 1 to 2, leader changed from 61218d0202f44940b61185f640880574 (127.2.157.1) to 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4). New cstate: current_term: 2 leader_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:45.747875 11810 ts_tablet_manager.cc:1434] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:30:45.749538 11810 tablet_bootstrap.cc:492] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574: Bootstrap starting.
W20260709 12:30:45.773653 11026 consensus_peers.cc:597] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:30:45.773842 11852 raft_consensus.cc:3060] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:45.773721 11810 tablet_bootstrap.cc:492] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.775591 11810 tablet_bootstrap.cc:492] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.776539 11810 ts_tablet_manager.cc:1403] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.000s
I20260709 12:30:45.779593 11810 raft_consensus.cc:359] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:45.780443 11810 raft_consensus.cc:740] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:45.781205 11810 consensus_queue.cc:260] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:45.783464 11810 ts_tablet_manager.cc:1434] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:30:45.784324 11810 tablet_bootstrap.cc:492] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:45.804435 11810 tablet_bootstrap.cc:492] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.805446 11810 tablet_bootstrap.cc:492] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.806145 11810 ts_tablet_manager.cc:1403] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 12:30:45.808578 11810 raft_consensus.cc:359] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:45.809242 11810 raft_consensus.cc:740] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:45.809887 11810 consensus_queue.cc:260] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:45.811448 11810 ts_tablet_manager.cc:1434] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:30:45.812446 11810 tablet_bootstrap.cc:492] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:45.826649 11810 tablet_bootstrap.cc:492] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.827658 11810 tablet_bootstrap.cc:492] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.828348 11810 ts_tablet_manager.cc:1403] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 12:30:45.830883 11810 raft_consensus.cc:359] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:45.831609 11810 raft_consensus.cc:740] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:45.832293 11810 consensus_queue.cc:260] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:45.834887 11810 ts_tablet_manager.cc:1434] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:30:45.837218 11810 tablet_bootstrap.cc:492] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:45.852773 11810 tablet_bootstrap.cc:492] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.853593 11810 tablet_bootstrap.cc:492] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.854272 11810 ts_tablet_manager.cc:1403] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:30:45.856168 11810 raft_consensus.cc:359] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:45.856716 11810 raft_consensus.cc:740] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:45.857275 11810 consensus_queue.cc:260] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:45.859324 11810 ts_tablet_manager.cc:1434] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:30:45.860519 11810 tablet_bootstrap.cc:492] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:45.875625 11810 tablet_bootstrap.cc:492] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.876662 11810 tablet_bootstrap.cc:492] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.877324 11810 ts_tablet_manager.cc:1403] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.002s
I20260709 12:30:45.879890 11810 raft_consensus.cc:359] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:45.880628 11810 raft_consensus.cc:740] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:45.881381 11810 consensus_queue.cc:260] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:45.883522 11810 ts_tablet_manager.cc:1434] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.001s
I20260709 12:30:45.884641 11810 tablet_bootstrap.cc:492] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:45.894520 11857 raft_consensus.cc:3060] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:45.910893 11810 tablet_bootstrap.cc:492] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.912021 11810 tablet_bootstrap.cc:492] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.911980 11852 raft_consensus.cc:3060] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:45.913079 11810 ts_tablet_manager.cc:1403] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.011s
I20260709 12:30:45.915963 11810 raft_consensus.cc:359] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:45.916666 11810 raft_consensus.cc:740] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:45.917402 11810 consensus_queue.cc:260] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:45.919700 11810 ts_tablet_manager.cc:1434] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:30:45.920572 11810 tablet_bootstrap.cc:492] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:45.943131 11810 tablet_bootstrap.cc:492] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.944422 11810 tablet_bootstrap.cc:492] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.945194 11810 ts_tablet_manager.cc:1403] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
I20260709 12:30:45.947909 11810 raft_consensus.cc:359] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:45.948637 11810 raft_consensus.cc:740] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:45.949388 11810 consensus_queue.cc:260] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:45.951759 11810 ts_tablet_manager.cc:1434] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:30:45.952607 11810 tablet_bootstrap.cc:492] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:45.975687 11810 tablet_bootstrap.cc:492] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:45.976683 11810 tablet_bootstrap.cc:492] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:45.977389 11810 ts_tablet_manager.cc:1403] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.003s
I20260709 12:30:45.981103 11810 raft_consensus.cc:359] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:45.981819 11810 raft_consensus.cc:740] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:45.982735 11810 consensus_queue.cc:260] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:45.984917 11810 ts_tablet_manager.cc:1434] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:30:45.985751 11810 tablet_bootstrap.cc:492] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:46.012099 11810 tablet_bootstrap.cc:492] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:46.013105 11810 tablet_bootstrap.cc:492] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:46.013854 11810 ts_tablet_manager.cc:1403] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.004s
I20260709 12:30:46.016373 11810 raft_consensus.cc:359] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:46.017055 11810 raft_consensus.cc:740] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.017735 11810 consensus_queue.cc:260] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:46.019791 11810 ts_tablet_manager.cc:1434] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:30:46.020421 11810 tablet_bootstrap.cc:492] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:46.032143 11810 tablet_bootstrap.cc:492] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:46.033116 11810 tablet_bootstrap.cc:492] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:46.033789 11810 ts_tablet_manager.cc:1403] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:30:46.036391 11810 raft_consensus.cc:359] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:46.037065 11810 raft_consensus.cc:740] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.037576 11810 consensus_queue.cc:260] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:46.039568 11810 ts_tablet_manager.cc:1434] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:30:46.041035 11810 tablet_bootstrap.cc:492] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:46.055261 11810 tablet_bootstrap.cc:492] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:46.056146 11810 tablet_bootstrap.cc:492] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:46.056777 11810 ts_tablet_manager.cc:1403] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:30:46.059077 11810 raft_consensus.cc:359] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:46.059564 11810 raft_consensus.cc:740] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.060367 11810 consensus_queue.cc:260] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:46.062510 11810 ts_tablet_manager.cc:1434] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:30:46.063853 11810 tablet_bootstrap.cc:492] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:46.103668 11810 tablet_bootstrap.cc:492] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:46.106264 11810 tablet_bootstrap.cc:492] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:46.114665 11810 ts_tablet_manager.cc:1403] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.023s
I20260709 12:30:46.115612 11857 raft_consensus.cc:3060] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:46.117282 11810 raft_consensus.cc:359] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:46.118407 11810 raft_consensus.cc:740] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.119127 11810 consensus_queue.cc:260] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:46.121271 11810 ts_tablet_manager.cc:1434] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:30:46.123234 11810 tablet_bootstrap.cc:492] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:46.139111 11810 tablet_bootstrap.cc:492] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:46.140225 11810 tablet_bootstrap.cc:492] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:46.141268 11810 ts_tablet_manager.cc:1403] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:30:46.143942 11810 raft_consensus.cc:359] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:46.144642 11810 raft_consensus.cc:740] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.145270 11810 consensus_queue.cc:260] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:46.146864 11810 ts_tablet_manager.cc:1434] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260709 12:30:46.147612 11810 tablet_bootstrap.cc:492] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:46.166435 11810 tablet_bootstrap.cc:492] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:46.167423 11810 tablet_bootstrap.cc:492] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:46.168062 11810 ts_tablet_manager.cc:1403] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:30:46.170197 11810 raft_consensus.cc:359] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:46.170845 11810 raft_consensus.cc:740] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.171422 11810 consensus_queue.cc:260] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:46.172969 11810 ts_tablet_manager.cc:1434] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:30:46.173911 11810 tablet_bootstrap.cc:492] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:46.190097 11810 tablet_bootstrap.cc:492] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:46.191202 11810 tablet_bootstrap.cc:492] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:46.191978 11810 ts_tablet_manager.cc:1403] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:30:46.194842 11810 raft_consensus.cc:359] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:46.195596 11810 raft_consensus.cc:740] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.196345 11810 consensus_queue.cc:260] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:46.198526 11810 ts_tablet_manager.cc:1434] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:30:46.201186 11810 tablet_bootstrap.cc:492] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:46.216848 11810 tablet_bootstrap.cc:492] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:46.217830 11810 tablet_bootstrap.cc:492] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:46.218528 11810 ts_tablet_manager.cc:1403] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:30:46.221046 11810 raft_consensus.cc:359] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:46.221747 11810 raft_consensus.cc:740] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.222450 11810 consensus_queue.cc:260] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:46.224692 11810 ts_tablet_manager.cc:1434] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:30:46.226059 11810 tablet_bootstrap.cc:492] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:46.242167 11810 tablet_bootstrap.cc:492] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:46.243213 11810 tablet_bootstrap.cc:492] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:46.243974 11810 ts_tablet_manager.cc:1403] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:30:46.246402 11810 raft_consensus.cc:359] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:46.247097 11810 raft_consensus.cc:740] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.247689 11810 consensus_queue.cc:260] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:46.250391 11810 ts_tablet_manager.cc:1434] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:30:46.253537 11810 tablet_bootstrap.cc:492] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:46.265331 11852 raft_consensus.cc:3060] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:46.274698 11810 tablet_bootstrap.cc:492] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:46.275887 11810 tablet_bootstrap.cc:492] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:46.276499 11810 ts_tablet_manager.cc:1403] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 12:30:46.278900 11810 raft_consensus.cc:359] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:46.279508 11810 raft_consensus.cc:740] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.280277 11810 consensus_queue.cc:260] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:46.282665 11810 ts_tablet_manager.cc:1434] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:30:46.286207 11810 tablet_bootstrap.cc:492] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574: Bootstrap starting.
I20260709 12:30:46.303853 11852 raft_consensus.cc:3060] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:46.318334 11810 tablet_bootstrap.cc:492] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:46.319440 11810 tablet_bootstrap.cc:492] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574: Bootstrap complete.
I20260709 12:30:46.320237 11810 ts_tablet_manager.cc:1403] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.002s
I20260709 12:30:46.325212 11852 raft_consensus.cc:3060] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:46.327298 11810 raft_consensus.cc:359] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:46.328142 11810 raft_consensus.cc:740] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61218d0202f44940b61185f640880574, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.330387 11810 consensus_queue.cc:260] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:46.332656 11810 ts_tablet_manager.cc:1434] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:30:46.352661 11857 raft_consensus.cc:3060] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:46.446888 11852 raft_consensus.cc:3060] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:46.457996 11857 raft_consensus.cc:3060] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:46.649299 11852 raft_consensus.cc:3060] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.406518  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:53.482721 11054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "226a387f2768431dac93d7610fee3655"
dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
mode: GRACEFUL
new_leader_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:42030
I20260709 12:30:53.483614 11054 raft_consensus.cc:606] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 LEADER]: Received request to transfer leadership to TS 61218d0202f44940b61185f640880574
I20260709 12:30:53.497583 11209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "233e7dc1963548a1b4309d90f787084c"
dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
mode: GRACEFUL
new_leader_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:41562
I20260709 12:30:53.498104 11209 raft_consensus.cc:606] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Received request to transfer leadership to TS 61218d0202f44940b61185f640880574
I20260709 12:30:53.512250 11135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45b83d519688476d84ef90b668ca9efd"
dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
mode: GRACEFUL
new_leader_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:36668
I20260709 12:30:53.512848 11135 raft_consensus.cc:606] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Received request to transfer leadership to TS 61218d0202f44940b61185f640880574
I20260709 12:30:53.515532 11054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84ac5be704e94cae97eba537ab6c9b8c"
dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
mode: GRACEFUL
new_leader_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:42030
I20260709 12:30:53.516052 11054 raft_consensus.cc:606] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Received request to transfer leadership to TS 61218d0202f44940b61185f640880574
I20260709 12:30:53.518026 12042 raft_consensus.cc:993] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1: : Instructing follower 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:53.518450 11054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdb14ded3ccc417d8d6cbe341049acec"
dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
mode: GRACEFUL
new_leader_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:42030
I20260709 12:30:53.518589 12052 raft_consensus.cc:1081] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Signalling peer 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:53.519075 11054 raft_consensus.cc:606] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Received request to transfer leadership to TS 61218d0202f44940b61185f640880574
I20260709 12:30:53.520413 11858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45b83d519688476d84ef90b668ca9efd"
dest_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:52338
I20260709 12:30:53.520996 11858 raft_consensus.cc:493] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:53.521410 11858 raft_consensus.cc:3060] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.522279 11054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1d35cef95ba4391b35aa31a166d5036"
dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
mode: GRACEFUL
new_leader_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:42030
I20260709 12:30:53.522715 11054 raft_consensus.cc:606] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Received request to transfer leadership to TS 61218d0202f44940b61185f640880574
I20260709 12:30:53.524879 11054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd68a22c9db0420690b7299323e36893"
dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
mode: GRACEFUL
new_leader_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:42030
I20260709 12:30:53.525302 11054 raft_consensus.cc:606] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Received request to transfer leadership to TS 61218d0202f44940b61185f640880574
I20260709 12:30:53.526376  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:30:53.527693  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:53.528563  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:53.530265 11858 raft_consensus.cc:515] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:53.538013 11858 leader_election.cc:290] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:53.552970 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45b83d519688476d84ef90b668ca9efd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:53.553774 11132 raft_consensus.cc:3055] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:53.554066 11132 raft_consensus.cc:740] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:53.554888 11132 consensus_queue.cc:260] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:53.555876 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45b83d519688476d84ef90b668ca9efd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:53.556298 11132 raft_consensus.cc:3060] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.556484 11054 raft_consensus.cc:3060] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.560137 12044 raft_consensus.cc:993] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f: : Instructing follower 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:53.560560 12044 raft_consensus.cc:1081] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Signalling peer 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:53.562196 11858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84ac5be704e94cae97eba537ab6c9b8c"
dest_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:52360
I20260709 12:30:53.562697 11858 raft_consensus.cc:493] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:53.563016 11858 raft_consensus.cc:3060] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.570197 11132 raft_consensus.cc:2468] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:53.570143 11054 raft_consensus.cc:2468] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:53.571902 11803 leader_election.cc:304] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:53.573727 12060 raft_consensus.cc:2804] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:53.579279 11858 raft_consensus.cc:515] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:53.584203 11858 leader_election.cc:290] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:53.584308 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ac5be704e94cae97eba537ab6c9b8c" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:53.584887 11135 raft_consensus.cc:3060] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.585309 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ac5be704e94cae97eba537ab6c9b8c" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:53.586133 11054 raft_consensus.cc:3055] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:53.586525 11054 raft_consensus.cc:740] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:53.587442 11054 consensus_queue.cc:260] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:53.586845 12060 raft_consensus.cc:697] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:53.588887 11054 raft_consensus.cc:3060] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.589110 12060 consensus_queue.cc:237] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:53.595722 12048 raft_consensus.cc:993] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f: : Instructing follower 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:53.596181 12048 raft_consensus.cc:1081] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 LEADER]: Signalling peer 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:53.598742 11858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "226a387f2768431dac93d7610fee3655"
dest_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:52360
I20260709 12:30:53.599872 11858 raft_consensus.cc:493] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:53.598886 11054 raft_consensus.cc:2468] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:53.602751 11806 leader_election.cc:304] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:53.600299 11858 raft_consensus.cc:3060] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:53.603775 12061 raft_consensus.cc:2804] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:53.599056 11135 raft_consensus.cc:2468] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:53.611837 12061 raft_consensus.cc:697] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:53.612146 11858 raft_consensus.cc:515] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:53.612931 12061 consensus_queue.cc:237] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:53.614652 11858 leader_election.cc:290] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 4 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:53.615692 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:53.616266 10882 catalog_manager.cc:5697] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 1 to 2, leader changed from a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3) to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:53.618225 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226a387f2768431dac93d7610fee3655" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:53.618839 11054 raft_consensus.cc:3055] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:30:53.619120 11054 raft_consensus.cc:740] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:53.619963 11054 consensus_queue.cc:260] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:53.621354 11054 raft_consensus.cc:3060] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:53.625306 12048 raft_consensus.cc:993] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f: : Instructing follower 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:53.616262 11135 raft_consensus.cc:3060] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:53.627714 12048 raft_consensus.cc:1081] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Signalling peer 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:53.631237 11857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdb14ded3ccc417d8d6cbe341049acec"
dest_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:52360
I20260709 12:30:53.631758 11857 raft_consensus.cc:493] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:53.632078 11857 raft_consensus.cc:3060] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.636782 11135 raft_consensus.cc:2468] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 4.
I20260709 12:30:53.638547 11803 leader_election.cc:304] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:53.639545 11054 raft_consensus.cc:2468] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 4.
I20260709 12:30:53.643078 12061 raft_consensus.cc:2804] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:30:53.643822 12061 raft_consensus.cc:697] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 4 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:53.645059 12061 consensus_queue.cc:237] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:53.646700 11857 raft_consensus.cc:515] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:53.649510 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb14ded3ccc417d8d6cbe341049acec" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:53.648880 10882 catalog_manager.cc:5697] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 1 to 2, leader changed from 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2) to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:53.650771 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb14ded3ccc417d8d6cbe341049acec" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:53.651779 11135 raft_consensus.cc:3060] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.652586 11857 leader_election.cc:290] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:53.651369 11054 raft_consensus.cc:3055] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:53.655870 11054 raft_consensus.cc:740] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:53.660741 11054 consensus_queue.cc:260] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:53.662137 11054 raft_consensus.cc:3060] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.664367 11135 raft_consensus.cc:2468] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:53.665565 11803 leader_election.cc:304] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:53.666527 12063 raft_consensus.cc:2804] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:53.667047 12063 raft_consensus.cc:697] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:53.668026 12063 consensus_queue.cc:237] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:53.670975 12038 raft_consensus.cc:993] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5: : Instructing follower 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:53.671450 12038 raft_consensus.cc:1081] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Signalling peer 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:53.676859 10882 catalog_manager.cc:5697] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 3 to 4, leader changed from 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2) to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 4 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:53.680052 11054 raft_consensus.cc:2468] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:53.681414 11858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "233e7dc1963548a1b4309d90f787084c"
dest_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:30:53.682484 12072 raft_consensus.cc:993] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f: : Instructing follower 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:53.682901 11858 raft_consensus.cc:493] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:53.683096 12072 raft_consensus.cc:1081] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Signalling peer 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:53.683601 11858 raft_consensus.cc:3060] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.685016 12044 raft_consensus.cc:993] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f: : Instructing follower 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:53.685494 12044 raft_consensus.cc:1081] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Signalling peer 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:53.685765 11852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1d35cef95ba4391b35aa31a166d5036"
dest_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:52360
I20260709 12:30:53.686324 11852 raft_consensus.cc:493] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:53.686657 11852 raft_consensus.cc:3060] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.690069 11857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd68a22c9db0420690b7299323e36893"
dest_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:52360
I20260709 12:30:53.690580 11857 raft_consensus.cc:493] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:53.690812 11857 raft_consensus.cc:3060] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:53.699285 11857 raft_consensus.cc:515] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:53.699395 11858 raft_consensus.cc:515] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:53.701576 11858 leader_election.cc:290] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:53.701601 11857 leader_election.cc:290] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 3 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:53.702801 11852 raft_consensus.cc:515] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:53.704173 11056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:53.704828 11056 raft_consensus.cc:3055] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:53.704917 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233e7dc1963548a1b4309d90f787084c" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:53.705188 11056 raft_consensus.cc:740] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:53.705690 11054 raft_consensus.cc:3060] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.706338 11056 consensus_queue.cc:260] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:53.707527 11056 raft_consensus.cc:3060] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:53.714175 11054 raft_consensus.cc:2468] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:53.715930 11056 raft_consensus.cc:2468] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 3.
I20260709 12:30:53.717605 11806 leader_election.cc:304] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:53.718112 11056 raft_consensus.cc:1240] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Rejecting Update request from peer 85f856f4709042d9b3ce1348bdfb2ad5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:53.718595 12063 raft_consensus.cc:2804] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:53.718631 11806 leader_election.cc:304] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:53.719182 12063 raft_consensus.cc:697] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:53.720162 12063 consensus_queue.cc:237] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:53.720821 12060 raft_consensus.cc:2804] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:53.721395 12060 raft_consensus.cc:697] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 3 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:53.722419 12060 consensus_queue.cc:237] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:53.725670 12069 consensus_queue.cc:1059] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:53.726755 12069 raft_consensus.cc:3055] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:53.727046 12069 raft_consensus.cc:740] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:53.728118 12069 consensus_queue.cc:260] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:53.730724 12069 raft_consensus.cc:3060] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.733299 11209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233e7dc1963548a1b4309d90f787084c" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:53.734020 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd68a22c9db0420690b7299323e36893" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:53.734666 11207 raft_consensus.cc:3060] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:53.733211 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d35cef95ba4391b35aa31a166d5036" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:53.736552 11206 raft_consensus.cc:3060] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.739938 11852 leader_election.cc:290] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Requested vote from peers 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:53.747512 10882 catalog_manager.cc:5697] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 1 to 2, leader changed from 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2) to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:53.750600 11209 raft_consensus.cc:2468] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:53.759766 11207 raft_consensus.cc:2468] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 3.
I20260709 12:30:53.760102 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d35cef95ba4391b35aa31a166d5036" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:53.760706 11054 raft_consensus.cc:3055] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:53.761003 11054 raft_consensus.cc:740] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03cdbc3ec1ef4354bd6ec49958026f5f, State: Running, Role: LEADER
I20260709 12:30:53.761761 11054 consensus_queue.cc:260] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:53.763072 11054 raft_consensus.cc:3060] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:53.748872 11206 raft_consensus.cc:2468] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:53.778748 11054 raft_consensus.cc:2468] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:53.779034 11804 leader_election.cc:304] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:53.778230 10882 catalog_manager.cc:5697] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 1 to 2, leader changed from 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4) to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:53.780591 12063 raft_consensus.cc:2804] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:53.781006 10882 catalog_manager.cc:5697] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 2 to 3, leader changed from 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2) to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 3 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:53.781129 12063 raft_consensus.cc:697] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:53.783820 12063 consensus_queue.cc:237] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:53.798986 10882 catalog_manager.cc:5697] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 1 to 2, leader changed from 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2) to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:54.065237 11135 raft_consensus.cc:1275] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 4 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:30:54.066687 12063 consensus_queue.cc:1048] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:54.082515 11056 raft_consensus.cc:1275] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 4 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:30:54.085218 12063 consensus_queue.cc:1048] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:54.093322 11135 raft_consensus.cc:1275] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:54.094612 12063 consensus_queue.cc:1048] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:54.108944 11056 raft_consensus.cc:1275] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:54.109829 11054 raft_consensus.cc:1275] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:54.111490 11054 raft_consensus.cc:1275] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:54.112709 12063 consensus_queue.cc:1048] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:54.113080 12061 consensus_queue.cc:1048] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:54.119719 12063 consensus_queue.cc:1048] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:54.123780 11135 raft_consensus.cc:1275] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:54.126497 12063 consensus_queue.cc:1048] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:54.155781 11132 raft_consensus.cc:1275] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:54.157725 12060 consensus_queue.cc:1048] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:54.184006 11054 raft_consensus.cc:1275] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:54.183997 11206 raft_consensus.cc:1275] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:54.185640 12060 consensus_queue.cc:1048] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:54.187119 12061 consensus_queue.cc:1048] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:54.192122 11059 raft_consensus.cc:1275] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:54.193759 12060 consensus_queue.cc:1048] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:54.220090 11056 raft_consensus.cc:1275] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:54.220214 11206 raft_consensus.cc:1275] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:54.221724 12061 consensus_queue.cc:1048] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:54.230429 12084 consensus_queue.cc:1048] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:30:54.234464 11207 raft_consensus.cc:1275] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 3 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:54.236402 12084 consensus_queue.cc:1048] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:54.588424  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:54.630643 11135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7befb3713bcb4d2194f4deacce467056"
dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
mode: GRACEFUL
new_leader_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:36668
I20260709 12:30:54.631410 11135 raft_consensus.cc:606] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Received request to transfer leadership to TS 61218d0202f44940b61185f640880574
I20260709 12:30:54.634311 11135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7db9ac26d7914efdb621c400b65a0b89"
dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
mode: GRACEFUL
new_leader_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:36668
I20260709 12:30:54.634820 11135 raft_consensus.cc:606] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Received request to transfer leadership to TS 61218d0202f44940b61185f640880574
I20260709 12:30:54.637064 11135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ff7da973fbe46b9bbf5a9c29068f675"
dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
mode: GRACEFUL
new_leader_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:36668
I20260709 12:30:54.637532 11135 raft_consensus.cc:606] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Received request to transfer leadership to TS 61218d0202f44940b61185f640880574
I20260709 12:30:54.639977 11203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce15f9449fe54fa9a8388a7964e137d4"
dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
mode: GRACEFUL
new_leader_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:41562
I20260709 12:30:54.640530 11203 raft_consensus.cc:606] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Received request to transfer leadership to TS 61218d0202f44940b61185f640880574
I20260709 12:30:54.643148 11203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e572b4a12e2d41008d2b3ba98f1429fb"
dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
mode: GRACEFUL
new_leader_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:41562
I20260709 12:30:54.643771 11203 raft_consensus.cc:606] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Received request to transfer leadership to TS 61218d0202f44940b61185f640880574
I20260709 12:30:54.644840  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:30:54.646378  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:54.647090  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:54.719273 12094 raft_consensus.cc:993] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5: : Instructing follower 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:54.719774 12094 raft_consensus.cc:1081] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Signalling peer 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:54.721293 11852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e572b4a12e2d41008d2b3ba98f1429fb"
dest_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:30:54.721839 11852 raft_consensus.cc:493] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:54.722157 11852 raft_consensus.cc:3060] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:54.728816 11852 raft_consensus.cc:515] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:54.730666 11852 leader_election.cc:290] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:54.730922 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e572b4a12e2d41008d2b3ba98f1429fb" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:54.731627 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e572b4a12e2d41008d2b3ba98f1429fb" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:54.732247 11135 raft_consensus.cc:3060] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:54.732302 11206 raft_consensus.cc:3055] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:54.732738 11206 raft_consensus.cc:740] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:54.733466 11206 consensus_queue.cc:260] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:54.734741 11206 raft_consensus.cc:3060] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:54.738981 11135 raft_consensus.cc:2468] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:54.740161 11803 leader_election.cc:304] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:54.740865 12061 raft_consensus.cc:2804] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:54.741336 11206 raft_consensus.cc:2468] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:54.741386 12061 raft_consensus.cc:697] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:54.741847 12094 raft_consensus.cc:993] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5: : Instructing follower 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:54.742502 11901 raft_consensus.cc:1081] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Signalling peer 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:54.742519 12061 consensus_queue.cc:237] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:54.747980 11852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce15f9449fe54fa9a8388a7964e137d4"
dest_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:30:54.748423 11852 raft_consensus.cc:493] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:54.748746 11852 raft_consensus.cc:3060] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:54.754297 11852 raft_consensus.cc:515] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:54.756382 11852 leader_election.cc:290] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:54.759339 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce15f9449fe54fa9a8388a7964e137d4" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:54.759970 11206 raft_consensus.cc:3055] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:54.760263 11206 raft_consensus.cc:740] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f856f4709042d9b3ce1348bdfb2ad5, State: Running, Role: LEADER
I20260709 12:30:54.761018 11206 consensus_queue.cc:260] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:54.761835 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce15f9449fe54fa9a8388a7964e137d4" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:54.762302 11206 raft_consensus.cc:3060] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:54.762534 11135 raft_consensus.cc:3060] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:54.767843 10880 catalog_manager.cc:5697] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 1 to 2, leader changed from 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4) to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:54.772192 11135 raft_consensus.cc:2468] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:54.773855 11803 leader_election.cc:304] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1; no voters: 
I20260709 12:30:54.774616 12060 raft_consensus.cc:2804] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:54.775072 12060 raft_consensus.cc:697] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:54.775909 12060 consensus_queue.cc:237] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:54.781453 11206 raft_consensus.cc:2468] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:54.804756 10880 catalog_manager.cc:5697] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 1 to 2, leader changed from 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4) to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:54.859782 12098 raft_consensus.cc:993] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1: : Instructing follower 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:54.860313 12052 raft_consensus.cc:1081] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Signalling peer 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:54.861692 11857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7db9ac26d7914efdb621c400b65a0b89"
dest_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:52338
I20260709 12:30:54.862233 11857 raft_consensus.cc:493] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:54.862468 11857 raft_consensus.cc:3060] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:54.867511 11857 raft_consensus.cc:515] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:54.868966 11857 leader_election.cc:290] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:54.870112 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db9ac26d7914efdb621c400b65a0b89" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:54.870956 11126 raft_consensus.cc:3055] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:54.871299 11126 raft_consensus.cc:740] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:54.870087 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db9ac26d7914efdb621c400b65a0b89" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:54.872174 11126 consensus_queue.cc:260] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:54.873539 11206 raft_consensus.cc:3060] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:54.873775 11126 raft_consensus.cc:3060] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:54.879114 11206 raft_consensus.cc:2468] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:54.880250 11804 leader_election.cc:304] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:54.881086 11126 raft_consensus.cc:2468] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:54.881774 12060 raft_consensus.cc:2804] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:54.882365 12060 raft_consensus.cc:697] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:54.883209 12060 consensus_queue.cc:237] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:54.893280 10880 catalog_manager.cc:5697] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 1 to 2, leader changed from a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3) to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:54.911329 12052 raft_consensus.cc:993] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1: : Instructing follower 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:54.912071 12098 raft_consensus.cc:1081] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Signalling peer 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:54.913642 11857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7befb3713bcb4d2194f4deacce467056"
dest_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:52338
I20260709 12:30:54.914211 11857 raft_consensus.cc:493] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:54.914520 11857 raft_consensus.cc:3060] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:54.920818 11857 raft_consensus.cc:515] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:54.923285 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befb3713bcb4d2194f4deacce467056" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:54.923933 11126 raft_consensus.cc:3055] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:54.924055 11857 leader_election.cc:290] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:54.924299 11126 raft_consensus.cc:740] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:54.924361 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7befb3713bcb4d2194f4deacce467056" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:54.925076 11206 raft_consensus.cc:3060] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:54.925283 11126 consensus_queue.cc:260] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:54.926568 11126 raft_consensus.cc:3060] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:54.933017 11206 raft_consensus.cc:2468] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:54.934293 11804 leader_election.cc:304] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:54.935061 12060 raft_consensus.cc:2804] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:54.935572 12060 raft_consensus.cc:697] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:54.936142 11126 raft_consensus.cc:2468] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:54.936517 12060 consensus_queue.cc:237] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:54.947955 10880 catalog_manager.cc:5697] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 1 to 2, leader changed from a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3) to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:55.060506 12105 raft_consensus.cc:993] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1: : Instructing follower 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:55.061152 12105 raft_consensus.cc:1081] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Signalling peer 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:55.063094 11852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ff7da973fbe46b9bbf5a9c29068f675"
dest_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:52338
I20260709 12:30:55.063660 11852 raft_consensus.cc:493] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:55.064116 11852 raft_consensus.cc:3060] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:55.069409 11852 raft_consensus.cc:515] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:55.071360 11852 leader_election.cc:290] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:55.072294 11126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7da973fbe46b9bbf5a9c29068f675" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:55.072415 11206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff7da973fbe46b9bbf5a9c29068f675" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:55.073005 11126 raft_consensus.cc:3055] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:55.073141 11206 raft_consensus.cc:3060] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:55.073411 11126 raft_consensus.cc:740] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:55.074421 11126 consensus_queue.cc:260] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:55.075801 11126 raft_consensus.cc:3060] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:55.078923 11206 raft_consensus.cc:2468] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:55.080157 11804 leader_election.cc:304] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:55.080983 12060 raft_consensus.cc:2804] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:55.081457 12060 raft_consensus.cc:697] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:55.082490 12060 consensus_queue.cc:237] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:55.083050 11126 raft_consensus.cc:2468] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:55.095111 10880 catalog_manager.cc:5697] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 1 to 2, leader changed from a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3) to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:55.253545 11203 raft_consensus.cc:1275] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:55.256906 12061 consensus_queue.cc:1048] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:55.260852 11135 raft_consensus.cc:1275] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:55.264030 12061 consensus_queue.cc:1048] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:55.306469 11135 raft_consensus.cc:1275] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:55.313788 12060 consensus_queue.cc:1048] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:55.332259 11203 raft_consensus.cc:1275] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:55.334017 12063 consensus_queue.cc:1048] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:55.345975 11207 raft_consensus.cc:1275] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:55.347297 12063 consensus_queue.cc:1048] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:55.365370 11206 raft_consensus.cc:1275] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:55.368311 12063 consensus_queue.cc:1048] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:55.374285 11135 raft_consensus.cc:1275] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:55.375903 12060 consensus_queue.cc:1048] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:55.391601 11132 raft_consensus.cc:1275] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:55.394549 12115 consensus_queue.cc:1048] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:55.586441 11207 raft_consensus.cc:1275] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:55.587766 12063 consensus_queue.cc:1048] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:55.605168 11132 raft_consensus.cc:1275] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:55.610822 12061 consensus_queue.cc:1048] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:55.691757  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:55.732293 11135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d20e41f0d4444beb8e9ad0cc6938918"
dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
mode: GRACEFUL
new_leader_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:36668
I20260709 12:30:55.732821 11135 raft_consensus.cc:606] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Received request to transfer leadership to TS 61218d0202f44940b61185f640880574
I20260709 12:30:55.735363 11135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd"
dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
mode: GRACEFUL
new_leader_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:36668
I20260709 12:30:55.735868 11135 raft_consensus.cc:606] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Received request to transfer leadership to TS 61218d0202f44940b61185f640880574
I20260709 12:30:55.736949  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:30:55.738305  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:55.738988  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:55.826985 12098 raft_consensus.cc:993] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1: : Instructing follower 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:55.827443 12105 raft_consensus.cc:1081] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Signalling peer 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:55.828933 11852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd"
dest_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:52338
I20260709 12:30:55.829341 11852 raft_consensus.cc:493] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:55.829566 11852 raft_consensus.cc:3060] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:55.834224 11852 raft_consensus.cc:515] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:55.836675 11852 leader_election.cc:290] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 3 election: Requested vote from peers 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695), a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703)
I20260709 12:30:55.836634 11054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f"
I20260709 12:30:55.836822 11135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f21b6512ac4704a7d26664b97dffcd" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:55.837252 11054 raft_consensus.cc:3060] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:55.837541 11135 raft_consensus.cc:3055] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:55.838016 11135 raft_consensus.cc:740] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:55.838860 11135 consensus_queue.cc:260] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:55.840032 11135 raft_consensus.cc:3060] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:55.843834 11054 raft_consensus.cc:2468] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 3.
I20260709 12:30:55.845356 11806 leader_election.cc:304] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574; no voters: 
I20260709 12:30:55.846107 12060 raft_consensus.cc:2804] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:55.846473 11135 raft_consensus.cc:2468] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 3.
I20260709 12:30:55.846662 12060 raft_consensus.cc:697] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 3 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:55.847658 12060 consensus_queue.cc:237] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } }
I20260709 12:30:55.857793 10880 catalog_manager.cc:5697] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 2 to 3, leader changed from a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3) to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 3 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:56.047711 12098 raft_consensus.cc:993] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1: : Instructing follower 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:56.048223 12105 raft_consensus.cc:1081] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Signalling peer 61218d0202f44940b61185f640880574 to start an election
I20260709 12:30:56.049625 11857 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d20e41f0d4444beb8e9ad0cc6938918"
dest_uuid: "61218d0202f44940b61185f640880574"
 from {username='slave'} at 127.0.0.1:52338
I20260709 12:30:56.050130 11857 raft_consensus.cc:493] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:56.050401 11857 raft_consensus.cc:3060] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:56.056758 11857 raft_consensus.cc:515] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:56.058820 11857 leader_election.cc:290] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Requested vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 85f856f4709042d9b3ce1348bdfb2ad5 (127.2.157.4:37545)
I20260709 12:30:56.059377 11132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d20e41f0d4444beb8e9ad0cc6938918" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a96b33d3dcf7432e904439b5be66dee1"
I20260709 12:30:56.059774 11207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d20e41f0d4444beb8e9ad0cc6938918" candidate_uuid: "61218d0202f44940b61185f640880574" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f856f4709042d9b3ce1348bdfb2ad5"
I20260709 12:30:56.060034 11132 raft_consensus.cc:3055] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:56.060424 11132 raft_consensus.cc:740] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a96b33d3dcf7432e904439b5be66dee1, State: Running, Role: LEADER
I20260709 12:30:56.060463 11207 raft_consensus.cc:3060] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:56.061093 11132 consensus_queue.cc:260] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:56.062078 11132 raft_consensus.cc:3060] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:56.065726 11207 raft_consensus.cc:2468] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:56.066924 11132 raft_consensus.cc:2468] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61218d0202f44940b61185f640880574 in term 2.
I20260709 12:30:56.067011 11804 leader_election.cc:304] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61218d0202f44940b61185f640880574, 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 
I20260709 12:30:56.067970 12061 raft_consensus.cc:2804] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:56.068418 12061 raft_consensus.cc:697] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Becoming Leader. State: Replica: 61218d0202f44940b61185f640880574, State: Running, Role: LEADER
I20260709 12:30:56.069344 12061 consensus_queue.cc:237] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:56.079638 10880 catalog_manager.cc:5697] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 reported cstate change: term changed from 1 to 2, leader changed from a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3) to 61218d0202f44940b61185f640880574 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "61218d0202f44940b61185f640880574" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:56.407709 11054 raft_consensus.cc:1275] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:56.410027 12115 consensus_queue.cc:1048] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:56.410889 11132 raft_consensus.cc:1275] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 3 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:56.412216 12061 consensus_queue.cc:1048] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:56.530473 11132 raft_consensus.cc:1275] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:56.531725 12115 consensus_queue.cc:1048] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:56.543440 11207 raft_consensus.cc:1275] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Refusing update from remote peer 61218d0202f44940b61185f640880574: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:56.544962 12115 consensus_queue.cc:1048] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:56.780073  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:56.816171  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:56.817188  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:56.817682  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:56.850646  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:56.885005  2676 tablet_server.cc:179] TabletServer@127.2.157.1:42037 shutting down...
W20260709 12:30:56.896292 11100 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 58 similar messages]
W20260709 12:30:56.901546 11100 consensus_peers.cc:597] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:56.908547 11174 consensus_peers.cc:597] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:56.923274  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:56.924299  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.925379  2676 raft_consensus.cc:2243] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:56.926033  2676 raft_consensus.cc:2272] T c9ef516951b743ae939b2880e001d2d2 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.929975  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.930935  2676 raft_consensus.cc:2243] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:30:56.931721 11026 consensus_peers.cc:597] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:56.931815  2676 raft_consensus.cc:2272] T 226a387f2768431dac93d7610fee3655 P 61218d0202f44940b61185f640880574 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:56.932272 11100 consensus_peers.cc:597] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:56.934340  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.934988  2676 raft_consensus.cc:2243] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:56.935441  2676 raft_consensus.cc:2272] T 61510ef1eced49019efc704e8fc16746 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.937570  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.938182  2676 raft_consensus.cc:2243] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:56.938557  2676 raft_consensus.cc:2272] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.940397  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.940938  2676 raft_consensus.cc:2243] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:56.941284  2676 raft_consensus.cc:2272] T a6980a48384841e9a62db7f664aa7b0f P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.943260  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.943972  2676 raft_consensus.cc:2243] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:56.944394  2676 raft_consensus.cc:2272] T f6b390078e79408a91ac1f52eaa9b4cd P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.947063  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.947880  2676 raft_consensus.cc:2243] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:56.948320  2676 raft_consensus.cc:2272] T 6f518b6c3e974aa3b500f4cd12acd425 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.951207  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.952123  2676 raft_consensus.cc:2243] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:56.953104  2676 raft_consensus.cc:2272] T cdb14ded3ccc417d8d6cbe341049acec P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.955753  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.956329  2676 raft_consensus.cc:2243] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:56.956765  2676 raft_consensus.cc:2272] T 1fe8221281e348018871f179e00af23e P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.958873  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.959466  2676 raft_consensus.cc:2243] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:56.960168  2676 raft_consensus.cc:2272] T 45b83d519688476d84ef90b668ca9efd P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.962257  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.962996  2676 raft_consensus.cc:2243] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:56.963429  2676 raft_consensus.cc:2272] T c10383d0fa134e14b6756caf02036ddd P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.965695  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.966419  2676 raft_consensus.cc:2243] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:56.966926  2676 raft_consensus.cc:2272] T 5ad1895184d543bebeba9172c4b7f560 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.969573  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.970414  2676 raft_consensus.cc:2243] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:56.970903  2676 raft_consensus.cc:2272] T 1a30a14e503d4acc89f1c6cf8b521e8a P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.974893  2676 tablet_replica.cc:333] stopping tablet replica
W20260709 12:30:56.975230 11026 consensus_peers.cc:597] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:56.975740  2676 raft_consensus.cc:2243] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:56.976295  2676 raft_consensus.cc:2272] T 9dff538bcd7e40a796271ede9c45aab6 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.978557  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.979231  2676 raft_consensus.cc:2243] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:56.980003  2676 raft_consensus.cc:2272] T ce15f9449fe54fa9a8388a7964e137d4 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.982690  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.983438  2676 raft_consensus.cc:2243] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:56.984050  2676 raft_consensus.cc:2272] T 5cac7da440174c7296f12f2879a05582 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.986864  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.987574  2676 raft_consensus.cc:2243] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:56.988066  2676 raft_consensus.cc:2272] T 0e805a87f353400daff9d7073bcfd03f P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.990976  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.991837  2676 raft_consensus.cc:2243] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:56.992403  2676 raft_consensus.cc:2272] T 4e8af63f7be04dffb88a232a6d6f4c9e P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:56.995339 11174 consensus_peers.cc:597] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:56.995625  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:56.996570  2676 raft_consensus.cc:2243] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:56.997474  2676 raft_consensus.cc:2272] T d1d35cef95ba4391b35aa31a166d5036 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:56.999612  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.000355  2676 raft_consensus.cc:2243] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.001336  2676 raft_consensus.cc:2272] T 4d20e41f0d4444beb8e9ad0cc6938918 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.005216  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.006078  2676 raft_consensus.cc:2243] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.006870  2676 raft_consensus.cc:2272] T 84ac5be704e94cae97eba537ab6c9b8c P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.007313 11026 consensus_peers.cc:597] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.009534  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.010295  2676 raft_consensus.cc:2243] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.010766  2676 raft_consensus.cc:2272] T 4eb59ce189c94c75972facd422484e58 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.013317  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.014099  2676 raft_consensus.cc:2243] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.014618  2676 raft_consensus.cc:2272] T 3cbb858478864fdd91f8a71c7d583382 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.016537 11100 consensus_peers.cc:597] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.017447  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.018294  2676 raft_consensus.cc:2243] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.019202  2676 raft_consensus.cc:2272] T fd68a22c9db0420690b7299323e36893 P 61218d0202f44940b61185f640880574 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.020496 11100 consensus_peers.cc:597] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.021456  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.022229  2676 raft_consensus.cc:2243] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.022658  2676 raft_consensus.cc:2272] T 271e5dce93d14266abb8069bb2020135 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.024751  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.025347  2676 raft_consensus.cc:2243] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.025766  2676 raft_consensus.cc:2272] T b29ac676c05840d384d97014df8fdffd P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.027772  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.028348  2676 raft_consensus.cc:2243] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.028774  2676 raft_consensus.cc:2272] T 9ff7a31e74574166b261914cd71d423e P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.030791  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.031373  2676 raft_consensus.cc:2243] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.031785  2676 raft_consensus.cc:2272] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.033699  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.034271  2676 raft_consensus.cc:2243] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.034680  2676 raft_consensus.cc:2272] T c81cc846f99441b693acaebd1a63ab21 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.037024  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.037761  2676 raft_consensus.cc:2243] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.038293  2676 raft_consensus.cc:2272] T 14c29611c5d144eeacac30952bc92aed P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.040854  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.041405  2676 raft_consensus.cc:2243] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.042402  2676 raft_consensus.cc:2272] T c4f21b6512ac4704a7d26664b97dffcd P 61218d0202f44940b61185f640880574 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.043251 11026 consensus_peers.cc:597] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.044921  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.045553  2676 raft_consensus.cc:2243] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.046321  2676 raft_consensus.cc:2272] T 233e7dc1963548a1b4309d90f787084c P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.048203  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.048754  2676 raft_consensus.cc:2243] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.049154  2676 raft_consensus.cc:2272] T ef715190ad3b417aa8cb7dba1f2853b6 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.051842  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.052608  2676 raft_consensus.cc:2243] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.053104  2676 raft_consensus.cc:2272] T 7a18a4e559724b479491cb39b42c0ce6 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.055177  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.055738  2676 raft_consensus.cc:2243] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.056552  2676 raft_consensus.cc:2272] T 7db9ac26d7914efdb621c400b65a0b89 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.058579  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.059162  2676 raft_consensus.cc:2243] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.059711  2676 raft_consensus.cc:2272] T 4bf709305a2b4084a73fb3108f94c828 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.062270  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.063017  2676 raft_consensus.cc:2243] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.063381  2676 raft_consensus.cc:2272] T a5c4f1fddaf1474aaf021d0b04387b4c P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.065380  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.065927  2676 raft_consensus.cc:2243] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.066314  2676 raft_consensus.cc:2272] T 67cba067154b43f0819177986955daf5 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.068542  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.069151  2676 raft_consensus.cc:2243] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.069984  2676 raft_consensus.cc:2272] T 7befb3713bcb4d2194f4deacce467056 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.072074  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.072700  2676 raft_consensus.cc:2243] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.073424  2676 raft_consensus.cc:2272] T 9ff7da973fbe46b9bbf5a9c29068f675 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.075596  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.076133  2676 raft_consensus.cc:2243] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.076602  2676 raft_consensus.cc:2272] T ddbef020004b425daa18c14ea59972d7 P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.078049 11174 consensus_peers.cc:597] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.078881  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.079517  2676 raft_consensus.cc:2243] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.079955  2676 raft_consensus.cc:2272] T fcae59975bce4cefbe8718f31534067b P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.081935  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.082474  2676 raft_consensus.cc:2243] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.082892  2676 raft_consensus.cc:2272] T b2c03f14392f45ba8f442cfec87fd85e P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.084949  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.085480  2676 raft_consensus.cc:2243] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.085986  2676 raft_consensus.cc:2272] T 657f19d4020f48ce8138638594474e13 P 61218d0202f44940b61185f640880574 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.088881  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:57.089473  2676 raft_consensus.cc:2243] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.090287  2676 raft_consensus.cc:2272] T e572b4a12e2d41008d2b3ba98f1429fb P 61218d0202f44940b61185f640880574 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.127290 11026 consensus_peers.cc:597] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.144532 11026 consensus_peers.cc:597] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.159601  2676 tablet_server.cc:196] TabletServer@127.2.157.1:42037 shutdown complete.
W20260709 12:30:57.179822 11174 consensus_peers.cc:597] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.182406 11174 consensus_peers.cc:597] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.188321 11026 consensus_peers.cc:597] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.222098 11100 consensus_peers.cc:597] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.236809 11174 consensus_peers.cc:597] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.243984 11100 consensus_peers.cc:597] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.251509 11026 consensus_peers.cc:597] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.263845  2676 tablet_server.cc:179] TabletServer@127.2.157.2:0 shutting down...
W20260709 12:30:57.271054 11175 consensus_peers.cc:597] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.272953 11101 consensus_peers.cc:597] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.286852 11175 consensus_peers.cc:597] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.287899 11026 consensus_peers.cc:597] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.293318 11026 consensus_peers.cc:597] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.299643 11026 consensus_peers.cc:597] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.302939 11100 consensus_peers.cc:597] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.307106 11174 consensus_peers.cc:597] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.313195  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:57.314342  2676 tablet_replica.cc:333] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.315207  2676 raft_consensus.cc:2243] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.315913  2676 raft_consensus.cc:2272] T 4e8af63f7be04dffb88a232a6d6f4c9e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.318562 11101 consensus_peers.cc:597] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.319152  2676 tablet_replica.cc:333] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
W20260709 12:30:57.319205 11101 consensus_peers.cc:597] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.320053  2676 raft_consensus.cc:2243] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.320534  2676 raft_consensus.cc:2272] T 8646b7e0b1ba4757a267d2e57601e24b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.323050  2676 tablet_replica.cc:333] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.324059  2676 raft_consensus.cc:2243] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.324654  2676 raft_consensus.cc:2272] T 45b83d519688476d84ef90b668ca9efd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.327561 11174 consensus_peers.cc:597] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.327598  2676 tablet_replica.cc:333] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.328881  2676 raft_consensus.cc:2243] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.329423  2676 raft_consensus.cc:2272] T 226a387f2768431dac93d7610fee3655 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.332342  2676 tablet_replica.cc:333] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.333422  2676 raft_consensus.cc:2243] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.334157  2676 raft_consensus.cc:2272] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.335889 11174 consensus_peers.cc:597] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.337179  2676 tablet_replica.cc:333] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.338119  2676 raft_consensus.cc:2243] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.339421  2676 raft_consensus.cc:2272] T 5cac7da440174c7296f12f2879a05582 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.342450  2676 tablet_replica.cc:333] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.343259  2676 raft_consensus.cc:2243] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.344239  2676 raft_consensus.cc:2272] T ef715190ad3b417aa8cb7dba1f2853b6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.347234  2676 tablet_replica.cc:333] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.348338  2676 raft_consensus.cc:2243] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.349555  2676 raft_consensus.cc:2272] T 67cba067154b43f0819177986955daf5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.352418  2676 tablet_replica.cc:333] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.353263  2676 raft_consensus.cc:2243] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.353852  2676 raft_consensus.cc:2272] T 2266db22c47c4604a6ac6d5cf892fc29 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.356655  2676 tablet_replica.cc:333] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.357303  2676 raft_consensus.cc:2243] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.358206  2676 raft_consensus.cc:2272] T c9ef516951b743ae939b2880e001d2d2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.360633  2676 tablet_replica.cc:333] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.361218  2676 raft_consensus.cc:2243] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.361644  2676 raft_consensus.cc:2272] T 0743c24d152b46b2ad08375da31705ea P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.364454  2676 tablet_replica.cc:333] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
W20260709 12:30:57.364609 11100 consensus_peers.cc:597] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.364972  2676 raft_consensus.cc:2243] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.365558  2676 raft_consensus.cc:2272] T 4eb59ce189c94c75972facd422484e58 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.367720  2676 tablet_replica.cc:333] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.368263  2676 raft_consensus.cc:2243] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.368739  2676 raft_consensus.cc:2272] T 3cbb858478864fdd91f8a71c7d583382 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.371411  2676 tablet_replica.cc:333] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.372320  2676 raft_consensus.cc:2243] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.372821  2676 raft_consensus.cc:2272] T fd68a22c9db0420690b7299323e36893 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.375061  2676 tablet_replica.cc:333] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.375757  2676 raft_consensus.cc:2243] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:30:57.375890 11175 consensus_peers.cc:597] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.376181  2676 raft_consensus.cc:2272] T 271e5dce93d14266abb8069bb2020135 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.378450  2676 tablet_replica.cc:333] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.379237  2676 raft_consensus.cc:2243] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.379750  2676 raft_consensus.cc:2272] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.382282  2676 tablet_replica.cc:333] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.383121  2676 raft_consensus.cc:2243] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.383621  2676 raft_consensus.cc:2272] T 2be854f634c14923853d3907984c6ca6 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.384402 11100 consensus_peers.cc:597] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.386456  2676 tablet_replica.cc:333] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
W20260709 12:30:57.386524 11175 consensus_peers.cc:597] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.387308  2676 raft_consensus.cc:2243] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:30:57.387617 11101 consensus_peers.cc:597] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.387889  2676 raft_consensus.cc:2272] T 9ff7a31e74574166b261914cd71d423e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.389997  2676 tablet_replica.cc:333] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.390558  2676 raft_consensus.cc:2243] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.391278  2676 raft_consensus.cc:2272] T b29ac676c05840d384d97014df8fdffd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.393580  2676 tablet_replica.cc:333] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.394373  2676 raft_consensus.cc:2243] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.395345  2676 raft_consensus.cc:2272] T 4a25febeedeb45368dcfe60611272c19 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.397658  2676 tablet_replica.cc:333] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.398386  2676 raft_consensus.cc:2243] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.398921  2676 raft_consensus.cc:2272] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.399950 11174 consensus_peers.cc:597] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.402917  2676 tablet_replica.cc:333] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.403829  2676 raft_consensus.cc:2243] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.404357  2676 raft_consensus.cc:2272] T d1d35cef95ba4391b35aa31a166d5036 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.407032  2676 tablet_replica.cc:333] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.407842  2676 raft_consensus.cc:2243] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.408347  2676 raft_consensus.cc:2272] T 84ac5be704e94cae97eba537ab6c9b8c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.410709  2676 tablet_replica.cc:333] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.411448  2676 raft_consensus.cc:2243] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.412016  2676 raft_consensus.cc:2272] T a5c4f1fddaf1474aaf021d0b04387b4c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.412729 11175 consensus_peers.cc:597] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.414790  2676 tablet_replica.cc:333] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.415640  2676 raft_consensus.cc:2243] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.416167  2676 raft_consensus.cc:2272] T 4bf709305a2b4084a73fb3108f94c828 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.417402 11101 consensus_peers.cc:597] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.418550  2676 tablet_replica.cc:333] T 45c4826eccd146d3875548011ee59fd4 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.419202  2676 raft_consensus.cc:2243] T 45c4826eccd146d3875548011ee59fd4 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.419641  2676 raft_consensus.cc:2272] T 45c4826eccd146d3875548011ee59fd4 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.422418  2676 tablet_replica.cc:333] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.423192  2676 raft_consensus.cc:2243] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.423660  2676 raft_consensus.cc:2272] T 6f518b6c3e974aa3b500f4cd12acd425 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.426191  2676 tablet_replica.cc:333] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.426761  2676 raft_consensus.cc:2243] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.427193  2676 raft_consensus.cc:2272] T b2c03f14392f45ba8f442cfec87fd85e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.429273  2676 tablet_replica.cc:333] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.429817  2676 raft_consensus.cc:2243] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.430682  2676 raft_consensus.cc:2272] T 657f19d4020f48ce8138638594474e13 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.432515  2676 tablet_replica.cc:333] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.433076  2676 raft_consensus.cc:2243] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.434091  2676 raft_consensus.cc:2272] T e793b1e1be754642bc961d9830f30c9b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.436802 11101 consensus_peers.cc:597] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.436846  2676 tablet_replica.cc:333] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.437813  2676 raft_consensus.cc:2243] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.438868  2676 raft_consensus.cc:2272] T 5ad1895184d543bebeba9172c4b7f560 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.441515  2676 tablet_replica.cc:333] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
W20260709 12:30:57.441579 11175 consensus_peers.cc:597] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.442323  2676 raft_consensus.cc:2243] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.442853  2676 raft_consensus.cc:2272] T c10383d0fa134e14b6756caf02036ddd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.445613  2676 tablet_replica.cc:333] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.446338  2676 raft_consensus.cc:2243] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.446846  2676 raft_consensus.cc:2272] T 233e7dc1963548a1b4309d90f787084c P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.449613  2676 tablet_replica.cc:333] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.450261  2676 raft_consensus.cc:2243] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.450778  2676 raft_consensus.cc:2272] T 3594610f072a45d7bc713888fe5cb278 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.453028  2676 tablet_replica.cc:333] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.453645  2676 raft_consensus.cc:2243] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.454443  2676 raft_consensus.cc:2272] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.456293  2676 tablet_replica.cc:333] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.456765  2676 raft_consensus.cc:2243] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.457491  2676 raft_consensus.cc:2272] T b82ae79252824afe8ff9ffcd83005eae P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.459445  2676 tablet_replica.cc:333] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.459906  2676 raft_consensus.cc:2243] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.460259  2676 raft_consensus.cc:2272] T fcae59975bce4cefbe8718f31534067b P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.462203  2676 tablet_replica.cc:333] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.462672  2676 raft_consensus.cc:2243] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.463387  2676 raft_consensus.cc:2272] T ddbef020004b425daa18c14ea59972d7 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.465983  2676 tablet_replica.cc:333] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.466416  2676 raft_consensus.cc:2243] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.466842  2676 raft_consensus.cc:2272] T c4f21b6512ac4704a7d26664b97dffcd P 03cdbc3ec1ef4354bd6ec49958026f5f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.468680  2676 tablet_replica.cc:333] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.469300  2676 raft_consensus.cc:2243] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.470592  2676 raft_consensus.cc:2272] T 61510ef1eced49019efc704e8fc16746 P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.472805  2676 tablet_replica.cc:333] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.473403  2676 raft_consensus.cc:2243] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.473917  2676 raft_consensus.cc:2272] T aa3d5568944e4b8ea21f3e487701995f P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.475821  2676 tablet_replica.cc:333] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.476356  2676 raft_consensus.cc:2243] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.477206  2676 raft_consensus.cc:2272] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 03cdbc3ec1ef4354bd6ec49958026f5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.479774  2676 tablet_replica.cc:333] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.480455  2676 raft_consensus.cc:2243] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:30:57.481213 11174 consensus_peers.cc:597] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Couldn't send request to peer 61218d0202f44940b61185f640880574. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.481387  2676 raft_consensus.cc:2272] T 1fe8221281e348018871f179e00af23e P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.483466  2676 tablet_replica.cc:333] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f: stopping tablet replica
I20260709 12:30:57.483969  2676 raft_consensus.cc:2243] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.484372  2676 raft_consensus.cc:2272] T cdb14ded3ccc417d8d6cbe341049acec P 03cdbc3ec1ef4354bd6ec49958026f5f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.539968 11101 consensus_peers.cc:597] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.543095 11175 connection.cc:573] client connection to 127.2.157.2:46695 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:30:57.543722 11175 consensus_peers.cc:597] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.554965 11175 consensus_peers.cc:597] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:46695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.561861  2676 tablet_server.cc:196] TabletServer@127.2.157.2:0 shutdown complete.
W20260709 12:30:57.606221 11175 consensus_peers.cc:597] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:46695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.631459  2676 tablet_server.cc:179] TabletServer@127.2.157.3:0 shutting down...
W20260709 12:30:57.666824 11101 consensus_peers.cc:597] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:46695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.667115 11175 consensus_peers.cc:597] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:46695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.688661 11172 consensus_peers.cc:597] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Couldn't send request to peer a96b33d3dcf7432e904439b5be66dee1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.704463  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:57.710763  2676 tablet_replica.cc:333] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.711684  2676 raft_consensus.cc:2243] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.712342  2676 raft_consensus.cc:2272] T 8646b7e0b1ba4757a267d2e57601e24b P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.715462  2676 tablet_replica.cc:333] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.716377  2676 raft_consensus.cc:2243] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.716917  2676 raft_consensus.cc:2272] T 45b83d519688476d84ef90b668ca9efd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.719789  2676 tablet_replica.cc:333] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.720654  2676 raft_consensus.cc:2243] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.721226  2676 raft_consensus.cc:2272] T 226a387f2768431dac93d7610fee3655 P a96b33d3dcf7432e904439b5be66dee1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.723932  2676 tablet_replica.cc:333] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.724807  2676 raft_consensus.cc:2243] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.725943  2676 raft_consensus.cc:2272] T 016a8f4a4c534fffa13dbf6e764c5fd1 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.728662  2676 tablet_replica.cc:333] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.729470  2676 raft_consensus.cc:2243] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.730031  2676 raft_consensus.cc:2272] T 5cac7da440174c7296f12f2879a05582 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.732702  2676 tablet_replica.cc:333] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.733556  2676 raft_consensus.cc:2243] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.734128  2676 raft_consensus.cc:2272] T 2266db22c47c4604a6ac6d5cf892fc29 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.736788  2676 tablet_replica.cc:333] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.737599  2676 raft_consensus.cc:2243] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.738124  2676 raft_consensus.cc:2272] T a6980a48384841e9a62db7f664aa7b0f P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.740612  2676 tablet_replica.cc:333] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.741329  2676 raft_consensus.cc:2243] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.742203  2676 raft_consensus.cc:2272] T 1d248b07c05b4adfb5ea2ebbc75aa249 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.744240  2676 tablet_replica.cc:333] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.744858  2676 raft_consensus.cc:2243] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.745960  2676 raft_consensus.cc:2272] T 0e805a87f353400daff9d7073bcfd03f P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.748605  2676 tablet_replica.cc:333] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.749423  2676 raft_consensus.cc:2243] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.750046  2676 raft_consensus.cc:2272] T e572b4a12e2d41008d2b3ba98f1429fb P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.752889  2676 tablet_replica.cc:333] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.753494  2676 raft_consensus.cc:2243] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.754711  2676 raft_consensus.cc:2272] T 0743c24d152b46b2ad08375da31705ea P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.757735  2676 tablet_replica.cc:333] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.758634  2676 raft_consensus.cc:2243] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.759181  2676 raft_consensus.cc:2272] T 67cba067154b43f0819177986955daf5 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.761958  2676 tablet_replica.cc:333] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.762730  2676 raft_consensus.cc:2243] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.763257  2676 raft_consensus.cc:2272] T 9ff7da973fbe46b9bbf5a9c29068f675 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.765993  2676 tablet_replica.cc:333] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.766708  2676 raft_consensus.cc:2243] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.767130  2676 raft_consensus.cc:2272] T 7befb3713bcb4d2194f4deacce467056 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.769649  2676 tablet_replica.cc:333] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.770511  2676 raft_consensus.cc:2243] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:30:57.771238 11101 consensus_peers.cc:597] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:46695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.771620  2676 raft_consensus.cc:2272] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.773674  2676 tablet_replica.cc:333] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.774286  2676 raft_consensus.cc:2243] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.775048  2676 raft_consensus.cc:2272] T 2be854f634c14923853d3907984c6ca6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.777124  2676 tablet_replica.cc:333] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.777802  2676 raft_consensus.cc:2243] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.778666  2676 raft_consensus.cc:2272] T 9ff7a31e74574166b261914cd71d423e P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.780509  2676 tablet_replica.cc:333] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.781054  2676 raft_consensus.cc:2243] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.781484  2676 raft_consensus.cc:2272] T b29ac676c05840d384d97014df8fdffd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.783854  2676 tablet_replica.cc:333] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.784438  2676 raft_consensus.cc:2243] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.785351  2676 raft_consensus.cc:2272] T b2c03f14392f45ba8f442cfec87fd85e P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.787631  2676 tablet_replica.cc:333] T 657f19d4020f48ce8138638594474e13 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.788249  2676 raft_consensus.cc:2243] T 657f19d4020f48ce8138638594474e13 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.788690  2676 raft_consensus.cc:2272] T 657f19d4020f48ce8138638594474e13 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.790726  2676 tablet_replica.cc:333] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.791306  2676 raft_consensus.cc:2243] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.791757  2676 raft_consensus.cc:2272] T e793b1e1be754642bc961d9830f30c9b P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.793741  2676 tablet_replica.cc:333] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.794342  2676 raft_consensus.cc:2243] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.794800  2676 raft_consensus.cc:2272] T 4a25febeedeb45368dcfe60611272c19 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.796770  2676 tablet_replica.cc:333] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.797260  2676 raft_consensus.cc:2243] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.797621  2676 raft_consensus.cc:2272] T f6b390078e79408a91ac1f52eaa9b4cd P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.799818  2676 tablet_replica.cc:333] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.800557  2676 raft_consensus.cc:2243] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.801105  2676 raft_consensus.cc:2272] T 4d20e41f0d4444beb8e9ad0cc6938918 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.803666  2676 tablet_replica.cc:333] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
W20260709 12:30:57.803679 11175 consensus_peers.cc:597] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Couldn't send request to peer 03cdbc3ec1ef4354bd6ec49958026f5f. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:46695: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.804456  2676 raft_consensus.cc:2243] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.805053  2676 raft_consensus.cc:2272] T 84ac5be704e94cae97eba537ab6c9b8c P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.807096  2676 tablet_replica.cc:333] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.807651  2676 raft_consensus.cc:2243] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.808410  2676 raft_consensus.cc:2272] T 7a18a4e559724b479491cb39b42c0ce6 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.810367  2676 tablet_replica.cc:333] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.810926  2676 raft_consensus.cc:2243] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.811328  2676 raft_consensus.cc:2272] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.813251  2676 tablet_replica.cc:333] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.813798  2676 raft_consensus.cc:2243] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.814244  2676 raft_consensus.cc:2272] T 7db9ac26d7914efdb621c400b65a0b89 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.816316  2676 tablet_replica.cc:333] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.817058  2676 raft_consensus.cc:2243] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.817986  2676 raft_consensus.cc:2272] T 45c4826eccd146d3875548011ee59fd4 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.819959  2676 tablet_replica.cc:333] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.820729  2676 raft_consensus.cc:2243] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.821607  2676 raft_consensus.cc:2272] T 6f518b6c3e974aa3b500f4cd12acd425 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.823446  2676 tablet_replica.cc:333] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.823979  2676 raft_consensus.cc:2243] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.824347  2676 raft_consensus.cc:2272] T 1a30a14e503d4acc89f1c6cf8b521e8a P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.826277  2676 tablet_replica.cc:333] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.826786  2676 raft_consensus.cc:2243] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.827515  2676 raft_consensus.cc:2272] T 9dff538bcd7e40a796271ede9c45aab6 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.830098  2676 tablet_replica.cc:333] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.830835  2676 raft_consensus.cc:2243] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.831312  2676 raft_consensus.cc:2272] T ce15f9449fe54fa9a8388a7964e137d4 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.833902  2676 tablet_replica.cc:333] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.834576  2676 raft_consensus.cc:2243] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.835103  2676 raft_consensus.cc:2272] T b82ae79252824afe8ff9ffcd83005eae P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.837611  2676 tablet_replica.cc:333] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.838282  2676 raft_consensus.cc:2243] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.839188  2676 raft_consensus.cc:2272] T c81cc846f99441b693acaebd1a63ab21 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.841840  2676 tablet_replica.cc:333] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.842588  2676 raft_consensus.cc:2243] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.843127  2676 raft_consensus.cc:2272] T aa3d5568944e4b8ea21f3e487701995f P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.843357 11172 consensus_peers.cc:597] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Couldn't send request to peer a96b33d3dcf7432e904439b5be66dee1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.845681  2676 tablet_replica.cc:333] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.846514  2676 raft_consensus.cc:2243] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.847090  2676 raft_consensus.cc:2272] T 1fe8221281e348018871f179e00af23e P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.849720  2676 tablet_replica.cc:333] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.850438  2676 raft_consensus.cc:2243] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.850944  2676 raft_consensus.cc:2272] T f5fbd15f7e3c4087a97ac3fbaf7870ce P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.851440 11172 consensus_peers.cc:597] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Couldn't send request to peer a96b33d3dcf7432e904439b5be66dee1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.853735  2676 tablet_replica.cc:333] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.854570  2676 raft_consensus.cc:2243] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.855057  2676 raft_consensus.cc:2272] T cdb14ded3ccc417d8d6cbe341049acec P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.857420  2676 tablet_replica.cc:333] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.858155  2676 raft_consensus.cc:2243] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.859099  2676 raft_consensus.cc:2272] T fcae59975bce4cefbe8718f31534067b P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.861148  2676 tablet_replica.cc:333] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.861614  2676 raft_consensus.cc:2243] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.862062  2676 raft_consensus.cc:2272] T ddbef020004b425daa18c14ea59972d7 P a96b33d3dcf7432e904439b5be66dee1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.863885  2676 tablet_replica.cc:333] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.864317  2676 raft_consensus.cc:2243] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.864686  2676 raft_consensus.cc:2272] T 14c29611c5d144eeacac30952bc92aed P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.866533  2676 tablet_replica.cc:333] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.867029  2676 raft_consensus.cc:2243] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:57.867420  2676 raft_consensus.cc:2272] T c4f21b6512ac4704a7d26664b97dffcd P a96b33d3dcf7432e904439b5be66dee1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:57.869166  2676 tablet_replica.cc:333] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1: stopping tablet replica
I20260709 12:30:57.869568  2676 raft_consensus.cc:2243] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:57.870278  2676 raft_consensus.cc:2272] T 3594610f072a45d7bc713888fe5cb278 P a96b33d3dcf7432e904439b5be66dee1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:57.890921 11172 consensus_peers.cc:597] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Couldn't send request to peer a96b33d3dcf7432e904439b5be66dee1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.893379 11172 consensus_peers.cc:597] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Couldn't send request to peer a96b33d3dcf7432e904439b5be66dee1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:57.902050 11172 consensus_peers.cc:597] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Couldn't send request to peer a96b33d3dcf7432e904439b5be66dee1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:57.941710  2676 tablet_server.cc:196] TabletServer@127.2.157.3:0 shutdown complete.
I20260709 12:30:58.012998  2676 tablet_server.cc:179] TabletServer@127.2.157.4:0 shutting down...
I20260709 12:30:58.051234 12147 raft_consensus.cc:493] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:58.051896 12147 raft_consensus.cc:515] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96b33d3dcf7432e904439b5be66dee1" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 44703 } } peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } }
I20260709 12:30:58.056905 12147 leader_election.cc:290] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703), 61218d0202f44940b61185f640880574 (127.2.157.1:42037)
W20260709 12:30:58.059674 11174 leader_election.cc:336] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111)
W20260709 12:30:58.060492 11172 leader_election.cc:336] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Network error: Client connection negotiation failed: client connection to 127.2.157.3:44703: connect: Connection refused (error 111)
I20260709 12:30:58.060933 11172 leader_election.cc:304] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 61218d0202f44940b61185f640880574, a96b33d3dcf7432e904439b5be66dee1
I20260709 12:30:58.061718 12147 raft_consensus.cc:2749] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:58.064965  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:58.066203  2676 tablet_replica.cc:333] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.067169  2676 raft_consensus.cc:2243] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.068171  2676 raft_consensus.cc:2272] T 8646b7e0b1ba4757a267d2e57601e24b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.070488  2676 tablet_replica.cc:333] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.071405  2676 raft_consensus.cc:2243] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.072450  2676 raft_consensus.cc:2272] T a6980a48384841e9a62db7f664aa7b0f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.075136  2676 tablet_replica.cc:333] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.076081  2676 raft_consensus.cc:2243] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:30:58.076548 11172 consensus_peers.cc:597] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 -> Peer a96b33d3dcf7432e904439b5be66dee1 (127.2.157.3:44703): Couldn't send request to peer a96b33d3dcf7432e904439b5be66dee1. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.3:44703: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:58.076692  2676 raft_consensus.cc:2272] T 1d248b07c05b4adfb5ea2ebbc75aa249 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.079466  2676 tablet_replica.cc:333] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.080091  2676 raft_consensus.cc:2243] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.080543  2676 raft_consensus.cc:2272] T 016a8f4a4c534fffa13dbf6e764c5fd1 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.082576  2676 tablet_replica.cc:333] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.083169  2676 raft_consensus.cc:2243] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.083611  2676 raft_consensus.cc:2272] T ef715190ad3b417aa8cb7dba1f2853b6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.085541  2676 tablet_replica.cc:333] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.086185  2676 raft_consensus.cc:2243] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.086943  2676 raft_consensus.cc:2272] T aa3d5568944e4b8ea21f3e487701995f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.088770  2676 tablet_replica.cc:333] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.089311  2676 raft_consensus.cc:2243] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.089708  2676 raft_consensus.cc:2272] T f5fbd15f7e3c4087a97ac3fbaf7870ce P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.091521  2676 tablet_replica.cc:333] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.092068  2676 raft_consensus.cc:2243] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.092471  2676 raft_consensus.cc:2272] T 0743c24d152b46b2ad08375da31705ea P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.094415  2676 tablet_replica.cc:333] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.094985  2676 raft_consensus.cc:2243] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.095041 12123 raft_consensus.cc:493] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 61218d0202f44940b61185f640880574)
I20260709 12:30:58.095844  2676 raft_consensus.cc:2272] T 4e8af63f7be04dffb88a232a6d6f4c9e P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.095687 12123 raft_consensus.cc:515] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f856f4709042d9b3ce1348bdfb2ad5" member_type: VOTER last_known_addr { host: "127.2.157.4" port: 37545 } } peers { permanent_uuid: "61218d0202f44940b61185f640880574" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42037 } } peers { permanent_uuid: "03cdbc3ec1ef4354bd6ec49958026f5f" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 46695 } }
I20260709 12:30:58.097863 12123 leader_election.cc:290] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 61218d0202f44940b61185f640880574 (127.2.157.1:42037), 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695)
I20260709 12:30:58.098513  2676 tablet_replica.cc:333] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.099395  2676 raft_consensus.cc:2243] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.099941  2676 raft_consensus.cc:2272] T 0e805a87f353400daff9d7073bcfd03f P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:58.102191 11175 leader_election.cc:336] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 03cdbc3ec1ef4354bd6ec49958026f5f (127.2.157.2:46695): Network error: Client connection negotiation failed: client connection to 127.2.157.2:46695: connect: Connection refused (error 111)
I20260709 12:30:58.102342  2676 tablet_replica.cc:333] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.103492  2676 raft_consensus.cc:2243] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:30:58.103875 11174 leader_election.cc:336] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 61218d0202f44940b61185f640880574 (127.2.157.1:42037): Network error: Client connection negotiation failed: client connection to 127.2.157.1:42037: connect: Connection refused (error 111)
I20260709 12:30:58.104276 11174 leader_election.cc:304] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f856f4709042d9b3ce1348bdfb2ad5; no voters: 03cdbc3ec1ef4354bd6ec49958026f5f, 61218d0202f44940b61185f640880574
I20260709 12:30:58.104460  2676 raft_consensus.cc:2272] T 2266db22c47c4604a6ac6d5cf892fc29 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.105060 12123 raft_consensus.cc:2749] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:58.106838  2676 tablet_replica.cc:333] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.107460  2676 raft_consensus.cc:2243] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.107877  2676 raft_consensus.cc:2272] T c9ef516951b743ae939b2880e001d2d2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.109699  2676 tablet_replica.cc:333] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.110289  2676 raft_consensus.cc:2243] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.110692  2676 raft_consensus.cc:2272] T d1d35cef95ba4391b35aa31a166d5036 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.112527  2676 tablet_replica.cc:333] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.113233  2676 raft_consensus.cc:2243] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.113754  2676 raft_consensus.cc:2272] T 4d20e41f0d4444beb8e9ad0cc6938918 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.115983  2676 tablet_replica.cc:333] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.116645  2676 raft_consensus.cc:2243] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.116998  2676 raft_consensus.cc:2272] T e572b4a12e2d41008d2b3ba98f1429fb P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.118779  2676 tablet_replica.cc:333] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.119256  2676 raft_consensus.cc:2243] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.119951  2676 raft_consensus.cc:2272] T 14c29611c5d144eeacac30952bc92aed P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.121757  2676 tablet_replica.cc:333] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.122321  2676 raft_consensus.cc:2243] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.122687  2676 raft_consensus.cc:2272] T 9ff7da973fbe46b9bbf5a9c29068f675 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.124363  2676 tablet_replica.cc:333] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.125000  2676 raft_consensus.cc:2243] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.125355  2676 raft_consensus.cc:2272] T 7befb3713bcb4d2194f4deacce467056 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.127136  2676 tablet_replica.cc:333] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.127647  2676 raft_consensus.cc:2243] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.128106  2676 raft_consensus.cc:2272] T b1cd03e5c5784bc2a3f7fd16049ed3e2 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.130541  2676 tablet_replica.cc:333] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.131199  2676 raft_consensus.cc:2243] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.131645  2676 raft_consensus.cc:2272] T 2be854f634c14923853d3907984c6ca6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.134068  2676 tablet_replica.cc:333] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.134584  2676 raft_consensus.cc:2243] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.134982  2676 raft_consensus.cc:2272] T fd68a22c9db0420690b7299323e36893 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.136684  2676 tablet_replica.cc:333] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.137202  2676 raft_consensus.cc:2243] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.137956  2676 raft_consensus.cc:2272] T 271e5dce93d14266abb8069bb2020135 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.139750  2676 tablet_replica.cc:333] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.140275  2676 raft_consensus.cc:2243] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.141052  2676 raft_consensus.cc:2272] T 4eb59ce189c94c75972facd422484e58 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.143082  2676 tablet_replica.cc:333] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.143633  2676 raft_consensus.cc:2243] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.144400  2676 raft_consensus.cc:2272] T 3cbb858478864fdd91f8a71c7d583382 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.146382  2676 tablet_replica.cc:333] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.146922  2676 raft_consensus.cc:2243] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.147648  2676 raft_consensus.cc:2272] T 1a30a14e503d4acc89f1c6cf8b521e8a P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.149484  2676 tablet_replica.cc:333] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.150087  2676 raft_consensus.cc:2243] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.150492  2676 raft_consensus.cc:2272] T 5ad1895184d543bebeba9172c4b7f560 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.152364  2676 tablet_replica.cc:333] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.152926  2676 raft_consensus.cc:2243] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.153344  2676 raft_consensus.cc:2272] T ce15f9449fe54fa9a8388a7964e137d4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.155252  2676 tablet_replica.cc:333] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.155818  2676 raft_consensus.cc:2243] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.156594  2676 raft_consensus.cc:2272] T c10383d0fa134e14b6756caf02036ddd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.158633  2676 tablet_replica.cc:333] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.159194  2676 raft_consensus.cc:2243] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.159631  2676 raft_consensus.cc:2272] T 9dff538bcd7e40a796271ede9c45aab6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.161406  2676 tablet_replica.cc:333] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.161971  2676 raft_consensus.cc:2243] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.162748  2676 raft_consensus.cc:2272] T a5c4f1fddaf1474aaf021d0b04387b4c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.164652  2676 tablet_replica.cc:333] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.165201  2676 raft_consensus.cc:2243] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.165964  2676 raft_consensus.cc:2272] T 4bf709305a2b4084a73fb3108f94c828 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.167698  2676 tablet_replica.cc:333] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.168218  2676 raft_consensus.cc:2243] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.168610  2676 raft_consensus.cc:2272] T 7db9ac26d7914efdb621c400b65a0b89 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.170401  2676 tablet_replica.cc:333] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.170921  2676 raft_consensus.cc:2243] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.171324  2676 raft_consensus.cc:2272] T 233e7dc1963548a1b4309d90f787084c P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.173183  2676 tablet_replica.cc:333] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.173790  2676 raft_consensus.cc:2243] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.174227  2676 raft_consensus.cc:2272] T e793b1e1be754642bc961d9830f30c9b P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.176062  2676 tablet_replica.cc:333] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.176595  2676 raft_consensus.cc:2243] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.177028  2676 raft_consensus.cc:2272] T 4a25febeedeb45368dcfe60611272c19 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.179157  2676 tablet_replica.cc:333] T 7a18a4e559724b479491cb39b42c0ce6 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.179838  2676 raft_consensus.cc:2243] T 7a18a4e559724b479491cb39b42c0ce6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.180398  2676 raft_consensus.cc:2272] T 7a18a4e559724b479491cb39b42c0ce6 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.182924  2676 tablet_replica.cc:333] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.183526  2676 raft_consensus.cc:2243] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.184321  2676 raft_consensus.cc:2272] T d4b07813c2dd4a5cbd0c31d8fb4fb267 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.186414  2676 tablet_replica.cc:333] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.186918  2676 raft_consensus.cc:2243] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.187666  2676 raft_consensus.cc:2272] T f6b390078e79408a91ac1f52eaa9b4cd P 85f856f4709042d9b3ce1348bdfb2ad5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.189595  2676 tablet_replica.cc:333] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.190227  2676 raft_consensus.cc:2243] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.190639  2676 raft_consensus.cc:2272] T 25dd54445c4b4d1ca4f230aea7f2f3d5 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.192526  2676 tablet_replica.cc:333] T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.193032  2676 raft_consensus.cc:2243] T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.193411  2676 raft_consensus.cc:2272] T b82ae79252824afe8ff9ffcd83005eae P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.195356  2676 tablet_replica.cc:333] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.195854  2676 raft_consensus.cc:2243] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.196260  2676 raft_consensus.cc:2272] T c81cc846f99441b693acaebd1a63ab21 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.198180  2676 tablet_replica.cc:333] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.198658  2676 raft_consensus.cc:2243] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.199069  2676 raft_consensus.cc:2272] T 3594610f072a45d7bc713888fe5cb278 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.200876  2676 tablet_replica.cc:333] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.201340  2676 raft_consensus.cc:2243] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.201757  2676 raft_consensus.cc:2272] T 45c4826eccd146d3875548011ee59fd4 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.203629  2676 tablet_replica.cc:333] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5: stopping tablet replica
I20260709 12:30:58.204141  2676 raft_consensus.cc:2243] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:58.204535  2676 raft_consensus.cc:2272] T 61510ef1eced49019efc704e8fc16746 P 85f856f4709042d9b3ce1348bdfb2ad5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.273581  2676 tablet_server.cc:196] TabletServer@127.2.157.4:0 shutdown complete.
I20260709 12:30:58.336141  2676 master.cc:562] Master@127.2.157.62:39749 shutting down...
I20260709 12:30:58.361444  2676 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:58.362061  2676 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:58.362414  2676 tablet_replica.cc:333] T 00000000000000000000000000000000 P fd570037dd044a17bb7315435491a898: stopping tablet replica
I20260709 12:30:58.384603  2676 master.cc:584] Master@127.2.157.62:39749 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (29511 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:30:58.484023  2676 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.62:44741
I20260709 12:30:58.485433  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:58.491408 12152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:58.492650 12153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:58.493090 12155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:58.493772  2676 server_base.cc:1061] running on GCE node
I20260709 12:30:58.494925  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:58.495121  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:58.495342  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600258495305 us; error 0 us; skew 500 ppm
I20260709 12:30:58.495999  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:58.498673  2676 webserver.cc:533] Webserver started at http://127.2.157.62:36513/ using document root <none> and password file <none>
I20260709 12:30:58.499189  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:58.499389  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:58.499718  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:58.500944  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/master-0-root/instance:
uuid: "2a01201fe7994e978e0dd4e88420a38c"
format_stamp: "Formatted at 2026-07-09 12:30:58 on dist-test-slave-0768"
I20260709 12:30:58.505810  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:30:58.509753 12160 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:58.510630  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:30:58.510955  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/master-0-root
uuid: "2a01201fe7994e978e0dd4e88420a38c"
format_stamp: "Formatted at 2026-07-09 12:30:58 on dist-test-slave-0768"
I20260709 12:30:58.511276  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:58.531586  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:58.532950  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:58.574077  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.62:44741
I20260709 12:30:58.574221 12211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.62:44741 every 8 connection(s)
I20260709 12:30:58.578274 12212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:58.589668 12212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c: Bootstrap starting.
I20260709 12:30:58.594972 12212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:58.599620 12212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c: No bootstrap required, opened a new log
I20260709 12:30:58.602078 12212 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a01201fe7994e978e0dd4e88420a38c" member_type: VOTER }
I20260709 12:30:58.602500 12212 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:58.602707 12212 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a01201fe7994e978e0dd4e88420a38c, State: Initialized, Role: FOLLOWER
I20260709 12:30:58.603354 12212 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a01201fe7994e978e0dd4e88420a38c" member_type: VOTER }
I20260709 12:30:58.603849 12212 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:30:58.604064 12212 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:30:58.604290 12212 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:58.609476 12212 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a01201fe7994e978e0dd4e88420a38c" member_type: VOTER }
I20260709 12:30:58.610146 12212 leader_election.cc:304] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a01201fe7994e978e0dd4e88420a38c; no voters: 
I20260709 12:30:58.611337 12212 leader_election.cc:290] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:30:58.611815 12215 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:58.613389 12215 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [term 1 LEADER]: Becoming Leader. State: Replica: 2a01201fe7994e978e0dd4e88420a38c, State: Running, Role: LEADER
I20260709 12:30:58.614207 12215 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a01201fe7994e978e0dd4e88420a38c" member_type: VOTER }
I20260709 12:30:58.614774 12212 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:30:58.620085 12216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a01201fe7994e978e0dd4e88420a38c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a01201fe7994e978e0dd4e88420a38c" member_type: VOTER } }
I20260709 12:30:58.620905 12216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [sys.catalog]: This master's current role is: LEADER
I20260709 12:30:58.620718 12217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a01201fe7994e978e0dd4e88420a38c. Latest consensus state: current_term: 1 leader_uuid: "2a01201fe7994e978e0dd4e88420a38c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a01201fe7994e978e0dd4e88420a38c" member_type: VOTER } }
I20260709 12:30:58.621351 12217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [sys.catalog]: This master's current role is: LEADER
I20260709 12:30:58.623661 12221 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:30:58.633036 12221 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:30:58.634155  2676 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:30:58.642916 12221 catalog_manager.cc:1383] Generated new cluster ID: fe43ac4a8eb143f8b892ba4c7205d288
I20260709 12:30:58.643231 12221 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:30:58.664883 12221 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:30:58.666209 12221 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:30:58.685329 12221 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c: Generated new TSK 0
I20260709 12:30:58.686048 12221 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:30:58.700767  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:58.707283 12233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:58.708618 12234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:58.710533 12236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:58.710988  2676 server_base.cc:1061] running on GCE node
I20260709 12:30:58.711992  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:58.712244  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:58.712430  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600258712406 us; error 0 us; skew 500 ppm
I20260709 12:30:58.713092  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:58.715615  2676 webserver.cc:533] Webserver started at http://127.2.157.1:38553/ using document root <none> and password file <none>
I20260709 12:30:58.716167  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:58.716467  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:58.716789  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:58.718062  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-0-root/instance:
uuid: "de4b3af4a2b3442fa050107035dcfff6"
format_stamp: "Formatted at 2026-07-09 12:30:58 on dist-test-slave-0768"
I20260709 12:30:58.722808  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:30:58.726295 12241 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:58.727186  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:30:58.727557  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-0-root
uuid: "de4b3af4a2b3442fa050107035dcfff6"
format_stamp: "Formatted at 2026-07-09 12:30:58 on dist-test-slave-0768"
I20260709 12:30:58.727833  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:58.736027  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:58.737185  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:58.738729  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:58.740991  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:58.741228  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:58.741457  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:58.741642  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:58.781172  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.1:36329
I20260709 12:30:58.781308 12303 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.1:36329 every 8 connection(s)
I20260709 12:30:58.786092  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:58.793138 12308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:58.794803 12309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:58.797554  2676 server_base.cc:1061] running on GCE node
W20260709 12:30:58.798290 12311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:58.799206  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:58.799439  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:58.799614  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600258799595 us; error 0 us; skew 500 ppm
I20260709 12:30:58.800145  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:58.802517  2676 webserver.cc:533] Webserver started at http://127.2.157.2:35251/ using document root <none> and password file <none>
I20260709 12:30:58.802994  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:58.803194  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:58.803452  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:58.804792  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-1-root/instance:
uuid: "9991f7979627435c88f2c2b58b90d87c"
format_stamp: "Formatted at 2026-07-09 12:30:58 on dist-test-slave-0768"
I20260709 12:30:58.805830 12304 heartbeater.cc:344] Connected to a master server at 127.2.157.62:44741
I20260709 12:30:58.806391 12304 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:58.807116 12304 heartbeater.cc:507] Master 127.2.157.62:44741 requested a full tablet report, sending...
I20260709 12:30:58.809303 12177 ts_manager.cc:194] Registered new tserver with Master: de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329)
I20260709 12:30:58.809872  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:30:58.811220 12177 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42304
I20260709 12:30:58.813675 12316 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:58.814654  2676 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:30:58.814895  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-1-root
uuid: "9991f7979627435c88f2c2b58b90d87c"
format_stamp: "Formatted at 2026-07-09 12:30:58 on dist-test-slave-0768"
I20260709 12:30:58.815135  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:58.824453  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:58.825544  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:58.826960  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:58.829118  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:58.829327  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:58.829563  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:58.829733  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:58.870079  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.2:32835
I20260709 12:30:58.870208 12378 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.2:32835 every 8 connection(s)
I20260709 12:30:58.874787  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:58.882521 12382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:58.882970 12383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:58.889480 12379 heartbeater.cc:344] Connected to a master server at 127.2.157.62:44741
I20260709 12:30:58.889753  2676 server_base.cc:1061] running on GCE node
I20260709 12:30:58.890079 12379 heartbeater.cc:461] Registering TS with master...
W20260709 12:30:58.890705 12385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:58.891175 12379 heartbeater.cc:507] Master 127.2.157.62:44741 requested a full tablet report, sending...
I20260709 12:30:58.891687  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:58.891933  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:58.892122  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600258892085 us; error 0 us; skew 500 ppm
I20260709 12:30:58.892854  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:58.893567 12177 ts_manager.cc:194] Registered new tserver with Master: 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:30:58.895258 12177 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42316
I20260709 12:30:58.895603  2676 webserver.cc:533] Webserver started at http://127.2.157.3:42793/ using document root <none> and password file <none>
I20260709 12:30:58.896231  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:58.896457  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:58.896755  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:58.897929  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-2-root/instance:
uuid: "372fc4cdae534a00bc75f3087d0bcfad"
format_stamp: "Formatted at 2026-07-09 12:30:58 on dist-test-slave-0768"
I20260709 12:30:58.902366  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:30:58.905519 12390 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:58.906385  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:30:58.906685  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-2-root
uuid: "372fc4cdae534a00bc75f3087d0bcfad"
format_stamp: "Formatted at 2026-07-09 12:30:58 on dist-test-slave-0768"
I20260709 12:30:58.906976  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:58.915052  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:58.916138  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:58.917557  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:58.919734  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:58.919955  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:58.920194  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:58.920368  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:58.961920  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.3:41211
I20260709 12:30:58.962164 12452 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.3:41211 every 8 connection(s)
I20260709 12:30:58.976198 12453 heartbeater.cc:344] Connected to a master server at 127.2.157.62:44741
I20260709 12:30:58.976833 12453 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:58.977685 12453 heartbeater.cc:507] Master 127.2.157.62:44741 requested a full tablet report, sending...
I20260709 12:30:58.979919 12177 ts_manager.cc:194] Registered new tserver with Master: 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:58.980126  2676 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014766041s
I20260709 12:30:58.981375 12177 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42324
I20260709 12:30:59.007526 12177 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42330:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:30:59.011109 12177 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:30:59.093736 12344 tablet_service.cc:1511] Processing CreateTablet for tablet f5158156db124267abc088180129dccc (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:30:59.095292 12344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5158156db124267abc088180129dccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.097906 12339 tablet_service.cc:1511] Processing CreateTablet for tablet 039ae3950aef4523a70d51cf3ede0865 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:30:59.099550 12339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039ae3950aef4523a70d51cf3ede0865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.099817 12341 tablet_service.cc:1511] Processing CreateTablet for tablet 53c561ccc54c4fa2971b10c4f4e42c55 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:30:59.101250 12341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c561ccc54c4fa2971b10c4f4e42c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.098001 12340 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4283da7c6b4df7a5be4614d3d9d297 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:30:59.103139 12340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4283da7c6b4df7a5be4614d3d9d297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.102991 12342 tablet_service.cc:1511] Processing CreateTablet for tablet bf043e9033134a2692d1980200717c1c (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:30:59.105139 12343 tablet_service.cc:1511] Processing CreateTablet for tablet 94481e8787914dbea7313a90452f7ad0 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:30:59.106854 12343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94481e8787914dbea7313a90452f7ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.110244 12342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf043e9033134a2692d1980200717c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.115693 12338 tablet_service.cc:1511] Processing CreateTablet for tablet 04dd84c108414f9f9722ca01990fc393 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:30:59.118021 12338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04dd84c108414f9f9722ca01990fc393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.119892 12468 tablet_bootstrap.cc:492] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c: Bootstrap starting.
I20260709 12:30:59.120995 12417 tablet_service.cc:1511] Processing CreateTablet for tablet 94481e8787914dbea7313a90452f7ad0 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:30:59.122484 12417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94481e8787914dbea7313a90452f7ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.123067 12416 tablet_service.cc:1511] Processing CreateTablet for tablet bf043e9033134a2692d1980200717c1c (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:30:59.124400 12416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf043e9033134a2692d1980200717c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.126539 12344 tablet_service.cc:1511] Processing CreateTablet for tablet 77b9d08e895f41f38ce6925c93be2c3d (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:30:59.127048 12415 tablet_service.cc:1511] Processing CreateTablet for tablet 53c561ccc54c4fa2971b10c4f4e42c55 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:30:59.127897 12344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b9d08e895f41f38ce6925c93be2c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.128533 12415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c561ccc54c4fa2971b10c4f4e42c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.130935 12414 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4283da7c6b4df7a5be4614d3d9d297 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:30:59.132313 12414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4283da7c6b4df7a5be4614d3d9d297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.135169 12413 tablet_service.cc:1511] Processing CreateTablet for tablet 039ae3950aef4523a70d51cf3ede0865 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:30:59.137032 12413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039ae3950aef4523a70d51cf3ede0865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.139515 12412 tablet_service.cc:1511] Processing CreateTablet for tablet 04dd84c108414f9f9722ca01990fc393 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:30:59.141064 12412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04dd84c108414f9f9722ca01990fc393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.143203 12337 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae06fd5a0f546fcaa1b4e0e4b23f594 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:30:59.144783 12337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae06fd5a0f546fcaa1b4e0e4b23f594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.147054 12336 tablet_service.cc:1511] Processing CreateTablet for tablet 5711e505622444fcbbc5c41a0e73b637 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:30:59.152287 12410 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae06fd5a0f546fcaa1b4e0e4b23f594 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:30:59.153685 12410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae06fd5a0f546fcaa1b4e0e4b23f594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.155405 12468 tablet_bootstrap.cc:654] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.155057 12411 tablet_service.cc:1511] Processing CreateTablet for tablet 77b9d08e895f41f38ce6925c93be2c3d (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:30:59.159747 12411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b9d08e895f41f38ce6925c93be2c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.155521 12409 tablet_service.cc:1511] Processing CreateTablet for tablet 5711e505622444fcbbc5c41a0e73b637 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:30:59.162389 12336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5711e505622444fcbbc5c41a0e73b637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.162716 12409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5711e505622444fcbbc5c41a0e73b637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.127048 12418 tablet_service.cc:1511] Processing CreateTablet for tablet f5158156db124267abc088180129dccc (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:30:59.166707 12418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5158156db124267abc088180129dccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.237223 12264 tablet_service.cc:1511] Processing CreateTablet for tablet 039ae3950aef4523a70d51cf3ede0865 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:30:59.238592 12264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039ae3950aef4523a70d51cf3ede0865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.238932 12268 tablet_service.cc:1511] Processing CreateTablet for tablet 94481e8787914dbea7313a90452f7ad0 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:30:59.240276 12268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94481e8787914dbea7313a90452f7ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.243286 12262 tablet_service.cc:1511] Processing CreateTablet for tablet 77b9d08e895f41f38ce6925c93be2c3d (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:30:59.244406 12263 tablet_service.cc:1511] Processing CreateTablet for tablet 04dd84c108414f9f9722ca01990fc393 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:30:59.245067 12267 tablet_service.cc:1511] Processing CreateTablet for tablet bf043e9033134a2692d1980200717c1c (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:30:59.246089 12265 tablet_service.cc:1511] Processing CreateTablet for tablet 5f4283da7c6b4df7a5be4614d3d9d297 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:30:59.246740 12269 tablet_service.cc:1511] Processing CreateTablet for tablet f5158156db124267abc088180129dccc (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:30:59.243446 12266 tablet_service.cc:1511] Processing CreateTablet for tablet 53c561ccc54c4fa2971b10c4f4e42c55 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:30:59.247861 12261 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae06fd5a0f546fcaa1b4e0e4b23f594 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:30:59.243352 12260 tablet_service.cc:1511] Processing CreateTablet for tablet 5711e505622444fcbbc5c41a0e73b637 (DEFAULT_TABLE table=test-workload [id=75731c50cbd04d85b4342c278e80fb0a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:30:59.244830 12468 tablet_bootstrap.cc:492] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c: No bootstrap required, opened a new log
I20260709 12:30:59.250334 12468 ts_tablet_manager.cc:1403] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c: Time spent bootstrapping tablet: real 0.131s	user 0.008s	sys 0.016s
I20260709 12:30:59.244782 12262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b9d08e895f41f38ce6925c93be2c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.254815 12261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae06fd5a0f546fcaa1b4e0e4b23f594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.258194 12266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c561ccc54c4fa2971b10c4f4e42c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.262359 12265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f4283da7c6b4df7a5be4614d3d9d297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.262526 12468 raft_consensus.cc:359] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:30:59.263366 12468 raft_consensus.cc:385] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.263665 12468 raft_consensus.cc:740] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.264662 12260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5711e505622444fcbbc5c41a0e73b637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.270421 12267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf043e9033134a2692d1980200717c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.271247 12263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04dd84c108414f9f9722ca01990fc393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.273968 12269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5158156db124267abc088180129dccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:59.270793 12468 consensus_queue.cc:260] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:30:59.286689 12470 tablet_bootstrap.cc:492] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad: Bootstrap starting.
I20260709 12:30:59.286731 12471 tablet_bootstrap.cc:492] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:30:59.303639 12379 heartbeater.cc:499] Master 127.2.157.62:44741 was elected leader, sending a full tablet report...
I20260709 12:30:59.304118 12470 tablet_bootstrap.cc:654] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.304697 12468 ts_tablet_manager.cc:1434] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.003s
I20260709 12:30:59.306083 12468 tablet_bootstrap.cc:492] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c: Bootstrap starting.
I20260709 12:30:59.313153 12471 tablet_bootstrap.cc:654] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.313400 12468 tablet_bootstrap.cc:654] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.339087 12468 tablet_bootstrap.cc:492] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c: No bootstrap required, opened a new log
I20260709 12:30:59.339629 12468 ts_tablet_manager.cc:1403] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.015s
I20260709 12:30:59.339895 12471 tablet_bootstrap.cc:492] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6: No bootstrap required, opened a new log
I20260709 12:30:59.340380 12471 ts_tablet_manager.cc:1403] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.054s	user 0.005s	sys 0.005s
I20260709 12:30:59.342629 12468 raft_consensus.cc:359] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.343401 12468 raft_consensus.cc:385] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.342931 12471 raft_consensus.cc:359] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.343747 12468 raft_consensus.cc:740] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.343858 12470 tablet_bootstrap.cc:492] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad: No bootstrap required, opened a new log
I20260709 12:30:59.343910 12471 raft_consensus.cc:385] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.344528 12470 ts_tablet_manager.cc:1403] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad: Time spent bootstrapping tablet: real 0.058s	user 0.004s	sys 0.007s
I20260709 12:30:59.344537 12471 raft_consensus.cc:740] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.345693 12471 consensus_queue.cc:260] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.344687 12468 consensus_queue.cc:260] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.348701 12468 ts_tablet_manager.cc:1434] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:30:59.349134 12304 heartbeater.cc:499] Master 127.2.157.62:44741 was elected leader, sending a full tablet report...
I20260709 12:30:59.349808 12468 tablet_bootstrap.cc:492] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c: Bootstrap starting.
I20260709 12:30:59.349915 12471 ts_tablet_manager.cc:1434] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:30:59.350800 12470 raft_consensus.cc:359] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.358235 12470 raft_consensus.cc:385] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.358508 12471 tablet_bootstrap.cc:492] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:30:59.358573 12470 raft_consensus.cc:740] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.360978 12470 consensus_queue.cc:260] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.364584 12468 tablet_bootstrap.cc:654] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.366880 12471 tablet_bootstrap.cc:654] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.380669 12471 tablet_bootstrap.cc:492] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6: No bootstrap required, opened a new log
I20260709 12:30:59.381340 12471 ts_tablet_manager.cc:1403] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.011s
I20260709 12:30:59.382202 12472 raft_consensus.cc:493] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:59.382462 12470 ts_tablet_manager.cc:1434] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad: Time spent starting tablet: real 0.037s	user 0.021s	sys 0.012s
I20260709 12:30:59.382797 12472 raft_consensus.cc:515] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:30:59.382191 12453 heartbeater.cc:499] Master 127.2.157.62:44741 was elected leader, sending a full tablet report...
I20260709 12:30:59.383601 12470 tablet_bootstrap.cc:492] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad: Bootstrap starting.
I20260709 12:30:59.385280 12468 tablet_bootstrap.cc:492] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c: No bootstrap required, opened a new log
I20260709 12:30:59.385838 12468 ts_tablet_manager.cc:1403] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.014s
I20260709 12:30:59.390220 12471 raft_consensus.cc:359] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.390447 12468 raft_consensus.cc:359] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.391005 12471 raft_consensus.cc:385] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.391368 12468 raft_consensus.cc:385] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.391439 12471 raft_consensus.cc:740] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.394371 12472 leader_election.cc:290] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211), de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329)
I20260709 12:30:59.391068 12470 tablet_bootstrap.cc:654] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.401208 12468 raft_consensus.cc:740] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.392294 12471 consensus_queue.cc:260] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.402556 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6" is_pre_election: true
I20260709 12:30:59.402513 12468 consensus_queue.cc:260] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.405318 12468 ts_tablet_manager.cc:1434] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:30:59.407577 12468 tablet_bootstrap.cc:492] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c: Bootstrap starting.
W20260709 12:30:59.408963 12320 leader_election.cc:343] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.414567 12468 tablet_bootstrap.cc:654] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.420739 12470 tablet_bootstrap.cc:492] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad: No bootstrap required, opened a new log
I20260709 12:30:59.421285 12470 ts_tablet_manager.cc:1403] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.010s
I20260709 12:30:59.422260 12471 ts_tablet_manager.cc:1434] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.002s
I20260709 12:30:59.422070 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
I20260709 12:30:59.426010 12468 tablet_bootstrap.cc:492] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c: No bootstrap required, opened a new log
W20260709 12:30:59.424312 12318 leader_election.cc:343] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.424358 12470 raft_consensus.cc:359] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.425141 12471 tablet_bootstrap.cc:492] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:30:59.427670 12468 ts_tablet_manager.cc:1403] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 12:30:59.427824 12470 raft_consensus.cc:385] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.428355 12470 raft_consensus.cc:740] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.429174 12470 consensus_queue.cc:260] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.431383 12468 raft_consensus.cc:359] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.431876 12470 ts_tablet_manager.cc:1434] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:30:59.432333 12468 raft_consensus.cc:385] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.432750 12468 raft_consensus.cc:740] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.433076 12470 tablet_bootstrap.cc:492] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad: Bootstrap starting.
I20260709 12:30:59.433640 12468 consensus_queue.cc:260] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.434690 12471 tablet_bootstrap.cc:654] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.436506 12468 ts_tablet_manager.cc:1434] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:30:59.437685 12468 tablet_bootstrap.cc:492] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c: Bootstrap starting.
I20260709 12:30:59.427692 12318 leader_election.cc:304] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9991f7979627435c88f2c2b58b90d87c; no voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6
I20260709 12:30:59.438709 12472 raft_consensus.cc:2749] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:59.440512 12470 tablet_bootstrap.cc:654] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.443464 12472 raft_consensus.cc:493] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:59.444043 12472 raft_consensus.cc:515] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.446301 12472 leader_election.cc:290] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:59.446487 12468 tablet_bootstrap.cc:654] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.447399 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b9d08e895f41f38ce6925c93be2c3d" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6" is_pre_election: true
I20260709 12:30:59.448904 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b9d08e895f41f38ce6925c93be2c3d" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
I20260709 12:30:59.449833 12428 raft_consensus.cc:2468] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 0.
I20260709 12:30:59.450081 12471 tablet_bootstrap.cc:492] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6: No bootstrap required, opened a new log
I20260709 12:30:59.451000 12471 ts_tablet_manager.cc:1403] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.005s
I20260709 12:30:59.451669 12318 leader_election.cc:304] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c; no voters: 
I20260709 12:30:59.452880 12472 raft_consensus.cc:2804] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:59.453388 12472 raft_consensus.cc:493] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:59.453812 12472 raft_consensus.cc:3060] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.455518 12471 raft_consensus.cc:359] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:30:59.456416 12471 raft_consensus.cc:385] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.456790 12471 raft_consensus.cc:740] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.457798 12471 consensus_queue.cc:260] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:30:59.458498 12468 tablet_bootstrap.cc:492] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c: No bootstrap required, opened a new log
I20260709 12:30:59.458767 12476 raft_consensus.cc:493] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:59.464999 12476 raft_consensus.cc:515] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
W20260709 12:30:59.470009 12320 leader_election.cc:343] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.472039 12468 ts_tablet_manager.cc:1403] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.002s
I20260709 12:30:59.477974 12472 raft_consensus.cc:515] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.479588 12471 ts_tablet_manager.cc:1434] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.005s
I20260709 12:30:59.480047 12476 leader_election.cc:290] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:59.482731 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b9d08e895f41f38ce6925c93be2c3d" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
W20260709 12:30:59.484500 12320 leader_election.cc:343] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.485222 12471 tablet_bootstrap.cc:492] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:30:59.486189 12468 raft_consensus.cc:359] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.487876 12468 raft_consensus.cc:385] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.488188 12468 raft_consensus.cc:740] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.489813 12472 leader_election.cc:290] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:59.491109 12470 tablet_bootstrap.cc:492] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad: No bootstrap required, opened a new log
I20260709 12:30:59.490958 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b9d08e895f41f38ce6925c93be2c3d" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
I20260709 12:30:59.491688 12470 ts_tablet_manager.cc:1403] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.030s
I20260709 12:30:59.491714 12428 raft_consensus.cc:3060] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.494951 12470 raft_consensus.cc:359] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.495666 12470 raft_consensus.cc:385] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.495961 12470 raft_consensus.cc:740] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.496815 12470 consensus_queue.cc:260] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.500382 12470 ts_tablet_manager.cc:1434] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:30:59.500841 12428 raft_consensus.cc:2468] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 1.
I20260709 12:30:59.501380 12470 tablet_bootstrap.cc:492] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad: Bootstrap starting.
I20260709 12:30:59.502192 12318 leader_election.cc:304] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c; no voters: de4b3af4a2b3442fa050107035dcfff6
I20260709 12:30:59.503448 12472 raft_consensus.cc:2804] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:59.504354 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dd84c108414f9f9722ca01990fc393" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c" is_pre_election: true
I20260709 12:30:59.504501 12468 consensus_queue.cc:260] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.505719 12471 tablet_bootstrap.cc:654] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6: Neither blocks nor log segments found. Creating new log.
W20260709 12:30:59.506284 12242 leader_election.cc:343] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.508575 12470 tablet_bootstrap.cc:654] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.511071 12468 ts_tablet_manager.cc:1434] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 12:30:59.512089 12468 tablet_bootstrap.cc:492] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c: Bootstrap starting.
I20260709 12:30:59.517197 12472 raft_consensus.cc:697] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Becoming Leader. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:30:59.518370 12472 consensus_queue.cc:237] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.519053 12486 raft_consensus.cc:493] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:59.520105 12486 raft_consensus.cc:515] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:30:59.523473 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dd84c108414f9f9722ca01990fc393" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
I20260709 12:30:59.524494 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c" is_pre_election: true
I20260709 12:30:59.525442 12354 raft_consensus.cc:2468] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de4b3af4a2b3442fa050107035dcfff6 in term 0.
W20260709 12:30:59.525923 12243 leader_election.cc:343] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.526695 12243 leader_election.cc:304] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de4b3af4a2b3442fa050107035dcfff6; no voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c
I20260709 12:30:59.527179 12242 leader_election.cc:304] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9991f7979627435c88f2c2b58b90d87c, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:30:59.528708 12476 raft_consensus.cc:2749] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:59.533880 12476 raft_consensus.cc:2804] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:59.534663 12476 raft_consensus.cc:493] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:59.535089 12476 raft_consensus.cc:3060] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.536188 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
I20260709 12:30:59.536710 12468 tablet_bootstrap.cc:654] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c: Neither blocks nor log segments found. Creating new log.
W20260709 12:30:59.537787 12243 leader_election.cc:343] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.538327 12470 tablet_bootstrap.cc:492] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad: No bootstrap required, opened a new log
I20260709 12:30:59.534868 12486 leader_election.cc:290] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:59.538982 12470 ts_tablet_manager.cc:1403] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.009s
I20260709 12:30:59.546267 12470 raft_consensus.cc:359] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.546927 12470 raft_consensus.cc:385] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.547214 12470 raft_consensus.cc:740] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.548024 12470 consensus_queue.cc:260] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.550354 12470 ts_tablet_manager.cc:1434] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:30:59.551514 12470 tablet_bootstrap.cc:492] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad: Bootstrap starting.
I20260709 12:30:59.553081 12472 raft_consensus.cc:493] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:59.553684 12472 raft_consensus.cc:515] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.556164 12472 leader_election.cc:290] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:59.563093 12476 raft_consensus.cc:515] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:30:59.566184 12476 leader_election.cc:290] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 election: Requested vote from peers 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:59.566581 12470 tablet_bootstrap.cc:654] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.562341 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94481e8787914dbea7313a90452f7ad0" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
I20260709 12:30:59.565820 12471 tablet_bootstrap.cc:492] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6: No bootstrap required, opened a new log
I20260709 12:30:59.567209 12428 raft_consensus.cc:2468] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 0.
I20260709 12:30:59.567838 12471 ts_tablet_manager.cc:1403] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.014s
I20260709 12:30:59.568611 12318 leader_election.cc:304] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c; no voters: 
I20260709 12:30:59.568374 12177 catalog_manager.cc:5697] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9991f7979627435c88f2c2b58b90d87c (127.2.157.2). New cstate: current_term: 1 leader_uuid: "9991f7979627435c88f2c2b58b90d87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:59.568818 12427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
I20260709 12:30:59.570940 12472 raft_consensus.cc:2804] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:30:59.571520 12243 leader_election.cc:343] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.572290 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94481e8787914dbea7313a90452f7ad0" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6" is_pre_election: true
I20260709 12:30:59.571520 12472 raft_consensus.cc:493] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:59.573324 12472 raft_consensus.cc:3060] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.573837 12468 tablet_bootstrap.cc:492] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c: No bootstrap required, opened a new log
I20260709 12:30:59.574470 12468 ts_tablet_manager.cc:1403] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.021s
I20260709 12:30:59.576448 12471 raft_consensus.cc:359] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.577302 12471 raft_consensus.cc:385] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.577803 12468 raft_consensus.cc:359] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.578612 12468 raft_consensus.cc:385] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.578935 12468 raft_consensus.cc:740] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.579939 12468 consensus_queue.cc:260] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.580750 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:30:59.581423 12354 raft_consensus.cc:3060] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.582582 12468 ts_tablet_manager.cc:1434] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:30:59.583773 12468 tablet_bootstrap.cc:492] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c: Bootstrap starting.
I20260709 12:30:59.577651 12471 raft_consensus.cc:740] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
W20260709 12:30:59.585930 12320 leader_election.cc:343] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.587929 12472 raft_consensus.cc:515] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.593343 12470 tablet_bootstrap.cc:492] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad: No bootstrap required, opened a new log
I20260709 12:30:59.593828 12427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94481e8787914dbea7313a90452f7ad0" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
I20260709 12:30:59.594380 12472 leader_election.cc:290] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:59.594144 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94481e8787914dbea7313a90452f7ad0" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:30:59.596539 12470 ts_tablet_manager.cc:1403] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.008s
W20260709 12:30:59.598111 12320 leader_election.cc:343] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.595837 12354 raft_consensus.cc:2468] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de4b3af4a2b3442fa050107035dcfff6 in term 1.
I20260709 12:30:59.598839 12468 tablet_bootstrap.cc:654] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.586297 12471 consensus_queue.cc:260] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.596514 12427 raft_consensus.cc:3060] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.600800 12470 raft_consensus.cc:359] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:30:59.601709 12470 raft_consensus.cc:385] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.602130 12470 raft_consensus.cc:740] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.600033 12242 leader_election.cc:304] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9991f7979627435c88f2c2b58b90d87c, de4b3af4a2b3442fa050107035dcfff6; no voters: 372fc4cdae534a00bc75f3087d0bcfad
I20260709 12:30:59.603165 12470 consensus_queue.cc:260] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:30:59.604261 12476 raft_consensus.cc:2804] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:59.605046 12476 raft_consensus.cc:697] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 1 LEADER]: Becoming Leader. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Running, Role: LEADER
I20260709 12:30:59.606016 12470 ts_tablet_manager.cc:1434] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:30:59.609193 12470 tablet_bootstrap.cc:492] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad: Bootstrap starting.
I20260709 12:30:59.610494 12472 raft_consensus.cc:493] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:59.609220 12427 raft_consensus.cc:2468] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 1.
I20260709 12:30:59.609153 12476 consensus_queue.cc:237] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:30:59.611096 12471 ts_tablet_manager.cc:1434] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:30:59.611061 12472 raft_consensus.cc:515] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.612422 12471 tablet_bootstrap.cc:492] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:30:59.613855 12472 leader_election.cc:290] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:59.618557 12318 leader_election.cc:304] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c; no voters: de4b3af4a2b3442fa050107035dcfff6
I20260709 12:30:59.620193 12471 tablet_bootstrap.cc:654] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.621855 12472 raft_consensus.cc:2804] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:59.622126 12470 tablet_bootstrap.cc:654] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.623063 12472 raft_consensus.cc:697] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Becoming Leader. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:30:59.624184 12472 consensus_queue.cc:237] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.625059 12175 catalog_manager.cc:5697] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 reported cstate change: term changed from 0 to 1, leader changed from <none> to de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "de4b3af4a2b3442fa050107035dcfff6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:59.626067 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf043e9033134a2692d1980200717c1c" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6" is_pre_election: true
W20260709 12:30:59.627750 12320 leader_election.cc:343] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:59.628355 12225 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:59.618567 12427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf043e9033134a2692d1980200717c1c" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
I20260709 12:30:59.639489 12470 tablet_bootstrap.cc:492] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad: No bootstrap required, opened a new log
I20260709 12:30:59.640098 12470 ts_tablet_manager.cc:1403] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.008s
W20260709 12:30:59.640501 12318 leader_election.cc:343] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.641093 12318 leader_election.cc:304] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9991f7979627435c88f2c2b58b90d87c; no voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6
I20260709 12:30:59.641299 12468 tablet_bootstrap.cc:492] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c: No bootstrap required, opened a new log
I20260709 12:30:59.642267 12468 ts_tablet_manager.cc:1403] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.010s
I20260709 12:30:59.642380 12472 raft_consensus.cc:2749] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:59.643508 12470 raft_consensus.cc:359] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.644423 12470 raft_consensus.cc:385] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.644770 12470 raft_consensus.cc:740] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.645613 12470 consensus_queue.cc:260] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.648087 12470 ts_tablet_manager.cc:1434] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:30:59.648414 12468 raft_consensus.cc:359] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.650104 12468 raft_consensus.cc:385] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.650528 12468 raft_consensus.cc:740] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.651556 12468 consensus_queue.cc:260] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.652308 12471 tablet_bootstrap.cc:492] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6: No bootstrap required, opened a new log
I20260709 12:30:59.652967 12471 ts_tablet_manager.cc:1403] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.014s
I20260709 12:30:59.654790 12468 ts_tablet_manager.cc:1434] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:30:59.656173 12468 tablet_bootstrap.cc:492] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c: Bootstrap starting.
I20260709 12:30:59.656447 12471 raft_consensus.cc:359] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.657327 12471 raft_consensus.cc:385] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.657671 12471 raft_consensus.cc:740] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.658819 12471 consensus_queue.cc:260] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.661813 12471 ts_tablet_manager.cc:1434] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 12:30:59.662997 12471 tablet_bootstrap.cc:492] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:30:59.664234 12177 catalog_manager.cc:5697] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9991f7979627435c88f2c2b58b90d87c (127.2.157.2). New cstate: current_term: 1 leader_uuid: "9991f7979627435c88f2c2b58b90d87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:59.667693 12468 tablet_bootstrap.cc:654] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.670354 12471 tablet_bootstrap.cc:654] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.649190 12470 tablet_bootstrap.cc:492] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad: Bootstrap starting.
I20260709 12:30:59.672722 12477 raft_consensus.cc:493] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:59.673291 12477 raft_consensus.cc:515] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.677846 12470 tablet_bootstrap.cc:654] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.678844 12477 leader_election.cc:290] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:30:59.684432 12468 tablet_bootstrap.cc:492] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c: No bootstrap required, opened a new log
I20260709 12:30:59.684984 12468 ts_tablet_manager.cc:1403] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.000s
I20260709 12:30:59.687955 12468 raft_consensus.cc:359] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.688627 12468 raft_consensus.cc:385] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.688871 12468 raft_consensus.cc:740] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.689517 12468 consensus_queue.cc:260] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.692245 12468 ts_tablet_manager.cc:1434] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:30:59.692423 12470 tablet_bootstrap.cc:492] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad: No bootstrap required, opened a new log
I20260709 12:30:59.692457 12471 tablet_bootstrap.cc:492] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6: No bootstrap required, opened a new log
I20260709 12:30:59.693075 12470 ts_tablet_manager.cc:1403] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.012s
I20260709 12:30:59.693127 12468 tablet_bootstrap.cc:492] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c: Bootstrap starting.
I20260709 12:30:59.693143 12471 ts_tablet_manager.cc:1403] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.012s
I20260709 12:30:59.696270 12470 raft_consensus.cc:359] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.697041 12470 raft_consensus.cc:385] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.697367 12470 raft_consensus.cc:740] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.698232 12470 consensus_queue.cc:260] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.698966 12468 tablet_bootstrap.cc:654] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.703063 12477 raft_consensus.cc:493] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:59.703217 12470 ts_tablet_manager.cc:1434] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:30:59.703626 12477 raft_consensus.cc:515] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.704378 12470 tablet_bootstrap.cc:492] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad: Bootstrap starting.
I20260709 12:30:59.706509 12477 leader_election.cc:290] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:30:59.711863 12470 tablet_bootstrap.cc:654] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.697589 12471 raft_consensus.cc:359] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.715055 12471 raft_consensus.cc:385] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.715458 12471 raft_consensus.cc:740] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.723156 12278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4283da7c6b4df7a5be4614d3d9d297" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6" is_pre_election: true
I20260709 12:30:59.723268 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dd84c108414f9f9722ca01990fc393" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6" is_pre_election: true
I20260709 12:30:59.723678 12470 tablet_bootstrap.cc:492] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad: No bootstrap required, opened a new log
I20260709 12:30:59.724313 12470 ts_tablet_manager.cc:1403] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:30:59.724273 12279 raft_consensus.cc:2468] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 0.
W20260709 12:30:59.724916 12394 leader_election.cc:343] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.726102 12394 leader_election.cc:304] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:30:59.727054 12477 raft_consensus.cc:2804] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:59.727592 12477 raft_consensus.cc:493] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:59.727478 12470 raft_consensus.cc:359] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.728072 12477 raft_consensus.cc:3060] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.728195 12470 raft_consensus.cc:385] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.728674 12470 raft_consensus.cc:740] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.729607 12470 consensus_queue.cc:260] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.726365 12471 consensus_queue.cc:260] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.739903 12471 ts_tablet_manager.cc:1434] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.003s
I20260709 12:30:59.741397 12471 tablet_bootstrap.cc:492] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:30:59.749477 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dd84c108414f9f9722ca01990fc393" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c" is_pre_election: true
I20260709 12:30:59.750536 12354 raft_consensus.cc:2468] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 0.
I20260709 12:30:59.752142 12353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4283da7c6b4df7a5be4614d3d9d297" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c" is_pre_election: true
I20260709 12:30:59.753149 12353 raft_consensus.cc:2468] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 0.
I20260709 12:30:59.756821 12391 leader_election.cc:304] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c; no voters: de4b3af4a2b3442fa050107035dcfff6
I20260709 12:30:59.758664 12470 ts_tablet_manager.cc:1434] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad: Time spent starting tablet: real 0.034s	user 0.013s	sys 0.016s
I20260709 12:30:59.756837 12477 raft_consensus.cc:515] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.759996 12470 tablet_bootstrap.cc:492] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad: Bootstrap starting.
I20260709 12:30:59.761191 12477 leader_election.cc:290] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:30:59.761698 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dd84c108414f9f9722ca01990fc393" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:30:59.762353 12279 raft_consensus.cc:3060] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.766301 12477 raft_consensus.cc:2804] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:59.767093 12470 tablet_bootstrap.cc:654] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.768589 12477 raft_consensus.cc:493] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:59.769171 12477 raft_consensus.cc:3060] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.778379 12353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dd84c108414f9f9722ca01990fc393" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:30:59.779412 12353 raft_consensus.cc:3060] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.787741 12279 raft_consensus.cc:2468] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 1.
I20260709 12:30:59.789752 12394 leader_election.cc:304] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:30:59.791313 12514 raft_consensus.cc:2804] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:59.792019 12514 raft_consensus.cc:697] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Becoming Leader. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:30:59.793241 12514 consensus_queue.cc:237] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.795818 12353 raft_consensus.cc:2468] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 1.
I20260709 12:30:59.802531 12470 tablet_bootstrap.cc:492] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad: No bootstrap required, opened a new log
I20260709 12:30:59.803368 12470 ts_tablet_manager.cc:1403] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.019s
I20260709 12:30:59.805157 12472 raft_consensus.cc:493] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:59.805748 12472 raft_consensus.cc:515] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.806689 12468 tablet_bootstrap.cc:492] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c: No bootstrap required, opened a new log
I20260709 12:30:59.807291 12468 ts_tablet_manager.cc:1403] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c: Time spent bootstrapping tablet: real 0.114s	user 0.055s	sys 0.051s
I20260709 12:30:59.806710 12470 raft_consensus.cc:359] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.807962 12470 raft_consensus.cc:385] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.808353 12470 raft_consensus.cc:740] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.810416 12468 raft_consensus.cc:359] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.811146 12468 raft_consensus.cc:385] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.808194 12472 leader_election.cc:290] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:59.811501 12468 raft_consensus.cc:740] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.811168 12427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
I20260709 12:30:59.811236 12470 consensus_queue.cc:260] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.812518 12427 raft_consensus.cc:2468] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 0.
I20260709 12:30:59.812546 12468 consensus_queue.cc:260] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.813709 12471 tablet_bootstrap.cc:654] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.814268 12318 leader_election.cc:304] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c; no voters: 
I20260709 12:30:59.814527 12470 ts_tablet_manager.cc:1434] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:30:59.814868 12468 ts_tablet_manager.cc:1434] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:30:59.815723 12470 tablet_bootstrap.cc:492] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad: Bootstrap starting.
I20260709 12:30:59.815938 12468 tablet_bootstrap.cc:492] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c: Bootstrap starting.
I20260709 12:30:59.811280 12477 raft_consensus.cc:515] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.815655 12489 raft_consensus.cc:2804] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:59.818836 12489 raft_consensus.cc:493] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:59.819279 12489 raft_consensus.cc:3060] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.820189 12477 leader_election.cc:290] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:30:59.822489 12468 tablet_bootstrap.cc:654] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.823323 12470 tablet_bootstrap.cc:654] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.823650 12353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4283da7c6b4df7a5be4614d3d9d297" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:30:59.824370 12353 raft_consensus.cc:3060] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.822301 12278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4283da7c6b4df7a5be4614d3d9d297" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
W20260709 12:30:59.827538 12394 leader_election.cc:343] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.833393 12490 raft_consensus.cc:493] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:59.834160 12490 raft_consensus.cc:515] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.835891 12470 tablet_bootstrap.cc:492] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad: No bootstrap required, opened a new log
I20260709 12:30:59.836508 12470 ts_tablet_manager.cc:1403] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:30:59.837155 12490 leader_election.cc:290] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:59.838327 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6" is_pre_election: true
I20260709 12:30:59.839123 12279 raft_consensus.cc:2468] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 0.
I20260709 12:30:59.839692 12476 raft_consensus.cc:493] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:59.840296 12476 raft_consensus.cc:515] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.841158 12470 raft_consensus.cc:359] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.841981 12470 raft_consensus.cc:385] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.842344 12470 raft_consensus.cc:740] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.843226 12470 consensus_queue.cc:260] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.844256 12427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
I20260709 12:30:59.845083 12427 raft_consensus.cc:2468] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de4b3af4a2b3442fa050107035dcfff6 in term 0.
I20260709 12:30:59.846549 12470 ts_tablet_manager.cc:1434] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:30:59.842358 12489 raft_consensus.cc:515] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.846462 12243 leader_election.cc:304] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:30:59.847016 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c" is_pre_election: true
I20260709 12:30:59.848034 12493 raft_consensus.cc:2804] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:59.848569 12493 raft_consensus.cc:493] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:59.848999 12493 raft_consensus.cc:3060] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.849352 12489 leader_election.cc:290] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:59.848134 12354 raft_consensus.cc:2393] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de4b3af4a2b3442fa050107035dcfff6 in current term 1: Already voted for candidate 9991f7979627435c88f2c2b58b90d87c in this term.
I20260709 12:30:59.850723 12278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:30:59.852401 12427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c561ccc54c4fa2971b10c4f4e42c55" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
I20260709 12:30:59.853150 12427 raft_consensus.cc:2468] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 0.
I20260709 12:30:59.853338 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
I20260709 12:30:59.854184 12428 raft_consensus.cc:3060] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.856617 12493 raft_consensus.cc:515] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.857720 12278 raft_consensus.cc:2393] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9991f7979627435c88f2c2b58b90d87c in current term 1: Already voted for candidate de4b3af4a2b3442fa050107035dcfff6 in this term.
I20260709 12:30:59.858534 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c561ccc54c4fa2971b10c4f4e42c55" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6" is_pre_election: true
I20260709 12:30:59.858788 12318 leader_election.cc:304] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c; no voters: 
I20260709 12:30:59.844096 12476 leader_election.cc:290] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:59.861865 12353 raft_consensus.cc:2468] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 1.
I20260709 12:30:59.863106 12493 leader_election.cc:290] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 election: Requested vote from peers 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:59.863435 12391 leader_election.cc:304] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c; no voters: de4b3af4a2b3442fa050107035dcfff6
I20260709 12:30:59.864859 12514 raft_consensus.cc:2804] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:59.865494 12514 raft_consensus.cc:697] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Becoming Leader. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:30:59.866488 12489 raft_consensus.cc:2804] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:59.867198 12489 raft_consensus.cc:493] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:59.866569 12514 consensus_queue.cc:237] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.867645 12489 raft_consensus.cc:3060] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.915406 12468 tablet_bootstrap.cc:492] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c: No bootstrap required, opened a new log
I20260709 12:30:59.917219 12468 ts_tablet_manager.cc:1403] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c: Time spent bootstrapping tablet: real 0.101s	user 0.022s	sys 0.036s
I20260709 12:30:59.914569 12427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
I20260709 12:30:59.909020 12471 tablet_bootstrap.cc:492] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6: No bootstrap required, opened a new log
I20260709 12:30:59.928632 12515 raft_consensus.cc:493] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:59.929633 12471 ts_tablet_manager.cc:1403] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.189s	user 0.025s	sys 0.001s
I20260709 12:30:59.929999 12515 raft_consensus.cc:515] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.933702 12515 leader_election.cc:290] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:30:59.934831 12353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:30:59.935024 12278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5711e505622444fcbbc5c41a0e73b637" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6" is_pre_election: true
I20260709 12:30:59.935555 12428 raft_consensus.cc:2468] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 1.
I20260709 12:30:59.936223 12278 raft_consensus.cc:2468] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 0.
I20260709 12:30:59.933694 12489 raft_consensus.cc:515] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.936626 12471 raft_consensus.cc:359] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.937806 12471 raft_consensus.cc:385] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:30:59.909022 12320 leader_election.cc:343] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.938316 12471 raft_consensus.cc:740] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.939528 12318 leader_election.cc:304] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c; no voters: 
I20260709 12:30:59.939798 12489 leader_election.cc:290] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:30:59.939704 12471 consensus_queue.cc:260] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.942807 12278 raft_consensus.cc:3060] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.938376 12394 leader_election.cc:304] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:30:59.944435 12515 raft_consensus.cc:2804] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:59.944903 12515 raft_consensus.cc:493] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:59.945021 12471 ts_tablet_manager.cc:1434] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 12:30:59.945315 12515 raft_consensus.cc:3060] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.945389 12428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c561ccc54c4fa2971b10c4f4e42c55" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
I20260709 12:30:59.947254 12471 tablet_bootstrap.cc:492] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:30:59.936365 12353 raft_consensus.cc:2393] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate de4b3af4a2b3442fa050107035dcfff6 in current term 1: Already voted for candidate 9991f7979627435c88f2c2b58b90d87c in this term.
I20260709 12:30:59.951649 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c561ccc54c4fa2971b10c4f4e42c55" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:30:59.954304 12468 raft_consensus.cc:359] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.955407 12468 raft_consensus.cc:385] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:59.950865 12177 catalog_manager.cc:5697] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad reported cstate change: term changed from 0 to 1, leader changed from <none> to 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3). New cstate: current_term: 1 leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:59.957960 12242 leader_election.cc:304] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de4b3af4a2b3442fa050107035dcfff6; no voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c
I20260709 12:30:59.955713 12468 raft_consensus.cc:740] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Initialized, Role: FOLLOWER
I20260709 12:30:59.949263 12428 raft_consensus.cc:3060] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.949803 12489 raft_consensus.cc:2804] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:59.956911 12477 raft_consensus.cc:493] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:59.960640 12493 raft_consensus.cc:2749] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:30:59.960750 12477 raft_consensus.cc:515] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
W20260709 12:30:59.963195 12320 leader_election.cc:343] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:59.965760 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6" is_pre_election: true
I20260709 12:30:59.967104 12489 raft_consensus.cc:697] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Becoming Leader. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:30:59.967480 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c" is_pre_election: true
I20260709 12:30:59.968143 12477 leader_election.cc:290] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835), de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329)
I20260709 12:30:59.968848 12354 raft_consensus.cc:2393] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 372fc4cdae534a00bc75f3087d0bcfad in current term 1: Already voted for candidate de4b3af4a2b3442fa050107035dcfff6 in this term.
I20260709 12:30:59.967160 12490 consensus_queue.cc:1048] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:30:59.971143 12468 consensus_queue.cc:260] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.981657 12468 ts_tablet_manager.cc:1434] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.005s
W20260709 12:30:59.979012 12521 log.cc:927] Time spent T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad: Append to log took a long time: real 0.072s	user 0.005s	sys 0.003s
I20260709 12:30:59.983245 12353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5711e505622444fcbbc5c41a0e73b637" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c" is_pre_election: true
I20260709 12:30:59.983511 12391 leader_election.cc:304] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad; no voters: 9991f7979627435c88f2c2b58b90d87c, de4b3af4a2b3442fa050107035dcfff6
I20260709 12:30:59.987681 12353 raft_consensus.cc:2468] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 0.
I20260709 12:30:59.988552 12477 raft_consensus.cc:3060] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:59.986245 12471 tablet_bootstrap.cc:654] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:59.972661 12489 consensus_queue.cc:237] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.981703 12515 raft_consensus.cc:515] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:30:59.999527 12515 leader_election.cc:290] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:31:00.000581 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5711e505622444fcbbc5c41a0e73b637" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:00.000865 12353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5711e505622444fcbbc5c41a0e73b637" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:31:00.001304 12279 raft_consensus.cc:3060] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:00.001802 12353 raft_consensus.cc:3060] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:00.006659 12493 raft_consensus.cc:493] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:00.007263 12493 raft_consensus.cc:515] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.008282 12428 raft_consensus.cc:2468] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 1.
I20260709 12:31:00.012243 12279 raft_consensus.cc:2468] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 1.
I20260709 12:31:00.015259 12471 tablet_bootstrap.cc:492] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6: No bootstrap required, opened a new log
I20260709 12:31:00.015800 12471 ts_tablet_manager.cc:1403] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.004s
I20260709 12:31:00.012037 12477 raft_consensus.cc:2749] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:00.016934 12318 leader_election.cc:304] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c; no voters: de4b3af4a2b3442fa050107035dcfff6
I20260709 12:31:00.018285 12490 raft_consensus.cc:2804] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:00.019876 12490 raft_consensus.cc:697] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Becoming Leader. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:00.021741 12490 consensus_queue.cc:237] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.023334 12471 raft_consensus.cc:359] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.024098 12471 raft_consensus.cc:385] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:00.024371 12471 raft_consensus.cc:740] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:31:00.025050 12476 consensus_queue.cc:1048] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:00.028529 12394 leader_election.cc:304] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:00.028734 12471 consensus_queue.cc:260] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.030033 12515 raft_consensus.cc:2804] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:00.030622 12515 raft_consensus.cc:697] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Becoming Leader. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:00.031641 12471 ts_tablet_manager.cc:1434] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.005s
I20260709 12:31:00.031890 12515 consensus_queue.cc:237] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.032980 12471 tablet_bootstrap.cc:492] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:31:00.033584 12353 raft_consensus.cc:2468] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 1.
I20260709 12:31:00.043947 12489 consensus_queue.cc:1048] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:00.047343 12493 leader_election.cc:290] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:31:00.048012 12353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b9d08e895f41f38ce6925c93be2c3d" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c" is_pre_election: true
I20260709 12:31:00.051709 12176 catalog_manager.cc:5697] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9991f7979627435c88f2c2b58b90d87c (127.2.157.2). New cstate: current_term: 1 leader_uuid: "9991f7979627435c88f2c2b58b90d87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:00.056838 12177 catalog_manager.cc:5697] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad reported cstate change: term changed from 0 to 1, leader changed from <none> to 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3). New cstate: current_term: 1 leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:00.059038 12471 tablet_bootstrap.cc:654] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:00.060599 12427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b9d08e895f41f38ce6925c93be2c3d" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
I20260709 12:31:00.074649 12243 leader_election.cc:304] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de4b3af4a2b3442fa050107035dcfff6; no voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c
I20260709 12:31:00.077368 12489 raft_consensus.cc:493] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:00.078387 12489 raft_consensus.cc:515] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.080719 12476 raft_consensus.cc:493] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:00.081687 12476 raft_consensus.cc:515] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.082020 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae06fd5a0f546fcaa1b4e0e4b23f594" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6" is_pre_election: true
I20260709 12:31:00.082808 12279 raft_consensus.cc:2468] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 0.
I20260709 12:31:00.092465 12493 consensus_queue.cc:1048] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:00.093446 12320 leader_election.cc:304] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9991f7979627435c88f2c2b58b90d87c, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:00.096139 12472 raft_consensus.cc:2804] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:00.096663 12472 raft_consensus.cc:493] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:00.097113 12472 raft_consensus.cc:3060] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:00.106504 12489 leader_election.cc:290] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:31:00.108702 12427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae06fd5a0f546fcaa1b4e0e4b23f594" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
I20260709 12:31:00.109567 12427 raft_consensus.cc:2468] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 0.
I20260709 12:31:00.114264 12531 raft_consensus.cc:2749] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:31:00.118278 12476 leader_election.cc:290] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:31:00.119493 12353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94481e8787914dbea7313a90452f7ad0" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c" is_pre_election: true
I20260709 12:31:00.127626 12426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94481e8787914dbea7313a90452f7ad0" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
I20260709 12:31:00.129115 12426 raft_consensus.cc:2393] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de4b3af4a2b3442fa050107035dcfff6 in current term 1: Already voted for candidate 9991f7979627435c88f2c2b58b90d87c in this term.
I20260709 12:31:00.134084 12177 catalog_manager.cc:5697] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad reported cstate change: term changed from 0 to 1, leader changed from <none> to 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3). New cstate: current_term: 1 leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:00.136368 12471 tablet_bootstrap.cc:492] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6: No bootstrap required, opened a new log
I20260709 12:31:00.136929 12471 ts_tablet_manager.cc:1403] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.104s	user 0.023s	sys 0.023s
I20260709 12:31:00.144512 12490 consensus_queue.cc:1048] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:31:00.147902 12471 raft_consensus.cc:359] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.149004 12471 raft_consensus.cc:385] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:00.148777 12472 raft_consensus.cc:515] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.149497 12471 raft_consensus.cc:740] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:31:00.150684 12471 consensus_queue.cc:260] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.153256 12471 ts_tablet_manager.cc:1434] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:31:00.154422 12471 tablet_bootstrap.cc:492] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:31:00.160000 12472 leader_election.cc:290] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:31:00.160629 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae06fd5a0f546fcaa1b4e0e4b23f594" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:00.161324 12279 raft_consensus.cc:3060] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:00.161924 12427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae06fd5a0f546fcaa1b4e0e4b23f594" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
I20260709 12:31:00.162580 12427 raft_consensus.cc:3060] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:00.166859 12471 tablet_bootstrap.cc:654] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:00.168334 12243 leader_election.cc:304] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de4b3af4a2b3442fa050107035dcfff6; no voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c
I20260709 12:31:00.170933 12476 raft_consensus.cc:3060] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:00.173252 12279 raft_consensus.cc:2468] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 1.
I20260709 12:31:00.174690 12320 leader_election.cc:304] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9991f7979627435c88f2c2b58b90d87c, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:00.175352 12531 raft_consensus.cc:493] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:00.175993 12531 raft_consensus.cc:515] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.174717 12175 catalog_manager.cc:5697] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9991f7979627435c88f2c2b58b90d87c (127.2.157.2). New cstate: current_term: 1 leader_uuid: "9991f7979627435c88f2c2b58b90d87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:00.178229 12531 leader_election.cc:290] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:31:00.179409 12353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c561ccc54c4fa2971b10c4f4e42c55" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c" is_pre_election: true
I20260709 12:31:00.180773 12425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c561ccc54c4fa2971b10c4f4e42c55" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
I20260709 12:31:00.181687 12425 raft_consensus.cc:2393] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de4b3af4a2b3442fa050107035dcfff6 in current term 1: Already voted for candidate 9991f7979627435c88f2c2b58b90d87c in this term.
I20260709 12:31:00.183110 12536 raft_consensus.cc:2804] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:00.183853 12243 leader_election.cc:304] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de4b3af4a2b3442fa050107035dcfff6; no voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c
I20260709 12:31:00.185199 12531 raft_consensus.cc:3060] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:00.184022 12536 raft_consensus.cc:697] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Becoming Leader. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:00.186674 12536 consensus_queue.cc:237] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.198737 12427 raft_consensus.cc:2468] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 1.
I20260709 12:31:00.204541 12471 tablet_bootstrap.cc:492] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6: No bootstrap required, opened a new log
I20260709 12:31:00.205262 12471 ts_tablet_manager.cc:1403] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.012s
I20260709 12:31:00.206221 12476 raft_consensus.cc:2749] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:00.208940 12471 raft_consensus.cc:359] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.209664 12471 raft_consensus.cc:385] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:00.209976 12471 raft_consensus.cc:740] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:31:00.212554 12531 raft_consensus.cc:2749] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:00.213095 12471 consensus_queue.cc:260] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.219328 12537 consensus_queue.cc:1048] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:00.220570 12176 catalog_manager.cc:5697] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9991f7979627435c88f2c2b58b90d87c (127.2.157.2). New cstate: current_term: 1 leader_uuid: "9991f7979627435c88f2c2b58b90d87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:00.222628 12471 ts_tablet_manager.cc:1434] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:31:00.230535 12515 raft_consensus.cc:493] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:00.231097 12515 raft_consensus.cc:515] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.233186 12515 leader_election.cc:290] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:31:00.235641 12278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf043e9033134a2692d1980200717c1c" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6" is_pre_election: true
I20260709 12:31:00.236333 12278 raft_consensus.cc:2468] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 0.
I20260709 12:31:00.237535 12394 leader_election.cc:304] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:00.237800 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf043e9033134a2692d1980200717c1c" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c" is_pre_election: true
I20260709 12:31:00.238662 12515 raft_consensus.cc:2804] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:00.238662 12354 raft_consensus.cc:2468] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 0.
I20260709 12:31:00.239351 12515 raft_consensus.cc:493] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:00.239848 12515 raft_consensus.cc:3060] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:00.249963 12515 raft_consensus.cc:515] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.253631 12279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf043e9033134a2692d1980200717c1c" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:00.254475 12279 raft_consensus.cc:3060] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:00.255502 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf043e9033134a2692d1980200717c1c" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:31:00.256233 12354 raft_consensus.cc:3060] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:00.262409 12515 leader_election.cc:290] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:31:00.263952 12279 raft_consensus.cc:2468] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 1.
I20260709 12:31:00.265100 12394 leader_election.cc:304] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:00.266032 12515 raft_consensus.cc:2804] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:00.266610 12515 raft_consensus.cc:697] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Becoming Leader. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:00.266301 12354 raft_consensus.cc:2468] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 1.
I20260709 12:31:00.267624 12515 consensus_queue.cc:237] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.275470 12176 catalog_manager.cc:5697] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad reported cstate change: term changed from 0 to 1, leader changed from <none> to 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3). New cstate: current_term: 1 leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:00.324517 12515 consensus_queue.cc:1048] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:00.338465 12544 consensus_queue.cc:1048] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:00.385897 12531 raft_consensus.cc:493] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:00.386487 12531 raft_consensus.cc:515] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:00.388393 12531 leader_election.cc:290] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:31:00.389253 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4283da7c6b4df7a5be4614d3d9d297" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c" is_pre_election: true
I20260709 12:31:00.389446 12426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4283da7c6b4df7a5be4614d3d9d297" candidate_uuid: "de4b3af4a2b3442fa050107035dcfff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
I20260709 12:31:00.390091 12354 raft_consensus.cc:2393] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de4b3af4a2b3442fa050107035dcfff6 in current term 1: Already voted for candidate 372fc4cdae534a00bc75f3087d0bcfad in this term.
I20260709 12:31:00.391127 12242 leader_election.cc:304] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de4b3af4a2b3442fa050107035dcfff6; no voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c
I20260709 12:31:00.391867 12531 raft_consensus.cc:3060] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:00.397660 12531 raft_consensus.cc:2749] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:00.420230 12544 consensus_queue.cc:1048] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:00.431318 12515 consensus_queue.cc:1048] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:00.462258 12537 consensus_queue.cc:1048] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:00.475200 12536 consensus_queue.cc:1048] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:00.490310  2676 ts_manager.cc:295] Set tserver state for de4b3af4a2b3442fa050107035dcfff6 to MAINTENANCE_MODE
I20260709 12:31:00.491463  2676 tablet_server.cc:179] TabletServer@127.2.157.1:0 shutting down...
I20260709 12:31:00.531590  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:00.532764  2676 tablet_replica.cc:333] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6: stopping tablet replica
I20260709 12:31:00.533522  2676 raft_consensus.cc:2243] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:00.534068  2676 raft_consensus.cc:2272] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:00.537058  2676 tablet_replica.cc:333] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6: stopping tablet replica
I20260709 12:31:00.537720  2676 raft_consensus.cc:2243] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:00.538317  2676 raft_consensus.cc:2272] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:00.538969 12536 consensus_queue.cc:1048] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:00.542233  2676 tablet_replica.cc:333] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6: stopping tablet replica
I20260709 12:31:00.543038  2676 raft_consensus.cc:2243] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:00.543465  2676 raft_consensus.cc:2272] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:00.546200  2676 tablet_replica.cc:333] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6: stopping tablet replica
I20260709 12:31:00.547008  2676 raft_consensus.cc:2243] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:00.547621  2676 raft_consensus.cc:2272] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:00.552465  2676 tablet_replica.cc:333] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6: stopping tablet replica
I20260709 12:31:00.553710  2676 raft_consensus.cc:2243] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:00.554405  2676 raft_consensus.cc:2272] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:00.558238  2676 tablet_replica.cc:333] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6: stopping tablet replica
I20260709 12:31:00.559437  2676 raft_consensus.cc:2243] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:00.560161  2676 raft_consensus.cc:2272] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:00.563943 12320 consensus_peers.cc:597] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:00.564885  2676 tablet_replica.cc:333] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6: stopping tablet replica
I20260709 12:31:00.565739  2676 raft_consensus.cc:2243] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:31:00.566329 12320 consensus_peers.cc:597] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:00.566380  2676 raft_consensus.cc:2272] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:00.569243  2676 tablet_replica.cc:333] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6: stopping tablet replica
I20260709 12:31:00.569940  2676 raft_consensus.cc:2243] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:00.570513  2676 raft_consensus.cc:2272] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:00.573536  2676 tablet_replica.cc:333] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6: stopping tablet replica
I20260709 12:31:00.574146  2676 raft_consensus.cc:2243] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:00.574977  2676 raft_consensus.cc:2272] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:00.577864  2676 tablet_replica.cc:333] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6: stopping tablet replica
I20260709 12:31:00.578532  2676 raft_consensus.cc:2243] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:00.579000  2676 raft_consensus.cc:2272] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:00.608587 12515 consensus_queue.cc:1048] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:00.613587  2676 tablet_server.cc:196] TabletServer@127.2.157.1:0 shutdown complete.
W20260709 12:31:00.639251 12225 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:31:00.643718 12394 consensus_peers.cc:597] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:00.662464 12536 consensus_queue.cc:1048] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:31:00.677348 12320 consensus_peers.cc:597] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:00.773509 12544 consensus_queue.cc:1048] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:31:00.781006 12320 consensus_peers.cc:597] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:31:00.789388 12394 consensus_peers.cc:597] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:31:00.909835 12394 consensus_peers.cc:597] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:31:01.007424 12394 consensus_peers.cc:597] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:31:01.024564 12320 consensus_peers.cc:597] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:31:01.640410 12225 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:31:01.671087 12536 raft_consensus.cc:493] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de4b3af4a2b3442fa050107035dcfff6)
I20260709 12:31:01.671671 12536 raft_consensus.cc:515] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:31:01.673456 12536 leader_election.cc:290] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211), de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329)
I20260709 12:31:01.674373 12426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad" is_pre_election: true
W20260709 12:31:01.677258 12320 leader_election.cc:336] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111)
I20260709 12:31:01.677618 12320 leader_election.cc:304] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9991f7979627435c88f2c2b58b90d87c; no voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6
I20260709 12:31:01.678215 12536 raft_consensus.cc:2749] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:31:01.680860 12477 raft_consensus.cc:493] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader de4b3af4a2b3442fa050107035dcfff6)
I20260709 12:31:01.681466 12477 raft_consensus.cc:515] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:31:01.683601 12477 leader_election.cc:290] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835), de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329)
I20260709 12:31:01.684161 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c" is_pre_election: true
I20260709 12:31:01.684885 12354 raft_consensus.cc:2468] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 1.
I20260709 12:31:01.686075 12391 leader_election.cc:304] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c; no voters: 
I20260709 12:31:01.686868 12477 raft_consensus.cc:2804] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:31:01.687306 12477 raft_consensus.cc:493] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Starting leader election (detected failure of leader de4b3af4a2b3442fa050107035dcfff6)
I20260709 12:31:01.687726 12477 raft_consensus.cc:3060] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:31:01.688201 12394 leader_election.cc:336] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111)
I20260709 12:31:01.693737 12477 raft_consensus.cc:515] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:31:01.696103 12477 leader_election.cc:290] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 election: Requested vote from peers 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835), de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329)
I20260709 12:31:01.696871 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:31:01.697451 12354 raft_consensus.cc:3060] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:31:01.700562 12394 leader_election.cc:336] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111)
I20260709 12:31:01.703792 12354 raft_consensus.cc:2468] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 2.
I20260709 12:31:01.704957 12391 leader_election.cc:304] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c; no voters: de4b3af4a2b3442fa050107035dcfff6
I20260709 12:31:01.705696 12477 raft_consensus.cc:2804] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:01.706197 12477 raft_consensus.cc:697] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Becoming Leader. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:01.707053 12477 consensus_queue.cc:237] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:31:01.714537 12176 catalog_manager.cc:5697] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad reported cstate change: term changed from 1 to 2, leader changed from de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1) to 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3). New cstate: current_term: 2 leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } }
W20260709 12:31:02.049083 12394 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111) [suppressed 125 similar messages]
W20260709 12:31:02.214694 12394 consensus_peers.cc:597] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:02.334439 12354 raft_consensus.cc:1275] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:02.335718 12477 consensus_queue.cc:1048] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:31:02.641425 12225 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:31:03.131235 12320 consensus_peers.cc:597] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:31:03.191092 12320 consensus_peers.cc:597] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:31:03.202167 12394 consensus_peers.cc:597] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:31:03.211081 12394 consensus_peers.cc:597] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:31:03.309254 12320 consensus_peers.cc:597] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:31:03.332528 12320 consensus_peers.cc:597] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:31:03.403123 12320 consensus_peers.cc:597] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:31:03.516167 12394 consensus_peers.cc:597] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:31:03.642524 12225 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:31:03.807919 12394 consensus_peers.cc:597] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:31:04.643481 12225 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:31:04.830205 12394 consensus_peers.cc:597] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:31:05.410486 12394 consensus_peers.cc:597] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:31:05.591985 12394 consensus_peers.cc:597] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:31:05.644369 12225 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:31:05.649689  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:05.657104 12570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:05.657200 12569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:05.659272 12572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:05.663166  2676 server_base.cc:1061] running on GCE node
I20260709 12:31:05.665979  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:05.666246  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:05.666455  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600265666434 us; error 0 us; skew 500 ppm
I20260709 12:31:05.667016  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:05.669783  2676 webserver.cc:533] Webserver started at http://127.2.157.1:38553/ using document root <none> and password file <none>
I20260709 12:31:05.670346  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:05.670557  2676 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:31:05.674427  2676 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:31:05.679030 12577 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:05.680013  2676 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:31:05.680418  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-0-root
uuid: "de4b3af4a2b3442fa050107035dcfff6"
format_stamp: "Formatted at 2026-07-09 12:30:58 on dist-test-slave-0768"
I20260709 12:31:05.680794  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599939977835-2676-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:31:05.681121 12320 consensus_peers.cc:597] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:31:05.697098  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:05.698400  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:05.699819  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:31:05.704257 12584 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:31:05.706599 12320 consensus_peers.cc:597] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:31:05.759599  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:31:05.759969  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.057s	user 0.001s	sys 0.002s
I20260709 12:31:05.760322  2676 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:31:05.765010 12584 tablet_bootstrap.cc:492] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:31:05.779006 12584 tablet_bootstrap.cc:492] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:31:05.779870 12584 tablet_bootstrap.cc:492] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap complete.
I20260709 12:31:05.780501 12584 ts_tablet_manager.cc:1403] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.006s
I20260709 12:31:05.782913 12584 raft_consensus.cc:359] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:05.783644 12584 raft_consensus.cc:740] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:31:05.784355 12584 consensus_queue.cc:260] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:05.787168 12584 ts_tablet_manager.cc:1434] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:31:05.788110 12584 tablet_bootstrap.cc:492] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:31:05.796978  2676 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:31:05.797343  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.037s	user 0.034s	sys 0.000s
I20260709 12:31:05.802798 12584 tablet_bootstrap.cc:492] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:31:05.803666 12584 tablet_bootstrap.cc:492] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap complete.
I20260709 12:31:05.804311 12584 ts_tablet_manager.cc:1403] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:31:05.807181 12584 raft_consensus.cc:359] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:05.807868 12584 raft_consensus.cc:740] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:31:05.808667 12584 consensus_queue.cc:260] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:05.811012 12584 ts_tablet_manager.cc:1434] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:31:05.811844 12584 tablet_bootstrap.cc:492] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:31:05.826447 12584 tablet_bootstrap.cc:492] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:31:05.827559 12584 tablet_bootstrap.cc:492] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6: Bootstrap complete.
I20260709 12:31:05.828477 12584 ts_tablet_manager.cc:1403] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:31:05.832149 12584 raft_consensus.cc:359] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:05.833046 12584 raft_consensus.cc:740] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:31:05.833997 12584 consensus_queue.cc:260] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:05.838094 12584 ts_tablet_manager.cc:1434] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 12:31:05.838985 12584 tablet_bootstrap.cc:492] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:31:05.852839 12584 tablet_bootstrap.cc:492] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:31:05.853799 12584 tablet_bootstrap.cc:492] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6: Bootstrap complete.
I20260709 12:31:05.854429 12584 ts_tablet_manager.cc:1403] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:31:05.856477 12584 raft_consensus.cc:359] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:31:05.857076 12584 raft_consensus.cc:740] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:31:05.857793 12584 consensus_queue.cc:260] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:31:05.859627 12584 ts_tablet_manager.cc:1434] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:31:05.860342 12584 tablet_bootstrap.cc:492] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:31:05.861024  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.1:36329
I20260709 12:31:05.861150 12645 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.1:36329 every 8 connection(s)
W20260709 12:31:05.867316 12647 tablet.cc:2406] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:31:05.867388  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:05.897070 12584 tablet_bootstrap.cc:492] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:31:05.899873 12584 tablet_bootstrap.cc:492] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap complete.
I20260709 12:31:05.900830 12584 ts_tablet_manager.cc:1403] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.041s	user 0.031s	sys 0.000s
I20260709 12:31:05.903831 12584 raft_consensus.cc:359] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:05.904662 12584 raft_consensus.cc:740] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
W20260709 12:31:05.904739 12320 consensus_peers.cc:597] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:31:05.905679 12584 consensus_queue.cc:260] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:05.907510 12646 heartbeater.cc:344] Connected to a master server at 127.2.157.62:44741
I20260709 12:31:05.907891 12584 ts_tablet_manager.cc:1434] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:31:05.908000 12646 heartbeater.cc:461] Registering TS with master...
I20260709 12:31:05.908911 12584 tablet_bootstrap.cc:492] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:31:05.909137 12646 heartbeater.cc:507] Master 127.2.157.62:44741 requested a full tablet report, sending...
I20260709 12:31:05.916340 12174 ts_manager.cc:194] Re-registered known tserver with Master: de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329)
I20260709 12:31:05.920768 12354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
mode: GRACEFUL
new_leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:41022
I20260709 12:31:05.921603 12354 raft_consensus.cc:606] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Received request to transfer leadership to TS 372fc4cdae534a00bc75f3087d0bcfad
I20260709 12:31:05.934150 12174 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42342
I20260709 12:31:05.937434 12620 raft_consensus.cc:3060] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:05.940268 12584 tablet_bootstrap.cc:492] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:31:05.941125 12584 tablet_bootstrap.cc:492] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap complete.
I20260709 12:31:05.941742 12584 ts_tablet_manager.cc:1403] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.033s	user 0.024s	sys 0.004s
I20260709 12:31:05.942521 12646 heartbeater.cc:499] Master 127.2.157.62:44741 was elected leader, sending a full tablet report...
I20260709 12:31:05.944517 12584 raft_consensus.cc:359] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:05.945291 12584 raft_consensus.cc:740] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:31:05.946081 12584 consensus_queue.cc:260] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:05.948201 12584 ts_tablet_manager.cc:1434] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:31:05.948889 12584 tablet_bootstrap.cc:492] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:31:05.951323 12426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5711e505622444fcbbc5c41a0e73b637"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
mode: GRACEFUL
new_leader_uuid: "9991f7979627435c88f2c2b58b90d87c"
 from {username='slave'} at 127.0.0.1:38166
I20260709 12:31:05.952086 12426 raft_consensus.cc:606] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Received request to transfer leadership to TS 9991f7979627435c88f2c2b58b90d87c
I20260709 12:31:05.955668 12354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77b9d08e895f41f38ce6925c93be2c3d"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
mode: GRACEFUL
new_leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:41022
I20260709 12:31:05.956264 12354 raft_consensus.cc:606] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Received request to transfer leadership to TS 372fc4cdae534a00bc75f3087d0bcfad
I20260709 12:31:05.957768  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:31:05.958525  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:05.959466  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:05.961826 12584 tablet_bootstrap.cc:492] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:31:05.962841 12584 tablet_bootstrap.cc:492] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap complete.
I20260709 12:31:05.963853 12584 ts_tablet_manager.cc:1403] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:31:05.966487 12584 raft_consensus.cc:359] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:05.967239 12584 raft_consensus.cc:740] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:31:05.968101 12584 consensus_queue.cc:260] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:05.970506 12584 ts_tablet_manager.cc:1434] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:31:05.971252 12584 tablet_bootstrap.cc:492] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:31:05.982936 12584 tablet_bootstrap.cc:492] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:31:05.983901 12584 tablet_bootstrap.cc:492] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap complete.
I20260709 12:31:05.984637 12584 ts_tablet_manager.cc:1403] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:31:05.987258 12584 raft_consensus.cc:359] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:05.987982 12584 raft_consensus.cc:740] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:31:05.988680 12584 consensus_queue.cc:260] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:05.990264 12584 ts_tablet_manager.cc:1434] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:31:05.991176 12584 tablet_bootstrap.cc:492] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
W20260709 12:31:05.994673 12320 consensus_peers.cc:597] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:31:06.006345 12584 tablet_bootstrap.cc:492] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:31:06.007277 12584 tablet_bootstrap.cc:492] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6: Bootstrap complete.
I20260709 12:31:06.007933 12584 ts_tablet_manager.cc:1403] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:31:06.010147 12584 raft_consensus.cc:359] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:06.010689 12584 raft_consensus.cc:740] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:31:06.011296 12584 consensus_queue.cc:260] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:06.013042 12584 ts_tablet_manager.cc:1434] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:31:06.014201 12584 tablet_bootstrap.cc:492] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap starting.
I20260709 12:31:06.030527 12584 tablet_bootstrap.cc:492] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:31:06.031481 12584 tablet_bootstrap.cc:492] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6: Bootstrap complete.
I20260709 12:31:06.032064 12584 ts_tablet_manager.cc:1403] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6: Time spent bootstrapping tablet: real 0.018s	user 0.003s	sys 0.011s
I20260709 12:31:06.034322 12584 raft_consensus.cc:359] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:06.034863 12584 raft_consensus.cc:740] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de4b3af4a2b3442fa050107035dcfff6, State: Initialized, Role: FOLLOWER
I20260709 12:31:06.035456 12584 consensus_queue.cc:260] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:06.037199 12584 ts_tablet_manager.cc:1434] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:31:06.125433 12536 raft_consensus.cc:993] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c: : Instructing follower 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:06.126070 12664 raft_consensus.cc:1081] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Signalling peer 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:06.127858 12426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77b9d08e895f41f38ce6925c93be2c3d"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:38152
I20260709 12:31:06.128504 12426 raft_consensus.cc:493] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:06.128829 12426 raft_consensus.cc:3060] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:06.135610 12426 raft_consensus.cc:515] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:06.137720 12426 leader_election.cc:290] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:31:06.139156 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b9d08e895f41f38ce6925c93be2c3d" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:31:06.139201 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b9d08e895f41f38ce6925c93be2c3d" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:06.139775 12354 raft_consensus.cc:3055] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:06.140019 12620 raft_consensus.cc:3060] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:06.140110 12354 raft_consensus.cc:740] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:06.141000 12354 consensus_queue.cc:260] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:06.142084 12354 raft_consensus.cc:3060] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:06.146521 12620 raft_consensus.cc:2468] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 2.
I20260709 12:31:06.147950 12394 leader_election.cc:304] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:06.148681 12354 raft_consensus.cc:2468] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 2.
I20260709 12:31:06.149196 12477 raft_consensus.cc:2804] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:06.151099 12477 raft_consensus.cc:697] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Becoming Leader. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:06.151921 12477 consensus_queue.cc:237] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:06.159644 12174 catalog_manager.cc:5697] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad reported cstate change: term changed from 1 to 2, leader changed from 9991f7979627435c88f2c2b58b90d87c (127.2.157.2) to 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3). New cstate: current_term: 2 leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:06.172093 12536 raft_consensus.cc:993] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c: : Instructing follower 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:06.172732 12664 raft_consensus.cc:1081] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Signalling peer 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:06.174701 12426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:38152
I20260709 12:31:06.175402 12426 raft_consensus.cc:493] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:06.175859 12426 raft_consensus.cc:3060] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:06.183920 12426 raft_consensus.cc:515] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:06.186619 12426 leader_election.cc:290] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:31:06.187224 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:31:06.187258 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:06.188057 12354 raft_consensus.cc:3055] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:06.188271 12619 raft_consensus.cc:3060] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:06.188463 12354 raft_consensus.cc:740] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:06.189431 12354 consensus_queue.cc:260] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:06.190901 12354 raft_consensus.cc:3060] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:06.194861 12619 raft_consensus.cc:2468] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 2.
I20260709 12:31:06.195932 12394 leader_election.cc:304] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:06.196667 12477 raft_consensus.cc:2804] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:06.197154 12477 raft_consensus.cc:697] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Becoming Leader. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:06.198040 12477 consensus_queue.cc:237] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:06.198398 12354 raft_consensus.cc:2468] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 2.
I20260709 12:31:06.206326 12174 catalog_manager.cc:5697] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad reported cstate change: term changed from 1 to 2, leader changed from 9991f7979627435c88f2c2b58b90d87c (127.2.157.2) to 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3). New cstate: current_term: 2 leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:06.268669 12666 raft_consensus.cc:993] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad: : Instructing follower 9991f7979627435c88f2c2b58b90d87c to start an election
I20260709 12:31:06.269141 12477 raft_consensus.cc:1081] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Signalling peer 9991f7979627435c88f2c2b58b90d87c to start an election
I20260709 12:31:06.270720 12354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5711e505622444fcbbc5c41a0e73b637"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
 from {username='slave'} at 127.0.0.1:41012
I20260709 12:31:06.271198 12354 raft_consensus.cc:493] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:06.271456 12354 raft_consensus.cc:3060] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:06.277076 12354 raft_consensus.cc:515] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:06.278990 12354 leader_election.cc:290] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 2 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:31:06.280025 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5711e505622444fcbbc5c41a0e73b637" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:06.280727 12620 raft_consensus.cc:3060] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:06.280483 12426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5711e505622444fcbbc5c41a0e73b637" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
I20260709 12:31:06.281950 12426 raft_consensus.cc:3055] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:06.282346 12426 raft_consensus.cc:740] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:06.283317 12426 consensus_queue.cc:260] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:06.284739 12426 raft_consensus.cc:3060] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:06.288116 12620 raft_consensus.cc:2468] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 2.
I20260709 12:31:06.289340 12320 leader_election.cc:304] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9991f7979627435c88f2c2b58b90d87c, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:06.290112 12664 raft_consensus.cc:2804] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:06.290602 12664 raft_consensus.cc:697] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 2 LEADER]: Becoming Leader. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:06.291456 12664 consensus_queue.cc:237] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:06.294123 12426 raft_consensus.cc:2468] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 2.
I20260709 12:31:06.301810 12174 catalog_manager.cc:5697] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c reported cstate change: term changed from 1 to 2, leader changed from 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3) to 9991f7979627435c88f2c2b58b90d87c (127.2.157.2). New cstate: current_term: 2 leader_uuid: "9991f7979627435c88f2c2b58b90d87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:06.562429 12620 raft_consensus.cc:1275] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:06.564137 12477 consensus_queue.cc:1048] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:06.575251 12354 raft_consensus.cc:1275] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:06.577298 12477 consensus_queue.cc:1048] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:31:06.645382 12225 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:31:06.656977 12354 raft_consensus.cc:1275] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:06.658928 12477 consensus_queue.cc:1048] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:06.672179 12620 raft_consensus.cc:1275] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:06.674618 12477 consensus_queue.cc:1048] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:06.691418 12620 raft_consensus.cc:1275] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Refusing update from remote peer 9991f7979627435c88f2c2b58b90d87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:06.692857 12680 consensus_queue.cc:1048] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:06.702564 12426 raft_consensus.cc:1275] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Refusing update from remote peer 9991f7979627435c88f2c2b58b90d87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:06.704521 12536 consensus_queue.cc:1048] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:06.971374  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:06.979606 12426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04dd84c108414f9f9722ca01990fc393"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
mode: GRACEFUL
new_leader_uuid: "9991f7979627435c88f2c2b58b90d87c"
 from {username='slave'} at 127.0.0.1:38166
I20260709 12:31:06.980311 12426 raft_consensus.cc:606] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Received request to transfer leadership to TS 9991f7979627435c88f2c2b58b90d87c
I20260709 12:31:06.983475 12354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ae06fd5a0f546fcaa1b4e0e4b23f594"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
mode: GRACEFUL
new_leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:41022
I20260709 12:31:06.983992 12354 raft_consensus.cc:606] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Received request to transfer leadership to TS 372fc4cdae534a00bc75f3087d0bcfad
I20260709 12:31:06.986891 12426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f4283da7c6b4df7a5be4614d3d9d297"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
mode: GRACEFUL
new_leader_uuid: "9991f7979627435c88f2c2b58b90d87c"
 from {username='slave'} at 127.0.0.1:38166
I20260709 12:31:06.987525 12426 raft_consensus.cc:606] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Received request to transfer leadership to TS 9991f7979627435c88f2c2b58b90d87c
I20260709 12:31:06.988641  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:31:06.989199  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:06.989939  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:07.263221 12666 raft_consensus.cc:993] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad: : Instructing follower 9991f7979627435c88f2c2b58b90d87c to start an election
I20260709 12:31:07.263732 12477 raft_consensus.cc:1081] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Signalling peer 9991f7979627435c88f2c2b58b90d87c to start an election
I20260709 12:31:07.265414 12354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04dd84c108414f9f9722ca01990fc393"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
 from {username='slave'} at 127.0.0.1:41012
I20260709 12:31:07.266004 12354 raft_consensus.cc:493] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:07.266307 12354 raft_consensus.cc:3060] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:07.271284 12354 raft_consensus.cc:515] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:07.273036 12354 leader_election.cc:290] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 2 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:31:07.273975 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dd84c108414f9f9722ca01990fc393" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:07.274250 12426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dd84c108414f9f9722ca01990fc393" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
I20260709 12:31:07.274670 12619 raft_consensus.cc:3060] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:07.274978 12426 raft_consensus.cc:3055] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:07.275331 12426 raft_consensus.cc:740] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:07.276120 12426 consensus_queue.cc:260] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:07.277462 12426 raft_consensus.cc:3060] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:07.281713 12619 raft_consensus.cc:2468] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 2.
I20260709 12:31:07.283078 12320 leader_election.cc:304] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9991f7979627435c88f2c2b58b90d87c, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:07.283891 12536 raft_consensus.cc:2804] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:07.284443 12536 raft_consensus.cc:697] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 2 LEADER]: Becoming Leader. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:07.284536 12426 raft_consensus.cc:2468] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 2.
I20260709 12:31:07.285632 12536 consensus_queue.cc:237] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:07.293401 12174 catalog_manager.cc:5697] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c reported cstate change: term changed from 1 to 2, leader changed from 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3) to 9991f7979627435c88f2c2b58b90d87c (127.2.157.2). New cstate: current_term: 2 leader_uuid: "9991f7979627435c88f2c2b58b90d87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:07.358675 12666 raft_consensus.cc:993] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad: : Instructing follower 9991f7979627435c88f2c2b58b90d87c to start an election
I20260709 12:31:07.359184 12666 raft_consensus.cc:1081] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Signalling peer 9991f7979627435c88f2c2b58b90d87c to start an election
I20260709 12:31:07.360596 12354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f4283da7c6b4df7a5be4614d3d9d297"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
 from {username='slave'} at 127.0.0.1:41012
I20260709 12:31:07.361011 12354 raft_consensus.cc:493] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:07.361238 12354 raft_consensus.cc:3060] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:07.365669 12354 raft_consensus.cc:515] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:07.367147 12354 leader_election.cc:290] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 2 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:31:07.368100 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4283da7c6b4df7a5be4614d3d9d297" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:07.368100 12426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f4283da7c6b4df7a5be4614d3d9d297" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
I20260709 12:31:07.368899 12619 raft_consensus.cc:3060] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:07.368999 12426 raft_consensus.cc:3055] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:07.369462 12426 raft_consensus.cc:740] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:07.370221 12426 consensus_queue.cc:260] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:07.371244 12426 raft_consensus.cc:3060] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:07.374300 12619 raft_consensus.cc:2468] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 2.
I20260709 12:31:07.375501 12320 leader_election.cc:304] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9991f7979627435c88f2c2b58b90d87c, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:07.376310 12536 raft_consensus.cc:2804] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:07.376752 12426 raft_consensus.cc:2468] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 2.
I20260709 12:31:07.376868 12536 raft_consensus.cc:697] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [term 2 LEADER]: Becoming Leader. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:07.378473 12664 raft_consensus.cc:993] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c: : Instructing follower 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:07.378134 12536 consensus_queue.cc:237] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:07.378984 12680 raft_consensus.cc:1081] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Signalling peer 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:07.380545 12426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ae06fd5a0f546fcaa1b4e0e4b23f594"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:38152
I20260709 12:31:07.380980 12426 raft_consensus.cc:493] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:07.381311 12426 raft_consensus.cc:3060] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:07.386221 12174 catalog_manager.cc:5697] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c reported cstate change: term changed from 1 to 2, leader changed from 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3) to 9991f7979627435c88f2c2b58b90d87c (127.2.157.2). New cstate: current_term: 2 leader_uuid: "9991f7979627435c88f2c2b58b90d87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:07.386807 12426 raft_consensus.cc:515] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:07.388322 12426 leader_election.cc:290] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:31:07.389176 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae06fd5a0f546fcaa1b4e0e4b23f594" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:07.389696 12619 raft_consensus.cc:3060] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:07.391170 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae06fd5a0f546fcaa1b4e0e4b23f594" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:31:07.391674 12354 raft_consensus.cc:3055] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:07.391927 12354 raft_consensus.cc:740] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:07.392659 12354 consensus_queue.cc:260] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:07.393594 12354 raft_consensus.cc:3060] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:07.396555 12619 raft_consensus.cc:2468] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 2.
I20260709 12:31:07.397636 12394 leader_election.cc:304] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:07.398298 12666 raft_consensus.cc:2804] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:07.398761 12666 raft_consensus.cc:697] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Becoming Leader. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:07.399253 12354 raft_consensus.cc:2468] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 2.
I20260709 12:31:07.399668 12666 consensus_queue.cc:237] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:07.406927 12174 catalog_manager.cc:5697] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad reported cstate change: term changed from 1 to 2, leader changed from 9991f7979627435c88f2c2b58b90d87c (127.2.157.2) to 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3). New cstate: current_term: 2 leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: HEALTHY } } }
W20260709 12:31:07.646472 12225 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:31:07.792199 12619 raft_consensus.cc:1275] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:07.793824 12666 consensus_queue.cc:1048] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:07.803889 12354 raft_consensus.cc:1275] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:07.805779 12666 consensus_queue.cc:1048] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:07.809125 12426 raft_consensus.cc:1275] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Refusing update from remote peer 9991f7979627435c88f2c2b58b90d87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:07.811081 12680 consensus_queue.cc:1048] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:07.822201 12619 raft_consensus.cc:1275] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Refusing update from remote peer 9991f7979627435c88f2c2b58b90d87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:07.824014 12680 consensus_queue.cc:1048] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:07.902645 12619 raft_consensus.cc:1275] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Refusing update from remote peer 9991f7979627435c88f2c2b58b90d87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:07.903936 12680 consensus_queue.cc:1048] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:07.913973 12426 raft_consensus.cc:1275] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Refusing update from remote peer 9991f7979627435c88f2c2b58b90d87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:07.916639 12664 consensus_queue.cc:1048] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:07.996963  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:08.004973 12354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53c561ccc54c4fa2971b10c4f4e42c55"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
mode: GRACEFUL
new_leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:41022
I20260709 12:31:08.005708 12354 raft_consensus.cc:606] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Received request to transfer leadership to TS 372fc4cdae534a00bc75f3087d0bcfad
I20260709 12:31:08.008694 12354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5711e505622444fcbbc5c41a0e73b637"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
mode: GRACEFUL
new_leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:41022
I20260709 12:31:08.009194 12354 raft_consensus.cc:606] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 2 LEADER]: Received request to transfer leadership to TS 372fc4cdae534a00bc75f3087d0bcfad
I20260709 12:31:08.012705 12426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5158156db124267abc088180129dccc"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
mode: GRACEFUL
new_leader_uuid: "9991f7979627435c88f2c2b58b90d87c"
 from {username='slave'} at 127.0.0.1:38166
I20260709 12:31:08.013295 12426 raft_consensus.cc:606] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Received request to transfer leadership to TS 9991f7979627435c88f2c2b58b90d87c
I20260709 12:31:08.014573  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:31:08.015133  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:08.015823  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:08.060949 12477 raft_consensus.cc:993] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad: : Instructing follower 9991f7979627435c88f2c2b58b90d87c to start an election
I20260709 12:31:08.061475 12666 raft_consensus.cc:1081] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Signalling peer 9991f7979627435c88f2c2b58b90d87c to start an election
I20260709 12:31:08.063141 12354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5158156db124267abc088180129dccc"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
 from {username='slave'} at 127.0.0.1:41012
I20260709 12:31:08.063639 12354 raft_consensus.cc:493] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:08.063963 12354 raft_consensus.cc:3060] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:08.069022 12354 raft_consensus.cc:515] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:31:08.070665 12354 leader_election.cc:290] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 3 election: Requested vote from peers 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211), de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329)
I20260709 12:31:08.071614 12426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
I20260709 12:31:08.071677 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:08.072417 12426 raft_consensus.cc:3055] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:31:08.072721 12426 raft_consensus.cc:740] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:08.072535 12619 raft_consensus.cc:3060] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:08.073559 12426 consensus_queue.cc:260] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:31:08.074606 12426 raft_consensus.cc:3060] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:08.079187 12426 raft_consensus.cc:2468] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 3.
I20260709 12:31:08.079454 12619 raft_consensus.cc:2468] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 3.
I20260709 12:31:08.080200 12318 leader_election.cc:304] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, 9991f7979627435c88f2c2b58b90d87c; no voters: 
I20260709 12:31:08.081205 12664 raft_consensus.cc:2804] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:31:08.081700 12664 raft_consensus.cc:697] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 3 LEADER]: Becoming Leader. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:08.082605 12664 consensus_queue.cc:237] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:31:08.089697 12174 catalog_manager.cc:5697] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c reported cstate change: term changed from 2 to 3, leader changed from 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3) to 9991f7979627435c88f2c2b58b90d87c (127.2.157.2). New cstate: current_term: 3 leader_uuid: "9991f7979627435c88f2c2b58b90d87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:08.310668 12536 raft_consensus.cc:993] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c: : Instructing follower 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:08.311201 12664 raft_consensus.cc:1081] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 2 LEADER]: Signalling peer 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:08.312855 12426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5711e505622444fcbbc5c41a0e73b637"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:38152
I20260709 12:31:08.313436 12426 raft_consensus.cc:493] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:08.313763 12426 raft_consensus.cc:3060] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:08.318405 12536 raft_consensus.cc:993] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c: : Instructing follower 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:08.318994 12664 raft_consensus.cc:1081] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Signalling peer 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:08.320657 12427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53c561ccc54c4fa2971b10c4f4e42c55"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:38152
I20260709 12:31:08.320701 12426 raft_consensus.cc:515] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:08.321206 12427 raft_consensus.cc:493] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:08.321667 12427 raft_consensus.cc:3060] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.322521 12426 leader_election.cc:290] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 3 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:31:08.323472 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5711e505622444fcbbc5c41a0e73b637" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:08.323642 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5711e505622444fcbbc5c41a0e73b637" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:31:08.324293 12619 raft_consensus.cc:3060] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:08.324373 12354 raft_consensus.cc:3055] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:31:08.325263 12354 raft_consensus.cc:740] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:08.328933 12354 consensus_queue.cc:260] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:08.330200 12354 raft_consensus.cc:3060] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:08.332826 12619 raft_consensus.cc:2468] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 3.
I20260709 12:31:08.332535 12427 raft_consensus.cc:515] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:08.334306 12394 leader_election.cc:304] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:08.335906 12477 raft_consensus.cc:2804] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:31:08.336817 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c561ccc54c4fa2971b10c4f4e42c55" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:08.337574 12354 raft_consensus.cc:2468] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 3.
I20260709 12:31:08.337697 12620 raft_consensus.cc:3060] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.339835 12477 raft_consensus.cc:697] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 LEADER]: Becoming Leader. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:08.340751 12477 consensus_queue.cc:237] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:08.345733 12427 leader_election.cc:290] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:31:08.347975 12620 raft_consensus.cc:2468] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 2.
I20260709 12:31:08.353052 12394 leader_election.cc:304] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:08.355827 12477 raft_consensus.cc:2804] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:08.356328 12477 raft_consensus.cc:697] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Becoming Leader. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:08.357146 12477 consensus_queue.cc:237] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:08.358235 12354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c561ccc54c4fa2971b10c4f4e42c55" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:31:08.358889 12354 raft_consensus.cc:3055] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:08.359220 12354 raft_consensus.cc:740] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:08.359984 12354 consensus_queue.cc:260] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:08.361122 12354 raft_consensus.cc:3060] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.364179 12174 catalog_manager.cc:5697] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad reported cstate change: term changed from 2 to 3, leader changed from 9991f7979627435c88f2c2b58b90d87c (127.2.157.2) to 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3). New cstate: current_term: 3 leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:08.368345 12354 raft_consensus.cc:2468] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 2.
I20260709 12:31:08.379631 12174 catalog_manager.cc:5697] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad reported cstate change: term changed from 1 to 2, leader changed from 9991f7979627435c88f2c2b58b90d87c (127.2.157.2) to 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3). New cstate: current_term: 2 leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:08.517531 12619 raft_consensus.cc:1275] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Refusing update from remote peer 9991f7979627435c88f2c2b58b90d87c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:08.519016 12664 consensus_queue.cc:1048] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:08.530768 12427 raft_consensus.cc:1275] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Refusing update from remote peer 9991f7979627435c88f2c2b58b90d87c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:08.532995 12664 consensus_queue.cc:1048] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:31:08.647496 12225 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:31:08.746335 12353 raft_consensus.cc:1275] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:08.748036 12706 consensus_queue.cc:1048] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:08.760067 12619 raft_consensus.cc:1275] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:08.761643 12477 consensus_queue.cc:1048] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:08.769830 12619 raft_consensus.cc:1275] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:08.771173 12477 consensus_queue.cc:1048] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:08.781442 12353 raft_consensus.cc:1275] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:08.783483 12477 consensus_queue.cc:1048] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.023835  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:09.032436 12427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
mode: GRACEFUL
new_leader_uuid: "9991f7979627435c88f2c2b58b90d87c"
 from {username='slave'} at 127.0.0.1:38166
I20260709 12:31:09.033070 12427 raft_consensus.cc:606] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Received request to transfer leadership to TS 9991f7979627435c88f2c2b58b90d87c
I20260709 12:31:09.035988 12353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04dd84c108414f9f9722ca01990fc393"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
mode: GRACEFUL
new_leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:41022
I20260709 12:31:09.036674 12353 raft_consensus.cc:606] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 2 LEADER]: Received request to transfer leadership to TS 372fc4cdae534a00bc75f3087d0bcfad
I20260709 12:31:09.039412 12427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf043e9033134a2692d1980200717c1c"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
mode: GRACEFUL
new_leader_uuid: "9991f7979627435c88f2c2b58b90d87c"
 from {username='slave'} at 127.0.0.1:38166
I20260709 12:31:09.039987 12427 raft_consensus.cc:606] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Received request to transfer leadership to TS 9991f7979627435c88f2c2b58b90d87c
I20260709 12:31:09.041203  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:31:09.041781  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:09.042469  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:09.260637 12706 raft_consensus.cc:993] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad: : Instructing follower 9991f7979627435c88f2c2b58b90d87c to start an election
I20260709 12:31:09.261103 12477 raft_consensus.cc:1081] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Signalling peer 9991f7979627435c88f2c2b58b90d87c to start an election
I20260709 12:31:09.262503 12353 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
 from {username='slave'} at 127.0.0.1:41012
I20260709 12:31:09.262948 12353 raft_consensus.cc:493] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:09.263209 12353 raft_consensus.cc:3060] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:09.268908 12353 raft_consensus.cc:515] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:09.270749 12353 leader_election.cc:290] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 3 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:31:09.271709 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:09.271827 12427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ae3950aef4523a70d51cf3ede0865" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
I20260709 12:31:09.272432 12619 raft_consensus.cc:3060] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:09.272504 12427 raft_consensus.cc:3055] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:31:09.272936 12427 raft_consensus.cc:740] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:09.273658 12427 consensus_queue.cc:260] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:09.274689 12427 raft_consensus.cc:3060] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:09.278455 12619 raft_consensus.cc:2468] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 3.
I20260709 12:31:09.279624 12427 raft_consensus.cc:2468] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 3.
I20260709 12:31:09.279937 12320 leader_election.cc:304] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9991f7979627435c88f2c2b58b90d87c, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:09.280916 12664 raft_consensus.cc:2804] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:31:09.281435 12664 raft_consensus.cc:697] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 3 LEADER]: Becoming Leader. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:09.282281 12664 consensus_queue.cc:237] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:09.289361 12174 catalog_manager.cc:5697] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c reported cstate change: term changed from 2 to 3, leader changed from 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3) to 9991f7979627435c88f2c2b58b90d87c (127.2.157.2). New cstate: current_term: 3 leader_uuid: "9991f7979627435c88f2c2b58b90d87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:09.353579 12477 raft_consensus.cc:993] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad: : Instructing follower 9991f7979627435c88f2c2b58b90d87c to start an election
I20260709 12:31:09.354089 12666 raft_consensus.cc:1081] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Signalling peer 9991f7979627435c88f2c2b58b90d87c to start an election
I20260709 12:31:09.355674 12353 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf043e9033134a2692d1980200717c1c"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
 from {username='slave'} at 127.0.0.1:41012
I20260709 12:31:09.356177 12353 raft_consensus.cc:493] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:09.356487 12353 raft_consensus.cc:3060] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:09.361497 12353 raft_consensus.cc:515] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:09.363238 12353 leader_election.cc:290] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 2 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:31:09.364068 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf043e9033134a2692d1980200717c1c" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:09.364332 12427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf043e9033134a2692d1980200717c1c" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
I20260709 12:31:09.364686 12619 raft_consensus.cc:3060] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:09.364915 12427 raft_consensus.cc:3055] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:09.365269 12427 raft_consensus.cc:740] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:09.366019 12427 consensus_queue.cc:260] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:09.366976 12427 raft_consensus.cc:3060] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:09.370486 12619 raft_consensus.cc:2468] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 2.
I20260709 12:31:09.371688 12320 leader_election.cc:304] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9991f7979627435c88f2c2b58b90d87c, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:09.372267 12427 raft_consensus.cc:2468] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 2.
I20260709 12:31:09.372409 12664 raft_consensus.cc:2804] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:09.373049 12664 raft_consensus.cc:697] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 2 LEADER]: Becoming Leader. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:09.373948 12664 consensus_queue.cc:237] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:09.383139 12174 catalog_manager.cc:5697] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c reported cstate change: term changed from 1 to 2, leader changed from 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3) to 9991f7979627435c88f2c2b58b90d87c (127.2.157.2). New cstate: current_term: 2 leader_uuid: "9991f7979627435c88f2c2b58b90d87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:09.542889 12536 raft_consensus.cc:993] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c: : Instructing follower 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:09.543473 12664 raft_consensus.cc:1081] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 2 LEADER]: Signalling peer 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:09.544857 12427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04dd84c108414f9f9722ca01990fc393"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:38152
I20260709 12:31:09.545295 12427 raft_consensus.cc:493] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:09.545547 12427 raft_consensus.cc:3060] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:09.550508 12427 raft_consensus.cc:515] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:09.552057 12427 leader_election.cc:290] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 3 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:31:09.552982 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dd84c108414f9f9722ca01990fc393" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:09.553215 12353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04dd84c108414f9f9722ca01990fc393" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:31:09.553604 12619 raft_consensus.cc:3060] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:09.553913 12353 raft_consensus.cc:3055] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:31:09.554308 12353 raft_consensus.cc:740] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:09.555124 12353 consensus_queue.cc:260] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:09.556191 12353 raft_consensus.cc:3060] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:09.558876 12619 raft_consensus.cc:2468] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 3.
I20260709 12:31:09.559950 12394 leader_election.cc:304] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:09.560612 12666 raft_consensus.cc:2804] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:31:09.561007 12666 raft_consensus.cc:697] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 LEADER]: Becoming Leader. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:09.561746 12666 consensus_queue.cc:237] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:09.562404 12353 raft_consensus.cc:2468] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 3.
I20260709 12:31:09.569368 12174 catalog_manager.cc:5697] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad reported cstate change: term changed from 2 to 3, leader changed from 9991f7979627435c88f2c2b58b90d87c (127.2.157.2) to 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3). New cstate: current_term: 3 leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: HEALTHY } } }
W20260709 12:31:09.648478 12225 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:31:09.667771 12619 raft_consensus.cc:1275] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Refusing update from remote peer 9991f7979627435c88f2c2b58b90d87c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:09.669340 12664 consensus_queue.cc:1048] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:09.681509 12427 raft_consensus.cc:1275] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Refusing update from remote peer 9991f7979627435c88f2c2b58b90d87c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:09.683655 12536 consensus_queue.cc:1048] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:09.793812 12619 raft_consensus.cc:1275] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Refusing update from remote peer 9991f7979627435c88f2c2b58b90d87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.795218 12728 consensus_queue.cc:1048] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.804455 12427 raft_consensus.cc:1275] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Refusing update from remote peer 9991f7979627435c88f2c2b58b90d87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.807552 12728 consensus_queue.cc:1048] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:10.016865 12353 raft_consensus.cc:1275] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:10.019035 12666 consensus_queue.cc:1048] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:31:10.035841 12619 raft_consensus.cc:1275] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:10.037281 12666 consensus_queue.cc:1048] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:10.049176  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:10.062361 12427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53c561ccc54c4fa2971b10c4f4e42c55"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
mode: GRACEFUL
new_leader_uuid: "9991f7979627435c88f2c2b58b90d87c"
 from {username='slave'} at 127.0.0.1:38166
I20260709 12:31:10.062978 12427 raft_consensus.cc:606] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Received request to transfer leadership to TS 9991f7979627435c88f2c2b58b90d87c
I20260709 12:31:10.065869 12353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94481e8787914dbea7313a90452f7ad0"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
mode: GRACEFUL
new_leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:41022
I20260709 12:31:10.066344 12353 raft_consensus.cc:606] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Received request to transfer leadership to TS 372fc4cdae534a00bc75f3087d0bcfad
I20260709 12:31:10.068907 12353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5158156db124267abc088180129dccc"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
mode: GRACEFUL
new_leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:41022
I20260709 12:31:10.069379 12353 raft_consensus.cc:606] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 3 LEADER]: Received request to transfer leadership to TS 372fc4cdae534a00bc75f3087d0bcfad
I20260709 12:31:10.070524  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:31:10.071022  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:10.071738  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:10.115809 12733 raft_consensus.cc:993] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c: : Instructing follower 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:10.116544 12728 raft_consensus.cc:1081] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 3 LEADER]: Signalling peer 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:10.118279 12427 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5158156db124267abc088180129dccc"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:38152
I20260709 12:31:10.118800 12427 raft_consensus.cc:493] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:10.119136 12427 raft_consensus.cc:3060] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:31:10.126983 12427 raft_consensus.cc:515] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:31:10.128907 12427 leader_election.cc:290] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 4 election: Requested vote from peers 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835), de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329)
I20260709 12:31:10.130069 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:10.130015 12353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5158156db124267abc088180129dccc" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:31:10.130955 12619 raft_consensus.cc:3060] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:31:10.130965 12353 raft_consensus.cc:3055] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:31:10.131453 12353 raft_consensus.cc:740] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:10.132470 12353 consensus_queue.cc:260] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:31:10.133855 12353 raft_consensus.cc:3060] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:31:10.137573 12619 raft_consensus.cc:2468] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 4.
I20260709 12:31:10.138770 12394 leader_election.cc:304] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:10.139499 12666 raft_consensus.cc:2804] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:31:10.139956 12666 raft_consensus.cc:697] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 4 LEADER]: Becoming Leader. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:10.141405 12353 raft_consensus.cc:2468] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 4.
I20260709 12:31:10.141185 12666 consensus_queue.cc:237] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } }
I20260709 12:31:10.149063 12176 catalog_manager.cc:5697] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad reported cstate change: term changed from 3 to 4, leader changed from 9991f7979627435c88f2c2b58b90d87c (127.2.157.2) to 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3). New cstate: current_term: 4 leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:10.214803 12477 raft_consensus.cc:993] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad: : Instructing follower 9991f7979627435c88f2c2b58b90d87c to start an election
I20260709 12:31:10.215292 12666 raft_consensus.cc:1081] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Signalling peer 9991f7979627435c88f2c2b58b90d87c to start an election
I20260709 12:31:10.217126 12353 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53c561ccc54c4fa2971b10c4f4e42c55"
dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
 from {username='slave'} at 127.0.0.1:41012
I20260709 12:31:10.217715 12353 raft_consensus.cc:493] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:10.218118 12353 raft_consensus.cc:3060] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:10.224689 12353 raft_consensus.cc:515] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:10.226343 12353 leader_election.cc:290] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 3 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3:41211)
I20260709 12:31:10.227334 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c561ccc54c4fa2971b10c4f4e42c55" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:10.227468 12427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c561ccc54c4fa2971b10c4f4e42c55" candidate_uuid: "9991f7979627435c88f2c2b58b90d87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
I20260709 12:31:10.228276 12427 raft_consensus.cc:3055] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:31:10.228255 12619 raft_consensus.cc:3060] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:10.228755 12427 raft_consensus.cc:740] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:10.229851 12427 consensus_queue.cc:260] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:10.231186 12427 raft_consensus.cc:3060] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:10.234618 12619 raft_consensus.cc:2468] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 3.
I20260709 12:31:10.236044 12320 leader_election.cc:304] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9991f7979627435c88f2c2b58b90d87c, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:10.236708 12728 raft_consensus.cc:2804] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:31:10.237138 12728 raft_consensus.cc:697] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 3 LEADER]: Becoming Leader. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:10.238247 12427 raft_consensus.cc:2468] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9991f7979627435c88f2c2b58b90d87c in term 3.
I20260709 12:31:10.238195 12728 consensus_queue.cc:237] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:10.246342 12176 catalog_manager.cc:5697] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c reported cstate change: term changed from 2 to 3, leader changed from 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3) to 9991f7979627435c88f2c2b58b90d87c (127.2.157.2). New cstate: current_term: 3 leader_uuid: "9991f7979627435c88f2c2b58b90d87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:10.557813 12664 raft_consensus.cc:993] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c: : Instructing follower 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:10.558346 12728 raft_consensus.cc:1081] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Signalling peer 372fc4cdae534a00bc75f3087d0bcfad to start an election
I20260709 12:31:10.559959 12426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94481e8787914dbea7313a90452f7ad0"
dest_uuid: "372fc4cdae534a00bc75f3087d0bcfad"
 from {username='slave'} at 127.0.0.1:38152
I20260709 12:31:10.560417 12426 raft_consensus.cc:493] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:10.560702 12426 raft_consensus.cc:3060] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:10.566947 12426 raft_consensus.cc:515] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:10.568534 12426 leader_election.cc:290] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 election: Requested vote from peers de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329), 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835)
I20260709 12:31:10.569205 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94481e8787914dbea7313a90452f7ad0" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "de4b3af4a2b3442fa050107035dcfff6"
I20260709 12:31:10.569571 12353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94481e8787914dbea7313a90452f7ad0" candidate_uuid: "372fc4cdae534a00bc75f3087d0bcfad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9991f7979627435c88f2c2b58b90d87c"
I20260709 12:31:10.569936 12619 raft_consensus.cc:3060] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:10.570233 12353 raft_consensus.cc:3055] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:10.570556 12353 raft_consensus.cc:740] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9991f7979627435c88f2c2b58b90d87c, State: Running, Role: LEADER
I20260709 12:31:10.571543 12353 consensus_queue.cc:260] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:10.572932 12353 raft_consensus.cc:3060] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:10.577183 12619 raft_consensus.cc:2468] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 2.
I20260709 12:31:10.578567 12394 leader_election.cc:304] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 372fc4cdae534a00bc75f3087d0bcfad, de4b3af4a2b3442fa050107035dcfff6; no voters: 
I20260709 12:31:10.579357 12666 raft_consensus.cc:2804] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:10.579773 12666 raft_consensus.cc:697] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Becoming Leader. State: Replica: 372fc4cdae534a00bc75f3087d0bcfad, State: Running, Role: LEADER
I20260709 12:31:10.580310 12353 raft_consensus.cc:2468] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 372fc4cdae534a00bc75f3087d0bcfad in term 2.
I20260709 12:31:10.580837 12666 consensus_queue.cc:237] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } }
I20260709 12:31:10.588397 12176 catalog_manager.cc:5697] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad reported cstate change: term changed from 1 to 2, leader changed from 9991f7979627435c88f2c2b58b90d87c (127.2.157.2) to 372fc4cdae534a00bc75f3087d0bcfad (127.2.157.3). New cstate: current_term: 2 leader_uuid: "372fc4cdae534a00bc75f3087d0bcfad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:10.603930 12619 raft_consensus.cc:1275] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 4 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:31:10.605139 12744 consensus_queue.cc:1048] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:31:10.617967 12353 raft_consensus.cc:1275] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 4 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:31:10.619860 12666 consensus_queue.cc:1048] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:31:10.635269 12426 raft_consensus.cc:1275] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Refusing update from remote peer 9991f7979627435c88f2c2b58b90d87c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:10.636435 12728 consensus_queue.cc:1048] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "372fc4cdae534a00bc75f3087d0bcfad" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:10.646803 12620 raft_consensus.cc:1275] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Refusing update from remote peer 9991f7979627435c88f2c2b58b90d87c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:10.648620 12728 consensus_queue.cc:1048] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:31:10.649833 12225 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:31:11.010727 12620 raft_consensus.cc:1275] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:11.012207 12666 consensus_queue.cc:1048] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "de4b3af4a2b3442fa050107035dcfff6" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:11.024823 12354 raft_consensus.cc:1275] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Refusing update from remote peer 372fc4cdae534a00bc75f3087d0bcfad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:11.026546 12744 consensus_queue.cc:1048] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9991f7979627435c88f2c2b58b90d87c" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:11.079023  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:11.115057  2676 tablet_server.cc:179] TabletServer@127.2.157.1:36329 shutting down...
I20260709 12:31:11.143882  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:11.145047  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:31:11.146289  2676 raft_consensus.cc:2243] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:31:11.146726 12320 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 74 similar messages]
I20260709 12:31:11.146924  2676 raft_consensus.cc:2272] T 94481e8787914dbea7313a90452f7ad0 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:11.150493 12320 consensus_peers.cc:597] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:11.150835  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:31:11.151469  2676 raft_consensus.cc:2243] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.151932  2676 raft_consensus.cc:2272] T 77b9d08e895f41f38ce6925c93be2c3d P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.154572  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:31:11.155170  2676 raft_consensus.cc:2243] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.155618  2676 raft_consensus.cc:2272] T 5711e505622444fcbbc5c41a0e73b637 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.157941  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:31:11.158524  2676 raft_consensus.cc:2243] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.158991  2676 raft_consensus.cc:2272] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.161442  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:31:11.162088  2676 raft_consensus.cc:2243] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.162519  2676 raft_consensus.cc:2272] T 53c561ccc54c4fa2971b10c4f4e42c55 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.165217  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:31:11.165817  2676 raft_consensus.cc:2243] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.166400  2676 raft_consensus.cc:2272] T bf043e9033134a2692d1980200717c1c P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.168632  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:31:11.169195  2676 raft_consensus.cc:2243] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.169859  2676 raft_consensus.cc:2272] T 039ae3950aef4523a70d51cf3ede0865 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.172932  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:31:11.173413  2676 raft_consensus.cc:2243] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.173938  2676 raft_consensus.cc:2272] T f5158156db124267abc088180129dccc P de4b3af4a2b3442fa050107035dcfff6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.176502  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:31:11.177099  2676 raft_consensus.cc:2243] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.177631  2676 raft_consensus.cc:2272] T 5f4283da7c6b4df7a5be4614d3d9d297 P de4b3af4a2b3442fa050107035dcfff6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.180159  2676 tablet_replica.cc:333] stopping tablet replica
I20260709 12:31:11.180699  2676 raft_consensus.cc:2243] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.181252  2676 raft_consensus.cc:2272] T 04dd84c108414f9f9722ca01990fc393 P de4b3af4a2b3442fa050107035dcfff6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:11.194373 12394 consensus_peers.cc:597] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:11.217517  2676 tablet_server.cc:196] TabletServer@127.2.157.1:36329 shutdown complete.
I20260709 12:31:11.245052  2676 tablet_server.cc:179] TabletServer@127.2.157.2:0 shutting down...
I20260709 12:31:11.274686  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:11.275597  2676 tablet_replica.cc:333] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c: stopping tablet replica
I20260709 12:31:11.276293  2676 raft_consensus.cc:2243] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:31:11.277156  2676 raft_consensus.cc:2272] T 53c561ccc54c4fa2971b10c4f4e42c55 P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.280948  2676 tablet_replica.cc:333] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c: stopping tablet replica
I20260709 12:31:11.281651  2676 raft_consensus.cc:2243] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.282161  2676 raft_consensus.cc:2272] T 04dd84c108414f9f9722ca01990fc393 P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.284826  2676 tablet_replica.cc:333] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c: stopping tablet replica
I20260709 12:31:11.286108  2676 raft_consensus.cc:2243] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:11.287281  2676 raft_consensus.cc:2272] T bf043e9033134a2692d1980200717c1c P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.290853  2676 tablet_replica.cc:333] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c: stopping tablet replica
I20260709 12:31:11.291458  2676 raft_consensus.cc:2243] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.291878  2676 raft_consensus.cc:2272] T 94481e8787914dbea7313a90452f7ad0 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.295377  2676 tablet_replica.cc:333] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c: stopping tablet replica
I20260709 12:31:11.295969  2676 raft_consensus.cc:2243] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.296471  2676 raft_consensus.cc:2272] T 5711e505622444fcbbc5c41a0e73b637 P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.299412  2676 tablet_replica.cc:333] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c: stopping tablet replica
I20260709 12:31:11.300081  2676 raft_consensus.cc:2243] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.300640  2676 raft_consensus.cc:2272] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:11.302800 12394 consensus_peers.cc:597] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad -> Peer de4b3af4a2b3442fa050107035dcfff6 (127.2.157.1:36329): Couldn't send request to peer de4b3af4a2b3442fa050107035dcfff6. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:11.303282  2676 tablet_replica.cc:333] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c: stopping tablet replica
I20260709 12:31:11.303993  2676 raft_consensus.cc:2243] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.304697  2676 raft_consensus.cc:2272] T 77b9d08e895f41f38ce6925c93be2c3d P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.308261  2676 tablet_replica.cc:333] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c: stopping tablet replica
I20260709 12:31:11.308964  2676 raft_consensus.cc:2243] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:11.309859  2676 raft_consensus.cc:2272] T 5f4283da7c6b4df7a5be4614d3d9d297 P 9991f7979627435c88f2c2b58b90d87c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.312474  2676 tablet_replica.cc:333] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c: stopping tablet replica
I20260709 12:31:11.313380  2676 raft_consensus.cc:2243] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:31:11.314615  2676 raft_consensus.cc:2272] T 039ae3950aef4523a70d51cf3ede0865 P 9991f7979627435c88f2c2b58b90d87c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:11.315805 12391 consensus_peers.cc:597] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad -> Peer 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835): Couldn't send request to peer 9991f7979627435c88f2c2b58b90d87c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:11.317947  2676 tablet_replica.cc:333] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c: stopping tablet replica
I20260709 12:31:11.318547  2676 raft_consensus.cc:2243] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.318941  2676 raft_consensus.cc:2272] T f5158156db124267abc088180129dccc P 9991f7979627435c88f2c2b58b90d87c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.356401  2676 tablet_server.cc:196] TabletServer@127.2.157.2:0 shutdown complete.
I20260709 12:31:11.382012  2676 tablet_server.cc:179] TabletServer@127.2.157.3:0 shutting down...
W20260709 12:31:11.391263 12391 consensus_peers.cc:597] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad -> Peer 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835): Couldn't send request to peer 9991f7979627435c88f2c2b58b90d87c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:32835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:31:11.402454 12391 consensus_peers.cc:597] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad -> Peer 9991f7979627435c88f2c2b58b90d87c (127.2.157.2:32835): Couldn't send request to peer 9991f7979627435c88f2c2b58b90d87c. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.2:32835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:11.419569  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:11.420426  2676 tablet_replica.cc:333] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad: stopping tablet replica
I20260709 12:31:11.421324  2676 raft_consensus.cc:2243] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.421815  2676 raft_consensus.cc:2272] T 53c561ccc54c4fa2971b10c4f4e42c55 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.424851  2676 tablet_replica.cc:333] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad: stopping tablet replica
I20260709 12:31:11.425526  2676 raft_consensus.cc:2243] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.426103  2676 raft_consensus.cc:2272] T bf043e9033134a2692d1980200717c1c P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.428468  2676 tablet_replica.cc:333] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad: stopping tablet replica
I20260709 12:31:11.429097  2676 raft_consensus.cc:2243] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:31:11.429966  2676 raft_consensus.cc:2272] T 04dd84c108414f9f9722ca01990fc393 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.432211  2676 tablet_replica.cc:333] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad: stopping tablet replica
I20260709 12:31:11.432786  2676 raft_consensus.cc:2243] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.433269  2676 raft_consensus.cc:2272] T 039ae3950aef4523a70d51cf3ede0865 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.435460  2676 tablet_replica.cc:333] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad: stopping tablet replica
I20260709 12:31:11.436051  2676 raft_consensus.cc:2243] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:31:11.436895  2676 raft_consensus.cc:2272] T f5158156db124267abc088180129dccc P 372fc4cdae534a00bc75f3087d0bcfad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.439910  2676 tablet_replica.cc:333] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad: stopping tablet replica
I20260709 12:31:11.440487  2676 raft_consensus.cc:2243] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:11.440994  2676 raft_consensus.cc:2272] T 5f4283da7c6b4df7a5be4614d3d9d297 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.442971  2676 tablet_replica.cc:333] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad: stopping tablet replica
I20260709 12:31:11.443483  2676 raft_consensus.cc:2243] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:11.444378  2676 raft_consensus.cc:2272] T 0ae06fd5a0f546fcaa1b4e0e4b23f594 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.446506  2676 tablet_replica.cc:333] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad: stopping tablet replica
I20260709 12:31:11.447000  2676 raft_consensus.cc:2243] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:31:11.447894  2676 raft_consensus.cc:2272] T 5711e505622444fcbbc5c41a0e73b637 P 372fc4cdae534a00bc75f3087d0bcfad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.449970  2676 tablet_replica.cc:333] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad: stopping tablet replica
I20260709 12:31:11.450484  2676 raft_consensus.cc:2243] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:11.451299  2676 raft_consensus.cc:2272] T 77b9d08e895f41f38ce6925c93be2c3d P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.453483  2676 tablet_replica.cc:333] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad: stopping tablet replica
I20260709 12:31:11.454063  2676 raft_consensus.cc:2243] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:11.454831  2676 raft_consensus.cc:2272] T 94481e8787914dbea7313a90452f7ad0 P 372fc4cdae534a00bc75f3087d0bcfad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.488557  2676 tablet_server.cc:196] TabletServer@127.2.157.3:0 shutdown complete.
I20260709 12:31:11.515625  2676 master.cc:562] Master@127.2.157.62:44741 shutting down...
I20260709 12:31:11.540745  2676 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:11.541332  2676 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:11.541643  2676 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2a01201fe7994e978e0dd4e88420a38c: stopping tablet replica
I20260709 12:31:11.563980  2676 master.cc:584] Master@127.2.157.62:44741 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13131 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:31:11.615585  2676 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.62:39655
I20260709 12:31:11.616868  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:11.623679 12761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:11.623690 12762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:11.623934 12764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:11.625342  2676 server_base.cc:1061] running on GCE node
I20260709 12:31:11.626480  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:11.626686  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:11.626886  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600271626870 us; error 0 us; skew 500 ppm
I20260709 12:31:11.627530  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:11.630558  2676 webserver.cc:533] Webserver started at http://127.2.157.62:35237/ using document root <none> and password file <none>
I20260709 12:31:11.631129  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:11.631338  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:11.631661  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:11.632903  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/master-0-root/instance:
uuid: "a85b0338f404483ea2566d2f1c2d814c"
format_stamp: "Formatted at 2026-07-09 12:31:11 on dist-test-slave-0768"
I20260709 12:31:11.637717  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:31:11.642346 12769 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:11.643033  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:31:11.643357  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/master-0-root
uuid: "a85b0338f404483ea2566d2f1c2d814c"
format_stamp: "Formatted at 2026-07-09 12:31:11 on dist-test-slave-0768"
I20260709 12:31:11.643646  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:11.674680  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:11.675915  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:11.714159  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.62:39655
I20260709 12:31:11.714267 12820 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.62:39655 every 8 connection(s)
I20260709 12:31:11.718029 12821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:11.729303 12821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c: Bootstrap starting.
I20260709 12:31:11.734241 12821 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:11.738528 12821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c: No bootstrap required, opened a new log
I20260709 12:31:11.740710 12821 raft_consensus.cc:359] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a85b0338f404483ea2566d2f1c2d814c" member_type: VOTER }
I20260709 12:31:11.741082 12821 raft_consensus.cc:385] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:11.741271 12821 raft_consensus.cc:740] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85b0338f404483ea2566d2f1c2d814c, State: Initialized, Role: FOLLOWER
I20260709 12:31:11.742019 12821 consensus_queue.cc:260] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a85b0338f404483ea2566d2f1c2d814c" member_type: VOTER }
I20260709 12:31:11.742450 12821 raft_consensus.cc:399] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:31:11.742640 12821 raft_consensus.cc:493] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:31:11.742841 12821 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:11.747974 12821 raft_consensus.cc:515] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a85b0338f404483ea2566d2f1c2d814c" member_type: VOTER }
I20260709 12:31:11.748549 12821 leader_election.cc:304] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a85b0338f404483ea2566d2f1c2d814c; no voters: 
I20260709 12:31:11.749564 12821 leader_election.cc:290] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:31:11.749958 12824 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:11.751439 12824 raft_consensus.cc:697] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [term 1 LEADER]: Becoming Leader. State: Replica: a85b0338f404483ea2566d2f1c2d814c, State: Running, Role: LEADER
I20260709 12:31:11.752151 12824 consensus_queue.cc:237] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a85b0338f404483ea2566d2f1c2d814c" member_type: VOTER }
I20260709 12:31:11.752607 12821 sys_catalog.cc:565] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:31:11.759145 12825 sys_catalog.cc:455] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a85b0338f404483ea2566d2f1c2d814c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a85b0338f404483ea2566d2f1c2d814c" member_type: VOTER } }
I20260709 12:31:11.759333 12826 sys_catalog.cc:455] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a85b0338f404483ea2566d2f1c2d814c. Latest consensus state: current_term: 1 leader_uuid: "a85b0338f404483ea2566d2f1c2d814c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a85b0338f404483ea2566d2f1c2d814c" member_type: VOTER } }
I20260709 12:31:11.760111 12825 sys_catalog.cc:458] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [sys.catalog]: This master's current role is: LEADER
I20260709 12:31:11.760219 12826 sys_catalog.cc:458] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [sys.catalog]: This master's current role is: LEADER
I20260709 12:31:11.762413 12833 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:31:11.768088 12833 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:31:11.769234  2676 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:31:11.777027 12833 catalog_manager.cc:1383] Generated new cluster ID: 89010287cd6f4ca89c8f951eef074334
I20260709 12:31:11.777333 12833 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:31:11.805182 12833 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:31:11.806686 12833 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:31:11.844655 12833 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c: Generated new TSK 0
I20260709 12:31:11.845417 12833 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:31:11.900802  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:11.907155 12842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:11.908344 12843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:11.909807 12845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:11.910073  2676 server_base.cc:1061] running on GCE node
I20260709 12:31:11.911154  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:11.911342  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:11.911465  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600271911454 us; error 0 us; skew 500 ppm
I20260709 12:31:11.911929  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:11.914222  2676 webserver.cc:533] Webserver started at http://127.2.157.1:36033/ using document root <none> and password file <none>
I20260709 12:31:11.914647  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:11.914799  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:11.915005  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:11.916126  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-0-root/instance:
uuid: "ccfb9877daec4cb398d89729ff2ea4ba"
format_stamp: "Formatted at 2026-07-09 12:31:11 on dist-test-slave-0768"
I20260709 12:31:11.920589  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:31:11.923864 12850 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:11.924654  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:31:11.924902  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-0-root
uuid: "ccfb9877daec4cb398d89729ff2ea4ba"
format_stamp: "Formatted at 2026-07-09 12:31:11 on dist-test-slave-0768"
I20260709 12:31:11.925158  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:11.945308  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:11.946606  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:11.947991  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:31:11.950312  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:31:11.950482  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:11.950667  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:31:11.950802  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:11.992116  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.1:42935
I20260709 12:31:11.992241 12912 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.1:42935 every 8 connection(s)
I20260709 12:31:11.997459  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:12.004282 12917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:12.005685 12918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:12.009287  2676 server_base.cc:1061] running on GCE node
W20260709 12:31:12.010298 12920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:12.011587  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:12.011865  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:12.012080  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600272012062 us; error 0 us; skew 500 ppm
I20260709 12:31:12.012096 12913 heartbeater.cc:344] Connected to a master server at 127.2.157.62:39655
I20260709 12:31:12.012643 12913 heartbeater.cc:461] Registering TS with master...
I20260709 12:31:12.012748  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:12.013455 12913 heartbeater.cc:507] Master 127.2.157.62:39655 requested a full tablet report, sending...
I20260709 12:31:12.016456 12786 ts_manager.cc:194] Registered new tserver with Master: ccfb9877daec4cb398d89729ff2ea4ba (127.2.157.1:42935)
I20260709 12:31:12.016697  2676 webserver.cc:533] Webserver started at http://127.2.157.2:40725/ using document root <none> and password file <none>
I20260709 12:31:12.017403  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:12.017661  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:12.017997  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:12.019052 12786 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60232
I20260709 12:31:12.019636  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-1-root/instance:
uuid: "8c3d0a1e64014387a60373d45ac89680"
format_stamp: "Formatted at 2026-07-09 12:31:12 on dist-test-slave-0768"
I20260709 12:31:12.024453  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:31:12.028792 12925 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:12.029542  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:31:12.029860  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-1-root
uuid: "8c3d0a1e64014387a60373d45ac89680"
format_stamp: "Formatted at 2026-07-09 12:31:12 on dist-test-slave-0768"
I20260709 12:31:12.030208  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:12.039639  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:12.040827  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:12.042346  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:31:12.045435  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:31:12.045693  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:12.046025  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:31:12.046195  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:12.086117  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.2:37399
I20260709 12:31:12.086274 12987 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.2:37399 every 8 connection(s)
I20260709 12:31:12.091102  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:12.098505 12991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:12.100332 12992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:12.103161  2676 server_base.cc:1061] running on GCE node
W20260709 12:31:12.104261 12994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:12.104635 12988 heartbeater.cc:344] Connected to a master server at 127.2.157.62:39655
I20260709 12:31:12.105115 12988 heartbeater.cc:461] Registering TS with master...
I20260709 12:31:12.105404  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:12.105662  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:12.105842  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600272105807 us; error 0 us; skew 500 ppm
I20260709 12:31:12.105997 12988 heartbeater.cc:507] Master 127.2.157.62:39655 requested a full tablet report, sending...
I20260709 12:31:12.106555  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:12.108088 12786 ts_manager.cc:194] Registered new tserver with Master: 8c3d0a1e64014387a60373d45ac89680 (127.2.157.2:37399)
I20260709 12:31:12.109352  2676 webserver.cc:533] Webserver started at http://127.2.157.3:34523/ using document root <none> and password file <none>
I20260709 12:31:12.109717 12786 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60240
I20260709 12:31:12.109987  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:12.110316  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:12.110582  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:12.111847  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-2-root/instance:
uuid: "8c662816efda4c2086bcca19b6e9ac54"
format_stamp: "Formatted at 2026-07-09 12:31:12 on dist-test-slave-0768"
I20260709 12:31:12.116108  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:31:12.119367 12999 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:12.120100  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:31:12.120347  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-2-root
uuid: "8c662816efda4c2086bcca19b6e9ac54"
format_stamp: "Formatted at 2026-07-09 12:31:12 on dist-test-slave-0768"
I20260709 12:31:12.120574  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599939977835-2676-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:12.139707  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:12.140820  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:12.142330  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:31:12.144484  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:31:12.144667  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:12.144948  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:31:12.145113  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:12.186390  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.3:42453
I20260709 12:31:12.186534 13061 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.3:42453 every 8 connection(s)
I20260709 12:31:12.200522 13062 heartbeater.cc:344] Connected to a master server at 127.2.157.62:39655
I20260709 12:31:12.201017 13062 heartbeater.cc:461] Registering TS with master...
I20260709 12:31:12.201779 13062 heartbeater.cc:507] Master 127.2.157.62:39655 requested a full tablet report, sending...
I20260709 12:31:12.203725 12786 ts_manager.cc:194] Registered new tserver with Master: 8c662816efda4c2086bcca19b6e9ac54 (127.2.157.3:42453)
I20260709 12:31:12.204192  2676 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014620845s
I20260709 12:31:12.205446 12786 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60250
I20260709 12:31:12.230295 12786 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60258:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:31:12.232501 12786 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:31:12.279433 12953 tablet_service.cc:1511] Processing CreateTablet for tablet fa097372d2cf420bbae324190c1a51fb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=36eb35c31f1248d29fd996b53c739f28]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:31:12.279917 12952 tablet_service.cc:1511] Processing CreateTablet for tablet 0397ef4de57c4a4492c16277153526df (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=36eb35c31f1248d29fd996b53c739f28]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:31:12.280838 12953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa097372d2cf420bbae324190c1a51fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:12.281719 12952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0397ef4de57c4a4492c16277153526df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:12.282648 13027 tablet_service.cc:1511] Processing CreateTablet for tablet fa097372d2cf420bbae324190c1a51fb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=36eb35c31f1248d29fd996b53c739f28]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:31:12.283953 13027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa097372d2cf420bbae324190c1a51fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:12.287637 13026 tablet_service.cc:1511] Processing CreateTablet for tablet 0397ef4de57c4a4492c16277153526df (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=36eb35c31f1248d29fd996b53c739f28]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:31:12.289047 13026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0397ef4de57c4a4492c16277153526df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:12.299448 12878 tablet_service.cc:1511] Processing CreateTablet for tablet fa097372d2cf420bbae324190c1a51fb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=36eb35c31f1248d29fd996b53c739f28]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:31:12.299885 12877 tablet_service.cc:1511] Processing CreateTablet for tablet 0397ef4de57c4a4492c16277153526df (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=36eb35c31f1248d29fd996b53c739f28]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:31:12.300954 12878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa097372d2cf420bbae324190c1a51fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:12.301612 12877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0397ef4de57c4a4492c16277153526df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:12.324380 13078 tablet_bootstrap.cc:492] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba: Bootstrap starting.
I20260709 12:31:12.333164 13077 tablet_bootstrap.cc:492] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680: Bootstrap starting.
I20260709 12:31:12.340757 13078 tablet_bootstrap.cc:654] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:12.341009 13079 tablet_bootstrap.cc:492] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54: Bootstrap starting.
I20260709 12:31:12.341545 13077 tablet_bootstrap.cc:654] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:12.346045 13078 tablet_bootstrap.cc:492] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba: No bootstrap required, opened a new log
I20260709 12:31:12.346472 13078 ts_tablet_manager.cc:1403] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.008s
I20260709 12:31:12.347117 13077 tablet_bootstrap.cc:492] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680: No bootstrap required, opened a new log
I20260709 12:31:12.347646 13077 ts_tablet_manager.cc:1403] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.008s
I20260709 12:31:12.348978 13079 tablet_bootstrap.cc:654] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:12.350791 13078 raft_consensus.cc:359] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } } peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } }
I20260709 12:31:12.351547 13078 raft_consensus.cc:385] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:12.351140 13077 raft_consensus.cc:359] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.351816 13078 raft_consensus.cc:740] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccfb9877daec4cb398d89729ff2ea4ba, State: Initialized, Role: FOLLOWER
I20260709 12:31:12.351986 13077 raft_consensus.cc:385] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:12.352540 13077 raft_consensus.cc:740] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3d0a1e64014387a60373d45ac89680, State: Initialized, Role: FOLLOWER
I20260709 12:31:12.352610 13078 consensus_queue.cc:260] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } } peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } }
I20260709 12:31:12.353732 13077 consensus_queue.cc:260] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.355244 12913 heartbeater.cc:499] Master 127.2.157.62:39655 was elected leader, sending a full tablet report...
I20260709 12:31:12.355576 13078 ts_tablet_manager.cc:1434] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:31:12.356463 13078 tablet_bootstrap.cc:492] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba: Bootstrap starting.
I20260709 12:31:12.364214 13077 ts_tablet_manager.cc:1434] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680: Time spent starting tablet: real 0.016s	user 0.014s	sys 0.003s
I20260709 12:31:12.365492 12988 heartbeater.cc:499] Master 127.2.157.62:39655 was elected leader, sending a full tablet report...
I20260709 12:31:12.367815 13079 tablet_bootstrap.cc:492] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54: No bootstrap required, opened a new log
I20260709 12:31:12.368450 13079 ts_tablet_manager.cc:1403] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.012s
I20260709 12:31:12.370908 13078 tablet_bootstrap.cc:654] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:12.371690 13079 raft_consensus.cc:359] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.372570 13077 tablet_bootstrap.cc:492] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680: Bootstrap starting.
I20260709 12:31:12.372551 13079 raft_consensus.cc:385] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:12.373095 13079 raft_consensus.cc:740] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c662816efda4c2086bcca19b6e9ac54, State: Initialized, Role: FOLLOWER
I20260709 12:31:12.374171 13079 consensus_queue.cc:260] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.381479 13077 tablet_bootstrap.cc:654] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:12.383105 13062 heartbeater.cc:499] Master 127.2.157.62:39655 was elected leader, sending a full tablet report...
I20260709 12:31:12.385442 13078 tablet_bootstrap.cc:492] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba: No bootstrap required, opened a new log
I20260709 12:31:12.386154 13078 ts_tablet_manager.cc:1403] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.006s
I20260709 12:31:12.383651 13079 ts_tablet_manager.cc:1434] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 12:31:12.390846 13079 tablet_bootstrap.cc:492] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54: Bootstrap starting.
I20260709 12:31:12.390480 13078 raft_consensus.cc:359] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.392578 13078 raft_consensus.cc:385] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:12.393061 13078 raft_consensus.cc:740] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccfb9877daec4cb398d89729ff2ea4ba, State: Initialized, Role: FOLLOWER
I20260709 12:31:12.394188 13078 consensus_queue.cc:260] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.400684 13078 ts_tablet_manager.cc:1434] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:31:12.402130 13086 raft_consensus.cc:493] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:12.402897 13086 raft_consensus.cc:515] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.405017 13079 tablet_bootstrap.cc:654] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:12.406457 13086 leader_election.cc:290] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccfb9877daec4cb398d89729ff2ea4ba (127.2.157.1:42935), 8c3d0a1e64014387a60373d45ac89680 (127.2.157.2:37399)
I20260709 12:31:12.413293 13077 tablet_bootstrap.cc:492] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680: No bootstrap required, opened a new log
I20260709 12:31:12.414047 13077 ts_tablet_manager.cc:1403] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.017s
I20260709 12:31:12.417762 13077 raft_consensus.cc:359] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } } peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } }
I20260709 12:31:12.418658 13077 raft_consensus.cc:385] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:12.419059 13077 raft_consensus.cc:740] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3d0a1e64014387a60373d45ac89680, State: Initialized, Role: FOLLOWER
I20260709 12:31:12.418982 13079 tablet_bootstrap.cc:492] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54: No bootstrap required, opened a new log
I20260709 12:31:12.420408 13079 ts_tablet_manager.cc:1403] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.005s
I20260709 12:31:12.419962 13077 consensus_queue.cc:260] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } } peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } }
I20260709 12:31:12.422756 13077 ts_tablet_manager.cc:1434] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:31:12.423465 12888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0397ef4de57c4a4492c16277153526df" candidate_uuid: "8c662816efda4c2086bcca19b6e9ac54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" is_pre_election: true
I20260709 12:31:12.424649 12888 raft_consensus.cc:2468] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c662816efda4c2086bcca19b6e9ac54 in term 0.
I20260709 12:31:12.424211 13079 raft_consensus.cc:359] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } } peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } }
I20260709 12:31:12.426194 13000 leader_election.cc:304] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c662816efda4c2086bcca19b6e9ac54, ccfb9877daec4cb398d89729ff2ea4ba; no voters: 
I20260709 12:31:12.427210 13086 raft_consensus.cc:2804] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:12.427574 13086 raft_consensus.cc:493] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:12.427887 13086 raft_consensus.cc:3060] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:12.428009 13079 raft_consensus.cc:385] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:12.428575 13079 raft_consensus.cc:740] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c662816efda4c2086bcca19b6e9ac54, State: Initialized, Role: FOLLOWER
I20260709 12:31:12.429551 13079 consensus_queue.cc:260] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } } peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } }
I20260709 12:31:12.432240 13079 ts_tablet_manager.cc:1434] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:31:12.433315 12963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0397ef4de57c4a4492c16277153526df" candidate_uuid: "8c662816efda4c2086bcca19b6e9ac54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3d0a1e64014387a60373d45ac89680" is_pre_election: true
I20260709 12:31:12.434100 12963 raft_consensus.cc:2468] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c662816efda4c2086bcca19b6e9ac54 in term 0.
I20260709 12:31:12.436223 13086 raft_consensus.cc:515] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.438206 13086 leader_election.cc:290] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [CANDIDATE]: Term 1 election: Requested vote from peers ccfb9877daec4cb398d89729ff2ea4ba (127.2.157.1:42935), 8c3d0a1e64014387a60373d45ac89680 (127.2.157.2:37399)
I20260709 12:31:12.439293 12888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0397ef4de57c4a4492c16277153526df" candidate_uuid: "8c662816efda4c2086bcca19b6e9ac54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccfb9877daec4cb398d89729ff2ea4ba"
I20260709 12:31:12.439857 12888 raft_consensus.cc:3060] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:12.439761 12963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0397ef4de57c4a4492c16277153526df" candidate_uuid: "8c662816efda4c2086bcca19b6e9ac54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3d0a1e64014387a60373d45ac89680"
I20260709 12:31:12.440501 12963 raft_consensus.cc:3060] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:12.442956 13084 raft_consensus.cc:493] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:12.443568 13084 raft_consensus.cc:515] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } } peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } }
I20260709 12:31:12.445822 12888 raft_consensus.cc:2468] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c662816efda4c2086bcca19b6e9ac54 in term 1.
I20260709 12:31:12.446600 13084 leader_election.cc:290] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c662816efda4c2086bcca19b6e9ac54 (127.2.157.3:42453), ccfb9877daec4cb398d89729ff2ea4ba (127.2.157.1:42935)
I20260709 12:31:12.449609 13000 leader_election.cc:304] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c662816efda4c2086bcca19b6e9ac54, ccfb9877daec4cb398d89729ff2ea4ba; no voters: 
I20260709 12:31:12.450385 12963 raft_consensus.cc:2468] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c662816efda4c2086bcca19b6e9ac54 in term 1.
I20260709 12:31:12.450656 13086 raft_consensus.cc:2804] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:12.451296 13086 raft_consensus.cc:697] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 1 LEADER]: Becoming Leader. State: Replica: 8c662816efda4c2086bcca19b6e9ac54, State: Running, Role: LEADER
I20260709 12:31:12.452210 13086 consensus_queue.cc:237] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.459672 12888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa097372d2cf420bbae324190c1a51fb" candidate_uuid: "8c3d0a1e64014387a60373d45ac89680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" is_pre_election: true
I20260709 12:31:12.460421 12888 raft_consensus.cc:2468] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3d0a1e64014387a60373d45ac89680 in term 0.
I20260709 12:31:12.460407 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa097372d2cf420bbae324190c1a51fb" candidate_uuid: "8c3d0a1e64014387a60373d45ac89680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c662816efda4c2086bcca19b6e9ac54" is_pre_election: true
I20260709 12:31:12.461366 13037 raft_consensus.cc:2468] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c3d0a1e64014387a60373d45ac89680 in term 0.
I20260709 12:31:12.462147 12926 leader_election.cc:304] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3d0a1e64014387a60373d45ac89680, ccfb9877daec4cb398d89729ff2ea4ba; no voters: 
I20260709 12:31:12.463037 13084 raft_consensus.cc:2804] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:12.463487 13084 raft_consensus.cc:493] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:12.463879 13084 raft_consensus.cc:3060] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:12.464049 12786 catalog_manager.cc:5697] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c662816efda4c2086bcca19b6e9ac54 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "8c662816efda4c2086bcca19b6e9ac54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:12.472009 13084 raft_consensus.cc:515] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } } peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } }
I20260709 12:31:12.474776 13084 leader_election.cc:290] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [CANDIDATE]: Term 1 election: Requested vote from peers 8c662816efda4c2086bcca19b6e9ac54 (127.2.157.3:42453), ccfb9877daec4cb398d89729ff2ea4ba (127.2.157.1:42935)
I20260709 12:31:12.475584 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa097372d2cf420bbae324190c1a51fb" candidate_uuid: "8c3d0a1e64014387a60373d45ac89680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c662816efda4c2086bcca19b6e9ac54"
I20260709 12:31:12.475812 12888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa097372d2cf420bbae324190c1a51fb" candidate_uuid: "8c3d0a1e64014387a60373d45ac89680" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccfb9877daec4cb398d89729ff2ea4ba"
I20260709 12:31:12.476207 13037 raft_consensus.cc:3060] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:12.476428 12888 raft_consensus.cc:3060] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:12.481561 12888 raft_consensus.cc:2468] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3d0a1e64014387a60373d45ac89680 in term 1.
I20260709 12:31:12.482295 13037 raft_consensus.cc:2468] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3d0a1e64014387a60373d45ac89680 in term 1.
I20260709 12:31:12.482717 12926 leader_election.cc:304] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3d0a1e64014387a60373d45ac89680, ccfb9877daec4cb398d89729ff2ea4ba; no voters: 
I20260709 12:31:12.483850 13084 raft_consensus.cc:2804] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:12.485162 13084 raft_consensus.cc:697] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 1 LEADER]: Becoming Leader. State: Replica: 8c3d0a1e64014387a60373d45ac89680, State: Running, Role: LEADER
I20260709 12:31:12.486060 13084 consensus_queue.cc:237] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } } peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } }
I20260709 12:31:12.493801 12786 catalog_manager.cc:5697] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c3d0a1e64014387a60373d45ac89680 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "8c3d0a1e64014387a60373d45ac89680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:12.565644 12786 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60272:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:31:12.567844 12786 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:31:12.591503 12877 tablet_service.cc:1511] Processing CreateTablet for tablet 80932ec27e4748f59a37702eb40cf5a2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a3bd11e47551448e84c1c9eb0d5b013b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:31:12.592998 12877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80932ec27e4748f59a37702eb40cf5a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:12.592836 12952 tablet_service.cc:1511] Processing CreateTablet for tablet 80932ec27e4748f59a37702eb40cf5a2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a3bd11e47551448e84c1c9eb0d5b013b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:31:12.594136 12952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80932ec27e4748f59a37702eb40cf5a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:12.597141 13026 tablet_service.cc:1511] Processing CreateTablet for tablet 80932ec27e4748f59a37702eb40cf5a2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a3bd11e47551448e84c1c9eb0d5b013b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:31:12.597263 12878 tablet_service.cc:1511] Processing CreateTablet for tablet b61acf9472c74f31b26371786841f6a2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a3bd11e47551448e84c1c9eb0d5b013b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:31:12.598471 13026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80932ec27e4748f59a37702eb40cf5a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:12.598812 12878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61acf9472c74f31b26371786841f6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:12.610683 13078 tablet_bootstrap.cc:492] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba: Bootstrap starting.
I20260709 12:31:12.612907 12953 tablet_service.cc:1511] Processing CreateTablet for tablet b61acf9472c74f31b26371786841f6a2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a3bd11e47551448e84c1c9eb0d5b013b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:31:12.614790 12953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61acf9472c74f31b26371786841f6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:12.648733 13077 tablet_bootstrap.cc:492] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680: Bootstrap starting.
I20260709 12:31:12.650272 13079 tablet_bootstrap.cc:492] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54: Bootstrap starting.
I20260709 12:31:12.652338 13078 tablet_bootstrap.cc:654] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:12.653506 13026 tablet_service.cc:1511] Processing CreateTablet for tablet b61acf9472c74f31b26371786841f6a2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a3bd11e47551448e84c1c9eb0d5b013b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:31:12.656126 13077 tablet_bootstrap.cc:654] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:12.657644 13079 tablet_bootstrap.cc:654] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:12.654912 13026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61acf9472c74f31b26371786841f6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:12.666179 13079 tablet_bootstrap.cc:492] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54: No bootstrap required, opened a new log
I20260709 12:31:12.666919 13079 ts_tablet_manager.cc:1403] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:31:12.671304 13079 raft_consensus.cc:359] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.672689 13079 raft_consensus.cc:385] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:12.673142 13079 raft_consensus.cc:740] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c662816efda4c2086bcca19b6e9ac54, State: Initialized, Role: FOLLOWER
I20260709 12:31:12.674265 13079 consensus_queue.cc:260] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.678269 13078 tablet_bootstrap.cc:492] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba: No bootstrap required, opened a new log
I20260709 12:31:12.678313 13079 ts_tablet_manager.cc:1434] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:31:12.679088 13078 ts_tablet_manager.cc:1403] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba: Time spent bootstrapping tablet: real 0.069s	user 0.026s	sys 0.006s
I20260709 12:31:12.679749 13079 tablet_bootstrap.cc:492] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54: Bootstrap starting.
I20260709 12:31:12.680361 13077 tablet_bootstrap.cc:492] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680: No bootstrap required, opened a new log
I20260709 12:31:12.680976 13077 ts_tablet_manager.cc:1403] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.000s
I20260709 12:31:12.682823 13078 raft_consensus.cc:359] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.683830 13078 raft_consensus.cc:385] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:12.684237 13078 raft_consensus.cc:740] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccfb9877daec4cb398d89729ff2ea4ba, State: Initialized, Role: FOLLOWER
I20260709 12:31:12.685335 13078 consensus_queue.cc:260] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.687902 13079 tablet_bootstrap.cc:654] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:12.688316 13078 ts_tablet_manager.cc:1434] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:31:12.689688 13078 tablet_bootstrap.cc:492] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba: Bootstrap starting.
I20260709 12:31:12.685387 13077 raft_consensus.cc:359] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.690243 13077 raft_consensus.cc:385] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:12.690673 13077 raft_consensus.cc:740] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3d0a1e64014387a60373d45ac89680, State: Initialized, Role: FOLLOWER
I20260709 12:31:12.691675 13077 consensus_queue.cc:260] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.694934 13077 ts_tablet_manager.cc:1434] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:31:12.700719 13077 tablet_bootstrap.cc:492] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680: Bootstrap starting.
I20260709 12:31:12.697651 13079 tablet_bootstrap.cc:492] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54: No bootstrap required, opened a new log
I20260709 12:31:12.702180 13079 ts_tablet_manager.cc:1403] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.002s
I20260709 12:31:12.705443 13078 tablet_bootstrap.cc:654] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:12.705696 13079 raft_consensus.cc:359] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.706673 13079 raft_consensus.cc:385] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:12.707108 13079 raft_consensus.cc:740] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c662816efda4c2086bcca19b6e9ac54, State: Initialized, Role: FOLLOWER
I20260709 12:31:12.708194 13079 consensus_queue.cc:260] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.708906 13077 tablet_bootstrap.cc:654] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:12.716849 13079 ts_tablet_manager.cc:1434] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:31:12.721131 13078 tablet_bootstrap.cc:492] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba: No bootstrap required, opened a new log
I20260709 12:31:12.721848 13078 ts_tablet_manager.cc:1403] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.011s
I20260709 12:31:12.721925 13077 tablet_bootstrap.cc:492] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680: No bootstrap required, opened a new log
I20260709 12:31:12.722764 13077 ts_tablet_manager.cc:1403] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.002s
I20260709 12:31:12.725556 13078 raft_consensus.cc:359] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.726615 13078 raft_consensus.cc:385] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:12.726190 13077 raft_consensus.cc:359] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.727052 13078 raft_consensus.cc:740] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccfb9877daec4cb398d89729ff2ea4ba, State: Initialized, Role: FOLLOWER
I20260709 12:31:12.727160 13077 raft_consensus.cc:385] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:12.727610 13077 raft_consensus.cc:740] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c3d0a1e64014387a60373d45ac89680, State: Initialized, Role: FOLLOWER
I20260709 12:31:12.728035 13078 consensus_queue.cc:260] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.728483 13077 consensus_queue.cc:260] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.730839 13078 ts_tablet_manager.cc:1434] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 12:31:12.731138 13077 ts_tablet_manager.cc:1434] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:31:12.750478 13086 raft_consensus.cc:493] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:12.751117 13086 raft_consensus.cc:515] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.753369 13086 leader_election.cc:290] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccfb9877daec4cb398d89729ff2ea4ba (127.2.157.1:42935), 8c3d0a1e64014387a60373d45ac89680 (127.2.157.2:37399)
I20260709 12:31:12.754070 12888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61acf9472c74f31b26371786841f6a2" candidate_uuid: "8c662816efda4c2086bcca19b6e9ac54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" is_pre_election: true
I20260709 12:31:12.754503 12963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61acf9472c74f31b26371786841f6a2" candidate_uuid: "8c662816efda4c2086bcca19b6e9ac54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3d0a1e64014387a60373d45ac89680" is_pre_election: true
I20260709 12:31:12.754819 12888 raft_consensus.cc:2468] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c662816efda4c2086bcca19b6e9ac54 in term 0.
I20260709 12:31:12.755192 12963 raft_consensus.cc:2468] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c662816efda4c2086bcca19b6e9ac54 in term 0.
I20260709 12:31:12.756283 13000 leader_election.cc:304] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c662816efda4c2086bcca19b6e9ac54, ccfb9877daec4cb398d89729ff2ea4ba; no voters: 
I20260709 12:31:12.757064 13086 raft_consensus.cc:2804] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:12.757476 13086 raft_consensus.cc:493] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:12.757768 13086 raft_consensus.cc:3060] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:12.763379 13086 raft_consensus.cc:515] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
W20260709 12:31:12.764021 12834 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:31:12.765368 13086 leader_election.cc:290] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [CANDIDATE]: Term 1 election: Requested vote from peers ccfb9877daec4cb398d89729ff2ea4ba (127.2.157.1:42935), 8c3d0a1e64014387a60373d45ac89680 (127.2.157.2:37399)
I20260709 12:31:12.766136 12888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61acf9472c74f31b26371786841f6a2" candidate_uuid: "8c662816efda4c2086bcca19b6e9ac54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccfb9877daec4cb398d89729ff2ea4ba"
I20260709 12:31:12.766470 12963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61acf9472c74f31b26371786841f6a2" candidate_uuid: "8c662816efda4c2086bcca19b6e9ac54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3d0a1e64014387a60373d45ac89680"
I20260709 12:31:12.766693 12888 raft_consensus.cc:3060] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:12.767161 12963 raft_consensus.cc:3060] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:12.771909 12888 raft_consensus.cc:2468] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c662816efda4c2086bcca19b6e9ac54 in term 1.
I20260709 12:31:12.772889 12963 raft_consensus.cc:2468] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c662816efda4c2086bcca19b6e9ac54 in term 1.
I20260709 12:31:12.773129 13000 leader_election.cc:304] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c662816efda4c2086bcca19b6e9ac54, ccfb9877daec4cb398d89729ff2ea4ba; no voters: 
I20260709 12:31:12.774358 13086 raft_consensus.cc:2804] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:12.774829 13086 raft_consensus.cc:697] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 1 LEADER]: Becoming Leader. State: Replica: 8c662816efda4c2086bcca19b6e9ac54, State: Running, Role: LEADER
I20260709 12:31:12.775722 13086 consensus_queue.cc:237] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.784189 12785 catalog_manager.cc:5697] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c662816efda4c2086bcca19b6e9ac54 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "8c662816efda4c2086bcca19b6e9ac54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:12.882752 13083 raft_consensus.cc:493] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:12.883370 13083 raft_consensus.cc:515] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.885784 13083 leader_election.cc:290] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c3d0a1e64014387a60373d45ac89680 (127.2.157.2:37399), 8c662816efda4c2086bcca19b6e9ac54 (127.2.157.3:42453)
I20260709 12:31:12.897578 12963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80932ec27e4748f59a37702eb40cf5a2" candidate_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3d0a1e64014387a60373d45ac89680" is_pre_election: true
I20260709 12:31:12.897996 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80932ec27e4748f59a37702eb40cf5a2" candidate_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c662816efda4c2086bcca19b6e9ac54" is_pre_election: true
I20260709 12:31:12.898439 12963 raft_consensus.cc:2468] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccfb9877daec4cb398d89729ff2ea4ba in term 0.
I20260709 12:31:12.898639 13037 raft_consensus.cc:2468] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccfb9877daec4cb398d89729ff2ea4ba in term 0.
I20260709 12:31:12.899592 12852 leader_election.cc:304] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3d0a1e64014387a60373d45ac89680, ccfb9877daec4cb398d89729ff2ea4ba; no voters: 
I20260709 12:31:12.900379 13083 raft_consensus.cc:2804] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:12.900723 13083 raft_consensus.cc:493] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:12.901051 13083 raft_consensus.cc:3060] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:12.906476 13083 raft_consensus.cc:515] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.908176 13083 leader_election.cc:290] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [CANDIDATE]: Term 1 election: Requested vote from peers 8c3d0a1e64014387a60373d45ac89680 (127.2.157.2:37399), 8c662816efda4c2086bcca19b6e9ac54 (127.2.157.3:42453)
I20260709 12:31:12.908972 12963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80932ec27e4748f59a37702eb40cf5a2" candidate_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c3d0a1e64014387a60373d45ac89680"
I20260709 12:31:12.909186 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80932ec27e4748f59a37702eb40cf5a2" candidate_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c662816efda4c2086bcca19b6e9ac54"
I20260709 12:31:12.909539 12963 raft_consensus.cc:3060] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:12.909813 13037 raft_consensus.cc:3060] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:12.915347 12963 raft_consensus.cc:2468] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccfb9877daec4cb398d89729ff2ea4ba in term 1.
I20260709 12:31:12.915351 13037 raft_consensus.cc:2468] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccfb9877daec4cb398d89729ff2ea4ba in term 1.
I20260709 12:31:12.916929 12851 leader_election.cc:304] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c662816efda4c2086bcca19b6e9ac54, ccfb9877daec4cb398d89729ff2ea4ba; no voters: 
I20260709 12:31:12.917546 13086 consensus_queue.cc:1048] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:12.917793 13083 raft_consensus.cc:2804] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:12.919153 13083 raft_consensus.cc:697] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 1 LEADER]: Becoming Leader. State: Replica: ccfb9877daec4cb398d89729ff2ea4ba, State: Running, Role: LEADER
I20260709 12:31:12.920073 13083 consensus_queue.cc:237] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:12.927970 13086 consensus_queue.cc:1048] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:12.929559 12785 catalog_manager.cc:5697] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba reported cstate change: term changed from 0 to 1, leader changed from <none> to ccfb9877daec4cb398d89729ff2ea4ba (127.2.157.1). New cstate: current_term: 1 leader_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:12.988359 12963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa097372d2cf420bbae324190c1a51fb"
dest_uuid: "8c3d0a1e64014387a60373d45ac89680"
mode: GRACEFUL
new_leader_uuid: "ccfb9877daec4cb398d89729ff2ea4ba"
 from {username='slave'} at 127.0.0.1:44414
I20260709 12:31:12.988909 12963 raft_consensus.cc:606] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 1 LEADER]: Received request to transfer leadership to TS ccfb9877daec4cb398d89729ff2ea4ba
I20260709 12:31:13.002146 13037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0397ef4de57c4a4492c16277153526df"
dest_uuid: "8c662816efda4c2086bcca19b6e9ac54"
mode: GRACEFUL
new_leader_uuid: "8c3d0a1e64014387a60373d45ac89680"
 from {username='slave'} at 127.0.0.1:49308
I20260709 12:31:13.002743 13037 raft_consensus.cc:606] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 1 LEADER]: Received request to transfer leadership to TS 8c3d0a1e64014387a60373d45ac89680
I20260709 12:31:13.011142 13037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b61acf9472c74f31b26371786841f6a2"
dest_uuid: "8c662816efda4c2086bcca19b6e9ac54"
mode: GRACEFUL
new_leader_uuid: "ccfb9877daec4cb398d89729ff2ea4ba"
 from {username='slave'} at 127.0.0.1:49308
I20260709 12:31:13.011693 13037 raft_consensus.cc:606] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 1 LEADER]: Received request to transfer leadership to TS ccfb9877daec4cb398d89729ff2ea4ba
I20260709 12:31:13.023339 13084 consensus_queue.cc:1048] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:13.037145 13120 consensus_queue.cc:1048] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:13.047881 13120 raft_consensus.cc:993] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680: : Instructing follower ccfb9877daec4cb398d89729ff2ea4ba to start an election
I20260709 12:31:13.048523 13119 raft_consensus.cc:1081] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 1 LEADER]: Signalling peer ccfb9877daec4cb398d89729ff2ea4ba to start an election
I20260709 12:31:13.050267 12888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa097372d2cf420bbae324190c1a51fb"
dest_uuid: "ccfb9877daec4cb398d89729ff2ea4ba"
 from {username='slave'} at 127.0.0.1:34952
I20260709 12:31:13.050853 12888 raft_consensus.cc:493] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:13.051204 12888 raft_consensus.cc:3060] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:13.057551 12888 raft_consensus.cc:515] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } } peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } }
I20260709 12:31:13.059815 12888 leader_election.cc:290] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [CANDIDATE]: Term 2 election: Requested vote from peers 8c3d0a1e64014387a60373d45ac89680 (127.2.157.2:37399), 8c662816efda4c2086bcca19b6e9ac54 (127.2.157.3:42453)
I20260709 12:31:13.060966 12963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa097372d2cf420bbae324190c1a51fb" candidate_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c3d0a1e64014387a60373d45ac89680"
I20260709 12:31:13.061730 12963 raft_consensus.cc:3055] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:13.060966 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa097372d2cf420bbae324190c1a51fb" candidate_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c662816efda4c2086bcca19b6e9ac54"
I20260709 12:31:13.062090 12963 raft_consensus.cc:740] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c3d0a1e64014387a60373d45ac89680, State: Running, Role: LEADER
I20260709 12:31:13.062675 13037 raft_consensus.cc:3060] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:13.063172 12963 consensus_queue.cc:260] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } } peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } }
I20260709 12:31:13.064282 12963 raft_consensus.cc:3060] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:13.070052 13037 raft_consensus.cc:2468] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccfb9877daec4cb398d89729ff2ea4ba in term 2.
I20260709 12:31:13.070276 12963 raft_consensus.cc:2468] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccfb9877daec4cb398d89729ff2ea4ba in term 2.
I20260709 12:31:13.071235 12851 leader_election.cc:304] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c662816efda4c2086bcca19b6e9ac54, ccfb9877daec4cb398d89729ff2ea4ba; no voters: 
I20260709 12:31:13.072108 13083 raft_consensus.cc:2804] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:13.072588 13083 raft_consensus.cc:697] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [term 2 LEADER]: Becoming Leader. State: Replica: ccfb9877daec4cb398d89729ff2ea4ba, State: Running, Role: LEADER
I20260709 12:31:13.073381 13083 consensus_queue.cc:237] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } } peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } }
I20260709 12:31:13.080745 12784 catalog_manager.cc:5697] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba reported cstate change: term changed from 1 to 2, leader changed from 8c3d0a1e64014387a60373d45ac89680 (127.2.157.2) to ccfb9877daec4cb398d89729ff2ea4ba (127.2.157.1). New cstate: current_term: 2 leader_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:13.260917 13087 consensus_queue.cc:1048] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:13.272181 13123 consensus_queue.cc:1048] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:13.280313 13086 raft_consensus.cc:993] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54: : Instructing follower ccfb9877daec4cb398d89729ff2ea4ba to start an election
I20260709 12:31:13.280803 13123 raft_consensus.cc:1081] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 1 LEADER]: Signalling peer ccfb9877daec4cb398d89729ff2ea4ba to start an election
I20260709 12:31:13.282456 12888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b61acf9472c74f31b26371786841f6a2"
dest_uuid: "ccfb9877daec4cb398d89729ff2ea4ba"
 from {username='slave'} at 127.0.0.1:34948
I20260709 12:31:13.282938 12888 raft_consensus.cc:493] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:13.283294 12888 raft_consensus.cc:3060] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:13.288547 12888 raft_consensus.cc:515] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:13.290433 12888 leader_election.cc:290] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [CANDIDATE]: Term 2 election: Requested vote from peers 8c3d0a1e64014387a60373d45ac89680 (127.2.157.2:37399), 8c662816efda4c2086bcca19b6e9ac54 (127.2.157.3:42453)
I20260709 12:31:13.291240 12963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61acf9472c74f31b26371786841f6a2" candidate_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c3d0a1e64014387a60373d45ac89680"
I20260709 12:31:13.291662 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61acf9472c74f31b26371786841f6a2" candidate_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c662816efda4c2086bcca19b6e9ac54"
I20260709 12:31:13.291968 12963 raft_consensus.cc:3060] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:13.292331 13037 raft_consensus.cc:3055] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:13.292698 13037 raft_consensus.cc:740] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c662816efda4c2086bcca19b6e9ac54, State: Running, Role: LEADER
I20260709 12:31:13.293548 13037 consensus_queue.cc:260] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:13.295013 13037 raft_consensus.cc:3060] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:13.297937 12963 raft_consensus.cc:2468] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccfb9877daec4cb398d89729ff2ea4ba in term 2.
I20260709 12:31:13.299157 12852 leader_election.cc:304] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3d0a1e64014387a60373d45ac89680, ccfb9877daec4cb398d89729ff2ea4ba; no voters: 
I20260709 12:31:13.299953 13083 raft_consensus.cc:2804] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:13.300431 13083 raft_consensus.cc:697] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 2 LEADER]: Becoming Leader. State: Replica: ccfb9877daec4cb398d89729ff2ea4ba, State: Running, Role: LEADER
I20260709 12:31:13.300962 13037 raft_consensus.cc:2468] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccfb9877daec4cb398d89729ff2ea4ba in term 2.
I20260709 12:31:13.301226 13083 consensus_queue.cc:237] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:13.307596 12785 catalog_manager.cc:5697] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba reported cstate change: term changed from 1 to 2, leader changed from 8c662816efda4c2086bcca19b6e9ac54 (127.2.157.3) to ccfb9877daec4cb398d89729ff2ea4ba (127.2.157.1). New cstate: current_term: 2 leader_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:13.358848 13086 raft_consensus.cc:993] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54: : Instructing follower 8c3d0a1e64014387a60373d45ac89680 to start an election
I20260709 12:31:13.359354 13123 raft_consensus.cc:1081] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 1 LEADER]: Signalling peer 8c3d0a1e64014387a60373d45ac89680 to start an election
I20260709 12:31:13.360860 12963 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0397ef4de57c4a4492c16277153526df"
dest_uuid: "8c3d0a1e64014387a60373d45ac89680"
 from {username='slave'} at 127.0.0.1:44400
I20260709 12:31:13.361389 12963 raft_consensus.cc:493] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:13.361704 12963 raft_consensus.cc:3060] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:13.367009 12963 raft_consensus.cc:515] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:13.368567 12963 leader_election.cc:290] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [CANDIDATE]: Term 2 election: Requested vote from peers ccfb9877daec4cb398d89729ff2ea4ba (127.2.157.1:42935), 8c662816efda4c2086bcca19b6e9ac54 (127.2.157.3:42453)
I20260709 12:31:13.369423 12888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0397ef4de57c4a4492c16277153526df" candidate_uuid: "8c3d0a1e64014387a60373d45ac89680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccfb9877daec4cb398d89729ff2ea4ba"
I20260709 12:31:13.369803 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0397ef4de57c4a4492c16277153526df" candidate_uuid: "8c3d0a1e64014387a60373d45ac89680" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c662816efda4c2086bcca19b6e9ac54"
I20260709 12:31:13.370131 12888 raft_consensus.cc:3060] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:13.370486 13037 raft_consensus.cc:3055] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:13.370800 13037 raft_consensus.cc:740] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c662816efda4c2086bcca19b6e9ac54, State: Running, Role: LEADER
I20260709 12:31:13.371522 13037 consensus_queue.cc:260] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:13.372512 13037 raft_consensus.cc:3060] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:13.376235 12888 raft_consensus.cc:2468] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3d0a1e64014387a60373d45ac89680 in term 2.
I20260709 12:31:13.377436 12926 leader_election.cc:304] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3d0a1e64014387a60373d45ac89680, ccfb9877daec4cb398d89729ff2ea4ba; no voters: 
I20260709 12:31:13.378342 13119 raft_consensus.cc:2804] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:13.378415 13037 raft_consensus.cc:2468] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c3d0a1e64014387a60373d45ac89680 in term 2.
I20260709 12:31:13.378880 13119 raft_consensus.cc:697] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [term 2 LEADER]: Becoming Leader. State: Replica: 8c3d0a1e64014387a60373d45ac89680, State: Running, Role: LEADER
I20260709 12:31:13.379812 13119 consensus_queue.cc:237] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:13.386118 12785 catalog_manager.cc:5697] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 reported cstate change: term changed from 1 to 2, leader changed from 8c662816efda4c2086bcca19b6e9ac54 (127.2.157.3) to 8c3d0a1e64014387a60373d45ac89680 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "8c3d0a1e64014387a60373d45ac89680" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:13.410272 13083 consensus_queue.cc:1048] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:13.421758 13083 consensus_queue.cc:1048] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:13.477034  2676 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:31:13.478880  2676 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:31:13.479326  2676 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:31:13.492000 12888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b61acf9472c74f31b26371786841f6a2"
dest_uuid: "ccfb9877daec4cb398d89729ff2ea4ba"
mode: GRACEFUL
new_leader_uuid: "8c662816efda4c2086bcca19b6e9ac54"
 from {username='slave'} at 127.0.0.1:34960
I20260709 12:31:13.492601 12888 raft_consensus.cc:606] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 2 LEADER]: Received request to transfer leadership to TS 8c662816efda4c2086bcca19b6e9ac54
I20260709 12:31:13.493798  2676 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:31:13.555713 12963 raft_consensus.cc:1275] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 2 FOLLOWER]: Refusing update from remote peer ccfb9877daec4cb398d89729ff2ea4ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:13.557090 13083 consensus_queue.cc:1048] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:13.565367 13037 raft_consensus.cc:1275] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54 [term 2 FOLLOWER]: Refusing update from remote peer ccfb9877daec4cb398d89729ff2ea4ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:13.567121 13109 consensus_queue.cc:1048] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:13.687005 12963 raft_consensus.cc:1275] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680 [term 2 FOLLOWER]: Refusing update from remote peer ccfb9877daec4cb398d89729ff2ea4ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:13.688457 13109 consensus_queue.cc:1048] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:13.696187 13037 raft_consensus.cc:1275] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 2 FOLLOWER]: Refusing update from remote peer ccfb9877daec4cb398d89729ff2ea4ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:13.698906 13109 consensus_queue.cc:1048] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:13.706568 13083 raft_consensus.cc:993] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba: : Instructing follower 8c662816efda4c2086bcca19b6e9ac54 to start an election
I20260709 12:31:13.707052 13109 raft_consensus.cc:1081] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 2 LEADER]: Signalling peer 8c662816efda4c2086bcca19b6e9ac54 to start an election
I20260709 12:31:13.708508 13037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b61acf9472c74f31b26371786841f6a2"
dest_uuid: "8c662816efda4c2086bcca19b6e9ac54"
 from {username='slave'} at 127.0.0.1:49304
I20260709 12:31:13.709064 13037 raft_consensus.cc:493] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:13.709510 13037 raft_consensus.cc:3060] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:13.714452 13037 raft_consensus.cc:515] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:13.716101 13037 leader_election.cc:290] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [CANDIDATE]: Term 3 election: Requested vote from peers ccfb9877daec4cb398d89729ff2ea4ba (127.2.157.1:42935), 8c3d0a1e64014387a60373d45ac89680 (127.2.157.2:37399)
I20260709 12:31:13.716970 12888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61acf9472c74f31b26371786841f6a2" candidate_uuid: "8c662816efda4c2086bcca19b6e9ac54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ccfb9877daec4cb398d89729ff2ea4ba"
I20260709 12:31:13.717221 12963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61acf9472c74f31b26371786841f6a2" candidate_uuid: "8c662816efda4c2086bcca19b6e9ac54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8c3d0a1e64014387a60373d45ac89680"
I20260709 12:31:13.717643 12888 raft_consensus.cc:3055] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:31:13.717864 12963 raft_consensus.cc:3060] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:13.718029 12888 raft_consensus.cc:740] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ccfb9877daec4cb398d89729ff2ea4ba, State: Running, Role: LEADER
I20260709 12:31:13.718868 12888 consensus_queue.cc:260] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:13.719832 12888 raft_consensus.cc:3060] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:13.724104 12963 raft_consensus.cc:2468] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c662816efda4c2086bcca19b6e9ac54 in term 3.
I20260709 12:31:13.725243 13001 leader_election.cc:304] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c3d0a1e64014387a60373d45ac89680, 8c662816efda4c2086bcca19b6e9ac54; no voters: 
I20260709 12:31:13.725241 12888 raft_consensus.cc:2468] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c662816efda4c2086bcca19b6e9ac54 in term 3.
I20260709 12:31:13.726118 13123 raft_consensus.cc:2804] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:31:13.726593 13123 raft_consensus.cc:697] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 3 LEADER]: Becoming Leader. State: Replica: 8c662816efda4c2086bcca19b6e9ac54, State: Running, Role: LEADER
I20260709 12:31:13.727284 13123 consensus_queue.cc:237] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } }
I20260709 12:31:13.733421 12786 catalog_manager.cc:5697] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 reported cstate change: term changed from 2 to 3, leader changed from ccfb9877daec4cb398d89729ff2ea4ba (127.2.157.1) to 8c662816efda4c2086bcca19b6e9ac54 (127.2.157.3). New cstate: current_term: 3 leader_uuid: "8c662816efda4c2086bcca19b6e9ac54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccfb9877daec4cb398d89729ff2ea4ba" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 42935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c3d0a1e64014387a60373d45ac89680" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:13.849349  2676 tablet_server.cc:179] TabletServer@127.2.157.1:0 shutting down...
I20260709 12:31:13.869365  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:13.870141  2676 tablet_replica.cc:333] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba: stopping tablet replica
I20260709 12:31:13.870760  2676 raft_consensus.cc:2243] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:13.871263  2676 raft_consensus.cc:2272] T b61acf9472c74f31b26371786841f6a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:13.873642  2676 tablet_replica.cc:333] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba: stopping tablet replica
I20260709 12:31:13.874305  2676 raft_consensus.cc:2243] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:13.874758  2676 raft_consensus.cc:2272] T 0397ef4de57c4a4492c16277153526df P ccfb9877daec4cb398d89729ff2ea4ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:13.877167  2676 tablet_replica.cc:333] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba: stopping tablet replica
I20260709 12:31:13.877745  2676 raft_consensus.cc:2243] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:13.878832  2676 raft_consensus.cc:2272] T 80932ec27e4748f59a37702eb40cf5a2 P ccfb9877daec4cb398d89729ff2ea4ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:13.882169  2676 tablet_replica.cc:333] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba: stopping tablet replica
W20260709 12:31:13.882653 12926 consensus_peers.cc:597] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 -> Peer ccfb9877daec4cb398d89729ff2ea4ba (127.2.157.1:42935): Couldn't send request to peer ccfb9877daec4cb398d89729ff2ea4ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:13.882867  2676 raft_consensus.cc:2243] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:13.883846  2676 raft_consensus.cc:2272] T fa097372d2cf420bbae324190c1a51fb P ccfb9877daec4cb398d89729ff2ea4ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:13.908126  2676 tablet_server.cc:196] TabletServer@127.2.157.1:0 shutdown complete.
I20260709 12:31:13.920121  2676 tablet_server.cc:179] TabletServer@127.2.157.2:0 shutting down...
I20260709 12:31:13.937668 13037 raft_consensus.cc:1275] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 2 FOLLOWER]: Refusing update from remote peer 8c3d0a1e64014387a60373d45ac89680: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:13.939630  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:13.939795 13119 consensus_queue.cc:1048] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c662816efda4c2086bcca19b6e9ac54" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 42453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:13.940507  2676 tablet_replica.cc:333] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680: stopping tablet replica
I20260709 12:31:13.941308  2676 raft_consensus.cc:2243] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:13.941777  2676 raft_consensus.cc:2272] T b61acf9472c74f31b26371786841f6a2 P 8c3d0a1e64014387a60373d45ac89680 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:13.944763  2676 tablet_replica.cc:333] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680: stopping tablet replica
I20260709 12:31:13.945438  2676 raft_consensus.cc:2243] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:13.946054  2676 raft_consensus.cc:2272] T 80932ec27e4748f59a37702eb40cf5a2 P 8c3d0a1e64014387a60373d45ac89680 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:13.948971  2676 tablet_replica.cc:333] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680: stopping tablet replica
I20260709 12:31:13.949733  2676 raft_consensus.cc:2243] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:13.950367  2676 raft_consensus.cc:2272] T fa097372d2cf420bbae324190c1a51fb P 8c3d0a1e64014387a60373d45ac89680 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:13.953720  2676 tablet_replica.cc:333] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680: stopping tablet replica
I20260709 12:31:13.954491  2676 raft_consensus.cc:2243] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:13.955415  2676 raft_consensus.cc:2272] T 0397ef4de57c4a4492c16277153526df P 8c3d0a1e64014387a60373d45ac89680 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:13.979880  2676 tablet_server.cc:196] TabletServer@127.2.157.2:0 shutdown complete.
I20260709 12:31:13.993057  2676 tablet_server.cc:179] TabletServer@127.2.157.3:0 shutting down...
I20260709 12:31:14.013092  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:14.013804  2676 tablet_replica.cc:333] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54: stopping tablet replica
I20260709 12:31:14.014501  2676 raft_consensus.cc:2243] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:31:14.015237  2676 pending_rounds.cc:70] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54: Trying to abort 1 pending ops.
I20260709 12:31:14.015455  2676 pending_rounds.cc:77] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305626721193791488 op_type: NO_OP noop_request { }
I20260709 12:31:14.015799  2676 raft_consensus.cc:2889] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:31:14.016126  2676 raft_consensus.cc:2272] T b61acf9472c74f31b26371786841f6a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:14.018452  2676 tablet_replica.cc:333] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54: stopping tablet replica
I20260709 12:31:14.019047  2676 raft_consensus.cc:2243] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:14.019506  2676 raft_consensus.cc:2272] T 80932ec27e4748f59a37702eb40cf5a2 P 8c662816efda4c2086bcca19b6e9ac54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:14.022607  2676 tablet_replica.cc:333] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54: stopping tablet replica
I20260709 12:31:14.023166  2676 raft_consensus.cc:2243] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:14.023638  2676 raft_consensus.cc:2272] T fa097372d2cf420bbae324190c1a51fb P 8c662816efda4c2086bcca19b6e9ac54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:14.026013  2676 tablet_replica.cc:333] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54: stopping tablet replica
I20260709 12:31:14.026533  2676 raft_consensus.cc:2243] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:14.026989  2676 raft_consensus.cc:2272] T 0397ef4de57c4a4492c16277153526df P 8c662816efda4c2086bcca19b6e9ac54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:14.051424  2676 tablet_server.cc:196] TabletServer@127.2.157.3:0 shutdown complete.
I20260709 12:31:14.063880  2676 master.cc:562] Master@127.2.157.62:39655 shutting down...
I20260709 12:31:14.079685  2676 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:14.080201  2676 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:14.080467  2676 tablet_replica.cc:333] T 00000000000000000000000000000000 P a85b0338f404483ea2566d2f1c2d814c: stopping tablet replica
I20260709 12:31:14.099520  2676 master.cc:584] Master@127.2.157.62:39655 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2511 ms)
[----------] 6 tests from LeaderRebalancerTest (333983 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:31:14.127322  2676 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.62:43177
I20260709 12:31:14.128357  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:14.133351 13134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:14.134313 13133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:14.134810 13136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:14.135519  2676 server_base.cc:1061] running on GCE node
I20260709 12:31:14.136291  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:14.136459  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:14.136571  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600274136560 us; error 0 us; skew 500 ppm
I20260709 12:31:14.137037  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:14.139365  2676 webserver.cc:533] Webserver started at http://127.2.157.62:44073/ using document root <none> and password file <none>
I20260709 12:31:14.139788  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:14.139946  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:14.140187  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:14.141199  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/master-0-root/instance:
uuid: "b913d0ad430f43d98633bf3ee561e83f"
format_stamp: "Formatted at 2026-07-09 12:31:14 on dist-test-slave-0768"
I20260709 12:31:14.145545  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:31:14.148841 13141 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:14.149613  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:31:14.149938  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/master-0-root
uuid: "b913d0ad430f43d98633bf3ee561e83f"
format_stamp: "Formatted at 2026-07-09 12:31:14 on dist-test-slave-0768"
I20260709 12:31:14.150199  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:14.178085  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:14.179141  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:14.215932  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.62:43177
I20260709 12:31:14.216066 13192 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.62:43177 every 8 connection(s)
I20260709 12:31:14.219744 13193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.231725 13193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f: Bootstrap starting.
I20260709 12:31:14.236586 13193 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:14.240545 13193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f: No bootstrap required, opened a new log
I20260709 12:31:14.242652 13193 raft_consensus.cc:359] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b913d0ad430f43d98633bf3ee561e83f" member_type: VOTER }
I20260709 12:31:14.243018 13193 raft_consensus.cc:385] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:14.243198 13193 raft_consensus.cc:740] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b913d0ad430f43d98633bf3ee561e83f, State: Initialized, Role: FOLLOWER
I20260709 12:31:14.243808 13193 consensus_queue.cc:260] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b913d0ad430f43d98633bf3ee561e83f" member_type: VOTER }
I20260709 12:31:14.244248 13193 raft_consensus.cc:399] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:31:14.244434 13193 raft_consensus.cc:493] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:31:14.244637 13193 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:14.249754 13193 raft_consensus.cc:515] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b913d0ad430f43d98633bf3ee561e83f" member_type: VOTER }
I20260709 12:31:14.250406 13193 leader_election.cc:304] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b913d0ad430f43d98633bf3ee561e83f; no voters: 
I20260709 12:31:14.251529 13193 leader_election.cc:290] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:31:14.251931 13196 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:14.253391 13196 raft_consensus.cc:697] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [term 1 LEADER]: Becoming Leader. State: Replica: b913d0ad430f43d98633bf3ee561e83f, State: Running, Role: LEADER
I20260709 12:31:14.254127 13196 consensus_queue.cc:237] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b913d0ad430f43d98633bf3ee561e83f" member_type: VOTER }
I20260709 12:31:14.254827 13193 sys_catalog.cc:565] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:31:14.257035 13198 sys_catalog.cc:455] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b913d0ad430f43d98633bf3ee561e83f. Latest consensus state: current_term: 1 leader_uuid: "b913d0ad430f43d98633bf3ee561e83f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b913d0ad430f43d98633bf3ee561e83f" member_type: VOTER } }
I20260709 12:31:14.257035 13197 sys_catalog.cc:455] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b913d0ad430f43d98633bf3ee561e83f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b913d0ad430f43d98633bf3ee561e83f" member_type: VOTER } }
I20260709 12:31:14.257841 13198 sys_catalog.cc:458] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [sys.catalog]: This master's current role is: LEADER
I20260709 12:31:14.257969 13197 sys_catalog.cc:458] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [sys.catalog]: This master's current role is: LEADER
I20260709 12:31:14.262250 13201 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:31:14.270612 13201 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:31:14.271736  2676 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:31:14.280058 13201 catalog_manager.cc:1383] Generated new cluster ID: 55f21cc7cd8046a6abd2f51ccab49022
I20260709 12:31:14.280360 13201 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:31:14.297405 13201 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:31:14.298991 13201 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:31:14.315620 13201 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f: Generated new TSK 0
I20260709 12:31:14.316268 13201 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:31:14.339231  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:14.345731 13214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:14.346688 13215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:14.348366 13217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:14.351217  2676 server_base.cc:1061] running on GCE node
I20260709 12:31:14.352422  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:14.352661  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:14.352845  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600274352829 us; error 0 us; skew 500 ppm
I20260709 12:31:14.353410  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:14.355885  2676 webserver.cc:533] Webserver started at http://127.2.157.1:37475/ using document root <none> and password file <none>
I20260709 12:31:14.356470  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:14.356712  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:14.357021  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:14.358286  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-0-root/instance:
uuid: "e6313f19634e486587e6214dd291eabc"
format_stamp: "Formatted at 2026-07-09 12:31:14 on dist-test-slave-0768"
I20260709 12:31:14.363162  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:31:14.366971 13222 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:14.367949  2676 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:31:14.368224  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-0-root
uuid: "e6313f19634e486587e6214dd291eabc"
format_stamp: "Formatted at 2026-07-09 12:31:14 on dist-test-slave-0768"
I20260709 12:31:14.368489  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:14.396023  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:14.397189  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:14.398707  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:31:14.401120  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:31:14.401309  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:14.401633  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:31:14.401808  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:14.442009  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.1:36049
I20260709 12:31:14.442142 13284 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.1:36049 every 8 connection(s)
I20260709 12:31:14.447548  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:14.455216 13289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:14.455554 13290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:14.459074 13292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:14.459889  2676 server_base.cc:1061] running on GCE node
I20260709 12:31:14.461529 13285 heartbeater.cc:344] Connected to a master server at 127.2.157.62:43177
I20260709 12:31:14.461716  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:31:14.461970 13285 heartbeater.cc:461] Registering TS with master...
W20260709 12:31:14.462148  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:14.462427  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600274462409 us; error 0 us; skew 500 ppm
I20260709 12:31:14.462898 13285 heartbeater.cc:507] Master 127.2.157.62:43177 requested a full tablet report, sending...
I20260709 12:31:14.463086  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:14.465238 13158 ts_manager.cc:194] Registered new tserver with Master: e6313f19634e486587e6214dd291eabc (127.2.157.1:36049)
I20260709 12:31:14.466190  2676 webserver.cc:533] Webserver started at http://127.2.157.2:35561/ using document root <none> and password file <none>
I20260709 12:31:14.466928  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:14.467187  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:14.467530  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:14.467938 13158 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38884
I20260709 12:31:14.469089  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-1-root/instance:
uuid: "12eb002a429b45fc9cd05bca9d8df352"
format_stamp: "Formatted at 2026-07-09 12:31:14 on dist-test-slave-0768"
I20260709 12:31:14.473735  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.002s
I20260709 12:31:14.477265 13297 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:14.478194  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:31:14.478520  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-1-root
uuid: "12eb002a429b45fc9cd05bca9d8df352"
format_stamp: "Formatted at 2026-07-09 12:31:14 on dist-test-slave-0768"
I20260709 12:31:14.478772  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:14.512655  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:14.513792  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:14.515282  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:31:14.518049  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:31:14.518271  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:14.518548  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:31:14.518723  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:14.558933  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.2:34897
I20260709 12:31:14.559055 13359 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.2:34897 every 8 connection(s)
I20260709 12:31:14.564049  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:14.572276 13364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:14.572520 13363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:14.576629 13366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:14.577273  2676 server_base.cc:1061] running on GCE node
I20260709 12:31:14.577814 13360 heartbeater.cc:344] Connected to a master server at 127.2.157.62:43177
I20260709 12:31:14.578404 13360 heartbeater.cc:461] Registering TS with master...
I20260709 12:31:14.578652  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:14.579020  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:14.579257  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600274579234 us; error 0 us; skew 500 ppm
I20260709 12:31:14.579417 13360 heartbeater.cc:507] Master 127.2.157.62:43177 requested a full tablet report, sending...
I20260709 12:31:14.580113  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:14.582175 13158 ts_manager.cc:194] Registered new tserver with Master: 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:14.583123  2676 webserver.cc:533] Webserver started at http://127.2.157.3:43905/ using document root <none> and password file <none>
I20260709 12:31:14.583767 13158 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38888
I20260709 12:31:14.583768  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:14.584379  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:14.584736  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:14.586407  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-2-root/instance:
uuid: "68ace02ab1b543de9544c9657a1fecb9"
format_stamp: "Formatted at 2026-07-09 12:31:14 on dist-test-slave-0768"
I20260709 12:31:14.591125  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:31:14.594688 13371 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:14.595604  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:31:14.595897  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-2-root
uuid: "68ace02ab1b543de9544c9657a1fecb9"
format_stamp: "Formatted at 2026-07-09 12:31:14 on dist-test-slave-0768"
I20260709 12:31:14.596175  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599939977835-2676-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:14.645442  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:14.646633  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:14.648106  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:31:14.650597  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:31:14.650794  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:14.650993  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:31:14.651135  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:14.692955  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.3:34867
I20260709 12:31:14.693078 13433 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.3:34867 every 8 connection(s)
I20260709 12:31:14.708024 13434 heartbeater.cc:344] Connected to a master server at 127.2.157.62:43177
I20260709 12:31:14.708463 13434 heartbeater.cc:461] Registering TS with master...
I20260709 12:31:14.709200 13434 heartbeater.cc:507] Master 127.2.157.62:43177 requested a full tablet report, sending...
I20260709 12:31:14.711228 13158 ts_manager.cc:194] Registered new tserver with Master: 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:14.711591  2676 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015204173s
I20260709 12:31:14.712735 13158 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38890
I20260709 12:31:14.739207 13158 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38894:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:31:14.741858 13158 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:31:14.827965 13399 tablet_service.cc:1511] Processing CreateTablet for tablet 5d8e777e5bb74c5086ea1699d4ec9b2c (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:14.829651 13399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d8e777e5bb74c5086ea1699d4ec9b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.830576 13396 tablet_service.cc:1511] Processing CreateTablet for tablet 1b744dfc98d74b50a950f09260fade67 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:14.832118 13396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b744dfc98d74b50a950f09260fade67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.837378 13397 tablet_service.cc:1511] Processing CreateTablet for tablet 00ca9668e73544c98b8f8dc4eb174a07 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:14.838929 13397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ca9668e73544c98b8f8dc4eb174a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.838716 13395 tablet_service.cc:1511] Processing CreateTablet for tablet 14f6ac9e3f194e0c85859fa49d469e13 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:14.840288 13395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f6ac9e3f194e0c85859fa49d469e13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.842200 13398 tablet_service.cc:1511] Processing CreateTablet for tablet 589af6ee0f434f1e9b3184f67b3484ba (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:14.842355 13394 tablet_service.cc:1511] Processing CreateTablet for tablet 30075c5fe45e48859d5690240429f0d0 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:14.843637 13398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589af6ee0f434f1e9b3184f67b3484ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.844300 13394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30075c5fe45e48859d5690240429f0d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.846753 13393 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9fae32bad549e5b2ba9094d725f982 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:14.848392 13393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9fae32bad549e5b2ba9094d725f982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.850281 13324 tablet_service.cc:1511] Processing CreateTablet for tablet 589af6ee0f434f1e9b3184f67b3484ba (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:14.851172 13325 tablet_service.cc:1511] Processing CreateTablet for tablet 5d8e777e5bb74c5086ea1699d4ec9b2c (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:14.851784 13324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589af6ee0f434f1e9b3184f67b3484ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.852746 13325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d8e777e5bb74c5086ea1699d4ec9b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.856860 13323 tablet_service.cc:1511] Processing CreateTablet for tablet 00ca9668e73544c98b8f8dc4eb174a07 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:14.858342 13323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ca9668e73544c98b8f8dc4eb174a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.872167 13322 tablet_service.cc:1511] Processing CreateTablet for tablet 1b744dfc98d74b50a950f09260fade67 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:14.873651 13322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b744dfc98d74b50a950f09260fade67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.881956 13321 tablet_service.cc:1511] Processing CreateTablet for tablet 14f6ac9e3f194e0c85859fa49d469e13 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:14.883451 13321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f6ac9e3f194e0c85859fa49d469e13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.885648 13392 tablet_service.cc:1511] Processing CreateTablet for tablet cde76a03b1e2433097b8c6986c632a1e (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:14.887307 13392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde76a03b1e2433097b8c6986c632a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.891578 13320 tablet_service.cc:1511] Processing CreateTablet for tablet 30075c5fe45e48859d5690240429f0d0 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:14.893034 13320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30075c5fe45e48859d5690240429f0d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.903612 13319 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9fae32bad549e5b2ba9094d725f982 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:14.905246 13319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9fae32bad549e5b2ba9094d725f982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.906617 13250 tablet_service.cc:1511] Processing CreateTablet for tablet 5d8e777e5bb74c5086ea1699d4ec9b2c (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:14.908180 13250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d8e777e5bb74c5086ea1699d4ec9b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.909159 13246 tablet_service.cc:1511] Processing CreateTablet for tablet 14f6ac9e3f194e0c85859fa49d469e13 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:14.910791 13246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f6ac9e3f194e0c85859fa49d469e13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.911229 13249 tablet_service.cc:1511] Processing CreateTablet for tablet 589af6ee0f434f1e9b3184f67b3484ba (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:14.912748 13249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589af6ee0f434f1e9b3184f67b3484ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.915189 13248 tablet_service.cc:1511] Processing CreateTablet for tablet 00ca9668e73544c98b8f8dc4eb174a07 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:14.916779 13248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ca9668e73544c98b8f8dc4eb174a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.919091 13318 tablet_service.cc:1511] Processing CreateTablet for tablet cde76a03b1e2433097b8c6986c632a1e (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:14.920683 13318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde76a03b1e2433097b8c6986c632a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.923105 13247 tablet_service.cc:1511] Processing CreateTablet for tablet 1b744dfc98d74b50a950f09260fade67 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:14.924695 13247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b744dfc98d74b50a950f09260fade67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.927127 13245 tablet_service.cc:1511] Processing CreateTablet for tablet 30075c5fe45e48859d5690240429f0d0 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:14.928717 13245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30075c5fe45e48859d5690240429f0d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.928838 13244 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9fae32bad549e5b2ba9094d725f982 (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:14.930379 13244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9fae32bad549e5b2ba9094d725f982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.935204 13243 tablet_service.cc:1511] Processing CreateTablet for tablet cde76a03b1e2433097b8c6986c632a1e (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:14.936851 13243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde76a03b1e2433097b8c6986c632a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.952602 13397 tablet_service.cc:1511] Processing CreateTablet for tablet 6f54ec1a531c467b8cad6c29a3f6dcfd (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:14.954537 13397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f54ec1a531c467b8cad6c29a3f6dcfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.966957 13242 tablet_service.cc:1511] Processing CreateTablet for tablet 6f54ec1a531c467b8cad6c29a3f6dcfd (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:14.969017 13242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f54ec1a531c467b8cad6c29a3f6dcfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.976945 13321 tablet_service.cc:1511] Processing CreateTablet for tablet 6f54ec1a531c467b8cad6c29a3f6dcfd (DEFAULT_TABLE table=test-workload [id=bb9e002e6722426098f6b6c1cc6eb89d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:14.979174 13321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f54ec1a531c467b8cad6c29a3f6dcfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:14.992412 13449 tablet_bootstrap.cc:492] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:15.007349 13450 tablet_bootstrap.cc:492] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:15.028852 13449 tablet_bootstrap.cc:654] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.039515 13451 tablet_bootstrap.cc:492] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:15.041801 13450 tablet_bootstrap.cc:654] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.044453 13449 tablet_bootstrap.cc:492] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:15.044903 13449 ts_tablet_manager.cc:1403] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.053s	user 0.005s	sys 0.010s
I20260709 12:31:15.046641 13451 tablet_bootstrap.cc:654] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.047602 13449 raft_consensus.cc:359] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.047905 13450 tablet_bootstrap.cc:492] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:15.048282 13449 raft_consensus.cc:385] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.048614 13449 raft_consensus.cc:740] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.048624 13450 ts_tablet_manager.cc:1403] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.007s
I20260709 12:31:15.049369 13449 consensus_queue.cc:260] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.052187 13434 heartbeater.cc:499] Master 127.2.157.62:43177 was elected leader, sending a full tablet report...
I20260709 12:31:15.052024 13450 raft_consensus.cc:359] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } }
I20260709 12:31:15.052587 13449 ts_tablet_manager.cc:1434] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:31:15.052452 13451 tablet_bootstrap.cc:492] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:15.053022 13450 raft_consensus.cc:385] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.053432 13450 raft_consensus.cc:740] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.053761 13451 ts_tablet_manager.cc:1403] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.006s
I20260709 12:31:15.053797 13449 tablet_bootstrap.cc:492] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:15.054421 13450 consensus_queue.cc:260] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } }
I20260709 12:31:15.057714 13451 raft_consensus.cc:359] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.058965 13451 raft_consensus.cc:385] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.059432 13451 raft_consensus.cc:740] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.060613 13451 consensus_queue.cc:260] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.064636 13449 tablet_bootstrap.cc:654] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.076501 13449 tablet_bootstrap.cc:492] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:15.077139 13449 ts_tablet_manager.cc:1403] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.005s
I20260709 12:31:15.080283 13449 raft_consensus.cc:359] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.081180 13449 raft_consensus.cc:385] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.081718 13449 raft_consensus.cc:740] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.082726 13449 consensus_queue.cc:260] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.084947 13360 heartbeater.cc:499] Master 127.2.157.62:43177 was elected leader, sending a full tablet report...
I20260709 12:31:15.085460 13450 ts_tablet_manager.cc:1434] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.036s	user 0.027s	sys 0.008s
I20260709 12:31:15.086386 13449 ts_tablet_manager.cc:1434] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 12:31:15.086606 13450 tablet_bootstrap.cc:492] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:15.087543 13449 tablet_bootstrap.cc:492] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:15.084983 13451 ts_tablet_manager.cc:1434] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.024s
I20260709 12:31:15.089922 13285 heartbeater.cc:499] Master 127.2.157.62:43177 was elected leader, sending a full tablet report...
I20260709 12:31:15.093923 13451 tablet_bootstrap.cc:492] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:15.098286 13450 tablet_bootstrap.cc:654] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.099148 13449 tablet_bootstrap.cc:654] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.099990 13451 tablet_bootstrap.cc:654] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.104286 13450 tablet_bootstrap.cc:492] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:15.104847 13450 ts_tablet_manager.cc:1403] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 12:31:15.107769 13450 raft_consensus.cc:359] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.108528 13450 raft_consensus.cc:385] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.108824 13450 raft_consensus.cc:740] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.109704 13450 consensus_queue.cc:260] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.111855 13450 ts_tablet_manager.cc:1434] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:31:15.114197 13450 tablet_bootstrap.cc:492] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:15.115149 13449 tablet_bootstrap.cc:492] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:15.115427 13451 tablet_bootstrap.cc:492] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:15.115742 13449 ts_tablet_manager.cc:1403] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.003s
I20260709 12:31:15.115923 13451 ts_tablet_manager.cc:1403] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 12:31:15.118952 13451 raft_consensus.cc:359] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.119663 13451 raft_consensus.cc:385] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.119946 13451 raft_consensus.cc:740] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.120360 13450 tablet_bootstrap.cc:654] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.120193 13449 raft_consensus.cc:359] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.120994 13449 raft_consensus.cc:385] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.120781 13451 consensus_queue.cc:260] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.121310 13449 raft_consensus.cc:740] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.122236 13449 consensus_queue.cc:260] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.123396 13451 ts_tablet_manager.cc:1434] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:31:15.124434 13451 tablet_bootstrap.cc:492] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:15.127408 13449 ts_tablet_manager.cc:1434] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:31:15.128571 13449 tablet_bootstrap.cc:492] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:15.130649 13451 tablet_bootstrap.cc:654] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.131873 13450 tablet_bootstrap.cc:492] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:15.132484 13450 ts_tablet_manager.cc:1403] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.008s
I20260709 12:31:15.135442 13450 raft_consensus.cc:359] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.136225 13450 raft_consensus.cc:385] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.136539 13450 raft_consensus.cc:740] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.144119 13450 consensus_queue.cc:260] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.144835 13449 tablet_bootstrap.cc:654] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.146775 13450 ts_tablet_manager.cc:1434] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.013s
I20260709 12:31:15.146847 13451 tablet_bootstrap.cc:492] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:15.147575 13451 ts_tablet_manager.cc:1403] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.009s
I20260709 12:31:15.147930 13450 tablet_bootstrap.cc:492] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:15.151317 13451 raft_consensus.cc:359] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.152386 13451 raft_consensus.cc:385] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.152784 13451 raft_consensus.cc:740] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.154186 13450 tablet_bootstrap.cc:654] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.153836 13451 consensus_queue.cc:260] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.156572 13449 tablet_bootstrap.cc:492] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:15.156529 13451 ts_tablet_manager.cc:1434] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:31:15.157542 13449 ts_tablet_manager.cc:1403] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.000s
I20260709 12:31:15.158115 13451 tablet_bootstrap.cc:492] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:15.160703 13449 raft_consensus.cc:359] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.161484 13449 raft_consensus.cc:385] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.161804 13449 raft_consensus.cc:740] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.162534 13456 raft_consensus.cc:493] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:15.162724 13449 consensus_queue.cc:260] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.163086 13456 raft_consensus.cc:515] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } }
I20260709 12:31:15.164816 13451 tablet_bootstrap.cc:654] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.167732 13456 leader_election.cc:290] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867), e6313f19634e486587e6214dd291eabc (127.2.157.1:36049)
I20260709 12:31:15.172247 13449 ts_tablet_manager.cc:1434] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 12:31:15.173841 13449 tablet_bootstrap.cc:492] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:15.175009 13450 tablet_bootstrap.cc:492] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:15.176033 13450 ts_tablet_manager.cc:1403] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 12:31:15.180086 13450 raft_consensus.cc:359] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.181671 13450 raft_consensus.cc:385] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.182060 13450 raft_consensus.cc:740] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.183048 13450 consensus_queue.cc:260] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.186033 13450 ts_tablet_manager.cc:1434] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:31:15.187212 13450 tablet_bootstrap.cc:492] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:15.194372 13449 tablet_bootstrap.cc:654] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.194612 13450 tablet_bootstrap.cc:654] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.212105 13449 tablet_bootstrap.cc:492] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:15.212922 13449 ts_tablet_manager.cc:1403] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.039s	user 0.004s	sys 0.019s
I20260709 12:31:15.216886 13449 raft_consensus.cc:359] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.217823 13449 raft_consensus.cc:385] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.218186 13449 raft_consensus.cc:740] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.219578 13451 tablet_bootstrap.cc:492] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:15.219156 13449 consensus_queue.cc:260] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.219434 13409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8e777e5bb74c5086ea1699d4ec9b2c" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
I20260709 12:31:15.220317 13450 tablet_bootstrap.cc:492] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:15.221009 13450 ts_tablet_manager.cc:1403] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.014s
I20260709 12:31:15.220257 13451 ts_tablet_manager.cc:1403] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.062s	user 0.025s	sys 0.027s
I20260709 12:31:15.222576 13449 ts_tablet_manager.cc:1434] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.003s
W20260709 12:31:15.222483 13299 leader_election.cc:343] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:15.223963 13449 tablet_bootstrap.cc:492] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:15.224624 13451 raft_consensus.cc:359] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.225394 13451 raft_consensus.cc:385] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.225709 13451 raft_consensus.cc:740] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.226662 13451 consensus_queue.cc:260] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.229341 13451 ts_tablet_manager.cc:1434] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 12:31:15.229506 13450 raft_consensus.cc:359] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.230454 13451 tablet_bootstrap.cc:492] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:15.232746 13449 tablet_bootstrap.cc:654] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.233687 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8e777e5bb74c5086ea1699d4ec9b2c" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:15.235110 13450 raft_consensus.cc:385] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:31:15.235608 13301 leader_election.cc:343] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:15.235616 13450 raft_consensus.cc:740] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.236254 13301 leader_election.cc:304] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352; no voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc
I20260709 12:31:15.237118 13456 raft_consensus.cc:2749] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:15.237025 13450 consensus_queue.cc:260] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.242599 13451 tablet_bootstrap.cc:654] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.245457 13450 ts_tablet_manager.cc:1434] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 12:31:15.246593 13450 tablet_bootstrap.cc:492] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:15.248978 13451 tablet_bootstrap.cc:492] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:15.249605 13449 tablet_bootstrap.cc:492] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:15.249676 13451 ts_tablet_manager.cc:1403] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.001s
I20260709 12:31:15.250425 13449 ts_tablet_manager.cc:1403] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.000s
I20260709 12:31:15.253618 13450 tablet_bootstrap.cc:654] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.254297 13451 raft_consensus.cc:359] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.254402 13449 raft_consensus.cc:359] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } }
I20260709 12:31:15.255379 13451 raft_consensus.cc:385] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.255437 13449 raft_consensus.cc:385] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.255954 13449 raft_consensus.cc:740] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.256002 13451 raft_consensus.cc:740] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.256987 13449 consensus_queue.cc:260] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } }
I20260709 12:31:15.257160 13451 consensus_queue.cc:260] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.260205 13451 ts_tablet_manager.cc:1434] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:31:15.261437 13451 tablet_bootstrap.cc:492] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:15.262502 13449 ts_tablet_manager.cc:1434] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:31:15.263712 13449 tablet_bootstrap.cc:492] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:15.262532 13450 tablet_bootstrap.cc:492] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:15.264504 13450 ts_tablet_manager.cc:1403] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:31:15.267683 13450 raft_consensus.cc:359] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.268505 13450 raft_consensus.cc:385] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.268831 13450 raft_consensus.cc:740] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.269460 13451 tablet_bootstrap.cc:654] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.269696 13450 consensus_queue.cc:260] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.273943 13449 tablet_bootstrap.cc:654] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.275346 13450 ts_tablet_manager.cc:1434] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:31:15.276464 13450 tablet_bootstrap.cc:492] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:15.284076 13451 tablet_bootstrap.cc:492] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:15.284984 13451 ts_tablet_manager.cc:1403] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 12:31:15.285866 13455 raft_consensus.cc:493] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:31:15.286908 13206 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:31:15.286540 13455 raft_consensus.cc:515] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.287177 13450 tablet_bootstrap.cc:654] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.290011 13451 raft_consensus.cc:359] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.294396 13451 raft_consensus.cc:385] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.299686 13451 raft_consensus.cc:740] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.299327 13455 leader_election.cc:290] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.300932 13451 consensus_queue.cc:260] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.302865 13449 tablet_bootstrap.cc:492] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:15.303501 13449 ts_tablet_manager.cc:1403] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.016s
I20260709 12:31:15.304366 13451 ts_tablet_manager.cc:1434] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.006s
I20260709 12:31:15.305817 13451 tablet_bootstrap.cc:492] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:15.307080 13449 raft_consensus.cc:359] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.308003 13449 raft_consensus.cc:385] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.308393 13449 raft_consensus.cc:740] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.309406 13449 consensus_queue.cc:260] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.313216 13449 ts_tablet_manager.cc:1434] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.007s
I20260709 12:31:15.313807 13457 raft_consensus.cc:493] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:15.314451 13449 tablet_bootstrap.cc:492] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:15.314435 13457 raft_consensus.cc:515] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.316418 13451 tablet_bootstrap.cc:654] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.324644 13457 leader_election.cc:290] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:15.339941 13450 tablet_bootstrap.cc:492] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:15.342633 13450 ts_tablet_manager.cc:1403] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.022s
I20260709 12:31:15.347256 13450 raft_consensus.cc:359] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.348306 13450 raft_consensus.cc:385] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.348695 13450 raft_consensus.cc:740] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.350649 13449 tablet_bootstrap.cc:654] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.349733 13450 consensus_queue.cc:260] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.353983 13457 raft_consensus.cc:493] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:15.354665 13457 raft_consensus.cc:515] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.356208 13450 ts_tablet_manager.cc:1434] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:31:15.357420 13450 tablet_bootstrap.cc:492] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:15.357753 13457 leader_election.cc:290] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:15.363523 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ca9668e73544c98b8f8dc4eb174a07" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:15.364421 13335 raft_consensus.cc:2468] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 0.
I20260709 12:31:15.364602 13451 tablet_bootstrap.cc:492] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:15.365192 13451 ts_tablet_manager.cc:1403] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.007s
I20260709 12:31:15.366729 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30075c5fe45e48859d5690240429f0d0" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:15.367529 13335 raft_consensus.cc:2468] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 0.
I20260709 12:31:15.368639 13450 tablet_bootstrap.cc:654] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.368815 13451 raft_consensus.cc:359] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } }
I20260709 12:31:15.369210 13226 leader_election.cc:304] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:15.369797 13451 raft_consensus.cc:385] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.370249 13451 raft_consensus.cc:740] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.370415 13226 leader_election.cc:304] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:15.371583 13457 raft_consensus.cc:2804] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:15.371253 13451 consensus_queue.cc:260] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } }
I20260709 12:31:15.372040 13457 raft_consensus.cc:493] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:15.372486 13457 raft_consensus.cc:3060] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.375353 13484 raft_consensus.cc:2804] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:15.376961 13484 raft_consensus.cc:493] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:15.377533 13484 raft_consensus.cc:3060] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.378086 13451 ts_tablet_manager.cc:1434] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:31:15.387919 13455 raft_consensus.cc:493] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:15.388986 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ca9668e73544c98b8f8dc4eb174a07" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:15.389351 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ca9668e73544c98b8f8dc4eb174a07" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:15.393357 13335 raft_consensus.cc:2468] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:15.392974 13455 raft_consensus.cc:515] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.385563 13457 raft_consensus.cc:515] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.394999 13260 raft_consensus.cc:2393] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68ace02ab1b543de9544c9657a1fecb9 in current term 1: Already voted for candidate e6313f19634e486587e6214dd291eabc in this term.
I20260709 12:31:15.389806 13456 raft_consensus.cc:493] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:15.395560 13455 leader_election.cc:290] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.395491 13456 raft_consensus.cc:515] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.397245 13451 tablet_bootstrap.cc:492] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:15.399469 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f6ac9e3f194e0c85859fa49d469e13" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:15.400193 13260 raft_consensus.cc:2468] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:15.400660 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ca9668e73544c98b8f8dc4eb174a07" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:15.401290 13335 raft_consensus.cc:3060] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.401579 13409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b744dfc98d74b50a950f09260fade67" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
I20260709 12:31:15.402379 13409 raft_consensus.cc:2468] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 0.
I20260709 12:31:15.402570 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b744dfc98d74b50a950f09260fade67" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:15.403371 13259 raft_consensus.cc:2468] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 0.
I20260709 12:31:15.403925 13299 leader_election.cc:304] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: 
I20260709 12:31:15.405246 13451 tablet_bootstrap.cc:654] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.409905 13334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f6ac9e3f194e0c85859fa49d469e13" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:15.410429 13457 leader_election.cc:290] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 election: Requested vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:15.409711 13335 raft_consensus.cc:2468] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 1.
I20260709 12:31:15.410992 13456 leader_election.cc:290] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:15.411545 13456 raft_consensus.cc:2804] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:15.411887 13456 raft_consensus.cc:493] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:15.412236 13456 raft_consensus.cc:3060] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.412153 13226 leader_election.cc:304] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:15.413117 13457 raft_consensus.cc:2804] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:15.413599 13457 raft_consensus.cc:697] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Becoming Leader. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:15.414430 13457 consensus_queue.cc:237] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.417737 13375 leader_election.cc:304] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: 
I20260709 12:31:15.419966 13455 raft_consensus.cc:2804] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:15.420488 13455 raft_consensus.cc:493] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:15.420992 13455 raft_consensus.cc:3060] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.391635 13449 tablet_bootstrap.cc:492] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:15.428965 13449 ts_tablet_manager.cc:1403] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.009s
I20260709 12:31:15.431082 13451 tablet_bootstrap.cc:492] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:15.391790 13487 raft_consensus.cc:493] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:15.431679 13451 ts_tablet_manager.cc:1403] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.019s
I20260709 12:31:15.432116 13455 raft_consensus.cc:515] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.431814 13487 raft_consensus.cc:515] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.433600 13334 raft_consensus.cc:2468] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:15.434809 13451 raft_consensus.cc:359] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.435082 13375 leader_election.cc:304] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:15.437400 13451 raft_consensus.cc:385] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.437763 13451 raft_consensus.cc:740] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.438514 13451 consensus_queue.cc:260] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.438934 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f6ac9e3f194e0c85859fa49d469e13" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:15.439499 13484 raft_consensus.cc:515] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.439819 13260 raft_consensus.cc:2468] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 0.
I20260709 12:31:15.441694 13301 leader_election.cc:304] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:15.442417 13455 leader_election.cc:290] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.442911 13488 raft_consensus.cc:2804] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:15.443364 13488 raft_consensus.cc:493] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:15.443295 13455 raft_consensus.cc:2804] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:15.444150 13488 raft_consensus.cc:3060] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.444271 13455 raft_consensus.cc:493] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:15.446189 13455 raft_consensus.cc:3060] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.447569 13487 leader_election.cc:290] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:15.449712 13334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ca9668e73544c98b8f8dc4eb174a07" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:15.450652 13334 raft_consensus.cc:2393] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 68ace02ab1b543de9544c9657a1fecb9 in current term 1: Already voted for candidate e6313f19634e486587e6214dd291eabc in this term.
I20260709 12:31:15.447427 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ca9668e73544c98b8f8dc4eb174a07" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:15.447487 13409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f6ac9e3f194e0c85859fa49d469e13" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
I20260709 12:31:15.452162 13488 raft_consensus.cc:515] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.442632 13451 ts_tablet_manager.cc:1434] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:31:15.448378 13449 raft_consensus.cc:359] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.453299 13449 raft_consensus.cc:385] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.453835 13451 tablet_bootstrap.cc:492] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:15.452780 13456 raft_consensus.cc:515] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.456632 13407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30075c5fe45e48859d5690240429f0d0" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
I20260709 12:31:15.457186 13484 leader_election.cc:290] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 election: Requested vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:15.457808 13488 leader_election.cc:290] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:15.458365 13334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30075c5fe45e48859d5690240429f0d0" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:15.458674 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f6ac9e3f194e0c85859fa49d469e13" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:15.459085 13334 raft_consensus.cc:3060] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.459309 13260 raft_consensus.cc:3060] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.459123 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f6ac9e3f194e0c85859fa49d469e13" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:15.453684 13449 raft_consensus.cc:740] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.455195 13408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ca9668e73544c98b8f8dc4eb174a07" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
I20260709 12:31:15.462035 13408 raft_consensus.cc:2393] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6313f19634e486587e6214dd291eabc in current term 1: Already voted for candidate 68ace02ab1b543de9544c9657a1fecb9 in this term.
I20260709 12:31:15.462033 13449 consensus_queue.cc:260] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.462747 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b744dfc98d74b50a950f09260fade67" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:15.463053 13407 raft_consensus.cc:2468] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 0.
I20260709 12:31:15.463346 13259 raft_consensus.cc:3060] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.464417 13449 ts_tablet_manager.cc:1434] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 12:31:15.469550 13451 tablet_bootstrap.cc:654] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.464901 13455 raft_consensus.cc:515] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.471913 13455 leader_election.cc:290] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.472776 13409 raft_consensus.cc:2393] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 12eb002a429b45fc9cd05bca9d8df352 in current term 1: Already voted for candidate 68ace02ab1b543de9544c9657a1fecb9 in this term.
I20260709 12:31:15.475186 13334 raft_consensus.cc:2468] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 1.
I20260709 12:31:15.476732 13226 leader_election.cc:304] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:15.473623 13408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30075c5fe45e48859d5690240429f0d0" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:15.477551 13407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ca9668e73544c98b8f8dc4eb174a07" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:15.478063 13408 raft_consensus.cc:3060] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.478575 13407 raft_consensus.cc:2393] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6313f19634e486587e6214dd291eabc in current term 1: Already voted for candidate 68ace02ab1b543de9544c9657a1fecb9 in this term.
I20260709 12:31:15.479585 13375 leader_election.cc:304] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9; no voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc
I20260709 12:31:15.474082 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b744dfc98d74b50a950f09260fade67" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:15.481079 13449 tablet_bootstrap.cc:492] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:15.481247 13406 raft_consensus.cc:3060] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.482579 13455 raft_consensus.cc:2749] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:31:15.485075 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f6ac9e3f194e0c85859fa49d469e13" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:15.485380 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14f6ac9e3f194e0c85859fa49d469e13" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:15.486601 13335 raft_consensus.cc:2393] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 68ace02ab1b543de9544c9657a1fecb9 in current term 1: Already voted for candidate 12eb002a429b45fc9cd05bca9d8df352 in this term.
I20260709 12:31:15.487828 13455 raft_consensus.cc:493] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:15.488526 13455 raft_consensus.cc:515] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.455972 13450 tablet_bootstrap.cc:492] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:15.490231 13450 ts_tablet_manager.cc:1403] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.133s	user 0.024s	sys 0.018s
I20260709 12:31:15.490985 13449 tablet_bootstrap.cc:654] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.491317 13455 leader_election.cc:290] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.493191 13450 raft_consensus.cc:359] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.502694 13450 raft_consensus.cc:385] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.503000 13450 raft_consensus.cc:740] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.477769 13484 raft_consensus.cc:2804] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:15.495537 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9fae32bad549e5b2ba9094d725f982" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:15.503526 13408 raft_consensus.cc:2468] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 1.
I20260709 12:31:15.504068 13258 raft_consensus.cc:2468] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:15.495864 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9fae32bad549e5b2ba9094d725f982" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:15.505584 13406 raft_consensus.cc:2468] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 1.
I20260709 12:31:15.505693 13335 raft_consensus.cc:2468] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:15.506441 13488 raft_consensus.cc:493] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:15.506807 13299 leader_election.cc:304] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: 
I20260709 12:31:15.507261 13484 raft_consensus.cc:697] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Becoming Leader. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:15.472199 13259 raft_consensus.cc:2468] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 1.
I20260709 12:31:15.507793 13487 raft_consensus.cc:2804] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:15.498615 13375 leader_election.cc:304] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9; no voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc
I20260709 12:31:15.500847 13456 leader_election.cc:290] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:15.508399 13484 consensus_queue.cc:237] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.510753 13455 raft_consensus.cc:2749] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:31:15.511301 13375 leader_election.cc:304] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: 
I20260709 12:31:15.512409 13455 raft_consensus.cc:2804] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:15.506910 13488 raft_consensus.cc:515] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.502135 13260 raft_consensus.cc:2468] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 1.
I20260709 12:31:15.512804 13455 raft_consensus.cc:493] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:15.497530 13451 tablet_bootstrap.cc:492] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:15.513233 13455 raft_consensus.cc:3060] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.513574 13451 ts_tablet_manager.cc:1403] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.008s
I20260709 12:31:15.513796 13301 leader_election.cc:304] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 68ace02ab1b543de9544c9657a1fecb9
I20260709 12:31:15.514451 13488 leader_election.cc:290] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:15.515039 13488 raft_consensus.cc:2804] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:15.515461 13488 raft_consensus.cc:697] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 LEADER]: Becoming Leader. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Running, Role: LEADER
I20260709 12:31:15.516088 13450 consensus_queue.cc:260] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.516283 13488 consensus_queue.cc:237] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.518231 13450 ts_tablet_manager.cc:1434] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:31:15.516120 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9fae32bad549e5b2ba9094d725f982" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:15.519217 13450 tablet_bootstrap.cc:492] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:15.519330 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9fae32bad549e5b2ba9094d725f982" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
I20260709 12:31:15.519119 13259 raft_consensus.cc:2468] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 0.
I20260709 12:31:15.521183 13301 leader_election.cc:304] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:15.522137 13456 raft_consensus.cc:2804] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:15.522497 13456 raft_consensus.cc:493] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:15.522810 13451 raft_consensus.cc:359] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.523574 13451 raft_consensus.cc:385] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.523334 13455 raft_consensus.cc:515] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.522850 13456 raft_consensus.cc:3060] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.521454 13155 catalog_manager.cc:5697] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc reported cstate change: term changed from 0 to 1, leader changed from <none> to e6313f19634e486587e6214dd291eabc (127.2.157.1). New cstate: current_term: 1 leader_uuid: "e6313f19634e486587e6214dd291eabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:15.524914 13406 raft_consensus.cc:2393] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 12eb002a429b45fc9cd05bca9d8df352 in current term 1: Already voted for candidate 68ace02ab1b543de9544c9657a1fecb9 in this term.
I20260709 12:31:15.526523 13455 leader_election.cc:290] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.523952 13451 raft_consensus.cc:740] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.527733 13451 consensus_queue.cc:260] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.529024 13450 tablet_bootstrap.cc:654] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:15.529534 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9fae32bad549e5b2ba9094d725f982" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:15.529951 13451 ts_tablet_manager.cc:1434] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 12:31:15.530393 13259 raft_consensus.cc:3060] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.535392 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9fae32bad549e5b2ba9094d725f982" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:15.537226 13449 tablet_bootstrap.cc:492] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:15.538259 13449 ts_tablet_manager.cc:1403] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.006s
I20260709 12:31:15.538466 13259 raft_consensus.cc:2468] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 1.
I20260709 12:31:15.540077 13375 leader_election.cc:304] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:15.541327 13455 raft_consensus.cc:2804] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:15.542011 13455 raft_consensus.cc:697] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Becoming Leader. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:15.541914 13449 raft_consensus.cc:359] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.542649 13487 raft_consensus.cc:697] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 LEADER]: Becoming Leader. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Running, Role: LEADER
I20260709 12:31:15.543298 13455 consensus_queue.cc:237] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.543653 13487 consensus_queue.cc:237] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.542807 13449 raft_consensus.cc:385] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.547664 13449 raft_consensus.cc:740] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.533246 13456 raft_consensus.cc:515] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.548921 13449 consensus_queue.cc:260] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.552277 13335 raft_consensus.cc:2393] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 68ace02ab1b543de9544c9657a1fecb9 in current term 1: Already voted for candidate 12eb002a429b45fc9cd05bca9d8df352 in this term.
I20260709 12:31:15.552434 13449 ts_tablet_manager.cc:1434] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:31:15.552480 13450 tablet_bootstrap.cc:492] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:15.553424 13450 ts_tablet_manager.cc:1403] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.013s
I20260709 12:31:15.554972 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9fae32bad549e5b2ba9094d725f982" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:15.556123 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9fae32bad549e5b2ba9094d725f982" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:15.556381 13450 raft_consensus.cc:359] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.558159 13450 raft_consensus.cc:385] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:15.558683 13450 raft_consensus.cc:740] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:15.558969 13259 raft_consensus.cc:2393] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 12eb002a429b45fc9cd05bca9d8df352 in current term 1: Already voted for candidate 68ace02ab1b543de9544c9657a1fecb9 in this term.
I20260709 12:31:15.558192 13456 leader_election.cc:290] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:15.560508 13450 consensus_queue.cc:260] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.563006 13450 ts_tablet_manager.cc:1434] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:31:15.562652 13301 leader_election.cc:304] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352; no voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc
I20260709 12:31:15.564414 13456 raft_consensus.cc:2749] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:31:15.565354 13158 catalog_manager.cc:5697] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 reported cstate change: term changed from 0 to 1, leader changed from <none> to 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "12eb002a429b45fc9cd05bca9d8df352" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:15.574229 13154 catalog_manager.cc:5697] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "68ace02ab1b543de9544c9657a1fecb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:15.576465 13455 raft_consensus.cc:493] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:15.577082 13455 raft_consensus.cc:515] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.579193 13455 leader_election.cc:290] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.581190 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde76a03b1e2433097b8c6986c632a1e" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:15.581648 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde76a03b1e2433097b8c6986c632a1e" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:15.581933 13335 raft_consensus.cc:2468] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:15.582425 13259 raft_consensus.cc:2468] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:15.583802 13375 leader_election.cc:304] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:15.583230 13158 catalog_manager.cc:5697] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc reported cstate change: term changed from 0 to 1, leader changed from <none> to e6313f19634e486587e6214dd291eabc (127.2.157.1). New cstate: current_term: 1 leader_uuid: "e6313f19634e486587e6214dd291eabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:15.585228 13455 raft_consensus.cc:2804] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:15.585645 13455 raft_consensus.cc:493] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:15.586019 13455 raft_consensus.cc:3060] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.593624 13491 raft_consensus.cc:493] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:15.593474 13455 raft_consensus.cc:515] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.593160 13155 catalog_manager.cc:5697] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 reported cstate change: term changed from 0 to 1, leader changed from <none> to 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "12eb002a429b45fc9cd05bca9d8df352" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:15.594211 13491 raft_consensus.cc:515] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.596272 13455 leader_election.cc:290] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.596411 13491 leader_election.cc:290] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.597543 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde76a03b1e2433097b8c6986c632a1e" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:15.598284 13259 raft_consensus.cc:3060] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.598204 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589af6ee0f434f1e9b3184f67b3484ba" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:15.598472 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde76a03b1e2433097b8c6986c632a1e" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:15.599005 13260 raft_consensus.cc:2468] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:15.599236 13334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589af6ee0f434f1e9b3184f67b3484ba" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:15.599634 13487 raft_consensus.cc:493] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:15.600133 13487 raft_consensus.cc:515] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.600315 13375 leader_election.cc:304] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:15.601226 13334 raft_consensus.cc:2468] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:15.602360 13487 leader_election.cc:290] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:15.599165 13335 raft_consensus.cc:3060] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.604091 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589af6ee0f434f1e9b3184f67b3484ba" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
I20260709 12:31:15.604732 13406 raft_consensus.cc:2468] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 0.
I20260709 12:31:15.606062 13299 leader_election.cc:304] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: 
I20260709 12:31:15.606171 13491 raft_consensus.cc:2804] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:15.606539 13259 raft_consensus.cc:2468] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 1.
I20260709 12:31:15.606798 13491 raft_consensus.cc:493] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:15.607303 13491 raft_consensus.cc:3060] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.608064 13487 raft_consensus.cc:2804] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:15.608242 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589af6ee0f434f1e9b3184f67b3484ba" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:15.608548 13487 raft_consensus.cc:493] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:15.608980 13487 raft_consensus.cc:3060] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.609035 13259 raft_consensus.cc:2468] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 0.
I20260709 12:31:15.610687 13335 raft_consensus.cc:2468] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 1.
I20260709 12:31:15.611413 13375 leader_election.cc:304] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:15.613381 13455 raft_consensus.cc:2804] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:15.614836 13455 raft_consensus.cc:697] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Becoming Leader. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:15.614615 13491 raft_consensus.cc:515] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.615806 13455 consensus_queue.cc:237] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.616494 13503 raft_consensus.cc:493] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:15.616750 13491 leader_election.cc:290] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.617202 13503 raft_consensus.cc:515] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.618266 13484 raft_consensus.cc:493] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:15.618749 13484 raft_consensus.cc:515] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } }
I20260709 12:31:15.619192 13503 leader_election.cc:290] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.620155 13487 raft_consensus.cc:515] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.620852 13484 leader_election.cc:290] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.622088 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8e777e5bb74c5086ea1699d4ec9b2c" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:15.622746 13335 raft_consensus.cc:2468] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 0.
I20260709 12:31:15.623263 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589af6ee0f434f1e9b3184f67b3484ba" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:15.623864 13259 raft_consensus.cc:3060] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.623946 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589af6ee0f434f1e9b3184f67b3484ba" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:15.624373 13226 leader_election.cc:304] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:15.625376 13484 raft_consensus.cc:2804] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:15.625767 13484 raft_consensus.cc:493] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:15.626120 13484 raft_consensus.cc:3060] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.627475 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f54ec1a531c467b8cad6c29a3f6dcfd" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:15.627766 13334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f54ec1a531c467b8cad6c29a3f6dcfd" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:15.627687 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589af6ee0f434f1e9b3184f67b3484ba" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:15.628158 13260 raft_consensus.cc:2468] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:15.628535 13334 raft_consensus.cc:2468] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:15.628804 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8e777e5bb74c5086ea1699d4ec9b2c" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
I20260709 12:31:15.629451 13406 raft_consensus.cc:2468] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 0.
I20260709 12:31:15.630110 13375 leader_election.cc:304] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: 
I20260709 12:31:15.631454 13491 raft_consensus.cc:493] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:15.632251 13491 raft_consensus.cc:515] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } }
I20260709 12:31:15.635418 13259 raft_consensus.cc:2468] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 1.
I20260709 12:31:15.635795 13484 raft_consensus.cc:515] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } }
I20260709 12:31:15.635564 13491 leader_election.cc:290] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.637168 13491 raft_consensus.cc:2804] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:15.638429 13491 raft_consensus.cc:493] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:15.638737 13487 leader_election.cc:290] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:15.639995 13335 raft_consensus.cc:2393] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 68ace02ab1b543de9544c9657a1fecb9 in current term 1: Already voted for candidate 12eb002a429b45fc9cd05bca9d8df352 in this term.
I20260709 12:31:15.640642 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589af6ee0f434f1e9b3184f67b3484ba" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:15.641556 13406 raft_consensus.cc:2393] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 12eb002a429b45fc9cd05bca9d8df352 in current term 1: Already voted for candidate 68ace02ab1b543de9544c9657a1fecb9 in this term.
I20260709 12:31:15.642948 13299 leader_election.cc:304] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352; no voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc
I20260709 12:31:15.643469 13375 leader_election.cc:304] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 12eb002a429b45fc9cd05bca9d8df352
I20260709 12:31:15.638783 13491 raft_consensus.cc:3060] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.643757 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8e777e5bb74c5086ea1699d4ec9b2c" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:15.644273 13487 raft_consensus.cc:2749] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:31:15.645045 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8e777e5bb74c5086ea1699d4ec9b2c" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:15.644683 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8e777e5bb74c5086ea1699d4ec9b2c" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:15.645808 13154 catalog_manager.cc:5697] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "68ace02ab1b543de9544c9657a1fecb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:15.646844 13259 raft_consensus.cc:2393] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 68ace02ab1b543de9544c9657a1fecb9 in current term 1: Already voted for candidate e6313f19634e486587e6214dd291eabc in this term.
I20260709 12:31:15.647652 13334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8e777e5bb74c5086ea1699d4ec9b2c" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:15.645742 13406 raft_consensus.cc:3060] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.652220 13484 leader_election.cc:290] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 election: Requested vote from peers 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.653558 13491 raft_consensus.cc:515] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.645854 13335 raft_consensus.cc:2468] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:15.656418 13491 leader_election.cc:290] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:15.658444 13406 raft_consensus.cc:2468] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 1.
I20260709 12:31:15.660288 13491 raft_consensus.cc:2804] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:15.660836 13491 raft_consensus.cc:697] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Becoming Leader. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:15.661708 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f54ec1a531c467b8cad6c29a3f6dcfd" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:15.661722 13491 consensus_queue.cc:237] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.662626 13259 raft_consensus.cc:3060] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.663287 13224 leader_election.cc:304] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 12eb002a429b45fc9cd05bca9d8df352
I20260709 12:31:15.664212 13484 raft_consensus.cc:2804] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:15.662364 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f54ec1a531c467b8cad6c29a3f6dcfd" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:15.665575 13335 raft_consensus.cc:3060] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:15.665666 13484 raft_consensus.cc:697] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Becoming Leader. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:15.666872 13484 consensus_queue.cc:237] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } }
I20260709 12:31:15.664826 13375 leader_election.cc:304] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: 
I20260709 12:31:15.671010 13259 raft_consensus.cc:2468] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 1.
I20260709 12:31:15.671497 13455 raft_consensus.cc:2764] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:31:15.672646 13375 leader_election.cc:304] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:15.673938 13455 raft_consensus.cc:2804] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:15.674479 13455 raft_consensus.cc:697] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Becoming Leader. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:15.675308 13455 consensus_queue.cc:237] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.680190 13154 catalog_manager.cc:5697] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "68ace02ab1b543de9544c9657a1fecb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:15.681393 13335 raft_consensus.cc:2468] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 1.
I20260709 12:31:15.683307 13155 catalog_manager.cc:5697] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc reported cstate change: term changed from 0 to 1, leader changed from <none> to e6313f19634e486587e6214dd291eabc (127.2.157.1). New cstate: current_term: 1 leader_uuid: "e6313f19634e486587e6214dd291eabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:15.695051 13155 catalog_manager.cc:5697] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "68ace02ab1b543de9544c9657a1fecb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:15.745813 13406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "589af6ee0f434f1e9b3184f67b3484ba"
dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
mode: GRACEFUL
new_leader_uuid: "e6313f19634e486587e6214dd291eabc"
 from {username='slave'} at 127.0.0.1:45280
I20260709 12:31:15.746420 13406 raft_consensus.cc:606] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Received request to transfer leadership to TS e6313f19634e486587e6214dd291eabc
I20260709 12:31:15.763958 13335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b744dfc98d74b50a950f09260fade67"
dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
mode: GRACEFUL
new_leader_uuid: "e6313f19634e486587e6214dd291eabc"
 from {username='slave'} at 127.0.0.1:36050
I20260709 12:31:15.764503 13335 raft_consensus.cc:606] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 LEADER]: Received request to transfer leadership to TS e6313f19634e486587e6214dd291eabc
I20260709 12:31:15.781224 13259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30075c5fe45e48859d5690240429f0d0"
dest_uuid: "e6313f19634e486587e6214dd291eabc"
mode: GRACEFUL
new_leader_uuid: "12eb002a429b45fc9cd05bca9d8df352"
 from {username='slave'} at 127.0.0.1:60410
I20260709 12:31:15.781845 13259 raft_consensus.cc:606] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Received request to transfer leadership to TS 12eb002a429b45fc9cd05bca9d8df352
I20260709 12:31:15.787722 13406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b9fae32bad549e5b2ba9094d725f982"
dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
mode: GRACEFUL
new_leader_uuid: "12eb002a429b45fc9cd05bca9d8df352"
 from {username='slave'} at 127.0.0.1:45280
I20260709 12:31:15.788256 13406 raft_consensus.cc:606] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Received request to transfer leadership to TS 12eb002a429b45fc9cd05bca9d8df352
I20260709 12:31:15.793533 13406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cde76a03b1e2433097b8c6986c632a1e"
dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
mode: GRACEFUL
new_leader_uuid: "12eb002a429b45fc9cd05bca9d8df352"
 from {username='slave'} at 127.0.0.1:45280
I20260709 12:31:15.794080 13406 raft_consensus.cc:606] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Received request to transfer leadership to TS 12eb002a429b45fc9cd05bca9d8df352
I20260709 12:31:15.903792 13484 consensus_queue.cc:1048] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:15.911278 13457 raft_consensus.cc:993] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc: : Instructing follower 12eb002a429b45fc9cd05bca9d8df352 to start an election
I20260709 12:31:15.911691 13485 consensus_queue.cc:1048] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:15.912859 13457 raft_consensus.cc:1081] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Signalling peer 12eb002a429b45fc9cd05bca9d8df352 to start an election
I20260709 12:31:15.916240 13335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30075c5fe45e48859d5690240429f0d0"
dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
 from {username='slave'} at 127.0.0.1:36038
I20260709 12:31:15.916937 13335 raft_consensus.cc:493] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:15.917433 13335 raft_consensus.cc:3060] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:15.929548 13335 raft_consensus.cc:515] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.930783 13334 raft_consensus.cc:1240] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Rejecting Update request from peer e6313f19634e486587e6214dd291eabc for earlier term 1. Current term is 2. Ops: []
I20260709 12:31:15.932873 13335 leader_election.cc:290] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 2 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:15.933678 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30075c5fe45e48859d5690240429f0d0" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:15.934413 13406 raft_consensus.cc:3060] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:15.935216 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30075c5fe45e48859d5690240429f0d0" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:15.935897 13259 raft_consensus.cc:3055] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:15.936260 13259 raft_consensus.cc:740] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:15.937168 13259 consensus_queue.cc:260] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.938654 13259 raft_consensus.cc:3060] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:15.944073 13406 raft_consensus.cc:2468] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 2.
I20260709 12:31:15.945484 13259 raft_consensus.cc:2468] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 2.
I20260709 12:31:15.945848 13299 leader_election.cc:304] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: 
I20260709 12:31:15.946982 13487 raft_consensus.cc:2804] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:15.947525 13487 raft_consensus.cc:697] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Becoming Leader. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Running, Role: LEADER
I20260709 12:31:15.948403 13487 consensus_queue.cc:237] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:15.948716 13494 consensus_queue.cc:1048] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:15.950080 13510 consensus_queue.cc:1048] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:31:15.953626 13494 consensus_queue.cc:1048] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:15.961656 13155 catalog_manager.cc:5697] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 reported cstate change: term changed from 1 to 2, leader changed from e6313f19634e486587e6214dd291eabc (127.2.157.1) to 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "12eb002a429b45fc9cd05bca9d8df352" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:15.976775 13457 consensus_queue.cc:1048] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:15.990034 13456 consensus_queue.cc:1048] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:16.001452 13494 consensus_queue.cc:1048] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:16.002557 13488 raft_consensus.cc:993] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352: : Instructing follower e6313f19634e486587e6214dd291eabc to start an election
I20260709 12:31:16.003245 13494 raft_consensus.cc:1081] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 LEADER]: Signalling peer e6313f19634e486587e6214dd291eabc to start an election
I20260709 12:31:16.009290 13259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b744dfc98d74b50a950f09260fade67"
dest_uuid: "e6313f19634e486587e6214dd291eabc"
 from {username='slave'} at 127.0.0.1:60380
I20260709 12:31:16.009979 13259 raft_consensus.cc:493] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:16.014961 13259 raft_consensus.cc:3060] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:16.026118 13259 raft_consensus.cc:515] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:16.028632 13259 leader_election.cc:290] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 2 election: Requested vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:16.029577 13334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b744dfc98d74b50a950f09260fade67" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:16.030416 13334 raft_consensus.cc:3055] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:16.030849 13334 raft_consensus.cc:740] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Running, Role: LEADER
I20260709 12:31:16.031661 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b744dfc98d74b50a950f09260fade67" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:16.032395 13406 raft_consensus.cc:3060] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:16.031898 13334 consensus_queue.cc:260] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:16.033701 13334 raft_consensus.cc:3060] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:16.038775 13406 raft_consensus.cc:2468] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 2.
I20260709 12:31:16.040247 13224 leader_election.cc:304] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:16.041009 13334 raft_consensus.cc:2468] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 2.
I20260709 12:31:16.041198 13457 raft_consensus.cc:2804] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:16.041780 13457 raft_consensus.cc:697] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [term 2 LEADER]: Becoming Leader. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:16.042747 13457 consensus_queue.cc:237] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:16.049856 13154 catalog_manager.cc:5697] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc reported cstate change: term changed from 1 to 2, leader changed from 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2) to e6313f19634e486587e6214dd291eabc (127.2.157.1). New cstate: current_term: 2 leader_uuid: "e6313f19634e486587e6214dd291eabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:16.068616 13510 consensus_queue.cc:1048] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:16.071834 13455 consensus_queue.cc:1048] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:16.082252 13335 raft_consensus.cc:3060] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:16.083330 13491 raft_consensus.cc:993] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9: : Instructing follower 12eb002a429b45fc9cd05bca9d8df352 to start an election
I20260709 12:31:16.083859 13491 raft_consensus.cc:1081] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Signalling peer 12eb002a429b45fc9cd05bca9d8df352 to start an election
I20260709 12:31:16.087213 13333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b9fae32bad549e5b2ba9094d725f982"
dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
 from {username='slave'} at 127.0.0.1:36044
I20260709 12:31:16.087970 13333 raft_consensus.cc:493] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:16.088428 13333 raft_consensus.cc:3060] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:16.093351 13491 consensus_queue.cc:1048] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:16.095909 13510 consensus_queue.cc:1048] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:16.097836 13333 raft_consensus.cc:515] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:16.100898 13334 raft_consensus.cc:1240] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Rejecting Update request from peer 68ace02ab1b543de9544c9657a1fecb9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:31:16.103492 13491 consensus_queue.cc:1048] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:16.113251 13333 leader_election.cc:290] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 2 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:16.118907 13503 consensus_queue.cc:1059] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:16.119352 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9fae32bad549e5b2ba9094d725f982" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:16.119527 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9fae32bad549e5b2ba9094d725f982" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:16.120144 13406 raft_consensus.cc:3055] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:16.120442 13259 raft_consensus.cc:3060] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:16.120604 13406 raft_consensus.cc:740] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:16.121757 13406 consensus_queue.cc:260] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:16.123364 13406 raft_consensus.cc:3060] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:16.119937 13503 consensus_queue.cc:1048] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:16.129555 13259 raft_consensus.cc:2468] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 2.
I20260709 12:31:16.131300 13301 leader_election.cc:304] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:16.132319 13488 raft_consensus.cc:2804] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:16.132784 13406 raft_consensus.cc:2468] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 2.
I20260709 12:31:16.133023 13488 raft_consensus.cc:697] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Becoming Leader. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Running, Role: LEADER
I20260709 12:31:16.134187 13488 consensus_queue.cc:237] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:16.134910 13455 raft_consensus.cc:993] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9: : Instructing follower 12eb002a429b45fc9cd05bca9d8df352 to start an election
I20260709 12:31:16.135488 13455 raft_consensus.cc:1081] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Signalling peer 12eb002a429b45fc9cd05bca9d8df352 to start an election
I20260709 12:31:16.138499 13335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cde76a03b1e2433097b8c6986c632a1e"
dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
 from {username='slave'} at 127.0.0.1:36044
I20260709 12:31:16.139123 13335 raft_consensus.cc:493] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:16.139581 13335 raft_consensus.cc:3060] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:16.147926 13503 consensus_queue.cc:1048] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:16.151752 13455 consensus_queue.cc:1048] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:16.153841 13531 raft_consensus.cc:993] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9: : Instructing follower e6313f19634e486587e6214dd291eabc to start an election
I20260709 12:31:16.154582 13491 raft_consensus.cc:1081] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Signalling peer e6313f19634e486587e6214dd291eabc to start an election
I20260709 12:31:16.154744 13158 catalog_manager.cc:5697] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 reported cstate change: term changed from 1 to 2, leader changed from 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3) to 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "12eb002a429b45fc9cd05bca9d8df352" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:16.159530 13258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "589af6ee0f434f1e9b3184f67b3484ba"
dest_uuid: "e6313f19634e486587e6214dd291eabc"
 from {username='slave'} at 127.0.0.1:60394
I20260709 12:31:16.159648 13335 raft_consensus.cc:515] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:16.160284 13258 raft_consensus.cc:493] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:16.160741 13258 raft_consensus.cc:3060] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:16.162614 13335 leader_election.cc:290] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 2 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:16.175833 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde76a03b1e2433097b8c6986c632a1e" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:16.169781 13258 raft_consensus.cc:515] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:16.170425 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde76a03b1e2433097b8c6986c632a1e" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:16.180186 13406 raft_consensus.cc:3055] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:16.180653 13406 raft_consensus.cc:740] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:16.182245 13258 leader_election.cc:290] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 2 election: Requested vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:16.182992 13406 consensus_queue.cc:260] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:16.184501 13406 raft_consensus.cc:3060] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:16.193058 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589af6ee0f434f1e9b3184f67b3484ba" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:16.194173 13335 raft_consensus.cc:3060] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:16.196193 13408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589af6ee0f434f1e9b3184f67b3484ba" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:16.197166 13408 raft_consensus.cc:3055] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:16.197674 13408 raft_consensus.cc:740] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:16.199455 13408 consensus_queue.cc:260] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:16.201254 13408 raft_consensus.cc:3060] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:16.214970 13335 raft_consensus.cc:2468] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 2.
I20260709 12:31:16.216349 13332 raft_consensus.cc:1240] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Rejecting Update request from peer 68ace02ab1b543de9544c9657a1fecb9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:31:16.218271 13406 raft_consensus.cc:2468] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 2.
I20260709 12:31:16.219161 13226 leader_election.cc:304] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:16.219911 13299 leader_election.cc:304] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: e6313f19634e486587e6214dd291eabc
I20260709 12:31:16.220243 13510 raft_consensus.cc:2804] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:16.220813 13510 raft_consensus.cc:697] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [term 2 LEADER]: Becoming Leader. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:16.221472 13488 raft_consensus.cc:2804] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:16.222167 13488 raft_consensus.cc:697] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Becoming Leader. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Running, Role: LEADER
I20260709 12:31:16.221745 13510 consensus_queue.cc:237] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:16.223335 13488 consensus_queue.cc:237] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:16.220256 13408 raft_consensus.cc:2468] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 2.
I20260709 12:31:16.234233 13455 consensus_queue.cc:1048] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:16.236614 13158 catalog_manager.cc:5697] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc reported cstate change: term changed from 1 to 2, leader changed from 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3) to e6313f19634e486587e6214dd291eabc (127.2.157.1). New cstate: current_term: 2 leader_uuid: "e6313f19634e486587e6214dd291eabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:16.246794 13157 catalog_manager.cc:5697] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 reported cstate change: term changed from 1 to 2, leader changed from 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3) to 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "12eb002a429b45fc9cd05bca9d8df352" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:16.435624 13332 raft_consensus.cc:1275] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Refusing update from remote peer e6313f19634e486587e6214dd291eabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:16.436928 13510 consensus_queue.cc:1048] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:16.445420 13408 raft_consensus.cc:1275] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Refusing update from remote peer e6313f19634e486587e6214dd291eabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:16.447572 13485 consensus_queue.cc:1048] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:16.483927 13259 raft_consensus.cc:1275] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Refusing update from remote peer 12eb002a429b45fc9cd05bca9d8df352: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:16.485217 13488 consensus_queue.cc:1048] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:16.493640 13408 raft_consensus.cc:1275] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Refusing update from remote peer 12eb002a429b45fc9cd05bca9d8df352: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:16.496138 13488 consensus_queue.cc:1048] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:16.561724 13408 raft_consensus.cc:1275] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Refusing update from remote peer 12eb002a429b45fc9cd05bca9d8df352: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:16.563163 13488 consensus_queue.cc:1048] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:16.571507 13259 raft_consensus.cc:1275] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Refusing update from remote peer 12eb002a429b45fc9cd05bca9d8df352: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:16.573318 13456 consensus_queue.cc:1048] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:16.770138 13408 raft_consensus.cc:1275] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Refusing update from remote peer 12eb002a429b45fc9cd05bca9d8df352: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:16.771533 13488 consensus_queue.cc:1048] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:31:16.780234 13259 raft_consensus.cc:3060] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:16.786415 13332 raft_consensus.cc:1275] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Refusing update from remote peer e6313f19634e486587e6214dd291eabc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:16.788832 13457 consensus_queue.cc:1048] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:16.796306 13259 raft_consensus.cc:1275] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Refusing update from remote peer 12eb002a429b45fc9cd05bca9d8df352: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:16.798730 13494 consensus_queue.cc:1048] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:16.811390 13408 raft_consensus.cc:1275] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Refusing update from remote peer e6313f19634e486587e6214dd291eabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:16.813385 13484 consensus_queue.cc:1048] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:18.823568 13158 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43892:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:31:18.825822 13158 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:31:18.880426 13242 tablet_service.cc:1511] Processing CreateTablet for tablet bae16b03f04a4bebbd56142c1316dd5a (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:18.881300 13318 tablet_service.cc:1511] Processing CreateTablet for tablet bae16b03f04a4bebbd56142c1316dd5a (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:18.881842 13242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae16b03f04a4bebbd56142c1316dd5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.882622 13318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae16b03f04a4bebbd56142c1316dd5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.882959 13397 tablet_service.cc:1511] Processing CreateTablet for tablet bae16b03f04a4bebbd56142c1316dd5a (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:18.884193 13397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae16b03f04a4bebbd56142c1316dd5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.890561 13393 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca39338cbaf40e8adbfd40861fd67ca (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:18.892079 13393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca39338cbaf40e8adbfd40861fd67ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.894546 13249 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca39338cbaf40e8adbfd40861fd67ca (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:18.896059 13249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca39338cbaf40e8adbfd40861fd67ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.895931 13250 tablet_service.cc:1511] Processing CreateTablet for tablet e0e921d4c39a4059a15b306e40ef8e94 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:18.896482 13320 tablet_service.cc:1511] Processing CreateTablet for tablet e0e921d4c39a4059a15b306e40ef8e94 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:18.897727 13250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e921d4c39a4059a15b306e40ef8e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.897902 13320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e921d4c39a4059a15b306e40ef8e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.900712 13321 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca39338cbaf40e8adbfd40861fd67ca (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:18.902299 13321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca39338cbaf40e8adbfd40861fd67ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.911511 13394 tablet_service.cc:1511] Processing CreateTablet for tablet e0e921d4c39a4059a15b306e40ef8e94 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:18.912914 13394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0e921d4c39a4059a15b306e40ef8e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.932389 13550 tablet_bootstrap.cc:492] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:18.937304 13246 tablet_service.cc:1511] Processing CreateTablet for tablet 860fe77584ef4607ad2b2e6d77540739 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:18.939522 13246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860fe77584ef4607ad2b2e6d77540739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.945211 13320 tablet_service.cc:1511] Processing CreateTablet for tablet 860fe77584ef4607ad2b2e6d77540739 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:18.945699 13551 tablet_bootstrap.cc:492] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:18.946707 13320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860fe77584ef4607ad2b2e6d77540739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.951066 13394 tablet_service.cc:1511] Processing CreateTablet for tablet 860fe77584ef4607ad2b2e6d77540739 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:18.952678 13394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860fe77584ef4607ad2b2e6d77540739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.954984 13245 tablet_service.cc:1511] Processing CreateTablet for tablet 94014e4a699c48a3a35d822b9e48c9dc (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:18.956624 13245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94014e4a699c48a3a35d822b9e48c9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.955030 13318 tablet_service.cc:1511] Processing CreateTablet for tablet 94014e4a699c48a3a35d822b9e48c9dc (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:18.957726 13318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94014e4a699c48a3a35d822b9e48c9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.961036 13397 tablet_service.cc:1511] Processing CreateTablet for tablet 94014e4a699c48a3a35d822b9e48c9dc (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:18.962401 13397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94014e4a699c48a3a35d822b9e48c9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.964538 13242 tablet_service.cc:1511] Processing CreateTablet for tablet 21d3e09fcc3143b5bf9532b750516a55 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:18.965977 13242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d3e09fcc3143b5bf9532b750516a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.972450 13325 tablet_service.cc:1511] Processing CreateTablet for tablet 21d3e09fcc3143b5bf9532b750516a55 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:18.973872 13325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d3e09fcc3143b5bf9532b750516a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.978935 13392 tablet_service.cc:1511] Processing CreateTablet for tablet 21d3e09fcc3143b5bf9532b750516a55 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:18.980355 13392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d3e09fcc3143b5bf9532b750516a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.987113 13551 tablet_bootstrap.cc:654] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:18.993517 13323 tablet_service.cc:1511] Processing CreateTablet for tablet 3e94831c3e21419ebd5c9b5e817a4ce8 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:18.995010 13323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e94831c3e21419ebd5c9b5e817a4ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:18.995293 13550 tablet_bootstrap.cc:654] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:18.996767 13393 tablet_service.cc:1511] Processing CreateTablet for tablet 3e94831c3e21419ebd5c9b5e817a4ce8 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:18.998467 13393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e94831c3e21419ebd5c9b5e817a4ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:19.002053 13552 tablet_bootstrap.cc:492] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:19.002749 13249 tablet_service.cc:1511] Processing CreateTablet for tablet 3e94831c3e21419ebd5c9b5e817a4ce8 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:19.014262 13250 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd83de38cac4f0ebf35952fccabb802 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:19.017023 13399 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd83de38cac4f0ebf35952fccabb802 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:19.026890 13399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd83de38cac4f0ebf35952fccabb802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:19.019161 13245 tablet_service.cc:1511] Processing CreateTablet for tablet f1d8644c769c4da3b3846266b02d73dc (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:19.021610 13324 tablet_service.cc:1511] Processing CreateTablet for tablet f1d8644c769c4da3b3846266b02d73dc (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:19.031383 13324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d8644c769c4da3b3846266b02d73dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:19.023373 13398 tablet_service.cc:1511] Processing CreateTablet for tablet f1d8644c769c4da3b3846266b02d73dc (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:19.034822 13398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d8644c769c4da3b3846266b02d73dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:19.035048 13321 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd83de38cac4f0ebf35952fccabb802 (DEFAULT_TABLE table=soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:19.036546 13321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd83de38cac4f0ebf35952fccabb802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:19.026890 13250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd83de38cac4f0ebf35952fccabb802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:19.039625 13249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e94831c3e21419ebd5c9b5e817a4ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:19.042341 13245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d8644c769c4da3b3846266b02d73dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:19.070973 13551 tablet_bootstrap.cc:492] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:19.071682 13551 ts_tablet_manager.cc:1403] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.126s	user 0.021s	sys 0.005s
I20260709 12:31:19.072402 13552 tablet_bootstrap.cc:654] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.073062 13550 tablet_bootstrap.cc:492] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:19.073647 13550 ts_tablet_manager.cc:1403] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.142s	user 0.011s	sys 0.012s
I20260709 12:31:19.075268 13551 raft_consensus.cc:359] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.076175 13551 raft_consensus.cc:385] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.076511 13551 raft_consensus.cc:740] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.077047 13550 raft_consensus.cc:359] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.077523 13551 consensus_queue.cc:260] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.080699 13551 ts_tablet_manager.cc:1434] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:31:19.081849 13551 tablet_bootstrap.cc:492] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:19.082123 13550 raft_consensus.cc:385] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.090054 13550 raft_consensus.cc:740] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.091030 13550 consensus_queue.cc:260] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.094007 13550 ts_tablet_manager.cc:1434] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:31:19.095090 13550 tablet_bootstrap.cc:492] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:19.097723 13551 tablet_bootstrap.cc:654] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.120488 13550 tablet_bootstrap.cc:654] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.128887 13551 tablet_bootstrap.cc:492] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:19.129530 13551 ts_tablet_manager.cc:1403] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.048s	user 0.000s	sys 0.017s
I20260709 12:31:19.133126 13551 raft_consensus.cc:359] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.134224 13551 raft_consensus.cc:385] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.134610 13551 raft_consensus.cc:740] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.135578 13551 consensus_queue.cc:260] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.147583 13551 ts_tablet_manager.cc:1434] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.004s
I20260709 12:31:19.153134 13539 raft_consensus.cc:493] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:19.153812 13539 raft_consensus.cc:515] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.157390 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e921d4c39a4059a15b306e40ef8e94" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:19.159484 13551 tablet_bootstrap.cc:492] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
W20260709 12:31:19.160423 13301 leader_election.cc:343] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:19.161147 13539 leader_election.cc:290] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:19.161996 13408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e921d4c39a4059a15b306e40ef8e94" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
W20260709 12:31:19.164037 13299 leader_election.cc:343] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:19.164588 13299 leader_election.cc:304] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352; no voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc
I20260709 12:31:19.167215 13539 raft_consensus.cc:2749] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:19.168514 13551 tablet_bootstrap.cc:654] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.181205 13550 tablet_bootstrap.cc:492] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:19.182040 13550 ts_tablet_manager.cc:1403] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.087s	user 0.029s	sys 0.039s
I20260709 12:31:19.186630 13550 raft_consensus.cc:359] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.187767 13550 raft_consensus.cc:385] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.188202 13550 raft_consensus.cc:740] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
W20260709 12:31:19.188609 13226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:34897, user_credentials={real_user=slave}} blocked reactor thread for 62592.7us
I20260709 12:31:19.189306 13550 consensus_queue.cc:260] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.193365 13550 ts_tablet_manager.cc:1434] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:31:19.195174 13550 tablet_bootstrap.cc:492] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:19.205256 13550 tablet_bootstrap.cc:654] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
W20260709 12:31:19.222214 13224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:34867, user_credentials={real_user=slave}} blocked reactor thread for 89559.7us
I20260709 12:31:19.223842 13550 tablet_bootstrap.cc:492] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:19.224411 13552 tablet_bootstrap.cc:492] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:19.224538 13550 ts_tablet_manager.cc:1403] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.008s
I20260709 12:31:19.225059 13552 ts_tablet_manager.cc:1403] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.223s	user 0.051s	sys 0.060s
I20260709 12:31:19.226579 13551 tablet_bootstrap.cc:492] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:19.227190 13551 ts_tablet_manager.cc:1403] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.068s	user 0.036s	sys 0.023s
I20260709 12:31:19.227658 13552 raft_consensus.cc:359] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.228309 13552 raft_consensus.cc:385] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.228600 13552 raft_consensus.cc:740] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.228323 13550 raft_consensus.cc:359] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.229300 13550 raft_consensus.cc:385] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.229317 13552 consensus_queue.cc:260] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.229772 13550 raft_consensus.cc:740] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.230587 13551 raft_consensus.cc:359] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.230816 13550 consensus_queue.cc:260] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.231405 13551 raft_consensus.cc:385] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.231889 13551 raft_consensus.cc:740] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.232867 13551 consensus_queue.cc:260] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.233399 13550 ts_tablet_manager.cc:1434] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:31:19.234604 13550 tablet_bootstrap.cc:492] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:19.231920 13552 ts_tablet_manager.cc:1434] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:31:19.236379 13552 tablet_bootstrap.cc:492] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:19.241716 13550 tablet_bootstrap.cc:654] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.243309 13552 tablet_bootstrap.cc:654] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.248586 13551 ts_tablet_manager.cc:1434] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 12:31:19.249840 13551 tablet_bootstrap.cc:492] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:19.253252 13550 tablet_bootstrap.cc:492] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:19.258531 13550 ts_tablet_manager.cc:1403] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.008s
I20260709 12:31:19.259110 13551 tablet_bootstrap.cc:654] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.262037 13550 raft_consensus.cc:359] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.267745 13550 raft_consensus.cc:385] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.268162 13550 raft_consensus.cc:740] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.269212 13550 consensus_queue.cc:260] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.272584 13550 ts_tablet_manager.cc:1434] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:31:19.273996 13550 tablet_bootstrap.cc:492] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:19.280315 13552 tablet_bootstrap.cc:492] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:19.280846 13552 ts_tablet_manager.cc:1403] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.018s
I20260709 12:31:19.282907 13550 tablet_bootstrap.cc:654] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.284293 13552 raft_consensus.cc:359] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.285367 13552 raft_consensus.cc:385] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.285754 13552 raft_consensus.cc:740] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.286909 13552 consensus_queue.cc:260] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.289646 13552 ts_tablet_manager.cc:1434] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:31:19.290705 13551 tablet_bootstrap.cc:492] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:19.291208 13552 tablet_bootstrap.cc:492] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:19.291266 13551 ts_tablet_manager.cc:1403] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.007s
I20260709 12:31:19.293563 13550 tablet_bootstrap.cc:492] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:19.294265 13550 ts_tablet_manager.cc:1403] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 12:31:19.295047 13551 raft_consensus.cc:359] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.295935 13551 raft_consensus.cc:385] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.296259 13551 raft_consensus.cc:740] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.297319 13551 consensus_queue.cc:260] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.298647 13552 tablet_bootstrap.cc:654] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.298178 13550 raft_consensus.cc:359] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.299553 13550 raft_consensus.cc:385] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.299938 13550 raft_consensus.cc:740] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.300787 13550 consensus_queue.cc:260] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.303841 13550 ts_tablet_manager.cc:1434] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:31:19.305009 13550 tablet_bootstrap.cc:492] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:19.307986 13551 ts_tablet_manager.cc:1434] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:31:19.309312 13551 tablet_bootstrap.cc:492] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:19.310603 13552 tablet_bootstrap.cc:492] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:19.311168 13552 ts_tablet_manager.cc:1403] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:31:19.312680 13550 tablet_bootstrap.cc:654] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.314352 13552 raft_consensus.cc:359] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.317852 13552 raft_consensus.cc:385] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.318188 13552 raft_consensus.cc:740] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.318969 13552 consensus_queue.cc:260] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.322381 13552 ts_tablet_manager.cc:1434] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:31:19.324473 13552 tablet_bootstrap.cc:492] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
W20260709 12:31:19.327226 13206 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:31:19.327459 13550 tablet_bootstrap.cc:492] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:19.327994 13550 ts_tablet_manager.cc:1403] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.000s
I20260709 12:31:19.328326 13551 tablet_bootstrap.cc:654] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.331338 13550 raft_consensus.cc:359] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.332168 13550 raft_consensus.cc:385] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.332463 13550 raft_consensus.cc:740] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.333266 13550 consensus_queue.cc:260] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.333649 13558 raft_consensus.cc:493] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:19.334070 13552 tablet_bootstrap.cc:654] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.334304 13558 raft_consensus.cc:515] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.334945 13551 tablet_bootstrap.cc:492] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:19.335642 13551 ts_tablet_manager.cc:1403] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.004s
I20260709 12:31:19.335764 13550 ts_tablet_manager.cc:1434] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:31:19.336781 13558 leader_election.cc:290] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:19.336966 13550 tablet_bootstrap.cc:492] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:19.340104 13551 raft_consensus.cc:359] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.340902 13551 raft_consensus.cc:385] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.341274 13551 raft_consensus.cc:740] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.342043 13551 consensus_queue.cc:260] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.344218 13550 tablet_bootstrap.cc:654] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.344419 13551 ts_tablet_manager.cc:1434] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:31:19.346500 13551 tablet_bootstrap.cc:492] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:19.355306 13551 tablet_bootstrap.cc:654] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.355886 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca39338cbaf40e8adbfd40861fd67ca" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:19.357033 13335 raft_consensus.cc:2468] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 0.
I20260709 12:31:19.362418 13559 raft_consensus.cc:493] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:19.363260 13551 tablet_bootstrap.cc:492] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:19.363967 13551 ts_tablet_manager.cc:1403] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:31:19.364288 13550 tablet_bootstrap.cc:492] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:19.364754 13408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca39338cbaf40e8adbfd40861fd67ca" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
I20260709 12:31:19.364827 13550 ts_tablet_manager.cc:1403] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.010s
I20260709 12:31:19.372365 13551 raft_consensus.cc:359] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.373193 13551 raft_consensus.cc:385] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.373474 13551 raft_consensus.cc:740] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.374367 13550 raft_consensus.cc:359] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.374322 13551 consensus_queue.cc:260] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.375149 13550 raft_consensus.cc:385] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.375452 13550 raft_consensus.cc:740] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.376260 13550 consensus_queue.cc:260] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.377658 13551 ts_tablet_manager.cc:1434] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 12:31:19.378655 13550 ts_tablet_manager.cc:1434] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:31:19.378805 13551 tablet_bootstrap.cc:492] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:19.379803 13550 tablet_bootstrap.cc:492] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:19.365864 13408 raft_consensus.cc:2468] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 0.
I20260709 12:31:19.386359 13551 tablet_bootstrap.cc:654] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.386518 13550 tablet_bootstrap.cc:654] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.363245 13559 raft_consensus.cc:515] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.391888 13559 leader_election.cc:290] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:19.397962 13550 tablet_bootstrap.cc:492] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:19.398226 13551 tablet_bootstrap.cc:492] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:19.398550 13550 ts_tablet_manager.cc:1403] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:31:19.398697 13551 ts_tablet_manager.cc:1403] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 12:31:19.401754 13551 raft_consensus.cc:359] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.401959 13550 raft_consensus.cc:359] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.402555 13551 raft_consensus.cc:385] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.402704 13550 raft_consensus.cc:385] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.402922 13551 raft_consensus.cc:740] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.402999 13550 raft_consensus.cc:740] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.403926 13550 consensus_queue.cc:260] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.403965 13551 consensus_queue.cc:260] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.406261 13550 ts_tablet_manager.cc:1434] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:31:19.406278 13551 ts_tablet_manager.cc:1434] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:31:19.407532 13551 tablet_bootstrap.cc:492] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:19.407532 13550 tablet_bootstrap.cc:492] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9: Bootstrap starting.
I20260709 12:31:19.408663 13224 leader_election.cc:304] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:19.412039 13407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94014e4a699c48a3a35d822b9e48c9dc" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
I20260709 12:31:19.412839 13407 raft_consensus.cc:2468] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 0.
I20260709 12:31:19.414239 13550 tablet_bootstrap.cc:654] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.414239 13551 tablet_bootstrap.cc:654] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.414748 13485 raft_consensus.cc:2804] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:19.415386 13485 raft_consensus.cc:493] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:19.415795 13485 raft_consensus.cc:3060] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.429265 13551 tablet_bootstrap.cc:492] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:19.430032 13551 ts_tablet_manager.cc:1403] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.011s
I20260709 12:31:19.418255 13558 raft_consensus.cc:493] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:19.430723 13558 raft_consensus.cc:515] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.432847 13536 raft_consensus.cc:493] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:19.433343 13558 leader_election.cc:290] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:19.433138 13551 raft_consensus.cc:359] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.433459 13536 raft_consensus.cc:515] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.434276 13551 raft_consensus.cc:385] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.434656 13551 raft_consensus.cc:740] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.435634 13536 leader_election.cc:290] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:19.438557 13551 consensus_queue.cc:260] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.441663 13551 ts_tablet_manager.cc:1434] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:31:19.443130 13551 tablet_bootstrap.cc:492] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352: Bootstrap starting.
I20260709 12:31:19.406198 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94014e4a699c48a3a35d822b9e48c9dc" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:19.450525 13333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae16b03f04a4bebbd56142c1316dd5a" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:19.451071 13335 raft_consensus.cc:2468] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 0.
I20260709 12:31:19.451195 13333 raft_consensus.cc:2468] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 0.
I20260709 12:31:19.451954 13551 tablet_bootstrap.cc:654] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.464883 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae16b03f04a4bebbd56142c1316dd5a" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:19.466089 13259 raft_consensus.cc:2468] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:19.466204 13226 leader_election.cc:304] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:19.436165 13224 leader_election.cc:304] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:19.461478 13578 raft_consensus.cc:493] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:19.437922 13536 raft_consensus.cc:493] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:19.482563 13558 raft_consensus.cc:2804] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:19.474143 13573 raft_consensus.cc:2804] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:19.495502 13558 raft_consensus.cc:493] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:19.495821 13573 raft_consensus.cc:493] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:19.496304 13573 raft_consensus.cc:3060] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.496218 13558 raft_consensus.cc:3060] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.479188 13536 raft_consensus.cc:515] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.498486 13552 tablet_bootstrap.cc:492] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:19.499310 13552 ts_tablet_manager.cc:1403] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.175s	user 0.062s	sys 0.090s
I20260709 12:31:19.500291 13536 leader_election.cc:290] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:19.483433 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae16b03f04a4bebbd56142c1316dd5a" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:19.502528 13335 raft_consensus.cc:2468] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:19.503985 13552 raft_consensus.cc:359] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.505137 13552 raft_consensus.cc:385] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:31:19.495474 13224 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.157.3:34867, user_credentials={real_user=slave}} blocked reactor thread for 59413.5us
I20260709 12:31:19.479755 13578 raft_consensus.cc:515] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.508414 13578 leader_election.cc:290] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:19.508960 13578 raft_consensus.cc:493] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:19.509418 13578 raft_consensus.cc:515] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.511572 13578 leader_election.cc:290] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:19.513619 13485 raft_consensus.cc:515] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.515635 13558 raft_consensus.cc:515] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.516129 13485 leader_election.cc:290] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 election: Requested vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:19.517781 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca39338cbaf40e8adbfd40861fd67ca" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:19.518425 13335 raft_consensus.cc:3060] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.505581 13552 raft_consensus.cc:740] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.520924 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94014e4a699c48a3a35d822b9e48c9dc" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:19.520772 13552 consensus_queue.cc:260] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.523448 13408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae16b03f04a4bebbd56142c1316dd5a" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
I20260709 12:31:19.521559 13550 tablet_bootstrap.cc:492] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9: No bootstrap required, opened a new log
I20260709 12:31:19.523715 13552 ts_tablet_manager.cc:1434] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 12:31:19.521600 13332 raft_consensus.cc:3060] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.525060 13552 tablet_bootstrap.cc:492] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:19.525039 13407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca39338cbaf40e8adbfd40861fd67ca" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:19.525771 13407 raft_consensus.cc:3060] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.524145 13408 raft_consensus.cc:2468] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 0.
I20260709 12:31:19.527805 13573 raft_consensus.cc:515] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.532579 13552 tablet_bootstrap.cc:654] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.533151 13335 raft_consensus.cc:2468] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 1.
I20260709 12:31:19.524237 13550 ts_tablet_manager.cc:1403] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9: Time spent bootstrapping tablet: real 0.117s	user 0.041s	sys 0.026s
I20260709 12:31:19.534570 13226 leader_election.cc:304] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:19.535782 13485 raft_consensus.cc:2804] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:19.536795 13550 raft_consensus.cc:359] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.547888 13550 raft_consensus.cc:385] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.544518 13552 tablet_bootstrap.cc:492] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:19.548339 13550 raft_consensus.cc:740] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.545902 13558 leader_election.cc:290] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 election: Requested vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:19.546965 13333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae16b03f04a4bebbd56142c1316dd5a" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:19.547348 13573 leader_election.cc:290] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 election: Requested vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:19.543907 13332 raft_consensus.cc:2468] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 1.
I20260709 12:31:19.548655 13552 ts_tablet_manager.cc:1403] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 12:31:19.549132 13333 raft_consensus.cc:3060] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.549175 13550 consensus_queue.cc:260] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.547906 13551 tablet_bootstrap.cc:492] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352: No bootstrap required, opened a new log
I20260709 12:31:19.550486 13551 ts_tablet_manager.cc:1403] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.012s
I20260709 12:31:19.552345 13552 raft_consensus.cc:359] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.550006 13485 raft_consensus.cc:697] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Becoming Leader. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:19.553112 13552 raft_consensus.cc:385] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.553442 13552 raft_consensus.cc:740] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.537348 13407 raft_consensus.cc:2468] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 1.
I20260709 12:31:19.554512 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e921d4c39a4059a15b306e40ef8e94" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:19.554229 13552 consensus_queue.cc:260] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.555480 13259 raft_consensus.cc:2468] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:19.556622 13226 leader_election.cc:304] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:19.557435 13552 ts_tablet_manager.cc:1434] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:31:19.558377 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d3e09fcc3143b5bf9532b750516a55" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:19.558538 13552 tablet_bootstrap.cc:492] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:19.559034 13260 raft_consensus.cc:2468] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:19.559617 13375 leader_election.cc:304] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:19.560371 13558 raft_consensus.cc:2804] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:19.561146 13558 raft_consensus.cc:697] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Becoming Leader. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:19.560173 13551 raft_consensus.cc:359] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.561579 13334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d3e09fcc3143b5bf9532b750516a55" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:19.561702 13551 raft_consensus.cc:385] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.563192 13551 raft_consensus.cc:740] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.563427 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e921d4c39a4059a15b306e40ef8e94" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:19.562269 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860fe77584ef4607ad2b2e6d77540739" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:19.562451 13334 raft_consensus.cc:2468] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:19.561798 13536 raft_consensus.cc:2804] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:19.564540 13536 raft_consensus.cc:493] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:19.564899 13536 raft_consensus.cc:3060] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.565804 13333 raft_consensus.cc:2468] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 1.
I20260709 12:31:19.553656 13550 ts_tablet_manager.cc:1434] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:31:19.562544 13375 leader_election.cc:304] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:19.562076 13558 consensus_queue.cc:237] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.567426 13375 leader_election.cc:304] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:19.568239 13578 raft_consensus.cc:2804] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:19.568596 13578 raft_consensus.cc:493] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:19.568984 13578 raft_consensus.cc:3060] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.554682 13485 consensus_queue.cc:237] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.570421 13579 raft_consensus.cc:2804] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:19.570842 13579 raft_consensus.cc:493] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:19.564105 13332 raft_consensus.cc:2468] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:19.571200 13579 raft_consensus.cc:3060] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.575317 13536 raft_consensus.cc:515] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.578497 13552 tablet_bootstrap.cc:654] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.564107 13551 consensus_queue.cc:260] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.578804 13226 leader_election.cc:304] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:19.579644 13573 raft_consensus.cc:2804] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:19.580313 13573 raft_consensus.cc:697] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Becoming Leader. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:19.581284 13551 ts_tablet_manager.cc:1434] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:31:19.581172 13573 consensus_queue.cc:237] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.582304 13578 raft_consensus.cc:515] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.578666 13536 leader_election.cc:290] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:19.584415 13578 leader_election.cc:290] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:19.588156 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860fe77584ef4607ad2b2e6d77540739" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:19.588864 13335 raft_consensus.cc:2468] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:19.595953 13579 raft_consensus.cc:515] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.598286 13579 leader_election.cc:290] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:19.598776 13579 raft_consensus.cc:493] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:19.599220 13579 raft_consensus.cc:515] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.601214 13579 leader_election.cc:290] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:19.602558 13552 tablet_bootstrap.cc:492] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:19.603283 13552 ts_tablet_manager.cc:1403] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.019s
I20260709 12:31:19.605631 13375 leader_election.cc:304] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: 
I20260709 12:31:19.606599 13536 raft_consensus.cc:2804] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:19.606328 13552 raft_consensus.cc:359] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.607065 13536 raft_consensus.cc:493] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:19.607161 13552 raft_consensus.cc:385] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.608055 13536 raft_consensus.cc:3060] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.608098 13552 raft_consensus.cc:740] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.609055 13552 consensus_queue.cc:260] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.611366 13552 ts_tablet_manager.cc:1434] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:31:19.612387 13552 tablet_bootstrap.cc:492] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:19.612389 13157 catalog_manager.cc:5697] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc reported cstate change: term changed from 0 to 1, leader changed from <none> to e6313f19634e486587e6214dd291eabc (127.2.157.1). New cstate: current_term: 1 leader_uuid: "e6313f19634e486587e6214dd291eabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:19.614653 13157 catalog_manager.cc:5697] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc reported cstate change: term changed from 0 to 1, leader changed from <none> to e6313f19634e486587e6214dd291eabc (127.2.157.1). New cstate: current_term: 1 leader_uuid: "e6313f19634e486587e6214dd291eabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:19.616305 13536 raft_consensus.cc:515] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.617614 13407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94014e4a699c48a3a35d822b9e48c9dc" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:19.618265 13407 raft_consensus.cc:3060] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.618451 13536 leader_election.cc:290] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:19.619115 13552 tablet_bootstrap.cc:654] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.620013 13408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae16b03f04a4bebbd56142c1316dd5a" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:19.626791 13407 raft_consensus.cc:2468] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 1.
I20260709 12:31:19.627568 13408 raft_consensus.cc:2393] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6313f19634e486587e6214dd291eabc in current term 1: Already voted for candidate 68ace02ab1b543de9544c9657a1fecb9 in this term.
I20260709 12:31:19.630532 13552 tablet_bootstrap.cc:492] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:19.630667 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae16b03f04a4bebbd56142c1316dd5a" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:19.631098 13552 ts_tablet_manager.cc:1403] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:31:19.631297 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae16b03f04a4bebbd56142c1316dd5a" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:19.632133 13335 raft_consensus.cc:2393] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 68ace02ab1b543de9544c9657a1fecb9 in current term 1: Already voted for candidate e6313f19634e486587e6214dd291eabc in this term.
I20260709 12:31:19.633229 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e921d4c39a4059a15b306e40ef8e94" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:19.633895 13259 raft_consensus.cc:3060] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.634269 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e921d4c39a4059a15b306e40ef8e94" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:19.634886 13335 raft_consensus.cc:3060] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.635275 13552 raft_consensus.cc:359] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.636265 13552 raft_consensus.cc:385] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.636629 13552 raft_consensus.cc:740] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.637794 13539 raft_consensus.cc:493] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:19.637607 13552 consensus_queue.cc:260] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.638301 13539 raft_consensus.cc:515] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.640427 13539 leader_election.cc:290] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:19.640838 13552 ts_tablet_manager.cc:1434] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260709 12:31:19.642373 13552 tablet_bootstrap.cc:492] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:19.643081 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd83de38cac4f0ebf35952fccabb802" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
W20260709 12:31:19.644600 13375 leader_election.cc:343] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:19.645900 13375 leader_election.cc:304] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9; no voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc
I20260709 12:31:19.646235 13408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd83de38cac4f0ebf35952fccabb802" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
I20260709 12:31:19.646880 13335 raft_consensus.cc:2468] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 1.
I20260709 12:31:19.647925 13536 raft_consensus.cc:2749] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:31:19.648824 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d8644c769c4da3b3846266b02d73dc" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc" is_pre_election: true
I20260709 12:31:19.649164 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860fe77584ef4607ad2b2e6d77540739" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:19.649812 13257 raft_consensus.cc:3060] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.651727 13552 tablet_bootstrap.cc:654] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
W20260709 12:31:19.652976 13301 leader_election.cc:343] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:31:19.651773 13375 leader_election.cc:343] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:19.654929 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860fe77584ef4607ad2b2e6d77540739" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:19.655726 13332 raft_consensus.cc:3060] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.655531 13375 leader_election.cc:304] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: 
I20260709 12:31:19.655855 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d3e09fcc3143b5bf9532b750516a55" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:19.656409 13485 raft_consensus.cc:493] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:19.656759 13260 raft_consensus.cc:3060] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.656967 13485 raft_consensus.cc:515] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.654899 13333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d8644c769c4da3b3846266b02d73dc" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:19.658241 13333 raft_consensus.cc:2468] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 0.
I20260709 12:31:19.659310 13485 leader_election.cc:290] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:19.659458 13375 leader_election.cc:304] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: e6313f19634e486587e6214dd291eabc
I20260709 12:31:19.660342 13579 raft_consensus.cc:2804] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:19.660817 13579 raft_consensus.cc:697] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Becoming Leader. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:19.660977 13583 raft_consensus.cc:2804] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:19.661384 13583 raft_consensus.cc:493] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:19.646950 13408 raft_consensus.cc:2468] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 0.
I20260709 12:31:19.661710 13583 raft_consensus.cc:3060] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.661585 13333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e94831c3e21419ebd5c9b5e817a4ce8" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:19.662694 13333 raft_consensus.cc:2468] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 0.
I20260709 12:31:19.662842 13299 leader_election.cc:304] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: e6313f19634e486587e6214dd291eabc
I20260709 12:31:19.661720 13579 consensus_queue.cc:237] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.664184 13226 leader_election.cc:304] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:19.665347 13485 raft_consensus.cc:2804] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:19.665845 13485 raft_consensus.cc:493] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:19.674510 13485 raft_consensus.cc:3060] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.665340 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d3e09fcc3143b5bf9532b750516a55" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:19.667006 13408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e94831c3e21419ebd5c9b5e817a4ce8" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
I20260709 12:31:19.675889 13335 raft_consensus.cc:3060] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.676105 13408 raft_consensus.cc:2468] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 0.
I20260709 12:31:19.665704 13539 raft_consensus.cc:2804] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:19.678447 13539 raft_consensus.cc:493] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:19.678858 13539 raft_consensus.cc:3060] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.684480 13335 raft_consensus.cc:2468] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 1.
I20260709 12:31:19.685812 13375 leader_election.cc:304] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: 
I20260709 12:31:19.686789 13536 raft_consensus.cc:2804] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:19.687270 13536 raft_consensus.cc:697] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Becoming Leader. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:19.688100 13536 consensus_queue.cc:237] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.691877 13583 raft_consensus.cc:515] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.697562 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d8644c769c4da3b3846266b02d73dc" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
W20260709 12:31:19.699609 13375 leader_election.cc:343] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:19.702272 13485 raft_consensus.cc:515] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.703742 13332 raft_consensus.cc:2468] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 1.
I20260709 12:31:19.705181 13259 raft_consensus.cc:2468] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 1.
I20260709 12:31:19.707437 13257 raft_consensus.cc:2468] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 1.
I20260709 12:31:19.705291 13333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e94831c3e21419ebd5c9b5e817a4ce8" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:19.707367 13375 leader_election.cc:304] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: 
I20260709 12:31:19.708245 13333 raft_consensus.cc:3060] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.709198 13539 raft_consensus.cc:515] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.709751 13578 raft_consensus.cc:2804] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:19.713546 13578 raft_consensus.cc:697] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Becoming Leader. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:19.714723 13578 consensus_queue.cc:237] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.715503 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd83de38cac4f0ebf35952fccabb802" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:19.716410 13333 raft_consensus.cc:2468] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 1.
I20260709 12:31:19.717694 13226 leader_election.cc:304] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:19.710642 13408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e94831c3e21419ebd5c9b5e817a4ce8" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:19.718688 13573 raft_consensus.cc:2804] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:19.718780 13408 raft_consensus.cc:3060] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.719245 13573 raft_consensus.cc:697] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Becoming Leader. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:19.720083 13573 consensus_queue.cc:237] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.718164 13260 raft_consensus.cc:2468] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 1.
W20260709 12:31:19.716995 13301 leader_election.cc:343] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:19.727365 13408 raft_consensus.cc:2468] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 1.
I20260709 12:31:19.727737 13407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd83de38cac4f0ebf35952fccabb802" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:19.728392 13407 raft_consensus.cc:3060] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.718755 13485 leader_election.cc:290] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 election: Requested vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:19.730880 13583 leader_election.cc:290] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:19.738935 13407 raft_consensus.cc:2468] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 1.
I20260709 12:31:19.742034 13299 leader_election.cc:304] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: e6313f19634e486587e6214dd291eabc
I20260709 12:31:19.742468 13552 tablet_bootstrap.cc:492] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:19.739946 13539 leader_election.cc:290] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 1 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:19.742964 13552 ts_tablet_manager.cc:1403] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.101s	user 0.034s	sys 0.057s
I20260709 12:31:19.740676 13333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d8644c769c4da3b3846266b02d73dc" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:19.743274 13560 raft_consensus.cc:2804] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:19.743953 13333 raft_consensus.cc:3060] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.744010 13560 raft_consensus.cc:697] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 LEADER]: Becoming Leader. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Running, Role: LEADER
I20260709 12:31:19.745021 13560 consensus_queue.cc:237] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.745896 13552 raft_consensus.cc:359] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.746587 13552 raft_consensus.cc:385] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.746857 13552 raft_consensus.cc:740] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.747506 13552 consensus_queue.cc:260] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.749586 13552 ts_tablet_manager.cc:1434] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:31:19.749010 13158 catalog_manager.cc:5697] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "68ace02ab1b543de9544c9657a1fecb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:19.750991 13552 tablet_bootstrap.cc:492] T 4dd83de38cac4f0ebf35952fccabb802 P e6313f19634e486587e6214dd291eabc: Bootstrap starting.
I20260709 12:31:19.757560 13552 tablet_bootstrap.cc:654] T 4dd83de38cac4f0ebf35952fccabb802 P e6313f19634e486587e6214dd291eabc: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:19.757565 13333 raft_consensus.cc:2468] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 1.
I20260709 12:31:19.764672 13552 tablet_bootstrap.cc:492] T 4dd83de38cac4f0ebf35952fccabb802 P e6313f19634e486587e6214dd291eabc: No bootstrap required, opened a new log
I20260709 12:31:19.765444 13552 ts_tablet_manager.cc:1403] T 4dd83de38cac4f0ebf35952fccabb802 P e6313f19634e486587e6214dd291eabc: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 12:31:19.767288 13375 leader_election.cc:304] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: e6313f19634e486587e6214dd291eabc
I20260709 12:31:19.768520 13579 raft_consensus.cc:2804] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:19.768596 13552 raft_consensus.cc:359] T 4dd83de38cac4f0ebf35952fccabb802 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.769078 13579 raft_consensus.cc:697] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Becoming Leader. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:19.769500 13552 raft_consensus.cc:385] T 4dd83de38cac4f0ebf35952fccabb802 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:19.769943 13552 raft_consensus.cc:740] T 4dd83de38cac4f0ebf35952fccabb802 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Initialized, Role: FOLLOWER
I20260709 12:31:19.770028 13579 consensus_queue.cc:237] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.770972 13552 consensus_queue.cc:260] T 4dd83de38cac4f0ebf35952fccabb802 P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.772884 13552 ts_tablet_manager.cc:1434] T 4dd83de38cac4f0ebf35952fccabb802 P e6313f19634e486587e6214dd291eabc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:31:19.779037 13155 catalog_manager.cc:5697] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 reported cstate change: term changed from 0 to 1, leader changed from <none> to 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "12eb002a429b45fc9cd05bca9d8df352" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:19.782655 13157 catalog_manager.cc:5697] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc reported cstate change: term changed from 0 to 1, leader changed from <none> to e6313f19634e486587e6214dd291eabc (127.2.157.1). New cstate: current_term: 1 leader_uuid: "e6313f19634e486587e6214dd291eabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:19.784284 13157 catalog_manager.cc:5697] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc reported cstate change: term changed from 0 to 1, leader changed from <none> to e6313f19634e486587e6214dd291eabc (127.2.157.1). New cstate: current_term: 1 leader_uuid: "e6313f19634e486587e6214dd291eabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:19.795346 13154 catalog_manager.cc:5697] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "68ace02ab1b543de9544c9657a1fecb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:19.796948 13154 catalog_manager.cc:5697] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "68ace02ab1b543de9544c9657a1fecb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:19.798343 13154 catalog_manager.cc:5697] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3). New cstate: current_term: 1 leader_uuid: "68ace02ab1b543de9544c9657a1fecb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:19.929607 13407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0e921d4c39a4059a15b306e40ef8e94"
dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
mode: GRACEFUL
new_leader_uuid: "e6313f19634e486587e6214dd291eabc"
 from {username='slave'} at 127.0.0.1:45280
I20260709 12:31:19.930176 13407 raft_consensus.cc:606] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Received request to transfer leadership to TS e6313f19634e486587e6214dd291eabc
I20260709 12:31:19.935731 13407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "860fe77584ef4607ad2b2e6d77540739"
dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
mode: GRACEFUL
new_leader_uuid: "e6313f19634e486587e6214dd291eabc"
 from {username='slave'} at 127.0.0.1:45280
I20260709 12:31:19.936187 13407 raft_consensus.cc:606] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Received request to transfer leadership to TS e6313f19634e486587e6214dd291eabc
I20260709 12:31:19.940896 13260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94014e4a699c48a3a35d822b9e48c9dc"
dest_uuid: "e6313f19634e486587e6214dd291eabc"
mode: GRACEFUL
new_leader_uuid: "12eb002a429b45fc9cd05bca9d8df352"
 from {username='slave'} at 127.0.0.1:60410
I20260709 12:31:19.941450 13260 raft_consensus.cc:606] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Received request to transfer leadership to TS 12eb002a429b45fc9cd05bca9d8df352
I20260709 12:31:19.944403 13573 raft_consensus.cc:493] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:19.944895 13573 raft_consensus.cc:515] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:19.947023 13573 leader_election.cc:290] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:19.947674 13407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21d3e09fcc3143b5bf9532b750516a55"
dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
mode: GRACEFUL
new_leader_uuid: "12eb002a429b45fc9cd05bca9d8df352"
 from {username='slave'} at 127.0.0.1:45280
I20260709 12:31:19.948105 13408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d8644c769c4da3b3846266b02d73dc" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68ace02ab1b543de9544c9657a1fecb9" is_pre_election: true
I20260709 12:31:19.948177 13333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d8644c769c4da3b3846266b02d73dc" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12eb002a429b45fc9cd05bca9d8df352" is_pre_election: true
I20260709 12:31:19.948372 13407 raft_consensus.cc:606] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Received request to transfer leadership to TS 12eb002a429b45fc9cd05bca9d8df352
I20260709 12:31:19.949225 13333 raft_consensus.cc:2393] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6313f19634e486587e6214dd291eabc in current term 1: Already voted for candidate 68ace02ab1b543de9544c9657a1fecb9 in this term.
I20260709 12:31:19.950239 13226 leader_election.cc:304] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6313f19634e486587e6214dd291eabc; no voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9
I20260709 12:31:19.950961 13573 raft_consensus.cc:3060] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:19.954433 13260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e94831c3e21419ebd5c9b5e817a4ce8"
dest_uuid: "e6313f19634e486587e6214dd291eabc"
mode: GRACEFUL
new_leader_uuid: "12eb002a429b45fc9cd05bca9d8df352"
 from {username='slave'} at 127.0.0.1:60410
I20260709 12:31:19.955029 13260 raft_consensus.cc:606] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Received request to transfer leadership to TS 12eb002a429b45fc9cd05bca9d8df352
I20260709 12:31:19.957455 13573 raft_consensus.cc:2749] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:20.047906 13485 consensus_queue.cc:1048] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:20.048993 13579 consensus_queue.cc:1048] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:20.068637 13583 raft_consensus.cc:993] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9: : Instructing follower e6313f19634e486587e6214dd291eabc to start an election
I20260709 12:31:20.069936 13536 raft_consensus.cc:1081] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Signalling peer e6313f19634e486587e6214dd291eabc to start an election
I20260709 12:31:20.077678 13259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0e921d4c39a4059a15b306e40ef8e94"
dest_uuid: "e6313f19634e486587e6214dd291eabc"
 from {username='slave'} at 127.0.0.1:60394
I20260709 12:31:20.078593 13259 raft_consensus.cc:493] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:20.079072 13259 raft_consensus.cc:3060] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.087108 13573 consensus_queue.cc:1048] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:20.087595 13579 consensus_queue.cc:1048] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:20.087522 13485 consensus_queue.cc:1048] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:20.103937 13259 raft_consensus.cc:515] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:20.113579 13332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e921d4c39a4059a15b306e40ef8e94" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:20.114470 13259 leader_election.cc:290] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 2 election: Requested vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:20.117838 13580 consensus_queue.cc:1048] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:31:20.122690 13407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e921d4c39a4059a15b306e40ef8e94" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:20.123478 13407 raft_consensus.cc:3055] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:20.123850 13407 raft_consensus.cc:740] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:20.125005 13407 consensus_queue.cc:260] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:20.126142 13407 raft_consensus.cc:3060] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.137619 13407 raft_consensus.cc:2468] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 2.
I20260709 12:31:20.158776 13224 leader_election.cc:304] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 12eb002a429b45fc9cd05bca9d8df352
I20260709 12:31:20.159802 13580 raft_consensus.cc:2804] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:20.161613 13580 raft_consensus.cc:697] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 2 LEADER]: Becoming Leader. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:20.162887 13580 consensus_queue.cc:237] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:20.174098 13154 catalog_manager.cc:5697] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc reported cstate change: term changed from 1 to 2, leader changed from 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3) to e6313f19634e486587e6214dd291eabc (127.2.157.1). New cstate: current_term: 2 leader_uuid: "e6313f19634e486587e6214dd291eabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:20.178861 13580 consensus_queue.cc:1048] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:20.180757 13610 consensus_queue.cc:1048] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:20.182399 13583 consensus_queue.cc:1048] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:20.185047 13560 consensus_queue.cc:1048] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:20.204519 13259 raft_consensus.cc:3060] T 4dd83de38cac4f0ebf35952fccabb802 P e6313f19634e486587e6214dd291eabc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:20.220543 13583 consensus_queue.cc:1048] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:20.227896 13560 consensus_queue.cc:1048] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:20.230180 13558 raft_consensus.cc:993] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc: : Instructing follower 12eb002a429b45fc9cd05bca9d8df352 to start an election
I20260709 12:31:20.230794 13558 raft_consensus.cc:1081] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Signalling peer 12eb002a429b45fc9cd05bca9d8df352 to start an election
I20260709 12:31:20.232983 13333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94014e4a699c48a3a35d822b9e48c9dc"
dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
 from {username='slave'} at 127.0.0.1:36038
I20260709 12:31:20.234081 13333 raft_consensus.cc:493] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:20.234637 13333 raft_consensus.cc:3060] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.250571 13578 consensus_queue.cc:1048] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:20.258595 13579 consensus_queue.cc:1048] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:20.269109 13333 raft_consensus.cc:515] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:20.281406 13580 consensus_queue.cc:1048] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:20.283504 13579 consensus_queue.cc:1048] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:20.290057 13536 consensus_queue.cc:1048] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:20.295013 13558 consensus_queue.cc:1048] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:20.300192 13536 raft_consensus.cc:993] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9: : Instructing follower 12eb002a429b45fc9cd05bca9d8df352 to start an election
I20260709 12:31:20.300683 13536 raft_consensus.cc:1081] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Signalling peer 12eb002a429b45fc9cd05bca9d8df352 to start an election
I20260709 12:31:20.330061 13334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21d3e09fcc3143b5bf9532b750516a55"
dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
 from {username='slave'} at 127.0.0.1:36044
I20260709 12:31:20.336071 13558 raft_consensus.cc:993] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc: : Instructing follower 12eb002a429b45fc9cd05bca9d8df352 to start an election
I20260709 12:31:20.336697 13558 raft_consensus.cc:1081] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Signalling peer 12eb002a429b45fc9cd05bca9d8df352 to start an election
I20260709 12:31:20.337845 13333 leader_election.cc:290] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 2 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:20.339207 13408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94014e4a699c48a3a35d822b9e48c9dc" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:20.339946 13408 raft_consensus.cc:3060] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.341461 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94014e4a699c48a3a35d822b9e48c9dc" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:20.342213 13260 raft_consensus.cc:3055] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:20.342543 13260 raft_consensus.cc:740] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:20.343406 13335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e94831c3e21419ebd5c9b5e817a4ce8"
dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
 from {username='slave'} at 127.0.0.1:36038
I20260709 12:31:20.344063 13335 raft_consensus.cc:493] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:20.343787 13260 consensus_queue.cc:260] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:20.344405 13335 raft_consensus.cc:3060] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.354702 13260 raft_consensus.cc:3060] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.331444 13334 raft_consensus.cc:493] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:20.358835 13334 raft_consensus.cc:3060] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.369047 13335 raft_consensus.cc:515] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:20.372542 13333 raft_consensus.cc:1240] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Rejecting Update request from peer e6313f19634e486587e6214dd291eabc for earlier term 1. Current term is 2. Ops: []
I20260709 12:31:20.373353 13260 raft_consensus.cc:2468] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 2.
I20260709 12:31:20.375687 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e94831c3e21419ebd5c9b5e817a4ce8" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:20.377542 13335 leader_election.cc:290] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 2 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:20.378007 13301 leader_election.cc:304] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:20.379474 13539 raft_consensus.cc:2804] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:20.376217 13580 consensus_queue.cc:1059] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:31:20.383579 13406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e94831c3e21419ebd5c9b5e817a4ce8" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:20.380086 13408 raft_consensus.cc:2468] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 2.
I20260709 12:31:20.387979 13258 raft_consensus.cc:3055] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:20.388609 13258 raft_consensus.cc:740] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:20.380120 13539 raft_consensus.cc:697] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Becoming Leader. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Running, Role: LEADER
I20260709 12:31:20.389961 13539 consensus_queue.cc:237] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:20.393349 13536 raft_consensus.cc:993] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9: : Instructing follower e6313f19634e486587e6214dd291eabc to start an election
I20260709 12:31:20.394125 13536 raft_consensus.cc:1081] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Signalling peer e6313f19634e486587e6214dd291eabc to start an election
I20260709 12:31:20.399036 13257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "860fe77584ef4607ad2b2e6d77540739"
dest_uuid: "e6313f19634e486587e6214dd291eabc"
 from {username='slave'} at 127.0.0.1:60394
I20260709 12:31:20.399729 13257 raft_consensus.cc:493] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:20.399405 13258 consensus_queue.cc:260] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:20.400166 13257 raft_consensus.cc:3060] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.401033 13258 raft_consensus.cc:3060] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.411244 13258 raft_consensus.cc:2468] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 2.
I20260709 12:31:20.410895 13257 raft_consensus.cc:515] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
W20260709 12:31:20.413656 13580 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:31:20.414340 13301 leader_election.cc:304] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 68ace02ab1b543de9544c9657a1fecb9
I20260709 12:31:20.415382 13539 raft_consensus.cc:2804] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:20.415699 13260 raft_consensus.cc:1240] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Rejecting Update request from peer 68ace02ab1b543de9544c9657a1fecb9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:31:20.415932 13539 raft_consensus.cc:697] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Becoming Leader. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Running, Role: LEADER
I20260709 12:31:20.417110 13539 consensus_queue.cc:237] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:20.418519 13583 consensus_queue.cc:1059] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:20.418676 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860fe77584ef4607ad2b2e6d77540739" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:20.419322 13335 raft_consensus.cc:3060] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.419668 13583 raft_consensus.cc:3055] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:20.420043 13583 raft_consensus.cc:740] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:20.420991 13583 consensus_queue.cc:260] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:20.423619 13407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860fe77584ef4607ad2b2e6d77540739" candidate_uuid: "e6313f19634e486587e6214dd291eabc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:20.425969 13583 raft_consensus.cc:3060] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.427373 13335 raft_consensus.cc:2468] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 2.
I20260709 12:31:20.427932 13334 raft_consensus.cc:515] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:20.428925 13226 leader_election.cc:304] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:20.429942 13580 raft_consensus.cc:2804] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:20.430402 13580 raft_consensus.cc:697] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [term 2 LEADER]: Becoming Leader. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:20.431236 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d3e09fcc3143b5bf9532b750516a55" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:20.431344 13580 consensus_queue.cc:237] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:20.431953 13260 raft_consensus.cc:3060] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.424139 13257 leader_election.cc:290] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [CANDIDATE]: Term 2 election: Requested vote from peers 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:20.439666 13334 leader_election.cc:290] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 2 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3:34867)
I20260709 12:31:20.441582 13408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d3e09fcc3143b5bf9532b750516a55" candidate_uuid: "12eb002a429b45fc9cd05bca9d8df352" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
I20260709 12:31:20.444139 13408 raft_consensus.cc:3055] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:20.444486 13408 raft_consensus.cc:740] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:20.445385 13408 consensus_queue.cc:260] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:20.446466 13408 raft_consensus.cc:3060] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.445940 13155 catalog_manager.cc:5697] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc reported cstate change: term changed from 1 to 2, leader changed from 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3) to e6313f19634e486587e6214dd291eabc (127.2.157.1). New cstate: current_term: 2 leader_uuid: "e6313f19634e486587e6214dd291eabc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:20.446738 13407 raft_consensus.cc:2468] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6313f19634e486587e6214dd291eabc in term 2.
I20260709 12:31:20.455902 13260 raft_consensus.cc:2468] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 2.
I20260709 12:31:20.457123 13408 raft_consensus.cc:2468] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12eb002a429b45fc9cd05bca9d8df352 in term 2.
I20260709 12:31:20.457222 13301 leader_election.cc:304] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:20.458312 13539 raft_consensus.cc:2804] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:20.458961 13539 raft_consensus.cc:697] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Becoming Leader. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Running, Role: LEADER
I20260709 12:31:20.458616 13154 catalog_manager.cc:5697] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 reported cstate change: term changed from 1 to 2, leader changed from e6313f19634e486587e6214dd291eabc (127.2.157.1) to 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "12eb002a429b45fc9cd05bca9d8df352" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:20.459939 13539 consensus_queue.cc:237] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:20.460489 13154 catalog_manager.cc:5697] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 reported cstate change: term changed from 1 to 2, leader changed from e6313f19634e486587e6214dd291eabc (127.2.157.1) to 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "12eb002a429b45fc9cd05bca9d8df352" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:20.477447 13154 catalog_manager.cc:5697] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 reported cstate change: term changed from 1 to 2, leader changed from 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3) to 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "12eb002a429b45fc9cd05bca9d8df352" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:20.640211 13408 raft_consensus.cc:1275] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Refusing update from remote peer e6313f19634e486587e6214dd291eabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:20.641587 13580 consensus_queue.cc:1048] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:20.649012 13334 raft_consensus.cc:3060] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.656955 13334 raft_consensus.cc:1275] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Refusing update from remote peer e6313f19634e486587e6214dd291eabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:20.659013 13573 consensus_queue.cc:1048] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:20.812944 13260 raft_consensus.cc:1275] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Refusing update from remote peer 12eb002a429b45fc9cd05bca9d8df352: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:20.814327 13539 consensus_queue.cc:1048] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:20.822813 13408 raft_consensus.cc:1275] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Refusing update from remote peer 12eb002a429b45fc9cd05bca9d8df352: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:20.824223 13598 consensus_queue.cc:1048] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:20.842734 13260 raft_consensus.cc:1275] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Refusing update from remote peer 12eb002a429b45fc9cd05bca9d8df352: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:20.844966 13539 consensus_queue.cc:1048] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:20.846909 13407 raft_consensus.cc:1275] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Refusing update from remote peer 12eb002a429b45fc9cd05bca9d8df352: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:20.848239 13539 consensus_queue.cc:1048] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:20.864676 13260 raft_consensus.cc:1275] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Refusing update from remote peer 12eb002a429b45fc9cd05bca9d8df352: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:20.866403 13539 consensus_queue.cc:1048] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:20.876756 13407 raft_consensus.cc:3060] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:20.884348 13407 raft_consensus.cc:1275] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Refusing update from remote peer 12eb002a429b45fc9cd05bca9d8df352: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:20.885835 13627 consensus_queue.cc:1048] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:31:20.937285 13407 raft_consensus.cc:1275] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Refusing update from remote peer e6313f19634e486587e6214dd291eabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:20.938712 13558 consensus_queue.cc:1048] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:20.948915 13334 raft_consensus.cc:1275] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Refusing update from remote peer e6313f19634e486587e6214dd291eabc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:20.950965 13558 consensus_queue.cc:1048] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:22.964782 13155 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43892:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:31:22.989147 13155 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43892:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:31:23.022522  2676 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:31:23.176563 13668 tablet.cc:1724] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:31:23.165831 13649 log.cc:927] Time spent T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:31:23.207810 13673 tablet.cc:1724] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:31:23.219684 13435 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:bae16b03f04a4bebbd56142c1316dd5a)
I20260709 12:31:23.324676 13688 tablet.cc:1724] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:31:23.292829 13226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:34897, user_credentials={real_user=slave}} blocked reactor thread for 95012.8us
I20260709 12:31:23.336782 13684 tablet.cc:1724] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.342126 13675 tablet.cc:1724] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:31:23.353446 13435 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:bae16b03f04a4bebbd56142c1316dd5a)
W20260709 12:31:23.377981 13663 log.cc:927] Time spent T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352: Append to log took a long time: real 0.123s	user 0.003s	sys 0.000s
I20260709 12:31:23.426489 13668 tablet.cc:1724] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.463331 13335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21d3e09fcc3143b5bf9532b750516a55"
dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
mode: GRACEFUL
new_leader_uuid: "68ace02ab1b543de9544c9657a1fecb9"
 from {username='slave'} at 127.0.0.1:49584
I20260709 12:31:23.471483 13335 raft_consensus.cc:606] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Received request to transfer leadership to TS 68ace02ab1b543de9544c9657a1fecb9
I20260709 12:31:23.470857 13692 tablet.cc:1724] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.485416 13696 tablet.cc:1724] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.517848 13693 tablet.cc:1724] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.511813 13684 tablet.cc:1724] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.544785 13668 tablet.cc:1724] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.563638 13703 tablet.cc:1724] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.577275 13667 raft_consensus.cc:993] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352: : Instructing follower 68ace02ab1b543de9544c9657a1fecb9 to start an election
I20260709 12:31:23.579265 13673 tablet.cc:1724] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.590102 13667 raft_consensus.cc:1081] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Signalling peer 68ace02ab1b543de9544c9657a1fecb9 to start an election
W20260709 12:31:23.594971 13286 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:2ca39338cbaf40e8adbfd40861fd67ca)
I20260709 12:31:23.563724 13704 tablet.cc:1724] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.606870 13692 tablet.cc:1724] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.609184 13405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21d3e09fcc3143b5bf9532b750516a55"
dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
 from {username='slave'} at 127.0.0.1:45260
I20260709 12:31:23.618592 13405 raft_consensus.cc:493] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:23.619067 13405 raft_consensus.cc:3060] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:23.610760 13702 tablet.cc:1724] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.612262 13696 tablet.cc:1724] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.641839 13668 tablet.cc:1724] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.632928 13688 tablet.cc:1724] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.658298 13693 tablet.cc:1724] T 4dd83de38cac4f0ebf35952fccabb802 P e6313f19634e486587e6214dd291eabc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.655159 13675 tablet.cc:1724] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.680737 13675 tablet.cc:1724] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.693408 13673 tablet.cc:1724] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.698858 13675 tablet.cc:1724] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.699949 13707 tablet.cc:1724] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.706753 13684 tablet.cc:1724] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.693943 13405 raft_consensus.cc:515] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:23.719872 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d3e09fcc3143b5bf9532b750516a55" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:23.720175 13260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0e921d4c39a4059a15b306e40ef8e94"
dest_uuid: "e6313f19634e486587e6214dd291eabc"
mode: GRACEFUL
new_leader_uuid: "68ace02ab1b543de9544c9657a1fecb9"
 from {username='slave'} at 127.0.0.1:38914
I20260709 12:31:23.720536 13256 raft_consensus.cc:3060] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:23.720857 13260 raft_consensus.cc:606] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 2 LEADER]: Received request to transfer leadership to TS 68ace02ab1b543de9544c9657a1fecb9
I20260709 12:31:23.727422  2676 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:31:23.728111  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:23.728310 13256 raft_consensus.cc:2468] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 3.
I20260709 12:31:23.736248 13375 leader_election.cc:304] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:23.728044 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d3e09fcc3143b5bf9532b750516a55" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:23.737179 13672 raft_consensus.cc:2804] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:31:23.737795 13672 raft_consensus.cc:697] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 LEADER]: Becoming Leader. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:23.738948 13672 consensus_queue.cc:237] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:23.742385 13335 raft_consensus.cc:3055] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:31:23.742872 13335 raft_consensus.cc:740] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Running, Role: LEADER
I20260709 12:31:23.744010 13335 consensus_queue.cc:260] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:23.745535 13335 raft_consensus.cc:3060] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:23.746228 13675 tablet.cc:1724] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:23.752863 13405 leader_election.cc:290] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 3 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:23.763505 13335 raft_consensus.cc:2468] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 3.
I20260709 12:31:23.772890 13335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30075c5fe45e48859d5690240429f0d0"
dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
mode: GRACEFUL
new_leader_uuid: "68ace02ab1b543de9544c9657a1fecb9"
 from {username='slave'} at 127.0.0.1:49584
I20260709 12:31:23.773447 13335 raft_consensus.cc:606] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Received request to transfer leadership to TS 68ace02ab1b543de9544c9657a1fecb9
I20260709 12:31:23.767311 13154 catalog_manager.cc:6242] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f: soft_deleted_table [id=b1d2b96b334d436aa97c8e5baff8a444] alter complete (version 1)
I20260709 12:31:23.778234 13157 catalog_manager.cc:5697] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 reported cstate change: term changed from 2 to 3, leader changed from 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2) to 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3). New cstate: current_term: 3 leader_uuid: "68ace02ab1b543de9544c9657a1fecb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:23.779528 13256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d8e777e5bb74c5086ea1699d4ec9b2c"
dest_uuid: "e6313f19634e486587e6214dd291eabc"
mode: GRACEFUL
new_leader_uuid: "68ace02ab1b543de9544c9657a1fecb9"
 from {username='slave'} at 127.0.0.1:38914
I20260709 12:31:23.780632 13256 raft_consensus.cc:606] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Received request to transfer leadership to TS 68ace02ab1b543de9544c9657a1fecb9
I20260709 12:31:23.782307  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:31:23.782927  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:23.953931 13671 raft_consensus.cc:993] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc: : Instructing follower 68ace02ab1b543de9544c9657a1fecb9 to start an election
I20260709 12:31:23.954548 13644 raft_consensus.cc:1081] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 2 LEADER]: Signalling peer 68ace02ab1b543de9544c9657a1fecb9 to start an election
I20260709 12:31:23.955816 13405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0e921d4c39a4059a15b306e40ef8e94"
dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
 from {username='slave'} at 127.0.0.1:45268
I20260709 12:31:23.956403 13405 raft_consensus.cc:493] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:23.956816 13405 raft_consensus.cc:3060] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:23.962146 13405 raft_consensus.cc:515] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:23.963841 13405 leader_election.cc:290] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 3 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:23.964876 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e921d4c39a4059a15b306e40ef8e94" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:23.964738 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0e921d4c39a4059a15b306e40ef8e94" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:23.965590 13335 raft_consensus.cc:3060] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:23.965742 13256 raft_consensus.cc:3055] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:31:23.966228 13256 raft_consensus.cc:740] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:23.967020 13256 consensus_queue.cc:260] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:23.968081 13256 raft_consensus.cc:3060] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:23.970613 13335 raft_consensus.cc:2468] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 3.
I20260709 12:31:23.971683 13375 leader_election.cc:304] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: 
I20260709 12:31:23.972330 13672 raft_consensus.cc:2804] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:31:23.972764 13672 raft_consensus.cc:697] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 LEADER]: Becoming Leader. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:23.973567 13672 consensus_queue.cc:237] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:23.974715 13256 raft_consensus.cc:2468] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 3.
I20260709 12:31:23.981959 13155 catalog_manager.cc:5697] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 reported cstate change: term changed from 2 to 3, leader changed from e6313f19634e486587e6214dd291eabc (127.2.157.1) to 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3). New cstate: current_term: 3 leader_uuid: "68ace02ab1b543de9544c9657a1fecb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:23.985394 13671 raft_consensus.cc:993] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc: : Instructing follower 68ace02ab1b543de9544c9657a1fecb9 to start an election
I20260709 12:31:23.985955 13644 raft_consensus.cc:1081] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Signalling peer 68ace02ab1b543de9544c9657a1fecb9 to start an election
I20260709 12:31:23.987859 13405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d8e777e5bb74c5086ea1699d4ec9b2c"
dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
 from {username='slave'} at 127.0.0.1:45268
I20260709 12:31:23.988421 13405 raft_consensus.cc:493] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:23.988780 13405 raft_consensus.cc:3060] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:23.994694 13405 raft_consensus.cc:515] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } }
I20260709 12:31:23.996384 13405 leader_election.cc:290] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 2 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:23.997223 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8e777e5bb74c5086ea1699d4ec9b2c" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:23.997378 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8e777e5bb74c5086ea1699d4ec9b2c" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:23.997956 13335 raft_consensus.cc:3060] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:23.997956 13256 raft_consensus.cc:3055] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:23.998440 13256 raft_consensus.cc:740] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6313f19634e486587e6214dd291eabc, State: Running, Role: LEADER
I20260709 12:31:23.999336 13256 consensus_queue.cc:260] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } }
I20260709 12:31:24.000592 13256 raft_consensus.cc:3060] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:24.005223 13335 raft_consensus.cc:2468] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 2.
I20260709 12:31:24.006419 13375 leader_election.cc:304] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12eb002a429b45fc9cd05bca9d8df352, 68ace02ab1b543de9544c9657a1fecb9; no voters: 
I20260709 12:31:24.007243 13672 raft_consensus.cc:2804] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:24.007789 13672 raft_consensus.cc:697] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 2 LEADER]: Becoming Leader. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:24.008816 13256 raft_consensus.cc:2468] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 2.
I20260709 12:31:24.008737 13672 consensus_queue.cc:237] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } }
I20260709 12:31:24.016305 13155 catalog_manager.cc:5697] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 reported cstate change: term changed from 1 to 2, leader changed from e6313f19634e486587e6214dd291eabc (127.2.157.1) to 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3). New cstate: current_term: 2 leader_uuid: "68ace02ab1b543de9544c9657a1fecb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:24.155038 13650 raft_consensus.cc:993] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352: : Instructing follower 68ace02ab1b543de9544c9657a1fecb9 to start an election
I20260709 12:31:24.155763 13690 raft_consensus.cc:1081] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Signalling peer 68ace02ab1b543de9544c9657a1fecb9 to start an election
I20260709 12:31:24.157476 13405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30075c5fe45e48859d5690240429f0d0"
dest_uuid: "68ace02ab1b543de9544c9657a1fecb9"
 from {username='slave'} at 127.0.0.1:45260
I20260709 12:31:24.158097 13405 raft_consensus.cc:493] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:24.158533 13405 raft_consensus.cc:3060] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:24.163977 13405 raft_consensus.cc:515] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:24.165772 13405 leader_election.cc:290] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 3 election: Requested vote from peers e6313f19634e486587e6214dd291eabc (127.2.157.1:36049), 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897)
I20260709 12:31:24.166452 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30075c5fe45e48859d5690240429f0d0" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e6313f19634e486587e6214dd291eabc"
I20260709 12:31:24.166676 13335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30075c5fe45e48859d5690240429f0d0" candidate_uuid: "68ace02ab1b543de9544c9657a1fecb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "12eb002a429b45fc9cd05bca9d8df352"
I20260709 12:31:24.167178 13256 raft_consensus.cc:3060] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:24.167325 13335 raft_consensus.cc:3055] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:31:24.167791 13335 raft_consensus.cc:740] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 12eb002a429b45fc9cd05bca9d8df352, State: Running, Role: LEADER
I20260709 12:31:24.168501 13335 consensus_queue.cc:260] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:24.169466 13335 raft_consensus.cc:3060] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:24.172832 13256 raft_consensus.cc:2468] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 3.
I20260709 12:31:24.174034 13375 leader_election.cc:304] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68ace02ab1b543de9544c9657a1fecb9, e6313f19634e486587e6214dd291eabc; no voters: 
I20260709 12:31:24.174181 13335 raft_consensus.cc:2468] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68ace02ab1b543de9544c9657a1fecb9 in term 3.
I20260709 12:31:24.174780 13672 raft_consensus.cc:2804] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:31:24.175283 13672 raft_consensus.cc:697] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 LEADER]: Becoming Leader. State: Replica: 68ace02ab1b543de9544c9657a1fecb9, State: Running, Role: LEADER
I20260709 12:31:24.176198 13672 consensus_queue.cc:237] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } }
I20260709 12:31:24.184010 13155 catalog_manager.cc:5697] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 reported cstate change: term changed from 2 to 3, leader changed from 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2) to 68ace02ab1b543de9544c9657a1fecb9 (127.2.157.3). New cstate: current_term: 3 leader_uuid: "68ace02ab1b543de9544c9657a1fecb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68ace02ab1b543de9544c9657a1fecb9" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 34867 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:24.277858 13256 raft_consensus.cc:1275] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [term 3 FOLLOWER]: Refusing update from remote peer 68ace02ab1b543de9544c9657a1fecb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:31:24.279338 13583 consensus_queue.cc:1048] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:31:24.280799 13335 raft_consensus.cc:1275] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 3 FOLLOWER]: Refusing update from remote peer 68ace02ab1b543de9544c9657a1fecb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:31:24.282245 13583 consensus_queue.cc:1048] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:31:24.497675 13256 raft_consensus.cc:1275] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 3 FOLLOWER]: Refusing update from remote peer 68ace02ab1b543de9544c9657a1fecb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:31:24.498915 13717 consensus_queue.cc:1048] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:31:24.510375 13335 raft_consensus.cc:1275] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 3 FOLLOWER]: Refusing update from remote peer 68ace02ab1b543de9544c9657a1fecb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:31:24.511915 13583 consensus_queue.cc:1048] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:31:24.531973 13335 raft_consensus.cc:1275] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Refusing update from remote peer 68ace02ab1b543de9544c9657a1fecb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:24.533165 13717 consensus_queue.cc:1048] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:24.541846 13256 raft_consensus.cc:1275] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Refusing update from remote peer 68ace02ab1b543de9544c9657a1fecb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:24.543143 13718 consensus_queue.cc:1048] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:24.589797 13335 raft_consensus.cc:1275] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 3 FOLLOWER]: Refusing update from remote peer 68ace02ab1b543de9544c9657a1fecb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:24.591214 13717 consensus_queue.cc:1048] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12eb002a429b45fc9cd05bca9d8df352" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:24.601061 13256 raft_consensus.cc:1275] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 3 FOLLOWER]: Refusing update from remote peer 68ace02ab1b543de9544c9657a1fecb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:24.602448 13583 consensus_queue.cc:1048] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6313f19634e486587e6214dd291eabc" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:24.784075  2676 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:31:24.789659  2676 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:31:24.790138  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:24.794919  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:24.795348  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:25.796401  2676 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:31:25.801582  2676 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:31:25.802089  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:25.807121  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:25.807512  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:26.809124  2676 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:31:26.816053  2676 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:31:26.816532  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:26.824997  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:26.825525  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:27.826680  2676 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:31:27.832180  2676 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:31:27.832602  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:27.838629  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:27.839094  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:28.840153  2676 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:31:28.845662  2676 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:31:28.846228  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:28.852455  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:28.852999  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:29.853989  2676 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:31:29.860687  2676 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:31:29.861123  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:29.866226  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:29.866694  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:30.867905  2676 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:31:30.874426  2676 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:31:30.874970  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:30.879670  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:30.879992  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:31.881080  2676 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:31:31.886900  2676 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:31:31.887439  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:31.892848  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:31.893199  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:32.894357  2676 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:31:32.901552  2676 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:31:32.902117  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:32.907868  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:32.908440  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:33.964138  2676 tablet_server.cc:179] TabletServer@127.2.157.1:0 shutting down...
W20260709 12:31:33.980939 13375 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 12:31:33.986670 13375 consensus_peers.cc:597] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 -> Peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Couldn't send request to peer e6313f19634e486587e6214dd291eabc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:34.015931  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:34.017004  2676 tablet_replica.cc:333] T 4dd83de38cac4f0ebf35952fccabb802 P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.018515  2676 raft_consensus.cc:2243] T 4dd83de38cac4f0ebf35952fccabb802 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.019675  2676 raft_consensus.cc:2272] T 4dd83de38cac4f0ebf35952fccabb802 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.023594  2676 tablet_replica.cc:333] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.024685  2676 raft_consensus.cc:2243] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:31:34.025414 13301 consensus_peers.cc:597] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 -> Peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Couldn't send request to peer e6313f19634e486587e6214dd291eabc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:34.025452  2676 raft_consensus.cc:2272] T f1d8644c769c4da3b3846266b02d73dc P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.028904  2676 tablet_replica.cc:333] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.029619  2676 raft_consensus.cc:2243] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.030704  2676 raft_consensus.cc:2272] T 860fe77584ef4607ad2b2e6d77540739 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.033543  2676 tablet_replica.cc:333] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.034409  2676 raft_consensus.cc:2243] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.035017  2676 raft_consensus.cc:2272] T e0e921d4c39a4059a15b306e40ef8e94 P e6313f19634e486587e6214dd291eabc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.038832  2676 tablet_replica.cc:333] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.039681  2676 raft_consensus.cc:2243] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.040903  2676 raft_consensus.cc:2272] T 2ca39338cbaf40e8adbfd40861fd67ca P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:34.041067 13375 consensus_peers.cc:597] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 -> Peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Couldn't send request to peer e6313f19634e486587e6214dd291eabc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:34.044353  2676 tablet_replica.cc:333] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.045497  2676 raft_consensus.cc:2243] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.046720  2676 raft_consensus.cc:2272] T bae16b03f04a4bebbd56142c1316dd5a P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.050320  2676 tablet_replica.cc:333] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc: stopping tablet replica
W20260709 12:31:34.050472 13375 consensus_peers.cc:597] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 -> Peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Couldn't send request to peer e6313f19634e486587e6214dd291eabc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:34.051079  2676 raft_consensus.cc:2243] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.051699  2676 raft_consensus.cc:2272] T 6f54ec1a531c467b8cad6c29a3f6dcfd P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.054232  2676 tablet_replica.cc:333] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.054787  2676 raft_consensus.cc:2243] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.055234  2676 raft_consensus.cc:2272] T 5d8e777e5bb74c5086ea1699d4ec9b2c P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.057730  2676 tablet_replica.cc:333] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.058353  2676 raft_consensus.cc:2243] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.058851  2676 raft_consensus.cc:2272] T cde76a03b1e2433097b8c6986c632a1e P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.061326  2676 tablet_replica.cc:333] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.061913  2676 raft_consensus.cc:2243] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.062471  2676 raft_consensus.cc:2272] T 94014e4a699c48a3a35d822b9e48c9dc P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.065567  2676 tablet_replica.cc:333] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.066362  2676 raft_consensus.cc:2243] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.067116  2676 raft_consensus.cc:2272] T 30075c5fe45e48859d5690240429f0d0 P e6313f19634e486587e6214dd291eabc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.070603  2676 tablet_replica.cc:333] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.071151  2676 raft_consensus.cc:2243] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.071684  2676 raft_consensus.cc:2272] T 3e94831c3e21419ebd5c9b5e817a4ce8 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.074425  2676 tablet_replica.cc:333] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.075165  2676 raft_consensus.cc:2243] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.075837  2676 raft_consensus.cc:2272] T 21d3e09fcc3143b5bf9532b750516a55 P e6313f19634e486587e6214dd291eabc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:34.078234 13375 consensus_peers.cc:597] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 -> Peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Couldn't send request to peer e6313f19634e486587e6214dd291eabc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:34.079250  2676 tablet_replica.cc:333] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.080009  2676 raft_consensus.cc:2243] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.081095  2676 raft_consensus.cc:2272] T 589af6ee0f434f1e9b3184f67b3484ba P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.083577  2676 tablet_replica.cc:333] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.084156  2676 raft_consensus.cc:2243] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.085034  2676 raft_consensus.cc:2272] T 1b744dfc98d74b50a950f09260fade67 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.087463  2676 tablet_replica.cc:333] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.088021  2676 raft_consensus.cc:2243] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.088896  2676 raft_consensus.cc:2272] T 00ca9668e73544c98b8f8dc4eb174a07 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.091272  2676 tablet_replica.cc:333] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.091796  2676 raft_consensus.cc:2243] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.092329  2676 raft_consensus.cc:2272] T 8b9fae32bad549e5b2ba9094d725f982 P e6313f19634e486587e6214dd291eabc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.095959  2676 tablet_replica.cc:333] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc: stopping tablet replica
I20260709 12:31:34.096674  2676 raft_consensus.cc:2243] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.097323  2676 raft_consensus.cc:2272] T 14f6ac9e3f194e0c85859fa49d469e13 P e6313f19634e486587e6214dd291eabc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:34.097460 13301 consensus_peers.cc:597] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 -> Peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Couldn't send request to peer e6313f19634e486587e6214dd291eabc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:34.137261  2676 tablet_server.cc:196] TabletServer@127.2.157.1:0 shutdown complete.
I20260709 12:31:34.182750  2676 tablet_server.cc:179] TabletServer@127.2.157.2:0 shutting down...
W20260709 12:31:34.215263 13301 consensus_peers.cc:597] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 -> Peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Couldn't send request to peer e6313f19634e486587e6214dd291eabc. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:31:34.216244 13375 consensus_peers.cc:597] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 -> Peer 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897): Couldn't send request to peer 12eb002a429b45fc9cd05bca9d8df352. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:34.219344  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:34.220523  2676 tablet_replica.cc:333] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.221764  2676 raft_consensus.cc:2243] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.222556  2676 raft_consensus.cc:2272] T f1d8644c769c4da3b3846266b02d73dc P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:34.222797 13301 consensus_peers.cc:597] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 -> Peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Couldn't send request to peer e6313f19634e486587e6214dd291eabc. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:34.225167  2676 tablet_replica.cc:333] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.225961  2676 raft_consensus.cc:2243] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.226882  2676 raft_consensus.cc:2272] T 4dd83de38cac4f0ebf35952fccabb802 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.229275  2676 tablet_replica.cc:333] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.229944  2676 raft_consensus.cc:2243] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.230425  2676 raft_consensus.cc:2272] T 860fe77584ef4607ad2b2e6d77540739 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.232755  2676 tablet_replica.cc:333] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.233371  2676 raft_consensus.cc:2243] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.234007  2676 raft_consensus.cc:2272] T 2ca39338cbaf40e8adbfd40861fd67ca P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.236357  2676 tablet_replica.cc:333] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.237018  2676 raft_consensus.cc:2243] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.237516  2676 raft_consensus.cc:2272] T bae16b03f04a4bebbd56142c1316dd5a P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.239612  2676 tablet_replica.cc:333] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.240195  2676 raft_consensus.cc:2243] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.240688  2676 raft_consensus.cc:2272] T 00ca9668e73544c98b8f8dc4eb174a07 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.242959  2676 tablet_replica.cc:333] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.243510  2676 raft_consensus.cc:2243] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.244036  2676 raft_consensus.cc:2272] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.246323  2676 tablet_replica.cc:333] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.246870  2676 raft_consensus.cc:2243] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.247309  2676 raft_consensus.cc:2272] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.249547  2676 tablet_replica.cc:333] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.250182  2676 raft_consensus.cc:2243] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.251065  2676 raft_consensus.cc:2272] T 8b9fae32bad549e5b2ba9094d725f982 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.253338  2676 tablet_replica.cc:333] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.253861  2676 raft_consensus.cc:2243] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.254724  2676 raft_consensus.cc:2272] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.256943  2676 tablet_replica.cc:333] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.257476  2676 raft_consensus.cc:2243] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.258121  2676 raft_consensus.cc:2272] T 21d3e09fcc3143b5bf9532b750516a55 P 12eb002a429b45fc9cd05bca9d8df352 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.260262  2676 tablet_replica.cc:333] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.260788  2676 raft_consensus.cc:2243] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.261308  2676 raft_consensus.cc:2272] T 1b744dfc98d74b50a950f09260fade67 P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.263422  2676 tablet_replica.cc:333] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.263939  2676 raft_consensus.cc:2243] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.264380  2676 raft_consensus.cc:2272] T 589af6ee0f434f1e9b3184f67b3484ba P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.266727  2676 tablet_replica.cc:333] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.267279  2676 raft_consensus.cc:2243] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.268137  2676 raft_consensus.cc:2272] T 14f6ac9e3f194e0c85859fa49d469e13 P 12eb002a429b45fc9cd05bca9d8df352 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.270375  2676 tablet_replica.cc:333] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.270931  2676 raft_consensus.cc:2243] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.271440  2676 raft_consensus.cc:2272] T e0e921d4c39a4059a15b306e40ef8e94 P 12eb002a429b45fc9cd05bca9d8df352 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.273520  2676 tablet_replica.cc:333] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.274039  2676 raft_consensus.cc:2243] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.274883  2676 raft_consensus.cc:2272] T 94014e4a699c48a3a35d822b9e48c9dc P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.277165  2676 tablet_replica.cc:333] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.277724  2676 raft_consensus.cc:2243] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.278249  2676 raft_consensus.cc:2272] T 30075c5fe45e48859d5690240429f0d0 P 12eb002a429b45fc9cd05bca9d8df352 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.280483  2676 tablet_replica.cc:333] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352: stopping tablet replica
I20260709 12:31:34.280959  2676 raft_consensus.cc:2243] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.281816  2676 raft_consensus.cc:2272] T cde76a03b1e2433097b8c6986c632a1e P 12eb002a429b45fc9cd05bca9d8df352 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:34.294842 13375 consensus_peers.cc:597] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 -> Peer 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897): Couldn't send request to peer 12eb002a429b45fc9cd05bca9d8df352. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:31:34.307222 13375 consensus_peers.cc:597] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 -> Peer 12eb002a429b45fc9cd05bca9d8df352 (127.2.157.2:34897): Couldn't send request to peer 12eb002a429b45fc9cd05bca9d8df352. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:34.326673  2676 tablet_server.cc:196] TabletServer@127.2.157.2:0 shutdown complete.
I20260709 12:31:34.367543  2676 tablet_server.cc:179] TabletServer@127.2.157.3:0 shutting down...
W20260709 12:31:34.392881 13375 consensus_peers.cc:597] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 -> Peer e6313f19634e486587e6214dd291eabc (127.2.157.1:36049): Couldn't send request to peer e6313f19634e486587e6214dd291eabc. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:36049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:34.406024  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:34.406859  2676 tablet_replica.cc:333] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.407727  2676 raft_consensus.cc:2243] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.408675  2676 raft_consensus.cc:2272] T f1d8644c769c4da3b3846266b02d73dc P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.411056  2676 tablet_replica.cc:333] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.411718  2676 raft_consensus.cc:2243] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.412278  2676 raft_consensus.cc:2272] T 4dd83de38cac4f0ebf35952fccabb802 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.414516  2676 tablet_replica.cc:333] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.415098  2676 raft_consensus.cc:2243] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.415606  2676 raft_consensus.cc:2272] T 860fe77584ef4607ad2b2e6d77540739 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.417711  2676 tablet_replica.cc:333] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.418335  2676 raft_consensus.cc:2243] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.418865  2676 raft_consensus.cc:2272] T 2ca39338cbaf40e8adbfd40861fd67ca P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.420977  2676 tablet_replica.cc:333] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.421650  2676 raft_consensus.cc:2243] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.422263  2676 raft_consensus.cc:2272] T bae16b03f04a4bebbd56142c1316dd5a P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.424381  2676 tablet_replica.cc:333] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.424963  2676 raft_consensus.cc:2243] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.425460  2676 raft_consensus.cc:2272] T cde76a03b1e2433097b8c6986c632a1e P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.427912  2676 tablet_replica.cc:333] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.428526  2676 raft_consensus.cc:2243] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.429631  2676 raft_consensus.cc:2272] T 5d8e777e5bb74c5086ea1699d4ec9b2c P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.432456  2676 tablet_replica.cc:333] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.433099  2676 raft_consensus.cc:2243] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.434034  2676 raft_consensus.cc:2272] T 6f54ec1a531c467b8cad6c29a3f6dcfd P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.436198  2676 tablet_replica.cc:333] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.436749  2676 raft_consensus.cc:2243] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.437242  2676 raft_consensus.cc:2272] T 8b9fae32bad549e5b2ba9094d725f982 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.439394  2676 tablet_replica.cc:333] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.439929  2676 raft_consensus.cc:2243] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.440419  2676 raft_consensus.cc:2272] T 3e94831c3e21419ebd5c9b5e817a4ce8 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.442471  2676 tablet_replica.cc:333] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.442994  2676 raft_consensus.cc:2243] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.443813  2676 raft_consensus.cc:2272] T 21d3e09fcc3143b5bf9532b750516a55 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.446012  2676 tablet_replica.cc:333] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.446585  2676 raft_consensus.cc:2243] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.447055  2676 raft_consensus.cc:2272] T 1b744dfc98d74b50a950f09260fade67 P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.449185  2676 tablet_replica.cc:333] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.449730  2676 raft_consensus.cc:2243] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.450263  2676 raft_consensus.cc:2272] T 589af6ee0f434f1e9b3184f67b3484ba P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.452630  2676 tablet_replica.cc:333] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.453146  2676 raft_consensus.cc:2243] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.453603  2676 raft_consensus.cc:2272] T 00ca9668e73544c98b8f8dc4eb174a07 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.455792  2676 tablet_replica.cc:333] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.456303  2676 raft_consensus.cc:2243] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.457227  2676 raft_consensus.cc:2272] T e0e921d4c39a4059a15b306e40ef8e94 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.459466  2676 tablet_replica.cc:333] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.459968  2676 raft_consensus.cc:2243] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.460456  2676 raft_consensus.cc:2272] T 94014e4a699c48a3a35d822b9e48c9dc P 68ace02ab1b543de9544c9657a1fecb9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.462608  2676 tablet_replica.cc:333] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.463089  2676 raft_consensus.cc:2243] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.463986  2676 raft_consensus.cc:2272] T 30075c5fe45e48859d5690240429f0d0 P 68ace02ab1b543de9544c9657a1fecb9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.466396  2676 tablet_replica.cc:333] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9: stopping tablet replica
I20260709 12:31:34.466929  2676 raft_consensus.cc:2243] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:34.467409  2676 raft_consensus.cc:2272] T 14f6ac9e3f194e0c85859fa49d469e13 P 68ace02ab1b543de9544c9657a1fecb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.511724  2676 tablet_server.cc:196] TabletServer@127.2.157.3:0 shutdown complete.
I20260709 12:31:34.552569  2676 master.cc:562] Master@127.2.157.62:43177 shutting down...
I20260709 12:31:34.578696  2676 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:34.579317  2676 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:34.579666  2676 tablet_replica.cc:333] T 00000000000000000000000000000000 P b913d0ad430f43d98633bf3ee561e83f: stopping tablet replica
I20260709 12:31:34.600339  2676 master.cc:584] Master@127.2.157.62:43177 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20533 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:31:34.660910  2676 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.157.62:42309
I20260709 12:31:34.662158  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:34.668566 13748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:34.668624 13749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:34.668995 13751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:34.670329  2676 server_base.cc:1061] running on GCE node
I20260709 12:31:34.671422  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:34.671660  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:34.671851  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600294671833 us; error 0 us; skew 500 ppm
I20260709 12:31:34.672420  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:34.675024  2676 webserver.cc:533] Webserver started at http://127.2.157.62:38985/ using document root <none> and password file <none>
I20260709 12:31:34.675530  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:34.675735  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:34.676007  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:34.677253  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/master-0-root/instance:
uuid: "2f5622bd8b494d8e9f8838b6f59b077e"
format_stamp: "Formatted at 2026-07-09 12:31:34 on dist-test-slave-0768"
I20260709 12:31:34.681998  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:31:34.685436 13756 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:34.686406  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:31:34.686661  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/master-0-root
uuid: "2f5622bd8b494d8e9f8838b6f59b077e"
format_stamp: "Formatted at 2026-07-09 12:31:34 on dist-test-slave-0768"
I20260709 12:31:34.686893  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:34.716624  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:34.717821  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:34.757112  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.62:42309
I20260709 12:31:34.757373 13807 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.62:42309 every 8 connection(s)
I20260709 12:31:34.761471 13808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:34.773270 13808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e: Bootstrap starting.
I20260709 12:31:34.778568 13808 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:34.783318 13808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e: No bootstrap required, opened a new log
I20260709 12:31:34.785974 13808 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5622bd8b494d8e9f8838b6f59b077e" member_type: VOTER }
I20260709 12:31:34.786484 13808 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:34.786733 13808 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f5622bd8b494d8e9f8838b6f59b077e, State: Initialized, Role: FOLLOWER
I20260709 12:31:34.787439 13808 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5622bd8b494d8e9f8838b6f59b077e" member_type: VOTER }
I20260709 12:31:34.787993 13808 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:31:34.788231 13808 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:31:34.788544 13808 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:34.793692 13808 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5622bd8b494d8e9f8838b6f59b077e" member_type: VOTER }
I20260709 12:31:34.794365 13808 leader_election.cc:304] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f5622bd8b494d8e9f8838b6f59b077e; no voters: 
I20260709 12:31:34.795619 13808 leader_election.cc:290] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:31:34.796026 13811 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:34.797533 13811 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [term 1 LEADER]: Becoming Leader. State: Replica: 2f5622bd8b494d8e9f8838b6f59b077e, State: Running, Role: LEADER
I20260709 12:31:34.798274 13811 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5622bd8b494d8e9f8838b6f59b077e" member_type: VOTER }
I20260709 12:31:34.798861 13808 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:31:34.803670 13812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f5622bd8b494d8e9f8838b6f59b077e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5622bd8b494d8e9f8838b6f59b077e" member_type: VOTER } }
I20260709 12:31:34.804551 13812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [sys.catalog]: This master's current role is: LEADER
I20260709 12:31:34.806481 13813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f5622bd8b494d8e9f8838b6f59b077e. Latest consensus state: current_term: 1 leader_uuid: "2f5622bd8b494d8e9f8838b6f59b077e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5622bd8b494d8e9f8838b6f59b077e" member_type: VOTER } }
I20260709 12:31:34.806881 13819 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:31:34.807303 13813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [sys.catalog]: This master's current role is: LEADER
I20260709 12:31:34.812682 13819 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:31:34.817018  2676 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:31:34.823575 13819 catalog_manager.cc:1383] Generated new cluster ID: 9dc4631b5ff94ea094e76dd3087b6e4f
I20260709 12:31:34.823882 13819 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:31:34.845093 13819 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:31:34.846405 13819 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:31:34.859582 13819 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e: Generated new TSK 0
I20260709 12:31:34.860203 13819 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:31:34.884640  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:34.891350 13829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:34.893524 13830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:34.894305 13832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:34.894680  2676 server_base.cc:1061] running on GCE node
I20260709 12:31:34.895790  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:34.895999  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:34.896144  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600294896132 us; error 0 us; skew 500 ppm
I20260709 12:31:34.896642  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:34.899098  2676 webserver.cc:533] Webserver started at http://127.2.157.1:43215/ using document root <none> and password file <none>
I20260709 12:31:34.899560  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:34.899729  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:34.899953  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:34.901364  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-0-root/instance:
uuid: "0ed90780da7b4996a1250b953d170468"
format_stamp: "Formatted at 2026-07-09 12:31:34 on dist-test-slave-0768"
I20260709 12:31:34.906391  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:31:34.910064 13837 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:34.910868  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:31:34.911219  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-0-root
uuid: "0ed90780da7b4996a1250b953d170468"
format_stamp: "Formatted at 2026-07-09 12:31:34 on dist-test-slave-0768"
I20260709 12:31:34.911553  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:34.930538  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:34.931866  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:34.933512  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:31:34.936367  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:31:34.936607  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:34.936863  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:31:34.937089  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:34.984987  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.1:39287
I20260709 12:31:34.985085 13899 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.1:39287 every 8 connection(s)
I20260709 12:31:34.990723  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:34.998497 13904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:34.999207 13905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:35.002382  2676 server_base.cc:1061] running on GCE node
W20260709 12:31:35.003281 13908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:35.004395  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:35.004638  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:35.004823  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600295004789 us; error 0 us; skew 500 ppm
I20260709 12:31:35.005558  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:35.007884 13900 heartbeater.cc:344] Connected to a master server at 127.2.157.62:42309
I20260709 12:31:35.008262 13900 heartbeater.cc:461] Registering TS with master...
I20260709 12:31:35.008561  2676 webserver.cc:533] Webserver started at http://127.2.157.2:45885/ using document root <none> and password file <none>
I20260709 12:31:35.009063 13900 heartbeater.cc:507] Master 127.2.157.62:42309 requested a full tablet report, sending...
I20260709 12:31:35.009155  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:35.009541  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:35.009840  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:35.011193  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-1-root/instance:
uuid: "85c975ef2dcf437e915b054ae37788d4"
format_stamp: "Formatted at 2026-07-09 12:31:35 on dist-test-slave-0768"
I20260709 12:31:35.011633 13773 ts_manager.cc:194] Registered new tserver with Master: 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287)
I20260709 12:31:35.013669 13773 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50786
I20260709 12:31:35.016383  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:31:35.020073 13912 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:35.020901  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:31:35.021225  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-1-root
uuid: "85c975ef2dcf437e915b054ae37788d4"
format_stamp: "Formatted at 2026-07-09 12:31:35 on dist-test-slave-0768"
I20260709 12:31:35.021481  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:35.046598  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:35.047819  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:35.049316  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:31:35.051599  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:31:35.051770  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:35.052044  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:31:35.052181  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:35.092525  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.2:34327
I20260709 12:31:35.092706 13974 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.2:34327 every 8 connection(s)
I20260709 12:31:35.097590  2676 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:35.106325 13979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:35.107717 13978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:35.111789 13975 heartbeater.cc:344] Connected to a master server at 127.2.157.62:42309
I20260709 12:31:35.112273 13975 heartbeater.cc:461] Registering TS with master...
W20260709 12:31:35.112809 13981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:35.113263 13975 heartbeater.cc:507] Master 127.2.157.62:42309 requested a full tablet report, sending...
I20260709 12:31:35.114990  2676 server_base.cc:1061] running on GCE node
I20260709 12:31:35.115833 13773 ts_manager.cc:194] Registered new tserver with Master: 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:35.115950  2676 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:35.116355  2676 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:35.116531  2676 hybrid_clock.cc:648] HybridClock initialized: now 1783600295116495 us; error 0 us; skew 500 ppm
I20260709 12:31:35.117149  2676 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:35.117552 13773 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50790
I20260709 12:31:35.120167  2676 webserver.cc:533] Webserver started at http://127.2.157.3:37593/ using document root <none> and password file <none>
I20260709 12:31:35.120818  2676 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:35.121009  2676 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:35.121300  2676 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:35.122534  2676 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-2-root/instance:
uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
format_stamp: "Formatted at 2026-07-09 12:31:35 on dist-test-slave-0768"
I20260709 12:31:35.127140  2676 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:31:35.130538 13986 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:35.131429  2676 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:31:35.131767  2676 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-2-root
uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
format_stamp: "Formatted at 2026-07-09 12:31:35 on dist-test-slave-0768"
I20260709 12:31:35.132058  2676 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:35.143513  2676 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:35.144698  2676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:35.146170  2676 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:31:35.148329  2676 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:31:35.148571  2676 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:35.148808  2676 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:31:35.148985  2676 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:35.188711  2676 rpc_server.cc:307] RPC server started. Bound to: 127.2.157.3:38003
I20260709 12:31:35.188809 14048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.157.3:38003 every 8 connection(s)
I20260709 12:31:35.203167 14049 heartbeater.cc:344] Connected to a master server at 127.2.157.62:42309
I20260709 12:31:35.203631 14049 heartbeater.cc:461] Registering TS with master...
I20260709 12:31:35.204564 14049 heartbeater.cc:507] Master 127.2.157.62:42309 requested a full tablet report, sending...
I20260709 12:31:35.206632 13773 ts_manager.cc:194] Registered new tserver with Master: ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:35.206779  2676 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014816724s
I20260709 12:31:35.208154 13773 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50794
I20260709 12:31:35.233029 13773 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50806:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:31:35.235948 13773 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:31:35.319712 13940 tablet_service.cc:1511] Processing CreateTablet for tablet 210b05f6d0bd4fb6bae9f5ae09ec4ea1 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:35.321219 13940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 210b05f6d0bd4fb6bae9f5ae09ec4ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.323030 14014 tablet_service.cc:1511] Processing CreateTablet for tablet 210b05f6d0bd4fb6bae9f5ae09ec4ea1 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:35.324561 14014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 210b05f6d0bd4fb6bae9f5ae09ec4ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.328539 14011 tablet_service.cc:1511] Processing CreateTablet for tablet 341b167d476f4e3287bcf5131f86a201 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:35.330175 14011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341b167d476f4e3287bcf5131f86a201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.331110 14009 tablet_service.cc:1511] Processing CreateTablet for tablet 62790f7879ea41aea075792ee44812f9 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:35.332603 14009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62790f7879ea41aea075792ee44812f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.334437 14012 tablet_service.cc:1511] Processing CreateTablet for tablet f7cf75a7a6b24af4a2024bd1d286ca31 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:35.334982 14008 tablet_service.cc:1511] Processing CreateTablet for tablet 76e1aba068f04178b14344347c5dfb76 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:35.335902 14012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cf75a7a6b24af4a2024bd1d286ca31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.337472 14013 tablet_service.cc:1511] Processing CreateTablet for tablet d3131b2fc314427ba539da38cde592ea (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:35.338804 13860 tablet_service.cc:1511] Processing CreateTablet for tablet 62790f7879ea41aea075792ee44812f9 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:35.339079 13938 tablet_service.cc:1511] Processing CreateTablet for tablet f7cf75a7a6b24af4a2024bd1d286ca31 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:35.340214 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62790f7879ea41aea075792ee44812f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.340533 13938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cf75a7a6b24af4a2024bd1d286ca31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.342087 13858 tablet_service.cc:1511] Processing CreateTablet for tablet 8c18b0d870cc438494c105baec4e94c7 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:35.342936 13861 tablet_service.cc:1511] Processing CreateTablet for tablet 1658e4cbe8044907b3d5647dcd259b67 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:35.343461 13858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c18b0d870cc438494c105baec4e94c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.344309 13861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1658e4cbe8044907b3d5647dcd259b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.340126 13857 tablet_service.cc:1511] Processing CreateTablet for tablet da0b8f59e5b8449888f11eb6bcbdee34 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:35.345660 13859 tablet_service.cc:1511] Processing CreateTablet for tablet 76e1aba068f04178b14344347c5dfb76 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:35.346659 13857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da0b8f59e5b8449888f11eb6bcbdee34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.347045 13862 tablet_service.cc:1511] Processing CreateTablet for tablet 341b167d476f4e3287bcf5131f86a201 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:35.347940 13932 tablet_service.cc:1511] Processing CreateTablet for tablet da0b8f59e5b8449888f11eb6bcbdee34 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:35.349334 13932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da0b8f59e5b8449888f11eb6bcbdee34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.349721 13863 tablet_service.cc:1511] Processing CreateTablet for tablet f7cf75a7a6b24af4a2024bd1d286ca31 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:35.351091 13933 tablet_service.cc:1511] Processing CreateTablet for tablet 8c18b0d870cc438494c105baec4e94c7 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:35.352402 13933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c18b0d870cc438494c105baec4e94c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.334455 13865 tablet_service.cc:1511] Processing CreateTablet for tablet 210b05f6d0bd4fb6bae9f5ae09ec4ea1 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:35.355057 13934 tablet_service.cc:1511] Processing CreateTablet for tablet 76e1aba068f04178b14344347c5dfb76 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:35.356411 13934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76e1aba068f04178b14344347c5dfb76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.359136 13935 tablet_service.cc:1511] Processing CreateTablet for tablet 62790f7879ea41aea075792ee44812f9 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:35.360594 13935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62790f7879ea41aea075792ee44812f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.363127 13936 tablet_service.cc:1511] Processing CreateTablet for tablet 1658e4cbe8044907b3d5647dcd259b67 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:35.365388 13937 tablet_service.cc:1511] Processing CreateTablet for tablet 341b167d476f4e3287bcf5131f86a201 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:35.366735 14010 tablet_service.cc:1511] Processing CreateTablet for tablet 1658e4cbe8044907b3d5647dcd259b67 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:35.352393 13864 tablet_service.cc:1511] Processing CreateTablet for tablet d3131b2fc314427ba539da38cde592ea (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:35.337316 13939 tablet_service.cc:1511] Processing CreateTablet for tablet d3131b2fc314427ba539da38cde592ea (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:35.338868 14013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3131b2fc314427ba539da38cde592ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.348342 13862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341b167d476f4e3287bcf5131f86a201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.371656 13865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 210b05f6d0bd4fb6bae9f5ae09ec4ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.372639 13859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76e1aba068f04178b14344347c5dfb76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.370790 14008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76e1aba068f04178b14344347c5dfb76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.373576 13863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cf75a7a6b24af4a2024bd1d286ca31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.375105 14010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1658e4cbe8044907b3d5647dcd259b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.376485 13864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3131b2fc314427ba539da38cde592ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.379014 14007 tablet_service.cc:1511] Processing CreateTablet for tablet 8c18b0d870cc438494c105baec4e94c7 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:35.380649 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c18b0d870cc438494c105baec4e94c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.381636 13937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341b167d476f4e3287bcf5131f86a201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.382783 14006 tablet_service.cc:1511] Processing CreateTablet for tablet da0b8f59e5b8449888f11eb6bcbdee34 (DEFAULT_TABLE table=test-workload [id=2ec05b4d45e7498182479b48dca81017]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:35.384449 14006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da0b8f59e5b8449888f11eb6bcbdee34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.382886 13936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1658e4cbe8044907b3d5647dcd259b67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.386279 13939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3131b2fc314427ba539da38cde592ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:35.485697 14064 tablet_bootstrap.cc:492] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:35.501581 14065 tablet_bootstrap.cc:492] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:35.524758 14066 tablet_bootstrap.cc:492] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:35.534821 14064 tablet_bootstrap.cc:654] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.544461 14066 tablet_bootstrap.cc:654] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.549625 14065 tablet_bootstrap.cc:654] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.609141 14066 tablet_bootstrap.cc:492] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:35.611253 14065 tablet_bootstrap.cc:492] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:35.611907 14064 tablet_bootstrap.cc:492] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:35.614266 14066 ts_tablet_manager.cc:1403] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.014s
I20260709 12:31:35.614359 14065 ts_tablet_manager.cc:1403] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.113s	user 0.020s	sys 0.044s
I20260709 12:31:35.614462 14064 ts_tablet_manager.cc:1403] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.129s	user 0.005s	sys 0.026s
I20260709 12:31:35.617484 14065 raft_consensus.cc:359] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.618216 14065 raft_consensus.cc:385] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.618484 14065 raft_consensus.cc:740] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.618508 14066 raft_consensus.cc:359] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.619334 14066 raft_consensus.cc:385] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.619211 14065 consensus_queue.cc:260] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.619736 14066 raft_consensus.cc:740] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.619839 14064 raft_consensus.cc:359] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:35.620599 14064 raft_consensus.cc:385] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.621119 14064 raft_consensus.cc:740] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.620565 14066 consensus_queue.cc:260] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.621901 14064 consensus_queue.cc:260] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:35.624068 14049 heartbeater.cc:499] Master 127.2.157.62:42309 was elected leader, sending a full tablet report...
I20260709 12:31:35.624400 14066 ts_tablet_manager.cc:1434] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.006s
I20260709 12:31:35.625452 14066 tablet_bootstrap.cc:492] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:35.630214 13900 heartbeater.cc:499] Master 127.2.157.62:42309 was elected leader, sending a full tablet report...
I20260709 12:31:35.630710 14065 ts_tablet_manager.cc:1434] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.007s
I20260709 12:31:35.632262 14065 tablet_bootstrap.cc:492] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:35.638254 14064 ts_tablet_manager.cc:1434] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.010s
I20260709 12:31:35.639196 13975 heartbeater.cc:499] Master 127.2.157.62:42309 was elected leader, sending a full tablet report...
I20260709 12:31:35.640156 14065 tablet_bootstrap.cc:654] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.641921 14066 tablet_bootstrap.cc:654] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.645257 14064 tablet_bootstrap.cc:492] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:35.653996 14066 tablet_bootstrap.cc:492] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:35.654644 14066 ts_tablet_manager.cc:1403] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.004s
I20260709 12:31:35.655535 14064 tablet_bootstrap.cc:654] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.657696 14066 raft_consensus.cc:359] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:35.659770 14066 raft_consensus.cc:385] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.660090 14066 raft_consensus.cc:740] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.661012 14066 consensus_queue.cc:260] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:35.663491 14066 ts_tablet_manager.cc:1434] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:31:35.664567 14066 tablet_bootstrap.cc:492] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:35.665036 14065 tablet_bootstrap.cc:492] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:35.665802 14065 ts_tablet_manager.cc:1403] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.008s
I20260709 12:31:35.670224 14065 raft_consensus.cc:359] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.670888 14065 raft_consensus.cc:385] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.671213 14065 raft_consensus.cc:740] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.672081 14065 consensus_queue.cc:260] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.672638 14066 tablet_bootstrap.cc:654] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.672744 14064 tablet_bootstrap.cc:492] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:35.673569 14064 ts_tablet_manager.cc:1403] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.012s
I20260709 12:31:35.674733 14065 ts_tablet_manager.cc:1434] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:31:35.675843 14065 tablet_bootstrap.cc:492] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:35.676741 14064 raft_consensus.cc:359] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.677531 14064 raft_consensus.cc:385] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.677820 14064 raft_consensus.cc:740] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.678638 14064 consensus_queue.cc:260] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.681192 14064 ts_tablet_manager.cc:1434] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:31:35.682229 14064 tablet_bootstrap.cc:492] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:35.685458 14065 tablet_bootstrap.cc:654] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.688830 14064 tablet_bootstrap.cc:654] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.707773 14070 raft_consensus.cc:493] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:35.708642 14070 raft_consensus.cc:515] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.719080 14070 leader_election.cc:290] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:35.726920 14065 tablet_bootstrap.cc:492] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:35.726963 14064 tablet_bootstrap.cc:492] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:35.727751 14064 ts_tablet_manager.cc:1403] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.024s
I20260709 12:31:35.727751 14065 ts_tablet_manager.cc:1403] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.052s	user 0.024s	sys 0.009s
I20260709 12:31:35.727777 14066 tablet_bootstrap.cc:492] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:35.728933 14066 ts_tablet_manager.cc:1403] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.065s	user 0.035s	sys 0.018s
I20260709 12:31:35.730995 14065 raft_consensus.cc:359] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:35.731192 14064 raft_consensus.cc:359] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.731863 14065 raft_consensus.cc:385] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.731909 14064 raft_consensus.cc:385] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.732260 14065 raft_consensus.cc:740] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.732306 14064 raft_consensus.cc:740] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.733152 14065 consensus_queue.cc:260] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:35.734386 14071 raft_consensus.cc:493] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:35.734884 14071 raft_consensus.cc:515] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:35.735558 14065 ts_tablet_manager.cc:1434] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:31:35.736667 14065 tablet_bootstrap.cc:492] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:35.737653 14071 leader_election.cc:290] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287)
I20260709 12:31:35.740478 14072 raft_consensus.cc:493] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:35.741068 14072 raft_consensus.cc:515] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.746003 14065 tablet_bootstrap.cc:654] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.738216 14066 raft_consensus.cc:359] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.747151 14066 raft_consensus.cc:385] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.747555 14066 raft_consensus.cc:740] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.751114 14066 consensus_queue.cc:260] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.755384 14072 leader_election.cc:290] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:35.760207 14066 ts_tablet_manager.cc:1434] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.003s
I20260709 12:31:35.764825 14066 tablet_bootstrap.cc:492] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:35.767030 13950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cf75a7a6b24af4a2024bd1d286ca31" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:35.772348 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cf75a7a6b24af4a2024bd1d286ca31" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
I20260709 12:31:35.733458 14064 consensus_queue.cc:260] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.773773 13950 raft_consensus.cc:2468] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 0.
W20260709 12:31:35.774281 13841 leader_election.cc:343] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:35.779258 13838 leader_election.cc:304] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:35.780263 14070 raft_consensus.cc:2804] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:35.780651 14070 raft_consensus.cc:493] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:35.780948 14070 raft_consensus.cc:3060] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:35.782294 14066 tablet_bootstrap.cc:654] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.785743 14064 ts_tablet_manager.cc:1434] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.058s	user 0.002s	sys 0.004s
I20260709 12:31:35.786917 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e1aba068f04178b14344347c5dfb76" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
W20260709 12:31:35.789459 13913 leader_election.cc:343] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:35.780659 14065 tablet_bootstrap.cc:492] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:35.786965 14064 tablet_bootstrap.cc:492] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:35.790568 14065 ts_tablet_manager.cc:1403] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.008s
I20260709 12:31:35.794036 14065 raft_consensus.cc:359] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.800156 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210b05f6d0bd4fb6bae9f5ae09ec4ea1" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:35.800431 14065 raft_consensus.cc:385] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.800954 13875 raft_consensus.cc:2468] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 0.
I20260709 12:31:35.803680 14065 raft_consensus.cc:740] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.803761 13950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210b05f6d0bd4fb6bae9f5ae09ec4ea1" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:35.795301 14070 raft_consensus.cc:515] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.804514 13950 raft_consensus.cc:2468] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 0.
I20260709 12:31:35.804710 13987 leader_election.cc:304] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:35.805739 14071 raft_consensus.cc:2804] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:35.806137 14071 raft_consensus.cc:493] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:35.806478 14071 raft_consensus.cc:3060] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:35.806938 14070 leader_election.cc:290] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 election: Requested vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:35.808199 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cf75a7a6b24af4a2024bd1d286ca31" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:35.809530 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e1aba068f04178b14344347c5dfb76" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
W20260709 12:31:35.809666 13841 leader_election.cc:343] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:35.809932 14065 consensus_queue.cc:260] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.810684 13950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cf75a7a6b24af4a2024bd1d286ca31" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
W20260709 12:31:35.810848 13916 leader_election.cc:343] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:35.811419 13916 leader_election.cc:304] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85c975ef2dcf437e915b054ae37788d4; no voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:35.812260 14072 raft_consensus.cc:2749] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:31:35.812456 13821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:31:35.802644 14066 tablet_bootstrap.cc:492] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:35.803292 14064 tablet_bootstrap.cc:654] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.811415 13950 raft_consensus.cc:3060] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:35.813267 14066 ts_tablet_manager.cc:1403] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.004s
I20260709 12:31:35.815086 14065 ts_tablet_manager.cc:1434] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:31:35.816215 14065 tablet_bootstrap.cc:492] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:35.816617 14066 raft_consensus.cc:359] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.817098 14070 raft_consensus.cc:493] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:35.817364 14066 raft_consensus.cc:385] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.817706 14066 raft_consensus.cc:740] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.817579 14070 raft_consensus.cc:515] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.818697 14066 consensus_queue.cc:260] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.821193 13950 raft_consensus.cc:2468] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 1.
I20260709 12:31:35.821812 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3131b2fc314427ba539da38cde592ea" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:35.822429 13838 leader_election.cc:304] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:35.824600 14070 leader_election.cc:290] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
W20260709 12:31:35.824721 13838 leader_election.cc:343] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:35.824831 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3131b2fc314427ba539da38cde592ea" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
I20260709 12:31:35.825624 14024 raft_consensus.cc:2468] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 0.
I20260709 12:31:35.826931 13841 leader_election.cc:304] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:35.827792 14070 raft_consensus.cc:2804] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:35.828230 14070 raft_consensus.cc:493] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:35.828613 14070 raft_consensus.cc:3060] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:35.824429 14091 raft_consensus.cc:2804] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:35.830837 14071 raft_consensus.cc:515] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:35.834946 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210b05f6d0bd4fb6bae9f5ae09ec4ea1" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:35.835780 13949 raft_consensus.cc:3060] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:35.836191 14066 ts_tablet_manager.cc:1434] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.007s
I20260709 12:31:35.839195 14065 tablet_bootstrap.cc:654] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.844810 13949 raft_consensus.cc:2468] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 1.
I20260709 12:31:35.840196 14066 tablet_bootstrap.cc:492] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:35.846110 13987 leader_election.cc:304] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c975ef2dcf437e915b054ae37788d4, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:35.848692 14090 raft_consensus.cc:2804] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:35.853732 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210b05f6d0bd4fb6bae9f5ae09ec4ea1" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:35.842239 14070 raft_consensus.cc:515] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.854740 13875 raft_consensus.cc:3060] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:35.858554 14070 leader_election.cc:290] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 election: Requested vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:35.859613 14066 tablet_bootstrap.cc:654] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.860378 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3131b2fc314427ba539da38cde592ea" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:35.861147 14024 raft_consensus.cc:3060] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:35.864622 14071 leader_election.cc:290] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 election: Requested vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287)
I20260709 12:31:35.866849 14065 tablet_bootstrap.cc:492] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:35.867501 14065 ts_tablet_manager.cc:1403] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.002s
I20260709 12:31:35.868939 13875 raft_consensus.cc:2468] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 1.
I20260709 12:31:35.870362 13950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3131b2fc314427ba539da38cde592ea" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:35.870858 14065 raft_consensus.cc:359] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.871780 14065 raft_consensus.cc:385] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.872131 14065 raft_consensus.cc:740] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
W20260709 12:31:35.872330 13838 leader_election.cc:343] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:35.872763 14024 raft_consensus.cc:2468] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 1.
I20260709 12:31:35.873066 14065 consensus_queue.cc:260] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.874250 13841 leader_election.cc:304] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:35.875717 14070 raft_consensus.cc:2804] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:35.874078 14091 raft_consensus.cc:697] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Becoming Leader. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:35.876209 14070 raft_consensus.cc:697] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Becoming Leader. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:35.876660 14090 raft_consensus.cc:697] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Becoming Leader. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:35.878065 14065 ts_tablet_manager.cc:1434] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:31:35.878460 14093 raft_consensus.cc:493] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:35.878512 14070 consensus_queue.cc:237] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.876777 14091 consensus_queue.cc:237] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.878307 14090 consensus_queue.cc:237] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:35.880975 14064 tablet_bootstrap.cc:492] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:35.881407 14065 tablet_bootstrap.cc:492] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:35.879201 14093 raft_consensus.cc:515] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.884382 14093 leader_election.cc:290] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:35.881521 14064 ts_tablet_manager.cc:1403] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.095s	user 0.031s	sys 0.017s
I20260709 12:31:35.886044 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1658e4cbe8044907b3d5647dcd259b67" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
W20260709 12:31:35.887490 13987 leader_election.cc:343] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:35.887980 14064 raft_consensus.cc:359] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.888598 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1658e4cbe8044907b3d5647dcd259b67" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:35.889147 14064 raft_consensus.cc:385] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.889483 14064 raft_consensus.cc:740] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
W20260709 12:31:35.890230 13987 leader_election.cc:343] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:35.890764 13987 leader_election.cc:304] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3facf0f98e4c44b1ad6312505ce23a; no voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:35.890434 14064 consensus_queue.cc:260] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.891348 14066 tablet_bootstrap.cc:492] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:35.891640 14093 raft_consensus.cc:2749] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:35.892205 14066 ts_tablet_manager.cc:1403] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.005s
I20260709 12:31:35.900108 14066 raft_consensus.cc:359] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.901109 14066 raft_consensus.cc:385] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.901494 14066 raft_consensus.cc:740] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.902087 14065 tablet_bootstrap.cc:654] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.903429 14066 consensus_queue.cc:260] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.906708 13773 catalog_manager.cc:5697] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ed90780da7b4996a1250b953d170468 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "0ed90780da7b4996a1250b953d170468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:35.906821 13771 catalog_manager.cc:5697] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3). New cstate: current_term: 1 leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:35.908098 14066 ts_tablet_manager.cc:1434] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 12:31:35.909212 14066 tablet_bootstrap.cc:492] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:35.910784 14065 tablet_bootstrap.cc:492] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:35.911469 14065 ts_tablet_manager.cc:1403] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.003s
I20260709 12:31:35.913476 14064 ts_tablet_manager.cc:1434] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:31:35.914798 14065 raft_consensus.cc:359] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.915570 14065 raft_consensus.cc:385] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.915915 14066 tablet_bootstrap.cc:654] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.915884 14065 raft_consensus.cc:740] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.916925 14065 consensus_queue.cc:260] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.918748 14064 tablet_bootstrap.cc:492] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:35.919975 14065 ts_tablet_manager.cc:1434] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:31:35.921420 14065 tablet_bootstrap.cc:492] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:35.927089 14064 tablet_bootstrap.cc:654] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.930584 14065 tablet_bootstrap.cc:654] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.939821 14064 tablet_bootstrap.cc:492] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:35.939824 14066 tablet_bootstrap.cc:492] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:35.940446 14064 ts_tablet_manager.cc:1403] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.000s
I20260709 12:31:35.940593 14066 ts_tablet_manager.cc:1403] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.032s	user 0.024s	sys 0.006s
I20260709 12:31:35.943807 14064 raft_consensus.cc:359] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.944586 14064 raft_consensus.cc:385] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.944134 14066 raft_consensus.cc:359] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
W20260709 12:31:35.944736 14050 tablet.cc:2406] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:31:35.945093 14066 raft_consensus.cc:385] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.945657 14066 raft_consensus.cc:740] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.946826 14066 consensus_queue.cc:260] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.948717 14066 ts_tablet_manager.cc:1434] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:31:35.949791 14066 tablet_bootstrap.cc:492] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:35.950736 14065 tablet_bootstrap.cc:492] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:35.951498 14065 ts_tablet_manager.cc:1403] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.030s	user 0.027s	sys 0.002s
I20260709 12:31:35.955761 14065 raft_consensus.cc:359] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.956853 14066 tablet_bootstrap.cc:654] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.956794 14065 raft_consensus.cc:385] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.958129 14065 raft_consensus.cc:740] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.944931 14064 raft_consensus.cc:740] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.959127 14065 consensus_queue.cc:260] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.959653 14064 consensus_queue.cc:260] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.966614 14065 ts_tablet_manager.cc:1434] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:31:35.967718 14065 tablet_bootstrap.cc:492] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:35.969326 14091 raft_consensus.cc:493] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:35.969867 14091 raft_consensus.cc:515] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.970299 14064 ts_tablet_manager.cc:1434] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.005s
I20260709 12:31:35.971850 14064 tablet_bootstrap.cc:492] T d3131b2fc314427ba539da38cde592ea P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:35.972199 14091 leader_election.cc:290] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:35.972801 14072 raft_consensus.cc:493] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:35.973485 14072 raft_consensus.cc:515] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.974140 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0b8f59e5b8449888f11eb6bcbdee34" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:35.974452 14065 tablet_bootstrap.cc:654] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:35.976540 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0b8f59e5b8449888f11eb6bcbdee34" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
I20260709 12:31:35.977701 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62790f7879ea41aea075792ee44812f9" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
I20260709 12:31:35.979581 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62790f7879ea41aea075792ee44812f9" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
W20260709 12:31:35.979709 13916 leader_election.cc:343] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:35.980093 14066 tablet_bootstrap.cc:492] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:35.980274 13875 raft_consensus.cc:2468] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 0.
I20260709 12:31:35.980716 14066 ts_tablet_manager.cc:1403] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.031s	user 0.024s	sys 0.003s
I20260709 12:31:35.980594 14072 leader_election.cc:290] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
W20260709 12:31:35.981348 13838 leader_election.cc:343] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:31:35.982605 13841 leader_election.cc:343] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:35.983059 13841 leader_election.cc:304] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ed90780da7b4996a1250b953d170468; no voters: 85c975ef2dcf437e915b054ae37788d4, ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:35.984396 13913 leader_election.cc:304] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:35.985177 14091 raft_consensus.cc:2749] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:35.985323 14072 raft_consensus.cc:2804] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:35.985980 14072 raft_consensus.cc:493] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:35.986443 14072 raft_consensus.cc:3060] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:35.987794 13771 catalog_manager.cc:5697] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ed90780da7b4996a1250b953d170468 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "0ed90780da7b4996a1250b953d170468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:35.984179 14066 raft_consensus.cc:359] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.991586 14066 raft_consensus.cc:385] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:35.991906 14066 raft_consensus.cc:740] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:35.992811 14066 consensus_queue.cc:260] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:35.995303 14066 ts_tablet_manager.cc:1434] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:31:35.996344 14066 tablet_bootstrap.cc:492] T 62790f7879ea41aea075792ee44812f9 P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:36.002770 14065 tablet_bootstrap.cc:492] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:36.003418 14065 ts_tablet_manager.cc:1403] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.022s
I20260709 12:31:36.004266 14066 tablet_bootstrap.cc:654] T 62790f7879ea41aea075792ee44812f9 P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:36.006268 14065 raft_consensus.cc:359] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.007218 14065 raft_consensus.cc:385] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:36.007483 14065 raft_consensus.cc:740] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:36.008266 14065 consensus_queue.cc:260] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.009527 14072 raft_consensus.cc:515] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.010646 14065 ts_tablet_manager.cc:1434] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:31:36.011700 14065 tablet_bootstrap.cc:492] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:36.013998 14064 tablet_bootstrap.cc:654] T d3131b2fc314427ba539da38cde592ea P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:36.017597 14065 tablet_bootstrap.cc:654] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:36.020476 14072 leader_election.cc:290] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:36.022002 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62790f7879ea41aea075792ee44812f9" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
W20260709 12:31:36.024199 13916 leader_election.cc:343] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:36.026611 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62790f7879ea41aea075792ee44812f9" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:36.027556 13875 raft_consensus.cc:3060] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.029838 14065 tablet_bootstrap.cc:492] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:36.030586 14065 ts_tablet_manager.cc:1403] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 12:31:36.034729 14065 raft_consensus.cc:359] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.035666 14065 raft_consensus.cc:385] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:36.036006 14065 raft_consensus.cc:740] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:36.037261 14065 consensus_queue.cc:260] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.040725 14065 ts_tablet_manager.cc:1434] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:31:36.049273 13875 raft_consensus.cc:2468] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 1.
I20260709 12:31:36.052064 13913 leader_election.cc:304] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:36.052881 14064 tablet_bootstrap.cc:492] T d3131b2fc314427ba539da38cde592ea P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:36.053336 14072 raft_consensus.cc:2804] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:36.053520 14064 ts_tablet_manager.cc:1403] T d3131b2fc314427ba539da38cde592ea P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.028s
I20260709 12:31:36.054826 14066 tablet_bootstrap.cc:492] T 62790f7879ea41aea075792ee44812f9 P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:36.055374 14066 ts_tablet_manager.cc:1403] T 62790f7879ea41aea075792ee44812f9 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.059s	user 0.025s	sys 0.031s
I20260709 12:31:36.057083 14064 raft_consensus.cc:359] T d3131b2fc314427ba539da38cde592ea P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.057948 14064 raft_consensus.cc:385] T d3131b2fc314427ba539da38cde592ea P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:36.058297 14064 raft_consensus.cc:740] T d3131b2fc314427ba539da38cde592ea P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:36.058203 14066 raft_consensus.cc:359] T 62790f7879ea41aea075792ee44812f9 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.059057 14066 raft_consensus.cc:385] T 62790f7879ea41aea075792ee44812f9 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:36.059378 14066 raft_consensus.cc:740] T 62790f7879ea41aea075792ee44812f9 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:36.059378 14064 consensus_queue.cc:260] T d3131b2fc314427ba539da38cde592ea P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.060406 14066 consensus_queue.cc:260] T 62790f7879ea41aea075792ee44812f9 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.063213 14072 raft_consensus.cc:697] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Becoming Leader. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:36.064383 14072 consensus_queue.cc:237] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.064839 14066 ts_tablet_manager.cc:1434] T 62790f7879ea41aea075792ee44812f9 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:31:36.066275 14066 tablet_bootstrap.cc:492] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:36.074950 14066 tablet_bootstrap.cc:654] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:36.075392 14091 raft_consensus.cc:493] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:36.075965 14091 raft_consensus.cc:515] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.078140 14091 leader_election.cc:290] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:36.079830 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1658e4cbe8044907b3d5647dcd259b67" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:36.080907 14064 ts_tablet_manager.cc:1434] T d3131b2fc314427ba539da38cde592ea P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.027s	user 0.014s	sys 0.011s
W20260709 12:31:36.081794 13838 leader_election.cc:343] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:36.081923 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1658e4cbe8044907b3d5647dcd259b67" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
I20260709 12:31:36.082609 14023 raft_consensus.cc:2468] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 0.
I20260709 12:31:36.082535 14064 tablet_bootstrap.cc:492] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:36.084239 13841 leader_election.cc:304] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:36.085435 14091 raft_consensus.cc:2804] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:36.085840 14091 raft_consensus.cc:493] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:36.086282 14091 raft_consensus.cc:3060] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.088073 13772 catalog_manager.cc:5697] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "85c975ef2dcf437e915b054ae37788d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:36.094513 14064 tablet_bootstrap.cc:654] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:36.094424 14091 raft_consensus.cc:515] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.096343 14066 tablet_bootstrap.cc:492] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:36.096865 14066 ts_tablet_manager.cc:1403] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.011s
I20260709 12:31:36.097855 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1658e4cbe8044907b3d5647dcd259b67" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
W20260709 12:31:36.099380 13838 leader_election.cc:343] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:36.099617 14066 raft_consensus.cc:359] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.100359 14066 raft_consensus.cc:385] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:36.100664 14066 raft_consensus.cc:740] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:36.101367 14066 consensus_queue.cc:260] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.101814 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1658e4cbe8044907b3d5647dcd259b67" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:36.102432 14023 raft_consensus.cc:3060] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.103610 14066 ts_tablet_manager.cc:1434] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:31:36.110859 14091 leader_election.cc:290] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 election: Requested vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:36.112537 14023 raft_consensus.cc:2468] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 1.
I20260709 12:31:36.113579 14064 tablet_bootstrap.cc:492] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:36.113704 13841 leader_election.cc:304] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:36.114189 14064 ts_tablet_manager.cc:1403] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.032s	user 0.024s	sys 0.002s
I20260709 12:31:36.114742 14091 raft_consensus.cc:2804] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:36.116055 14091 raft_consensus.cc:697] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Becoming Leader. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:36.116978 14091 consensus_queue.cc:237] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.117509 14064 raft_consensus.cc:359] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.118378 14064 raft_consensus.cc:385] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:36.118697 14064 raft_consensus.cc:740] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:36.119439 14064 consensus_queue.cc:260] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.121987 14064 ts_tablet_manager.cc:1434] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:31:36.123056 14064 tablet_bootstrap.cc:492] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:36.126746 13772 catalog_manager.cc:5697] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ed90780da7b4996a1250b953d170468 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "0ed90780da7b4996a1250b953d170468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:36.129523 14064 tablet_bootstrap.cc:654] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:36.134967 14064 tablet_bootstrap.cc:492] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:36.135483 14064 ts_tablet_manager.cc:1403] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 12:31:36.137849 14064 raft_consensus.cc:359] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.138398 14064 raft_consensus.cc:385] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:36.138617 14064 raft_consensus.cc:740] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:36.139217 14064 consensus_queue.cc:260] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.140921 14064 ts_tablet_manager.cc:1434] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:31:36.142257 14064 tablet_bootstrap.cc:492] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:36.146415 14064 tablet_bootstrap.cc:654] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:36.151006 14064 tablet_bootstrap.cc:492] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:36.151423 14064 ts_tablet_manager.cc:1403] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:31:36.151592 14072 raft_consensus.cc:493] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:36.152137 14072 raft_consensus.cc:515] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.154322 14072 leader_election.cc:290] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:36.154134 14064 raft_consensus.cc:359] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.154870 14064 raft_consensus.cc:385] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:36.155141 14064 raft_consensus.cc:740] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:36.155156 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0b8f59e5b8449888f11eb6bcbdee34" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:36.155534 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0b8f59e5b8449888f11eb6bcbdee34" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
I20260709 12:31:36.156040 13875 raft_consensus.cc:2468] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 0.
I20260709 12:31:36.155915 14064 consensus_queue.cc:260] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.156210 14023 raft_consensus.cc:2468] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 0.
I20260709 12:31:36.157205 13913 leader_election.cc:304] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: 
I20260709 12:31:36.158025 14064 ts_tablet_manager.cc:1434] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:31:36.158479 14072 raft_consensus.cc:2804] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:36.158773 14072 raft_consensus.cc:493] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:36.158984 14072 raft_consensus.cc:3060] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.165050 14072 raft_consensus.cc:515] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.166664 14072 leader_election.cc:290] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:36.167501 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0b8f59e5b8449888f11eb6bcbdee34" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:36.168143 13875 raft_consensus.cc:3060] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.168123 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0b8f59e5b8449888f11eb6bcbdee34" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:36.169034 14023 raft_consensus.cc:3060] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.174194 13875 raft_consensus.cc:2468] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 1.
I20260709 12:31:36.175346 13913 leader_election.cc:304] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: 
I20260709 12:31:36.175891 14023 raft_consensus.cc:2468] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 1.
I20260709 12:31:36.176146 14072 raft_consensus.cc:2804] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:36.176772 14072 raft_consensus.cc:697] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Becoming Leader. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:36.178081 14072 consensus_queue.cc:237] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.185717 13773 catalog_manager.cc:5697] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "85c975ef2dcf437e915b054ae37788d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:36.220425 14072 raft_consensus.cc:493] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:36.221133 14072 raft_consensus.cc:515] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.223143 14072 leader_election.cc:290] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:36.224053 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1658e4cbe8044907b3d5647dcd259b67" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:36.224289 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1658e4cbe8044907b3d5647dcd259b67" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
I20260709 12:31:36.225080 14023 raft_consensus.cc:2393] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85c975ef2dcf437e915b054ae37788d4 in current term 1: Already voted for candidate 0ed90780da7b4996a1250b953d170468 in this term.
I20260709 12:31:36.226652 13916 leader_election.cc:304] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85c975ef2dcf437e915b054ae37788d4; no voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:36.227372 14072 raft_consensus.cc:3060] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.232447 14072 raft_consensus.cc:2749] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:36.234687 14090 raft_consensus.cc:493] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:36.235140 14090 raft_consensus.cc:515] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.236809 14090 leader_election.cc:290] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:36.237659 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341b167d476f4e3287bcf5131f86a201" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:36.237911 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341b167d476f4e3287bcf5131f86a201" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:36.238415 13875 raft_consensus.cc:2468] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 0.
I20260709 12:31:36.238498 13949 raft_consensus.cc:2468] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 0.
I20260709 12:31:36.239490 13987 leader_election.cc:304] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:36.240103 14090 raft_consensus.cc:2804] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:36.240450 14090 raft_consensus.cc:493] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:36.240754 14090 raft_consensus.cc:3060] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.245687 14090 raft_consensus.cc:515] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.247491 14090 leader_election.cc:290] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:36.248502 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341b167d476f4e3287bcf5131f86a201" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:36.248528 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341b167d476f4e3287bcf5131f86a201" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:36.249051 13949 raft_consensus.cc:3060] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.249269 13875 raft_consensus.cc:3060] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.254148 13949 raft_consensus.cc:2468] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 1.
I20260709 12:31:36.254637 13875 raft_consensus.cc:2468] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 1.
I20260709 12:31:36.255232 13987 leader_election.cc:304] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c975ef2dcf437e915b054ae37788d4, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:36.255970 14090 raft_consensus.cc:2804] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:36.256469 14090 raft_consensus.cc:697] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Becoming Leader. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:36.257181 14090 consensus_queue.cc:237] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.264817 13773 catalog_manager.cc:5697] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3). New cstate: current_term: 1 leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:36.270205 14090 consensus_queue.cc:1048] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:36.282269 13950 raft_consensus.cc:3060] T d3131b2fc314427ba539da38cde592ea P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.283962 14090 consensus_queue.cc:1048] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:36.295853 14091 consensus_queue.cc:1048] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:36.325646 14092 consensus_queue.cc:1048] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:36.332828 14092 raft_consensus.cc:493] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:36.333382 14092 raft_consensus.cc:515] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.335537 14092 leader_election.cc:290] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:36.336447 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e1aba068f04178b14344347c5dfb76" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:36.336938 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e1aba068f04178b14344347c5dfb76" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
I20260709 12:31:36.337224 13948 raft_consensus.cc:2468] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 0.
I20260709 12:31:36.337600 14023 raft_consensus.cc:2468] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 0.
I20260709 12:31:36.338428 13838 leader_election.cc:304] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: 
I20260709 12:31:36.338562 14090 raft_consensus.cc:493] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:36.339090 14090 raft_consensus.cc:515] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.340078 14092 raft_consensus.cc:2804] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:36.340533 14092 raft_consensus.cc:493] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:36.340867 14092 raft_consensus.cc:3060] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.341207 14090 leader_election.cc:290] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:36.342761 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cf75a7a6b24af4a2024bd1d286ca31" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:36.343528 14090 raft_consensus.cc:493] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:36.344045 14090 raft_consensus.cc:515] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.344899 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cf75a7a6b24af4a2024bd1d286ca31" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:36.345767 13948 raft_consensus.cc:2393] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea3facf0f98e4c44b1ad6312505ce23a in current term 1: Already voted for candidate 0ed90780da7b4996a1250b953d170468 in this term.
I20260709 12:31:36.346227 14090 leader_election.cc:290] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:36.347249 13987 leader_election.cc:304] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3facf0f98e4c44b1ad6312505ce23a; no voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:36.347647 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c18b0d870cc438494c105baec4e94c7" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:36.347813 14092 raft_consensus.cc:515] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.348630 13948 raft_consensus.cc:2468] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 0.
I20260709 12:31:36.350332 14092 leader_election.cc:290] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 election: Requested vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:36.350708 13987 leader_election.cc:304] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c975ef2dcf437e915b054ae37788d4, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:36.348788 14090 raft_consensus.cc:3060] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.348649 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c18b0d870cc438494c105baec4e94c7" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:36.351257 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e1aba068f04178b14344347c5dfb76" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:36.351645 14124 raft_consensus.cc:2804] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:36.351856 14023 raft_consensus.cc:3060] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.352129 14124 raft_consensus.cc:493] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:36.352547 14124 raft_consensus.cc:3060] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.355463 13875 raft_consensus.cc:2468] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 0.
I20260709 12:31:36.350844 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e1aba068f04178b14344347c5dfb76" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:36.356688 13948 raft_consensus.cc:3060] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.358492 14090 raft_consensus.cc:2749] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:36.360329 14023 raft_consensus.cc:2468] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 1.
I20260709 12:31:36.361621 13841 leader_election.cc:304] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:36.362077 14092 consensus_queue.cc:1048] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:36.362495 14070 raft_consensus.cc:2804] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:36.363093 14070 raft_consensus.cc:697] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Becoming Leader. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:36.362963 14124 raft_consensus.cc:515] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.364054 14070 consensus_queue.cc:237] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.365032 13948 raft_consensus.cc:2468] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 1.
I20260709 12:31:36.365211 14124 leader_election.cc:290] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:36.367129 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c18b0d870cc438494c105baec4e94c7" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:36.367715 13875 raft_consensus.cc:3060] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.376196 13875 raft_consensus.cc:2468] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 1.
I20260709 12:31:36.377252 13987 leader_election.cc:304] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:36.378182 14124 raft_consensus.cc:2804] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:36.378659 14124 raft_consensus.cc:697] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Becoming Leader. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:36.379492 14124 consensus_queue.cc:237] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.379597 13773 catalog_manager.cc:5697] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ed90780da7b4996a1250b953d170468 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "0ed90780da7b4996a1250b953d170468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:36.385461 14070 consensus_queue.cc:1048] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:36.385699 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c18b0d870cc438494c105baec4e94c7" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:36.386993 13948 raft_consensus.cc:3060] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.395066 13948 raft_consensus.cc:2468] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 1.
I20260709 12:31:36.394603 13773 catalog_manager.cc:5697] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3). New cstate: current_term: 1 leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:36.424182 14023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "210b05f6d0bd4fb6bae9f5ae09ec4ea1"
dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
mode: GRACEFUL
new_leader_uuid: "0ed90780da7b4996a1250b953d170468"
 from {username='slave'} at 127.0.0.1:37862
I20260709 12:31:36.424788 14023 raft_consensus.cc:606] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Received request to transfer leadership to TS 0ed90780da7b4996a1250b953d170468
I20260709 12:31:36.436636 14023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "341b167d476f4e3287bcf5131f86a201"
dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
mode: GRACEFUL
new_leader_uuid: "0ed90780da7b4996a1250b953d170468"
 from {username='slave'} at 127.0.0.1:37862
I20260709 12:31:36.437198 14023 raft_consensus.cc:606] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Received request to transfer leadership to TS 0ed90780da7b4996a1250b953d170468
I20260709 12:31:36.451323 13875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1658e4cbe8044907b3d5647dcd259b67"
dest_uuid: "0ed90780da7b4996a1250b953d170468"
mode: GRACEFUL
new_leader_uuid: "85c975ef2dcf437e915b054ae37788d4"
 from {username='slave'} at 127.0.0.1:33024
I20260709 12:31:36.452000 13875 raft_consensus.cc:606] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Received request to transfer leadership to TS 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:36.460870 13875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76e1aba068f04178b14344347c5dfb76"
dest_uuid: "0ed90780da7b4996a1250b953d170468"
mode: GRACEFUL
new_leader_uuid: "85c975ef2dcf437e915b054ae37788d4"
 from {username='slave'} at 127.0.0.1:33024
I20260709 12:31:36.461431 13875 raft_consensus.cc:606] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Received request to transfer leadership to TS 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:36.466786 14023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c18b0d870cc438494c105baec4e94c7"
dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
mode: GRACEFUL
new_leader_uuid: "85c975ef2dcf437e915b054ae37788d4"
 from {username='slave'} at 127.0.0.1:37862
I20260709 12:31:36.467401 14023 raft_consensus.cc:606] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Received request to transfer leadership to TS 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:36.482275 13949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da0b8f59e5b8449888f11eb6bcbdee34"
dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
mode: GRACEFUL
new_leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
 from {username='slave'} at 127.0.0.1:41396
I20260709 12:31:36.482787 13949 raft_consensus.cc:606] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Received request to transfer leadership to TS ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:36.488306 14072 consensus_queue.cc:1048] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:36.497946 14023 raft_consensus.cc:3060] T 62790f7879ea41aea075792ee44812f9 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:36.506745 14072 consensus_queue.cc:1048] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:36.523456 14070 consensus_queue.cc:1048] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:36.535895 14091 consensus_queue.cc:1048] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:36.543437 14092 raft_consensus.cc:993] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468: : Instructing follower 85c975ef2dcf437e915b054ae37788d4 to start an election
I20260709 12:31:36.543939 14091 raft_consensus.cc:1081] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Signalling peer 85c975ef2dcf437e915b054ae37788d4 to start an election
I20260709 12:31:36.545632 13949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1658e4cbe8044907b3d5647dcd259b67"
dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
 from {username='slave'} at 127.0.0.1:41378
I20260709 12:31:36.546232 13949 raft_consensus.cc:493] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:36.546605 13949 raft_consensus.cc:3060] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.551704 13949 raft_consensus.cc:515] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.554378 13949 leader_election.cc:290] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 2 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:36.554610 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1658e4cbe8044907b3d5647dcd259b67" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:36.554803 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1658e4cbe8044907b3d5647dcd259b67" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:36.555282 13875 raft_consensus.cc:3055] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:36.555445 14023 raft_consensus.cc:3060] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.555680 13875 raft_consensus.cc:740] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:36.556627 13875 consensus_queue.cc:260] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.557615 13875 raft_consensus.cc:3060] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.563200 14023 raft_consensus.cc:2468] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 2.
I20260709 12:31:36.563050 14072 consensus_queue.cc:1048] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:36.563941 13875 raft_consensus.cc:2468] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 2.
I20260709 12:31:36.564319 13916 leader_election.cc:304] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c975ef2dcf437e915b054ae37788d4, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:36.565095 14072 raft_consensus.cc:2804] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:36.565589 14072 raft_consensus.cc:697] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [term 2 LEADER]: Becoming Leader. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:36.566421 14072 consensus_queue.cc:237] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.571301 14113 raft_consensus.cc:993] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4: : Instructing follower ea3facf0f98e4c44b1ad6312505ce23a to start an election
I20260709 12:31:36.571938 14112 raft_consensus.cc:1081] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Signalling peer ea3facf0f98e4c44b1ad6312505ce23a to start an election
I20260709 12:31:36.575498 14024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da0b8f59e5b8449888f11eb6bcbdee34"
dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
 from {username='slave'} at 127.0.0.1:37858
I20260709 12:31:36.574733 13772 catalog_manager.cc:5697] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 reported cstate change: term changed from 1 to 2, leader changed from 0ed90780da7b4996a1250b953d170468 (127.2.157.1) to 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "85c975ef2dcf437e915b054ae37788d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:36.576363 14024 raft_consensus.cc:493] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:36.576404 14072 consensus_queue.cc:1048] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:36.576891 14024 raft_consensus.cc:3060] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.584535 14024 raft_consensus.cc:515] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.587579 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0b8f59e5b8449888f11eb6bcbdee34" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:36.588841 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0b8f59e5b8449888f11eb6bcbdee34" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:36.589512 13949 raft_consensus.cc:3055] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:36.589829 13949 raft_consensus.cc:740] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:36.590615 13949 consensus_queue.cc:260] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.591326 13949 raft_consensus.cc:3060] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.594885 14024 leader_election.cc:290] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 2 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:36.602099 13949 raft_consensus.cc:2468] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 2.
I20260709 12:31:36.603353 13987 leader_election.cc:304] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85c975ef2dcf437e915b054ae37788d4, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 0ed90780da7b4996a1250b953d170468
I20260709 12:31:36.604288 14124 raft_consensus.cc:2804] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:36.604830 14124 raft_consensus.cc:697] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 LEADER]: Becoming Leader. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:36.605751 14124 consensus_queue.cc:237] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.614076 13771 catalog_manager.cc:5697] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a reported cstate change: term changed from 1 to 2, leader changed from 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2) to ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3). New cstate: current_term: 2 leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:36.733588 14124 consensus_queue.cc:1048] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:36.745478 14090 consensus_queue.cc:1048] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:36.752585 14093 raft_consensus.cc:993] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a: : Instructing follower 0ed90780da7b4996a1250b953d170468 to start an election
I20260709 12:31:36.753089 14090 raft_consensus.cc:1081] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Signalling peer 0ed90780da7b4996a1250b953d170468 to start an election
I20260709 12:31:36.754859 13875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "341b167d476f4e3287bcf5131f86a201"
dest_uuid: "0ed90780da7b4996a1250b953d170468"
 from {username='slave'} at 127.0.0.1:33022
I20260709 12:31:36.755448 13875 raft_consensus.cc:493] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:36.755877 13875 raft_consensus.cc:3060] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.761633 13875 raft_consensus.cc:515] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.763679 13875 leader_election.cc:290] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 2 election: Requested vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:36.764539 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341b167d476f4e3287bcf5131f86a201" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:36.764930 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341b167d476f4e3287bcf5131f86a201" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:36.765251 13949 raft_consensus.cc:3060] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.765623 14024 raft_consensus.cc:3055] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:36.765972 14024 raft_consensus.cc:740] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:36.766822 14024 consensus_queue.cc:260] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.768132 14024 raft_consensus.cc:3060] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.772782 13949 raft_consensus.cc:2468] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 2.
I20260709 12:31:36.774027 13838 leader_election.cc:304] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: 
I20260709 12:31:36.774792 14091 raft_consensus.cc:2804] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:36.775277 14024 raft_consensus.cc:2468] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 2.
I20260709 12:31:36.775303 14091 raft_consensus.cc:697] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Becoming Leader. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:36.776454 14091 consensus_queue.cc:237] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.783154 13769 catalog_manager.cc:5697] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 reported cstate change: term changed from 1 to 2, leader changed from ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3) to 0ed90780da7b4996a1250b953d170468 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "0ed90780da7b4996a1250b953d170468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:36.811937 14090 consensus_queue.cc:1048] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:36.822115 14070 consensus_queue.cc:1048] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:36.826535 14093 consensus_queue.cc:1048] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:36.839102 14070 consensus_queue.cc:1048] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:36.846170 14124 raft_consensus.cc:993] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a: : Instructing follower 85c975ef2dcf437e915b054ae37788d4 to start an election
I20260709 12:31:36.846792 14071 raft_consensus.cc:1081] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Signalling peer 85c975ef2dcf437e915b054ae37788d4 to start an election
I20260709 12:31:36.850096 13949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c18b0d870cc438494c105baec4e94c7"
dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
 from {username='slave'} at 127.0.0.1:41392
I20260709 12:31:36.850708 13949 raft_consensus.cc:493] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:36.851099 14070 raft_consensus.cc:993] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468: : Instructing follower 85c975ef2dcf437e915b054ae37788d4 to start an election
I20260709 12:31:36.851111 13949 raft_consensus.cc:3060] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.851647 14070 raft_consensus.cc:1081] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Signalling peer 85c975ef2dcf437e915b054ae37788d4 to start an election
I20260709 12:31:36.853494 13948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76e1aba068f04178b14344347c5dfb76"
dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
 from {username='slave'} at 127.0.0.1:41378
I20260709 12:31:36.854041 13948 raft_consensus.cc:493] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:36.854383 13948 raft_consensus.cc:3060] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.858361 13949 raft_consensus.cc:515] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.860193 13949 leader_election.cc:290] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 2 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:36.860948 13948 raft_consensus.cc:515] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.861999 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c18b0d870cc438494c105baec4e94c7" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:36.862649 13875 raft_consensus.cc:3060] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.863992 13948 leader_election.cc:290] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 2 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:36.864111 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e1aba068f04178b14344347c5dfb76" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:36.864809 13874 raft_consensus.cc:3055] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:36.865142 13874 raft_consensus.cc:740] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:36.865957 13874 consensus_queue.cc:260] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.867210 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e1aba068f04178b14344347c5dfb76" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:36.867924 14023 raft_consensus.cc:3060] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.867918 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c18b0d870cc438494c105baec4e94c7" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:36.869405 14024 raft_consensus.cc:3055] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:36.869900 14024 raft_consensus.cc:740] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:36.870767 13875 raft_consensus.cc:2468] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 2.
I20260709 12:31:36.870749 14024 consensus_queue.cc:260] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.872228 14024 raft_consensus.cc:3060] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.872653 13913 leader_election.cc:304] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: 
I20260709 12:31:36.873588 13874 raft_consensus.cc:3060] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.873802 14112 raft_consensus.cc:2804] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:36.875133 14112 raft_consensus.cc:697] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [term 2 LEADER]: Becoming Leader. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:36.876565 14112 consensus_queue.cc:237] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.883275 13874 raft_consensus.cc:2468] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 2.
I20260709 12:31:36.884697 13913 leader_election.cc:304] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: 
I20260709 12:31:36.885584 14112 raft_consensus.cc:2804] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:36.886094 14112 raft_consensus.cc:697] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 2 LEADER]: Becoming Leader. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:36.886945 14112 consensus_queue.cc:237] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:36.888590 14071 raft_consensus.cc:993] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a: : Instructing follower 0ed90780da7b4996a1250b953d170468 to start an election
I20260709 12:31:36.889127 14023 raft_consensus.cc:2468] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 2.
I20260709 12:31:36.889355 14124 raft_consensus.cc:1081] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Signalling peer 0ed90780da7b4996a1250b953d170468 to start an election
I20260709 12:31:36.889030 13769 catalog_manager.cc:5697] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 reported cstate change: term changed from 1 to 2, leader changed from ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3) to 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "85c975ef2dcf437e915b054ae37788d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:36.891429 13874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "210b05f6d0bd4fb6bae9f5ae09ec4ea1"
dest_uuid: "0ed90780da7b4996a1250b953d170468"
 from {username='slave'} at 127.0.0.1:33022
I20260709 12:31:36.892040 13874 raft_consensus.cc:493] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:36.892432 13874 raft_consensus.cc:3060] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.893736 14024 raft_consensus.cc:2468] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 2.
I20260709 12:31:36.900372 13874 raft_consensus.cc:515] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:36.903021 13874 leader_election.cc:290] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 2 election: Requested vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:36.904217 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210b05f6d0bd4fb6bae9f5ae09ec4ea1" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:36.904870 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210b05f6d0bd4fb6bae9f5ae09ec4ea1" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:36.904922 14024 raft_consensus.cc:3055] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:36.905557 14024 raft_consensus.cc:740] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:36.905599 13948 raft_consensus.cc:3060] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.906788 14024 consensus_queue.cc:260] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:36.908097 14024 raft_consensus.cc:3060] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:36.908499 13769 catalog_manager.cc:5697] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 reported cstate change: term changed from 1 to 2, leader changed from 0ed90780da7b4996a1250b953d170468 (127.2.157.1) to 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "85c975ef2dcf437e915b054ae37788d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:36.915026 13948 raft_consensus.cc:2468] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 2.
I20260709 12:31:36.915313 14024 raft_consensus.cc:2468] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 2.
I20260709 12:31:36.916344 13838 leader_election.cc:304] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: 
I20260709 12:31:36.917377 14091 raft_consensus.cc:2804] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:36.917987 14091 raft_consensus.cc:697] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Becoming Leader. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:36.918860 14091 consensus_queue.cc:237] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:36.928524 13769 catalog_manager.cc:5697] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 reported cstate change: term changed from 1 to 2, leader changed from ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3) to 0ed90780da7b4996a1250b953d170468 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "0ed90780da7b4996a1250b953d170468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:36.953114 13874 raft_consensus.cc:1275] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Refusing update from remote peer 85c975ef2dcf437e915b054ae37788d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:36.954411 14112 consensus_queue.cc:1048] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:36.963774 14024 raft_consensus.cc:1275] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Refusing update from remote peer 85c975ef2dcf437e915b054ae37788d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:36.964979 14072 consensus_queue.cc:1048] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:37.089210 13874 raft_consensus.cc:3060] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:37.095022 13874 raft_consensus.cc:1275] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Refusing update from remote peer ea3facf0f98e4c44b1ad6312505ce23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:37.096426 14071 consensus_queue.cc:1048] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:37.104948 13948 raft_consensus.cc:1275] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Refusing update from remote peer ea3facf0f98e4c44b1ad6312505ce23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:37.107076 14093 consensus_queue.cc:1048] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:37.157967 14024 raft_consensus.cc:1275] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Refusing update from remote peer 0ed90780da7b4996a1250b953d170468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:37.159237 14091 consensus_queue.cc:1048] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:37.167526 13948 raft_consensus.cc:1275] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Refusing update from remote peer 0ed90780da7b4996a1250b953d170468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:37.169126 14150 consensus_queue.cc:1048] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:37.274472 14024 raft_consensus.cc:1275] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Refusing update from remote peer 85c975ef2dcf437e915b054ae37788d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:37.275837 14112 consensus_queue.cc:1048] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:37.284350 13874 raft_consensus.cc:1275] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Refusing update from remote peer 85c975ef2dcf437e915b054ae37788d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:37.286164 14072 consensus_queue.cc:1048] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:37.299211 13948 raft_consensus.cc:1275] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Refusing update from remote peer 0ed90780da7b4996a1250b953d170468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:37.301582 14150 consensus_queue.cc:1048] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:31:37.310822 14024 raft_consensus.cc:1275] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Refusing update from remote peer 0ed90780da7b4996a1250b953d170468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:37.312748 14070 consensus_queue.cc:1048] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:37.445844 14022 raft_consensus.cc:1275] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Refusing update from remote peer 85c975ef2dcf437e915b054ae37788d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:37.447435 14072 consensus_queue.cc:1048] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:37.455554 13874 raft_consensus.cc:1275] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Refusing update from remote peer 85c975ef2dcf437e915b054ae37788d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:37.457298 14113 consensus_queue.cc:1048] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:39.516319 13771 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44480:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:31:39.518535 13771 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:31:39.567533 13858 tablet_service.cc:1511] Processing CreateTablet for tablet 563f5d371b2049ecade2ef7486c53a9f (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:39.568869 13936 tablet_service.cc:1511] Processing CreateTablet for tablet 563f5d371b2049ecade2ef7486c53a9f (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:39.570323 13936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563f5d371b2049ecade2ef7486c53a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.570746 14008 tablet_service.cc:1511] Processing CreateTablet for tablet 563f5d371b2049ecade2ef7486c53a9f (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:39.568899 13858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563f5d371b2049ecade2ef7486c53a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.571979 13861 tablet_service.cc:1511] Processing CreateTablet for tablet 6797ce9ec8834f56b4d65f9b4d88dfde (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:39.573268 13861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6797ce9ec8834f56b4d65f9b4d88dfde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.572038 14008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563f5d371b2049ecade2ef7486c53a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.574795 14007 tablet_service.cc:1511] Processing CreateTablet for tablet 6797ce9ec8834f56b4d65f9b4d88dfde (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:39.576072 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6797ce9ec8834f56b4d65f9b4d88dfde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.579461 13932 tablet_service.cc:1511] Processing CreateTablet for tablet 6797ce9ec8834f56b4d65f9b4d88dfde (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:39.580816 13932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6797ce9ec8834f56b4d65f9b4d88dfde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.581281 13862 tablet_service.cc:1511] Processing CreateTablet for tablet a40b7f3daaab49a68fee491d7e00094e (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:39.582616 13862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40b7f3daaab49a68fee491d7e00094e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.599226 13933 tablet_service.cc:1511] Processing CreateTablet for tablet a40b7f3daaab49a68fee491d7e00094e (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:39.599946 14009 tablet_service.cc:1511] Processing CreateTablet for tablet a40b7f3daaab49a68fee491d7e00094e (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:39.600736 13933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40b7f3daaab49a68fee491d7e00094e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.601263 14009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40b7f3daaab49a68fee491d7e00094e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.605397 13860 tablet_service.cc:1511] Processing CreateTablet for tablet 2585b1ca60964e6e805c60801722e038 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:39.613579 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2585b1ca60964e6e805c60801722e038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.620267 14167 tablet_bootstrap.cc:492] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:39.626240 14166 tablet_bootstrap.cc:492] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:39.630954 14167 tablet_bootstrap.cc:654] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.636413 14168 tablet_bootstrap.cc:492] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:39.643121 13932 tablet_service.cc:1511] Processing CreateTablet for tablet 2585b1ca60964e6e805c60801722e038 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:39.644577 13932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2585b1ca60964e6e805c60801722e038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.648730 14009 tablet_service.cc:1511] Processing CreateTablet for tablet 2585b1ca60964e6e805c60801722e038 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:39.650125 14167 tablet_bootstrap.cc:492] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:39.650774 14167 ts_tablet_manager.cc:1403] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.009s
I20260709 12:31:39.650226 14009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2585b1ca60964e6e805c60801722e038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.650710 13861 tablet_service.cc:1511] Processing CreateTablet for tablet ea651d088c394fd3bbeb8e692d9e4a63 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:39.656891 14167 raft_consensus.cc:359] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.657737 14167 raft_consensus.cc:385] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:39.658066 14167 raft_consensus.cc:740] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:39.658092 13861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea651d088c394fd3bbeb8e692d9e4a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.664947 14166 tablet_bootstrap.cc:654] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.658850 14167 consensus_queue.cc:260] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.665913 14168 tablet_bootstrap.cc:654] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.667440 14167 ts_tablet_manager.cc:1434] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:31:39.668521 14167 tablet_bootstrap.cc:492] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:39.659307 13936 tablet_service.cc:1511] Processing CreateTablet for tablet ea651d088c394fd3bbeb8e692d9e4a63 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:39.671293 13936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea651d088c394fd3bbeb8e692d9e4a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.680711 14007 tablet_service.cc:1511] Processing CreateTablet for tablet ea651d088c394fd3bbeb8e692d9e4a63 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:39.682471 14007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea651d088c394fd3bbeb8e692d9e4a63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.685182 13933 tablet_service.cc:1511] Processing CreateTablet for tablet 90355a851e704b64a0aa6a90d217bc01 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:39.687047 13933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90355a851e704b64a0aa6a90d217bc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.692330 13860 tablet_service.cc:1511] Processing CreateTablet for tablet 90355a851e704b64a0aa6a90d217bc01 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:39.697515 14008 tablet_service.cc:1511] Processing CreateTablet for tablet 90355a851e704b64a0aa6a90d217bc01 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:39.698302 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90355a851e704b64a0aa6a90d217bc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.699043 14008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90355a851e704b64a0aa6a90d217bc01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.702461 14006 tablet_service.cc:1511] Processing CreateTablet for tablet d3ad87e1cfd94ac1a0cdf44540e5fa21 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:39.703879 14006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ad87e1cfd94ac1a0cdf44540e5fa21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.706624 13858 tablet_service.cc:1511] Processing CreateTablet for tablet d3ad87e1cfd94ac1a0cdf44540e5fa21 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:39.708002 13858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ad87e1cfd94ac1a0cdf44540e5fa21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.709013 13932 tablet_service.cc:1511] Processing CreateTablet for tablet d3ad87e1cfd94ac1a0cdf44540e5fa21 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:39.710539 13932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3ad87e1cfd94ac1a0cdf44540e5fa21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.725765 13862 tablet_service.cc:1511] Processing CreateTablet for tablet 7a825b7ff3a84b0386e22a8cffce199b (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:39.727527 13862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a825b7ff3a84b0386e22a8cffce199b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.728493 14167 tablet_bootstrap.cc:654] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.747000 13933 tablet_service.cc:1511] Processing CreateTablet for tablet 7a825b7ff3a84b0386e22a8cffce199b (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:39.748454 13933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a825b7ff3a84b0386e22a8cffce199b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.749567 13860 tablet_service.cc:1511] Processing CreateTablet for tablet d76a08c1200d4ca3aad288d6495fcd94 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:39.750957 13860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76a08c1200d4ca3aad288d6495fcd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.759882 13939 tablet_service.cc:1511] Processing CreateTablet for tablet d76a08c1200d4ca3aad288d6495fcd94 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:39.761260 13939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76a08c1200d4ca3aad288d6495fcd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.764482 14012 tablet_service.cc:1511] Processing CreateTablet for tablet d76a08c1200d4ca3aad288d6495fcd94 (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:39.766340 14012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76a08c1200d4ca3aad288d6495fcd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.773147 14006 tablet_service.cc:1511] Processing CreateTablet for tablet 7a825b7ff3a84b0386e22a8cffce199b (DEFAULT_TABLE table=soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:39.774577 14006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a825b7ff3a84b0386e22a8cffce199b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:39.792476 14167 tablet_bootstrap.cc:492] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:39.793104 14167 ts_tablet_manager.cc:1403] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.000s
I20260709 12:31:39.793475 14166 tablet_bootstrap.cc:492] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:39.794078 14166 ts_tablet_manager.cc:1403] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.168s	user 0.044s	sys 0.027s
I20260709 12:31:39.796315 14167 raft_consensus.cc:359] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.797150 14167 raft_consensus.cc:385] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:39.796943 14166 raft_consensus.cc:359] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.797505 14167 raft_consensus.cc:740] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:39.797761 14166 raft_consensus.cc:385] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:39.798189 14166 raft_consensus.cc:740] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:39.799024 14166 consensus_queue.cc:260] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.801424 14166 ts_tablet_manager.cc:1434] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:31:39.805428 14166 tablet_bootstrap.cc:492] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:39.809453 14167 consensus_queue.cc:260] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.811851 14167 ts_tablet_manager.cc:1434] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:31:39.812645 14167 tablet_bootstrap.cc:492] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:39.819289 14168 tablet_bootstrap.cc:492] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:39.819970 14168 ts_tablet_manager.cc:1403] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.184s	user 0.026s	sys 0.008s
I20260709 12:31:39.826839 14166 tablet_bootstrap.cc:654] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.832072 14167 tablet_bootstrap.cc:654] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.824736 14168 raft_consensus.cc:359] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.838750 14168 raft_consensus.cc:385] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:39.839156 14168 raft_consensus.cc:740] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:39.840138 14168 consensus_queue.cc:260] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.847556 14168 ts_tablet_manager.cc:1434] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:31:39.848594 14168 tablet_bootstrap.cc:492] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:39.849376 14167 tablet_bootstrap.cc:492] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:39.850277 14167 ts_tablet_manager.cc:1403] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.006s
I20260709 12:31:39.855543 14168 tablet_bootstrap.cc:654] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.854918 14167 raft_consensus.cc:359] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.856065 14167 raft_consensus.cc:385] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:39.856528 14167 raft_consensus.cc:740] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:39.857728 14167 consensus_queue.cc:260] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
W20260709 12:31:39.860491 13821 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:31:39.860509 14167 ts_tablet_manager.cc:1434] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:31:39.861766 14167 tablet_bootstrap.cc:492] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:39.863677 14166 tablet_bootstrap.cc:492] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:39.863840 14153 raft_consensus.cc:493] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:39.864403 14166 ts_tablet_manager.cc:1403] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.017s
I20260709 12:31:39.864447 14153 raft_consensus.cc:515] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.866936 14153 leader_election.cc:290] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:39.868714 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40b7f3daaab49a68fee491d7e00094e" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:39.869304 14167 tablet_bootstrap.cc:654] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.869417 14166 raft_consensus.cc:359] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
W20260709 12:31:39.870282 13987 leader_election.cc:343] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:39.870507 14166 raft_consensus.cc:385] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:39.872126 14166 raft_consensus.cc:740] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:39.873529 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40b7f3daaab49a68fee491d7e00094e" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:39.874977 13875 raft_consensus.cc:2468] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 0.
I20260709 12:31:39.874891 14166 consensus_queue.cc:260] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.876413 13987 leader_election.cc:304] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:39.876816 14168 tablet_bootstrap.cc:492] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:39.877701 14173 raft_consensus.cc:2804] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:39.878049 14168 ts_tablet_manager.cc:1403] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.000s
I20260709 12:31:39.878176 14173 raft_consensus.cc:493] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:39.878576 14166 ts_tablet_manager.cc:1434] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:31:39.878790 14173 raft_consensus.cc:3060] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:39.879689 14166 tablet_bootstrap.cc:492] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:39.883196 14168 raft_consensus.cc:359] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.884089 14168 raft_consensus.cc:385] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:39.884469 14168 raft_consensus.cc:740] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:39.885360 14168 consensus_queue.cc:260] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.887096 14166 tablet_bootstrap.cc:654] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.887941 14168 ts_tablet_manager.cc:1434] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:31:39.889158 14168 tablet_bootstrap.cc:492] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:39.895696 14153 raft_consensus.cc:493] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:39.896682 14168 tablet_bootstrap.cc:654] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.896440 14153 raft_consensus.cc:515] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.899430 14153 leader_election.cc:290] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:39.900748 14167 tablet_bootstrap.cc:492] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:39.901511 14167 ts_tablet_manager.cc:1403] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.005s
I20260709 12:31:39.906601 14167 raft_consensus.cc:359] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.907544 14167 raft_consensus.cc:385] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:39.908000 14167 raft_consensus.cc:740] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:39.908725 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563f5d371b2049ecade2ef7486c53a9f" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:39.908941 14167 consensus_queue.cc:260] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.911087 14168 tablet_bootstrap.cc:492] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:39.911401 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563f5d371b2049ecade2ef7486c53a9f" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:39.911782 14168 ts_tablet_manager.cc:1403] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.006s
I20260709 12:31:39.912075 14167 ts_tablet_manager.cc:1434] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
W20260709 12:31:39.913561 13987 leader_election.cc:343] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:31:39.914364 13987 leader_election.cc:343] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:39.914415 14167 tablet_bootstrap.cc:492] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:39.914875 13987 leader_election.cc:304] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3facf0f98e4c44b1ad6312505ce23a; no voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:39.916064 14168 raft_consensus.cc:359] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.922025 14168 raft_consensus.cc:385] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:39.922503 14168 raft_consensus.cc:740] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:39.923974 14153 raft_consensus.cc:2749] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:39.923669 14168 consensus_queue.cc:260] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.924921 14166 tablet_bootstrap.cc:492] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:39.925565 14166 ts_tablet_manager.cc:1403] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.011s
I20260709 12:31:39.929036 14166 raft_consensus.cc:359] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.929917 14166 raft_consensus.cc:385] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:39.930259 14166 raft_consensus.cc:740] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:39.929052 14173 raft_consensus.cc:515] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.931316 14168 ts_tablet_manager.cc:1434] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 12:31:39.931172 14166 consensus_queue.cc:260] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.932943 14168 tablet_bootstrap.cc:492] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:39.933014 14173 leader_election.cc:290] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:39.935590 14167 tablet_bootstrap.cc:654] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.936125 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40b7f3daaab49a68fee491d7e00094e" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:39.936794 13948 raft_consensus.cc:3060] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:39.938642 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40b7f3daaab49a68fee491d7e00094e" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:39.939296 13875 raft_consensus.cc:3060] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:39.939554 14166 ts_tablet_manager.cc:1434] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 12:31:39.940790 14166 tablet_bootstrap.cc:492] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:39.941592 14168 tablet_bootstrap.cc:654] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.947686 14166 tablet_bootstrap.cc:654] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.948639 13948 raft_consensus.cc:2468] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 1.
I20260709 12:31:39.950176 13987 leader_election.cc:304] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c975ef2dcf437e915b054ae37788d4, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:39.951114 14173 raft_consensus.cc:2804] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:39.951812 14173 raft_consensus.cc:697] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Becoming Leader. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:39.955819 13875 raft_consensus.cc:2468] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 1.
I20260709 12:31:39.958648 14174 raft_consensus.cc:493] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:39.959146 14174 raft_consensus.cc:515] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.962378 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6797ce9ec8834f56b4d65f9b4d88dfde" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:39.963037 13875 raft_consensus.cc:2468] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 0.
I20260709 12:31:39.964176 14167 tablet_bootstrap.cc:492] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:39.964880 14167 ts_tablet_manager.cc:1403] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.001s
I20260709 12:31:39.965153 14174 leader_election.cc:290] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:39.965606 14153 raft_consensus.cc:493] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:39.952705 14173 consensus_queue.cc:237] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.966149 14153 raft_consensus.cc:515] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.968343 14153 leader_election.cc:290] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:39.970124 14167 raft_consensus.cc:359] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.974481 14167 raft_consensus.cc:385] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:39.973914 14168 tablet_bootstrap.cc:492] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:39.975422 14168 ts_tablet_manager.cc:1403] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.007s
I20260709 12:31:39.974368 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6797ce9ec8834f56b4d65f9b4d88dfde" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
I20260709 12:31:39.976405 14166 tablet_bootstrap.cc:492] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:39.977059 14166 ts_tablet_manager.cc:1403] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.037s	user 0.026s	sys 0.003s
I20260709 12:31:39.976333 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6797ce9ec8834f56b4d65f9b4d88dfde" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:39.977788 13948 raft_consensus.cc:2468] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 0.
I20260709 12:31:39.979140 14168 raft_consensus.cc:359] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.980476 14168 raft_consensus.cc:385] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:39.964944 13913 leader_election.cc:304] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: 
I20260709 12:31:39.980895 14168 raft_consensus.cc:740] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:39.980692 14166 raft_consensus.cc:359] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.981593 14166 raft_consensus.cc:385] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:39.982111 14174 raft_consensus.cc:2804] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:39.982355 14166 raft_consensus.cc:740] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:39.979712 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6797ce9ec8834f56b4d65f9b4d88dfde" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:39.982086 14168 consensus_queue.cc:260] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.983299 13875 raft_consensus.cc:2468] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 0.
I20260709 12:31:39.982893 14174 raft_consensus.cc:493] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:39.984421 14174 raft_consensus.cc:3060] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:39.984588 14166 consensus_queue.cc:260] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:39.985387 13987 leader_election.cc:304] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c975ef2dcf437e915b054ae37788d4, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:39.986094 14168 ts_tablet_manager.cc:1434] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:31:39.987381 14168 tablet_bootstrap.cc:492] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:39.988029 13769 catalog_manager.cc:5697] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3). New cstate: current_term: 1 leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:39.990094 14166 ts_tablet_manager.cc:1434] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.001s
I20260709 12:31:39.991307 14166 tablet_bootstrap.cc:492] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:39.976850 14022 raft_consensus.cc:2468] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 0.
I20260709 12:31:39.979990 14167 raft_consensus.cc:740] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:39.998807 14166 tablet_bootstrap.cc:654] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.999539 14168 tablet_bootstrap.cc:654] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:39.999307 14167 consensus_queue.cc:260] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.000594 14153 raft_consensus.cc:2804] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:40.000990 14153 raft_consensus.cc:493] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:40.001343 14153 raft_consensus.cc:3060] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.011571 14168 tablet_bootstrap.cc:492] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:40.012830 14168 ts_tablet_manager.cc:1403] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.007s
I20260709 12:31:40.014840 14167 ts_tablet_manager.cc:1434] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 12:31:40.016947 14166 tablet_bootstrap.cc:492] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:40.017609 14166 ts_tablet_manager.cc:1403] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.003s
I20260709 12:31:40.018443 14168 raft_consensus.cc:359] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.019441 14168 raft_consensus.cc:385] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:40.019409 14174 raft_consensus.cc:515] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.020138 14168 raft_consensus.cc:740] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:40.021214 14166 raft_consensus.cc:359] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.021195 14168 consensus_queue.cc:260] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.022166 14166 raft_consensus.cc:385] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:40.022336 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6797ce9ec8834f56b4d65f9b4d88dfde" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:40.022584 14166 raft_consensus.cc:740] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:40.023005 13875 raft_consensus.cc:3060] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.023869 14167 tablet_bootstrap.cc:492] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:40.023488 14166 consensus_queue.cc:260] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.026557 14166 ts_tablet_manager.cc:1434] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:31:40.027683 14166 tablet_bootstrap.cc:492] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:40.028439 14168 ts_tablet_manager.cc:1434] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:31:40.029702 14168 tablet_bootstrap.cc:492] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:40.030691 13875 raft_consensus.cc:2468] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 1.
I20260709 12:31:40.031877 13913 leader_election.cc:304] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: 
I20260709 12:31:40.031975 14153 raft_consensus.cc:515] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.032788 14113 raft_consensus.cc:2804] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:40.038017 14153 leader_election.cc:290] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:40.039981 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6797ce9ec8834f56b4d65f9b4d88dfde" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:40.040825 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6797ce9ec8834f56b4d65f9b4d88dfde" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:40.055740 14168 tablet_bootstrap.cc:654] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:40.054991 13875 raft_consensus.cc:2393] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea3facf0f98e4c44b1ad6312505ce23a in current term 1: Already voted for candidate 85c975ef2dcf437e915b054ae37788d4 in this term.
I20260709 12:31:40.054431 14113 raft_consensus.cc:697] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Becoming Leader. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:40.060115 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6797ce9ec8834f56b4d65f9b4d88dfde" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:40.060964 14022 raft_consensus.cc:2393] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 85c975ef2dcf437e915b054ae37788d4 in current term 1: Already voted for candidate ea3facf0f98e4c44b1ad6312505ce23a in this term.
I20260709 12:31:40.060679 14113 consensus_queue.cc:237] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.052964 14166 tablet_bootstrap.cc:654] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:40.057830 14167 tablet_bootstrap.cc:654] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:40.058290 14174 leader_election.cc:290] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:40.066512 14168 tablet_bootstrap.cc:492] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:40.067374 14168 ts_tablet_manager.cc:1403] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.000s
I20260709 12:31:40.071535 14168 raft_consensus.cc:359] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.072762 14168 raft_consensus.cc:385] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:40.073215 14168 raft_consensus.cc:740] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:40.074210 14168 consensus_queue.cc:260] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.076925 14168 ts_tablet_manager.cc:1434] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:31:40.077224 14166 tablet_bootstrap.cc:492] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:40.077844 14166 ts_tablet_manager.cc:1403] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.011s
I20260709 12:31:40.078323 14168 tablet_bootstrap.cc:492] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:40.080296 14174 raft_consensus.cc:493] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:40.080955 14174 raft_consensus.cc:515] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.083256 14166 raft_consensus.cc:359] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.084151 14166 raft_consensus.cc:385] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:40.084458 14166 raft_consensus.cc:740] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:40.084604 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90355a851e704b64a0aa6a90d217bc01" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:40.085290 14166 consensus_queue.cc:260] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.086550 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90355a851e704b64a0aa6a90d217bc01" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
I20260709 12:31:40.088140 14166 ts_tablet_manager.cc:1434] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
W20260709 12:31:40.088482 13916 leader_election.cc:343] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:40.088572 14168 tablet_bootstrap.cc:654] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:40.083273 14174 leader_election.cc:290] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:40.088670 13875 raft_consensus.cc:2468] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 0.
I20260709 12:31:40.090296 14166 tablet_bootstrap.cc:492] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:40.091380 13913 leader_election.cc:304] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:40.092643 14174 raft_consensus.cc:2804] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:40.093024 14174 raft_consensus.cc:493] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:40.093376 14174 raft_consensus.cc:3060] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.097759 14166 tablet_bootstrap.cc:654] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:40.103490 14174 raft_consensus.cc:515] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.106948 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90355a851e704b64a0aa6a90d217bc01" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:40.107863 13875 raft_consensus.cc:3060] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.112102 14167 tablet_bootstrap.cc:492] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:40.112727 14167 ts_tablet_manager.cc:1403] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.003s
I20260709 12:31:40.115686 14168 tablet_bootstrap.cc:492] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:40.116379 14168 ts_tablet_manager.cc:1403] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.020s
I20260709 12:31:40.116477 13987 leader_election.cc:304] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3facf0f98e4c44b1ad6312505ce23a; no voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:40.117430 14153 raft_consensus.cc:2749] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:31:40.119920 14168 raft_consensus.cc:359] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.120556 14168 raft_consensus.cc:385] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:40.120805 14168 raft_consensus.cc:740] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:40.121718 14153 raft_consensus.cc:493] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:40.121416 14168 consensus_queue.cc:260] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.122241 14153 raft_consensus.cc:515] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.124348 14168 ts_tablet_manager.cc:1434] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:31:40.124446 14153 leader_election.cc:290] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:40.125545 14168 tablet_bootstrap.cc:492] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:40.126091 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585b1ca60964e6e805c60801722e038" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:40.127063 13874 raft_consensus.cc:2468] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 0.
I20260709 12:31:40.128465 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585b1ca60964e6e805c60801722e038" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:40.128819 13987 leader_election.cc:304] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:40.129395 13948 raft_consensus.cc:2468] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 0.
I20260709 12:31:40.129848 14153 raft_consensus.cc:2804] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:40.131111 14153 raft_consensus.cc:493] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:40.131502 14153 raft_consensus.cc:3060] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.131739 14168 tablet_bootstrap.cc:654] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:40.123625 14167 raft_consensus.cc:359] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.138039 14113 raft_consensus.cc:493] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:40.138890 14113 raft_consensus.cc:515] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.142948 14113 leader_election.cc:290] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:40.137331 14167 raft_consensus.cc:385] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:40.143376 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563f5d371b2049ecade2ef7486c53a9f" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
I20260709 12:31:40.143939 14167 raft_consensus.cc:740] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:40.144433 14022 raft_consensus.cc:2468] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 0.
I20260709 12:31:40.145076 14167 consensus_queue.cc:260] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.146623 13916 leader_election.cc:304] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c975ef2dcf437e915b054ae37788d4, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:40.149257 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90355a851e704b64a0aa6a90d217bc01" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:40.152222 14113 raft_consensus.cc:2804] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:40.153324 14113 raft_consensus.cc:493] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:40.153544 14167 ts_tablet_manager.cc:1434] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.004s
I20260709 12:31:40.154057 14113 raft_consensus.cc:3060] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.147217 14174 leader_election.cc:290] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:40.155592 14167 tablet_bootstrap.cc:492] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
W20260709 12:31:40.196621 13916 leader_election.cc:343] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:40.202011 13771 catalog_manager.cc:5697] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "85c975ef2dcf437e915b054ae37788d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:40.205650 14168 tablet_bootstrap.cc:492] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:40.206782 14168 ts_tablet_manager.cc:1403] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.081s	user 0.025s	sys 0.007s
I20260709 12:31:40.212591 14168 raft_consensus.cc:359] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.213665 14168 raft_consensus.cc:385] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:40.212710 14113 raft_consensus.cc:515] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.214079 14168 raft_consensus.cc:740] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:40.193068 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563f5d371b2049ecade2ef7486c53a9f" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:40.216974 14113 leader_election.cc:290] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:40.217911 14166 tablet_bootstrap.cc:492] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:40.217670 14168 consensus_queue.cc:260] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.219020 14166 ts_tablet_manager.cc:1403] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.129s	user 0.029s	sys 0.024s
I20260709 12:31:40.219278 14189 raft_consensus.cc:493] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:40.220335 14189 raft_consensus.cc:515] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.220504 14168 ts_tablet_manager.cc:1434] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:31:40.224205 14189 leader_election.cc:290] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:40.224663 14168 tablet_bootstrap.cc:492] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4: Bootstrap starting.
I20260709 12:31:40.225747 13873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563f5d371b2049ecade2ef7486c53a9f" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:40.234640 14021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a825b7ff3a84b0386e22a8cffce199b" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
I20260709 12:31:40.224756 14166 raft_consensus.cc:359] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.234707 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563f5d371b2049ecade2ef7486c53a9f" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:40.215835 13874 raft_consensus.cc:2468] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 0.
I20260709 12:31:40.237150 14166 raft_consensus.cc:385] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:40.237524 14024 raft_consensus.cc:3060] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.237615 14166 raft_consensus.cc:740] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:40.239037 14166 consensus_queue.cc:260] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.240108 14168 tablet_bootstrap.cc:654] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:40.228569 14167 tablet_bootstrap.cc:654] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:40.242456 14153 raft_consensus.cc:515] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.243435 14166 ts_tablet_manager.cc:1434] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.005s
I20260709 12:31:40.250123 14166 tablet_bootstrap.cc:492] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:40.226244 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a825b7ff3a84b0386e22a8cffce199b" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:40.251338 13872 raft_consensus.cc:2468] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 0.
I20260709 12:31:40.259582 14153 leader_election.cc:290] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:40.262749 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585b1ca60964e6e805c60801722e038" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:40.263921 13948 raft_consensus.cc:3060] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.265214 14166 tablet_bootstrap.cc:654] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:40.268826 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585b1ca60964e6e805c60801722e038" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:40.270299 13872 raft_consensus.cc:3060] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:31:40.266633 13916 leader_election.cc:343] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:40.277575 14167 tablet_bootstrap.cc:492] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:40.278475 14167 ts_tablet_manager.cc:1403] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.123s	user 0.020s	sys 0.013s
I20260709 12:31:40.280043 13913 leader_election.cc:304] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:40.286618 14168 tablet_bootstrap.cc:492] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4: No bootstrap required, opened a new log
I20260709 12:31:40.286232 14167 raft_consensus.cc:359] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.287170 14168 ts_tablet_manager.cc:1403] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.006s
I20260709 12:31:40.290066 14174 raft_consensus.cc:2804] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:40.290774 14174 raft_consensus.cc:493] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:40.291316 14174 raft_consensus.cc:3060] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.292372 14168 raft_consensus.cc:359] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.293267 14168 raft_consensus.cc:385] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:40.293555 14168 raft_consensus.cc:740] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Initialized, Role: FOLLOWER
I20260709 12:31:40.295574 14024 raft_consensus.cc:2468] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 1.
I20260709 12:31:40.307699 13916 leader_election.cc:304] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85c975ef2dcf437e915b054ae37788d4, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 0ed90780da7b4996a1250b953d170468
I20260709 12:31:40.309422 13872 raft_consensus.cc:2468] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 1.
I20260709 12:31:40.311887 14168 consensus_queue.cc:260] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.310966 14189 raft_consensus.cc:2804] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:40.313302 14189 raft_consensus.cc:697] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Becoming Leader. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:40.314473 14168 ts_tablet_manager.cc:1434] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:31:40.287185 14167 raft_consensus.cc:385] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:40.314320 13948 raft_consensus.cc:2468] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 1.
I20260709 12:31:40.317459 13987 leader_election.cc:304] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:40.318750 14153 raft_consensus.cc:2804] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:40.319234 14153 raft_consensus.cc:697] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Becoming Leader. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:40.320443 14153 consensus_queue.cc:237] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.316674 14167 raft_consensus.cc:740] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:40.324239 14167 consensus_queue.cc:260] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.327162 14167 ts_tablet_manager.cc:1434] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.002s
I20260709 12:31:40.320418 14189 consensus_queue.cc:237] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.328719 14167 tablet_bootstrap.cc:492] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:40.334055 14166 tablet_bootstrap.cc:492] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:40.334638 14166 ts_tablet_manager.cc:1403] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.030s
I20260709 12:31:40.337334 14167 tablet_bootstrap.cc:654] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:40.337620 14166 raft_consensus.cc:359] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.338503 14166 raft_consensus.cc:385] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:40.338774 14166 raft_consensus.cc:740] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:40.339710 14166 consensus_queue.cc:260] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.341931 14166 ts_tablet_manager.cc:1434] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:31:40.343132 14166 tablet_bootstrap.cc:492] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468: Bootstrap starting.
I20260709 12:31:40.353171 14166 tablet_bootstrap.cc:654] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:40.357455 14167 tablet_bootstrap.cc:492] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:40.358132 14167 ts_tablet_manager.cc:1403] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.007s
I20260709 12:31:40.361436 14167 raft_consensus.cc:359] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.362267 14167 raft_consensus.cc:385] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:40.362530 14167 raft_consensus.cc:740] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:40.363181 14167 consensus_queue.cc:260] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.365342 14167 ts_tablet_manager.cc:1434] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:31:40.366605 14167 tablet_bootstrap.cc:492] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a: Bootstrap starting.
I20260709 12:31:40.370007 14091 raft_consensus.cc:493] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:40.371026 14091 raft_consensus.cc:515] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.372548 14167 tablet_bootstrap.cc:654] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:40.374869 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea651d088c394fd3bbeb8e692d9e4a63" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:40.375782 13949 raft_consensus.cc:2468] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 0.
I20260709 12:31:40.377473 13838 leader_election.cc:304] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: 
I20260709 12:31:40.378930 14185 raft_consensus.cc:2804] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:40.379415 14185 raft_consensus.cc:493] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:40.379818 14185 raft_consensus.cc:3060] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.388424 14173 raft_consensus.cc:493] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:40.389281 14173 raft_consensus.cc:515] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.393072 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ad87e1cfd94ac1a0cdf44540e5fa21" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:40.394374 13872 raft_consensus.cc:2468] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 0.
I20260709 12:31:40.395800 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ad87e1cfd94ac1a0cdf44540e5fa21" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:40.396106 13987 leader_election.cc:304] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:40.396793 13949 raft_consensus.cc:2468] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 0.
I20260709 12:31:40.397961 14174 raft_consensus.cc:515] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.393923 14173 leader_election.cc:290] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:40.400142 14173 raft_consensus.cc:2804] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:40.392968 13875 raft_consensus.cc:2468] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 1.
I20260709 12:31:40.400741 14173 raft_consensus.cc:493] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:40.401767 14173 raft_consensus.cc:3060] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.410809 13913 leader_election.cc:304] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:40.414270 14188 raft_consensus.cc:2804] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:40.415028 14188 raft_consensus.cc:697] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Becoming Leader. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:40.416602 14188 consensus_queue.cc:237] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.427848 14091 leader_election.cc:290] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:40.436223 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a825b7ff3a84b0386e22a8cffce199b" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:40.437184 13875 raft_consensus.cc:3060] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.436715 13769 catalog_manager.cc:5697] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3). New cstate: current_term: 1 leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:40.436250 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a825b7ff3a84b0386e22a8cffce199b" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
W20260709 12:31:40.442250 13916 leader_election.cc:343] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:40.446583 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea651d088c394fd3bbeb8e692d9e4a63" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
I20260709 12:31:40.447330 14024 raft_consensus.cc:2468] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 0.
I20260709 12:31:40.449393 14174 leader_election.cc:290] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:40.452785 14185 raft_consensus.cc:515] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.453238 13772 catalog_manager.cc:5697] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "85c975ef2dcf437e915b054ae37788d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:40.456094 14167 tablet_bootstrap.cc:492] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a: No bootstrap required, opened a new log
I20260709 12:31:40.456691 14167 ts_tablet_manager.cc:1403] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.043s
I20260709 12:31:40.459998 14167 raft_consensus.cc:359] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.460770 14167 raft_consensus.cc:385] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:40.461112 14167 raft_consensus.cc:740] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Initialized, Role: FOLLOWER
I20260709 12:31:40.466398 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea651d088c394fd3bbeb8e692d9e4a63" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:40.466702 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea651d088c394fd3bbeb8e692d9e4a63" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:40.467214 14024 raft_consensus.cc:3060] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.467607 13949 raft_consensus.cc:3060] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.470079 13875 raft_consensus.cc:2468] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 1.
I20260709 12:31:40.471593 14185 leader_election.cc:290] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 election: Requested vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:40.471601 13913 leader_election.cc:304] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:40.472843 14188 raft_consensus.cc:2804] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:40.473316 14188 raft_consensus.cc:697] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Becoming Leader. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:40.474402 14188 consensus_queue.cc:237] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.477316 14024 raft_consensus.cc:2468] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 1.
I20260709 12:31:40.480325 14173 raft_consensus.cc:515] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.484802 14167 consensus_queue.cc:260] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.487131 14189 consensus_queue.cc:1048] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:40.487998 13841 leader_election.cc:304] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:40.489233 14185 raft_consensus.cc:2804] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:40.489852 14185 raft_consensus.cc:697] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Becoming Leader. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:40.491009 14185 consensus_queue.cc:237] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.492669 14167 ts_tablet_manager.cc:1434] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:31:40.493590 14207 raft_consensus.cc:493] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:40.494201 14207 raft_consensus.cc:515] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.497092 14166 tablet_bootstrap.cc:492] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468: No bootstrap required, opened a new log
I20260709 12:31:40.497742 14166 ts_tablet_manager.cc:1403] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468: Time spent bootstrapping tablet: real 0.155s	user 0.049s	sys 0.040s
I20260709 12:31:40.497704 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90355a851e704b64a0aa6a90d217bc01" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:40.498179 13949 raft_consensus.cc:2468] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 1.
I20260709 12:31:40.498783 13872 raft_consensus.cc:2393] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea3facf0f98e4c44b1ad6312505ce23a in current term 1: Already voted for candidate 85c975ef2dcf437e915b054ae37788d4 in this term.
I20260709 12:31:40.501072 14166 raft_consensus.cc:359] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.501806 14166 raft_consensus.cc:385] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:40.502151 14166 raft_consensus.cc:740] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Initialized, Role: FOLLOWER
I20260709 12:31:40.503052 14166 consensus_queue.cc:260] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.505616 14166 ts_tablet_manager.cc:1434] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:31:40.505913 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ad87e1cfd94ac1a0cdf44540e5fa21" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:40.505716 14153 consensus_queue.cc:1048] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:40.506608 13872 raft_consensus.cc:3060] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.507653 14173 leader_election.cc:290] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:40.497037 14207 leader_election.cc:290] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:40.512387 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90355a851e704b64a0aa6a90d217bc01" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:40.515799 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ad87e1cfd94ac1a0cdf44540e5fa21" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:40.516508 13948 raft_consensus.cc:3060] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.516800 13987 leader_election.cc:304] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3facf0f98e4c44b1ad6312505ce23a; no voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:40.518404 13769 catalog_manager.cc:5697] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ed90780da7b4996a1250b953d170468 (127.2.157.1). New cstate: current_term: 1 leader_uuid: "0ed90780da7b4996a1250b953d170468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:40.518054 14207 raft_consensus.cc:3060] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.523069 13773 catalog_manager.cc:5697] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "85c975ef2dcf437e915b054ae37788d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:40.525056 13773 catalog_manager.cc:5697] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "85c975ef2dcf437e915b054ae37788d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:40.528468 14189 raft_consensus.cc:493] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:40.529145 14189 raft_consensus.cc:515] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.530742 13872 raft_consensus.cc:2468] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 1.
I20260709 12:31:40.531895 13987 leader_election.cc:304] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:40.531767 14189 leader_election.cc:290] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:40.532819 14153 raft_consensus.cc:2804] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:40.533147 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76a08c1200d4ca3aad288d6495fcd94" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" is_pre_election: true
I20260709 12:31:40.533360 14153 raft_consensus.cc:697] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Becoming Leader. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:40.533972 14022 raft_consensus.cc:2468] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 0.
I20260709 12:31:40.534578 14153 consensus_queue.cc:237] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.535107 13916 leader_election.cc:304] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c975ef2dcf437e915b054ae37788d4, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:40.536166 14174 raft_consensus.cc:2804] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:40.536615 14174 raft_consensus.cc:493] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:40.536216 14188 consensus_queue.cc:1048] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:40.537012 14174 raft_consensus.cc:3060] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.543109 14207 raft_consensus.cc:2749] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:40.546183 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76a08c1200d4ca3aad288d6495fcd94" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:40.546978 13875 raft_consensus.cc:2468] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 0.
I20260709 12:31:40.549984 14174 raft_consensus.cc:515] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.551931 13948 raft_consensus.cc:2468] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 1.
I20260709 12:31:40.552870 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76a08c1200d4ca3aad288d6495fcd94" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:40.553481 13875 raft_consensus.cc:3060] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.560920 13875 raft_consensus.cc:2468] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 1.
I20260709 12:31:40.562388 13913 leader_election.cc:304] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: 
I20260709 12:31:40.563443 14113 raft_consensus.cc:2804] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:40.585716 14153 consensus_queue.cc:1048] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:40.580565 14113 raft_consensus.cc:697] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Becoming Leader. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:40.592010 14113 consensus_queue.cc:237] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.600705 14174 leader_election.cc:290] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 1 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:40.604712 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76a08c1200d4ca3aad288d6495fcd94" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:40.605748 14022 raft_consensus.cc:3060] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.609414 13772 catalog_manager.cc:5697] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3). New cstate: current_term: 1 leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:40.639010 14022 raft_consensus.cc:2468] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 1.
I20260709 12:31:40.647756 13773 catalog_manager.cc:5697] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2). New cstate: current_term: 1 leader_uuid: "85c975ef2dcf437e915b054ae37788d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:40.750201 13949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "563f5d371b2049ecade2ef7486c53a9f"
dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
mode: GRACEFUL
new_leader_uuid: "0ed90780da7b4996a1250b953d170468"
 from {username='slave'} at 127.0.0.1:41396
I20260709 12:31:40.750857 13949 raft_consensus.cc:606] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Received request to transfer leadership to TS 0ed90780da7b4996a1250b953d170468
I20260709 12:31:40.755964 13949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6797ce9ec8834f56b4d65f9b4d88dfde"
dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
mode: GRACEFUL
new_leader_uuid: "0ed90780da7b4996a1250b953d170468"
 from {username='slave'} at 127.0.0.1:41396
I20260709 12:31:40.756520 13949 raft_consensus.cc:606] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Received request to transfer leadership to TS 0ed90780da7b4996a1250b953d170468
I20260709 12:31:40.761829 14022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a40b7f3daaab49a68fee491d7e00094e"
dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
mode: GRACEFUL
new_leader_uuid: "0ed90780da7b4996a1250b953d170468"
 from {username='slave'} at 127.0.0.1:37862
I20260709 12:31:40.762432 14022 raft_consensus.cc:606] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Received request to transfer leadership to TS 0ed90780da7b4996a1250b953d170468
I20260709 12:31:40.767766 14022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2585b1ca60964e6e805c60801722e038"
dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
mode: GRACEFUL
new_leader_uuid: "0ed90780da7b4996a1250b953d170468"
 from {username='slave'} at 127.0.0.1:37862
I20260709 12:31:40.768306 14022 raft_consensus.cc:606] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Received request to transfer leadership to TS 0ed90780da7b4996a1250b953d170468
I20260709 12:31:40.773422 13872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea651d088c394fd3bbeb8e692d9e4a63"
dest_uuid: "0ed90780da7b4996a1250b953d170468"
mode: GRACEFUL
new_leader_uuid: "85c975ef2dcf437e915b054ae37788d4"
 from {username='slave'} at 127.0.0.1:33024
I20260709 12:31:40.773988 13872 raft_consensus.cc:606] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Received request to transfer leadership to TS 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:40.782002 14022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3ad87e1cfd94ac1a0cdf44540e5fa21"
dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
mode: GRACEFUL
new_leader_uuid: "85c975ef2dcf437e915b054ae37788d4"
 from {username='slave'} at 127.0.0.1:37862
I20260709 12:31:40.782569 14022 raft_consensus.cc:606] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Received request to transfer leadership to TS 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:40.790315 13949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d76a08c1200d4ca3aad288d6495fcd94"
dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
mode: GRACEFUL
new_leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
 from {username='slave'} at 127.0.0.1:41396
I20260709 12:31:40.790874 13949 raft_consensus.cc:606] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Received request to transfer leadership to TS ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:40.798607 14113 consensus_queue.cc:1048] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:40.809154 13872 raft_consensus.cc:3060] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.820596 14215 consensus_queue.cc:1048] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:40.820804 14207 consensus_queue.cc:1048] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:40.838469 14215 raft_consensus.cc:993] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4: : Instructing follower 0ed90780da7b4996a1250b953d170468 to start an election
I20260709 12:31:40.839035 14189 raft_consensus.cc:1081] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Signalling peer 0ed90780da7b4996a1250b953d170468 to start an election
I20260709 12:31:40.839900 14173 consensus_queue.cc:1048] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:40.842118 13875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "563f5d371b2049ecade2ef7486c53a9f"
dest_uuid: "0ed90780da7b4996a1250b953d170468"
 from {username='slave'} at 127.0.0.1:33006
I20260709 12:31:40.842924 13875 raft_consensus.cc:493] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:40.843333 13875 raft_consensus.cc:3060] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:40.853727 13875 raft_consensus.cc:515] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.857074 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563f5d371b2049ecade2ef7486c53a9f" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:40.858441 14153 raft_consensus.cc:993] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a: : Instructing follower 0ed90780da7b4996a1250b953d170468 to start an election
I20260709 12:31:40.859059 14173 raft_consensus.cc:1081] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Signalling peer 0ed90780da7b4996a1250b953d170468 to start an election
I20260709 12:31:40.858659 13949 raft_consensus.cc:3055] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:40.860505 13949 raft_consensus.cc:740] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:40.861508 13949 consensus_queue.cc:260] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.863364 13949 raft_consensus.cc:3060] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:40.860875 13872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2585b1ca60964e6e805c60801722e038"
dest_uuid: "0ed90780da7b4996a1250b953d170468"
 from {username='slave'} at 127.0.0.1:33022
I20260709 12:31:40.865760 13872 raft_consensus.cc:493] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:40.866230 13872 raft_consensus.cc:3060] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:40.874606 13949 raft_consensus.cc:2468] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 2.
I20260709 12:31:40.875993 14215 consensus_queue.cc:1048] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:40.879381 14022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563f5d371b2049ecade2ef7486c53a9f" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:40.877225 13875 leader_election.cc:290] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 2 election: Requested vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:40.880084 14022 raft_consensus.cc:3060] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:40.880223 13838 leader_election.cc:304] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: 
I20260709 12:31:40.881294 14206 raft_consensus.cc:2804] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:40.881781 14206 raft_consensus.cc:697] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Becoming Leader. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:40.883522 14206 consensus_queue.cc:237] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.886936 13872 raft_consensus.cc:515] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.888725 14024 raft_consensus.cc:3060] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:40.890507 13872 leader_election.cc:290] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 2 election: Requested vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:40.891441 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585b1ca60964e6e805c60801722e038" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:40.892068 13949 raft_consensus.cc:3060] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:40.895944 13773 catalog_manager.cc:5697] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 reported cstate change: term changed from 1 to 2, leader changed from 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2) to 0ed90780da7b4996a1250b953d170468 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "0ed90780da7b4996a1250b953d170468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:40.899047 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2585b1ca60964e6e805c60801722e038" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:40.899747 14023 raft_consensus.cc:3055] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:40.900054 14023 raft_consensus.cc:740] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:40.900898 14023 consensus_queue.cc:260] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.902520 14023 raft_consensus.cc:3060] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:40.905843 13949 raft_consensus.cc:2468] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 2.
I20260709 12:31:40.907163 13838 leader_election.cc:304] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: 
I20260709 12:31:40.907981 14206 raft_consensus.cc:2804] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:40.908473 14206 raft_consensus.cc:697] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Becoming Leader. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:40.909399 14206 consensus_queue.cc:237] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.913555 14022 raft_consensus.cc:2468] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 2.
I20260709 12:31:40.914417 14023 raft_consensus.cc:2468] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 2.
I20260709 12:31:40.918846 14173 raft_consensus.cc:493] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:40.919418 14173 raft_consensus.cc:515] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.924965 14173 leader_election.cc:290] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:40.925433 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a825b7ff3a84b0386e22a8cffce199b" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468" is_pre_election: true
I20260709 12:31:40.926155 13875 raft_consensus.cc:2468] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 1.
I20260709 12:31:40.927495 13987 leader_election.cc:304] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:40.928301 14153 raft_consensus.cc:2804] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:31:40.928757 14153 raft_consensus.cc:493] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:40.929113 14153 raft_consensus.cc:3060] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:40.927934 13772 catalog_manager.cc:5697] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 reported cstate change: term changed from 1 to 2, leader changed from ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3) to 0ed90780da7b4996a1250b953d170468 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "0ed90780da7b4996a1250b953d170468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:40.931388 14173 consensus_queue.cc:1048] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:40.931627 14174 consensus_queue.cc:1048] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:40.925779 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a825b7ff3a84b0386e22a8cffce199b" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4" is_pre_election: true
I20260709 12:31:40.938618 14153 raft_consensus.cc:515] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.941953 13875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a825b7ff3a84b0386e22a8cffce199b" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:40.942723 13875 raft_consensus.cc:3060] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:40.942723 14153 leader_election.cc:290] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 2 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:40.943333 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a825b7ff3a84b0386e22a8cffce199b" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:40.954106 14173 raft_consensus.cc:993] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a: : Instructing follower 85c975ef2dcf437e915b054ae37788d4 to start an election
I20260709 12:31:40.954648 14173 raft_consensus.cc:1081] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Signalling peer 85c975ef2dcf437e915b054ae37788d4 to start an election
I20260709 12:31:40.956893 14189 consensus_queue.cc:1048] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:40.957451 13875 raft_consensus.cc:2468] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 2.
I20260709 12:31:40.960628 13987 leader_election.cc:304] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 85c975ef2dcf437e915b054ae37788d4
I20260709 12:31:40.961462 14153 raft_consensus.cc:2804] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:40.961953 14153 raft_consensus.cc:697] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 2 LEADER]: Becoming Leader. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:40.963027 13948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3ad87e1cfd94ac1a0cdf44540e5fa21"
dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
 from {username='slave'} at 127.0.0.1:41392
I20260709 12:31:40.962863 14153 consensus_queue.cc:237] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.963655 13948 raft_consensus.cc:493] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:40.964191 13948 raft_consensus.cc:3060] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:40.973448 14207 consensus_queue.cc:1048] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:40.976171 13948 raft_consensus.cc:515] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.978259 14024 raft_consensus.cc:1240] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 2 LEADER]: Rejecting Update request from peer 85c975ef2dcf437e915b054ae37788d4 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:31:40.980829 13874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ad87e1cfd94ac1a0cdf44540e5fa21" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:40.981027 13948 leader_election.cc:290] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 2 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:40.982852 14174 consensus_queue.cc:1059] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:40.983819 14174 consensus_queue.cc:1243] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Peer ea3facf0f98e4c44b1ad6312505ce23a log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:31:40.985837 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3ad87e1cfd94ac1a0cdf44540e5fa21" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:40.986634 14024 raft_consensus.cc:3055] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:40.986982 14024 raft_consensus.cc:740] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:40.987986 14024 consensus_queue.cc:260] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.989378 14024 raft_consensus.cc:3060] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:40.989558 13772 catalog_manager.cc:5697] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a reported cstate change: term changed from 1 to 2, leader changed from 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2) to ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3). New cstate: current_term: 2 leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:40.986653 14189 raft_consensus.cc:3055] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:40.992329 14189 raft_consensus.cc:740] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:40.993194 14189 consensus_queue.cc:260] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:40.996579 14174 consensus_queue.cc:1048] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:40.996995 14189 raft_consensus.cc:3060] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:40.999624 14024 raft_consensus.cc:2468] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 2.
I20260709 12:31:41.001222 13916 leader_election.cc:304] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85c975ef2dcf437e915b054ae37788d4, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 0ed90780da7b4996a1250b953d170468
I20260709 12:31:41.002146 14174 raft_consensus.cc:2804] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:41.002882 14174 raft_consensus.cc:697] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [term 2 LEADER]: Becoming Leader. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:41.003818 14174 consensus_queue.cc:237] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:41.016018 13773 catalog_manager.cc:5697] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 reported cstate change: term changed from 1 to 2, leader changed from ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3) to 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "85c975ef2dcf437e915b054ae37788d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:41.025278 14153 raft_consensus.cc:993] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a: : Instructing follower 0ed90780da7b4996a1250b953d170468 to start an election
I20260709 12:31:41.025967 14153 raft_consensus.cc:1081] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Signalling peer 0ed90780da7b4996a1250b953d170468 to start an election
I20260709 12:31:41.029620 13872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a40b7f3daaab49a68fee491d7e00094e"
dest_uuid: "0ed90780da7b4996a1250b953d170468"
 from {username='slave'} at 127.0.0.1:33022
I20260709 12:31:41.030290 13872 raft_consensus.cc:493] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:41.030702 13872 raft_consensus.cc:3060] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:41.035815 14215 consensus_queue.cc:1048] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:41.039537 14206 consensus_queue.cc:1048] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:41.046418 13872 raft_consensus.cc:515] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:41.050268 13872 leader_election.cc:290] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 2 election: Requested vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:41.051074 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40b7f3daaab49a68fee491d7e00094e" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:41.052037 13948 raft_consensus.cc:3060] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:41.057003 14174 raft_consensus.cc:993] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4: : Instructing follower ea3facf0f98e4c44b1ad6312505ce23a to start an election
I20260709 12:31:41.057669 14174 raft_consensus.cc:1081] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Signalling peer ea3facf0f98e4c44b1ad6312505ce23a to start an election
I20260709 12:31:41.059700 14024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d76a08c1200d4ca3aad288d6495fcd94"
dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
 from {username='slave'} at 127.0.0.1:37858
I20260709 12:31:41.060349 14024 raft_consensus.cc:493] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:41.062903 14024 raft_consensus.cc:3060] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:41.062427 13948 raft_consensus.cc:2468] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 2.
I20260709 12:31:41.066591 14023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40b7f3daaab49a68fee491d7e00094e" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:41.067310 14023 raft_consensus.cc:3055] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:41.067644 14023 raft_consensus.cc:740] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:41.068773 13949 raft_consensus.cc:1240] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Rejecting Update request from peer ea3facf0f98e4c44b1ad6312505ce23a for earlier term 1. Current term is 2. Ops: []
I20260709 12:31:41.068758 14023 consensus_queue.cc:260] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:41.069448 13838 leader_election.cc:304] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, 85c975ef2dcf437e915b054ae37788d4; no voters: 
I20260709 12:31:41.070107 14023 raft_consensus.cc:3060] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:41.070923 14185 raft_consensus.cc:2804] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:41.071455 14185 raft_consensus.cc:697] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Becoming Leader. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:41.072436 14185 consensus_queue.cc:237] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:41.078641 14023 raft_consensus.cc:2468] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 2.
I20260709 12:31:41.082732 14185 consensus_queue.cc:1048] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:41.083559 14024 raft_consensus.cc:515] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:41.086192 14024 leader_election.cc:290] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 2 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:41.088866 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76a08c1200d4ca3aad288d6495fcd94" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:41.089643 13872 raft_consensus.cc:3060] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:41.092159 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76a08c1200d4ca3aad288d6495fcd94" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:41.095000 13949 raft_consensus.cc:3055] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:41.095417 13949 raft_consensus.cc:740] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:41.096356 13949 consensus_queue.cc:260] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:41.097994 13949 raft_consensus.cc:3060] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:41.100119 13872 raft_consensus.cc:2468] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 2.
I20260709 12:31:41.099650 13773 catalog_manager.cc:5697] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 reported cstate change: term changed from 1 to 2, leader changed from ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3) to 0ed90780da7b4996a1250b953d170468 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "0ed90780da7b4996a1250b953d170468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:41.101307 13987 leader_election.cc:304] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:41.102381 14233 raft_consensus.cc:2804] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:41.102967 14233 raft_consensus.cc:697] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 LEADER]: Becoming Leader. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:41.103935 14233 consensus_queue.cc:237] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:41.106801 13949 raft_consensus.cc:2468] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 2.
I20260709 12:31:41.111243 14206 raft_consensus.cc:993] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468: : Instructing follower 85c975ef2dcf437e915b054ae37788d4 to start an election
I20260709 12:31:41.111730 14206 raft_consensus.cc:1081] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Signalling peer 85c975ef2dcf437e915b054ae37788d4 to start an election
I20260709 12:31:41.115871 13948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea651d088c394fd3bbeb8e692d9e4a63"
dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
 from {username='slave'} at 127.0.0.1:41378
I20260709 12:31:41.116420 13948 raft_consensus.cc:493] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:41.117745 13948 raft_consensus.cc:3060] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:41.117911 13772 catalog_manager.cc:5697] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a reported cstate change: term changed from 1 to 2, leader changed from 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2) to ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3). New cstate: current_term: 2 leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:41.123683 13948 raft_consensus.cc:515] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:41.126729 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea651d088c394fd3bbeb8e692d9e4a63" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:41.126893 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea651d088c394fd3bbeb8e692d9e4a63" candidate_uuid: "85c975ef2dcf437e915b054ae37788d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:41.127357 13872 raft_consensus.cc:3055] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:41.127504 14024 raft_consensus.cc:3060] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:41.127737 13872 raft_consensus.cc:740] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:41.127808 13948 leader_election.cc:290] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 2 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:41.128654 13872 consensus_queue.cc:260] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:41.130012 13872 raft_consensus.cc:3060] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:41.135715 14024 raft_consensus.cc:2468] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 2.
I20260709 12:31:41.137475 13872 raft_consensus.cc:2468] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c975ef2dcf437e915b054ae37788d4 in term 2.
I20260709 12:31:41.138228 13916 leader_election.cc:304] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c975ef2dcf437e915b054ae37788d4, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:41.139200 14174 raft_consensus.cc:2804] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:41.139730 14174 raft_consensus.cc:697] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [term 2 LEADER]: Becoming Leader. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:41.140508 14174 consensus_queue.cc:237] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:41.147038 13772 catalog_manager.cc:5697] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 reported cstate change: term changed from 1 to 2, leader changed from 0ed90780da7b4996a1250b953d170468 (127.2.157.1) to 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2). New cstate: current_term: 2 leader_uuid: "85c975ef2dcf437e915b054ae37788d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:41.223577 14215 raft_consensus.cc:993] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4: : Instructing follower 0ed90780da7b4996a1250b953d170468 to start an election
I20260709 12:31:41.224100 14174 raft_consensus.cc:1081] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Signalling peer 0ed90780da7b4996a1250b953d170468 to start an election
I20260709 12:31:41.225716 13872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6797ce9ec8834f56b4d65f9b4d88dfde"
dest_uuid: "0ed90780da7b4996a1250b953d170468"
 from {username='slave'} at 127.0.0.1:33006
I20260709 12:31:41.226292 13872 raft_consensus.cc:493] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:41.226622 13872 raft_consensus.cc:3060] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:41.232072 13872 raft_consensus.cc:515] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:41.233954 13872 leader_election.cc:290] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 2 election: Requested vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3:38003)
I20260709 12:31:41.235107 13948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6797ce9ec8834f56b4d65f9b4d88dfde" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:41.235033 14024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6797ce9ec8834f56b4d65f9b4d88dfde" candidate_uuid: "0ed90780da7b4996a1250b953d170468" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
I20260709 12:31:41.236016 13948 raft_consensus.cc:3055] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:41.236018 14024 raft_consensus.cc:3060] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:41.236514 13948 raft_consensus.cc:740] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:41.237439 13948 consensus_queue.cc:260] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:41.238843 13948 raft_consensus.cc:3060] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:41.244181 14024 raft_consensus.cc:2468] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 2.
I20260709 12:31:41.245668 13841 leader_election.cc:304] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:41.246706 14237 raft_consensus.cc:2804] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:41.246824 13948 raft_consensus.cc:2468] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed90780da7b4996a1250b953d170468 in term 2.
I20260709 12:31:41.247288 14237 raft_consensus.cc:697] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Becoming Leader. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:41.248337 14237 consensus_queue.cc:237] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:41.256124 13772 catalog_manager.cc:5697] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 reported cstate change: term changed from 1 to 2, leader changed from 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2) to 0ed90780da7b4996a1250b953d170468 (127.2.157.1). New cstate: current_term: 2 leader_uuid: "0ed90780da7b4996a1250b953d170468" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:41.299187 14024 raft_consensus.cc:1275] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Refusing update from remote peer 0ed90780da7b4996a1250b953d170468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:41.300482 14237 consensus_queue.cc:1048] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:41.309083 13948 raft_consensus.cc:1275] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Refusing update from remote peer 0ed90780da7b4996a1250b953d170468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:41.310879 14185 consensus_queue.cc:1048] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:41.334568 14024 raft_consensus.cc:1275] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Refusing update from remote peer 0ed90780da7b4996a1250b953d170468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:41.335887 14185 consensus_queue.cc:1048] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:41.343415 13948 raft_consensus.cc:1275] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Refusing update from remote peer 0ed90780da7b4996a1250b953d170468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:41.345582 14237 consensus_queue.cc:1048] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:41.378626 13948 raft_consensus.cc:1275] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Refusing update from remote peer ea3facf0f98e4c44b1ad6312505ce23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:31:41.378958 13948 pending_rounds.cc:85] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4: Aborting all ops after (but not including) 0
I20260709 12:31:41.379172 13948 pending_rounds.cc:107] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:31:41.379402 13948 raft_consensus.cc:2889] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:31:41.380736 14233 consensus_queue.cc:1048] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:41.388203 13872 raft_consensus.cc:1275] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Refusing update from remote peer ea3facf0f98e4c44b1ad6312505ce23a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:31:41.389984 14173 consensus_queue.cc:1048] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:41.432719 14024 raft_consensus.cc:1275] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Refusing update from remote peer 85c975ef2dcf437e915b054ae37788d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:41.433948 14174 consensus_queue.cc:1048] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:41.440855 13872 raft_consensus.cc:3060] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:41.448612 13872 raft_consensus.cc:1275] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Refusing update from remote peer 85c975ef2dcf437e915b054ae37788d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:41.449925 14189 consensus_queue.cc:1048] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:41.496847 13948 raft_consensus.cc:1275] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Refusing update from remote peer ea3facf0f98e4c44b1ad6312505ce23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:41.498409 14173 consensus_queue.cc:1048] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:41.508169 13872 raft_consensus.cc:1275] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Refusing update from remote peer ea3facf0f98e4c44b1ad6312505ce23a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:41.509943 14173 consensus_queue.cc:1048] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:41.527191 13948 raft_consensus.cc:1275] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Refusing update from remote peer 0ed90780da7b4996a1250b953d170468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:41.529042 14206 consensus_queue.cc:1048] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:41.536943 14024 raft_consensus.cc:1275] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Refusing update from remote peer 0ed90780da7b4996a1250b953d170468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:41.538705 14237 consensus_queue.cc:1048] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:41.541069 13874 raft_consensus.cc:1275] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Refusing update from remote peer 85c975ef2dcf437e915b054ae37788d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:41.542730 14189 consensus_queue.cc:1048] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:41.552862 14024 raft_consensus.cc:1275] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Refusing update from remote peer 85c975ef2dcf437e915b054ae37788d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:41.554280 14174 consensus_queue.cc:1048] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:41.724128 13948 raft_consensus.cc:1275] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Refusing update from remote peer 0ed90780da7b4996a1250b953d170468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:41.725343 14185 consensus_queue.cc:1048] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:41.734381 14023 raft_consensus.cc:1275] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Refusing update from remote peer 0ed90780da7b4996a1250b953d170468: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:41.736059 14237 consensus_queue.cc:1048] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:43.794271 13769 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44480:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:31:43.816125 13769 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44480:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:31:43.856662  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:31:43.963591 13841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.3:38003, user_credentials={real_user=slave}} blocked reactor thread for 119625us
I20260709 12:31:43.996825 14273 tablet.cc:1724] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.010154 14289 tablet.cc:1724] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.025082 14290 tablet.cc:1724] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.035578 14287 tablet.cc:1724] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.042583 14279 tablet.cc:1724] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:31:44.058326 14272 log.cc:927] Time spent T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:31:44.103402 14300 tablet.cc:1724] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.117365 14295 tablet.cc:1724] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.175704 14304 tablet.cc:1724] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:31:44.193320 14292 log.cc:927] Time spent T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:31:44.197574 14279 tablet.cc:1724] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.198494 14299 tablet.cc:1724] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.206691 14296 tablet.cc:1724] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:31:44.253556 13838 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:34327, user_credentials={real_user=slave}} blocked reactor thread for 97811.2us
I20260709 12:31:44.232723 14303 tablet.cc:1724] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.248193 14287 tablet.cc:1724] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.257225 14273 tablet.cc:1724] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.238566 14289 tablet.cc:1724] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.282925 14305 tablet.cc:1724] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.297811 14299 tablet.cc:1724] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.304600 14273 tablet.cc:1724] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.309007 14279 tablet.cc:1724] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.294380 14290 tablet.cc:1724] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.318953 14300 tablet.cc:1724] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:31:44.300688 13987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.157.2:34327, user_credentials={real_user=slave}} blocked reactor thread for 62126.1us
I20260709 12:31:44.326361 13875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "210b05f6d0bd4fb6bae9f5ae09ec4ea1"
dest_uuid: "0ed90780da7b4996a1250b953d170468"
mode: GRACEFUL
new_leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
 from {username='slave'} at 127.0.0.1:38984
I20260709 12:31:44.327071 13875 raft_consensus.cc:606] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Received request to transfer leadership to TS ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:44.344271 14300 tablet.cc:1724] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.344936 14289 tablet.cc:1724] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.353221 14304 tablet.cc:1724] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.359942 14306 raft_consensus.cc:993] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468: : Instructing follower ea3facf0f98e4c44b1ad6312505ce23a to start an election
I20260709 12:31:44.360510 14306 raft_consensus.cc:1081] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Signalling peer ea3facf0f98e4c44b1ad6312505ce23a to start an election
I20260709 12:31:44.362596 14020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "210b05f6d0bd4fb6bae9f5ae09ec4ea1"
dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
 from {username='slave'} at 127.0.0.1:37854
I20260709 12:31:44.363189 14020 raft_consensus.cc:493] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:44.363535 14020 raft_consensus.cc:3060] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:44.370662 14296 tablet.cc:1724] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.377503 14020 raft_consensus.cc:515] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:44.378217 14303 tablet.cc:1724] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.381196 14020 leader_election.cc:290] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 3 election: Requested vote from peers 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327), 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287)
I20260709 12:31:44.382624 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210b05f6d0bd4fb6bae9f5ae09ec4ea1" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:44.383333 13872 raft_consensus.cc:3055] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:31:44.383729 13872 raft_consensus.cc:740] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ed90780da7b4996a1250b953d170468, State: Running, Role: LEADER
I20260709 12:31:44.384756 13872 consensus_queue.cc:260] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:44.386155 13872 raft_consensus.cc:3060] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:44.390077 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "210b05f6d0bd4fb6bae9f5ae09ec4ea1" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:44.390707 13949 raft_consensus.cc:3060] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:44.391774 14273 tablet.cc:1724] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:44.394325 13872 raft_consensus.cc:2468] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 3.
I20260709 12:31:44.395650 13987 leader_election.cc:304] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:44.396997 14308 raft_consensus.cc:2804] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:31:44.397461 14308 raft_consensus.cc:697] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 3 LEADER]: Becoming Leader. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:44.397722 13949 raft_consensus.cc:2468] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 3.
I20260709 12:31:44.398327 14308 consensus_queue.cc:237] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } }
I20260709 12:31:44.424278 13949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76e1aba068f04178b14344347c5dfb76"
dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
mode: GRACEFUL
new_leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
 from {username='slave'} at 127.0.0.1:44998
I20260709 12:31:44.424952 13949 raft_consensus.cc:606] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 2 LEADER]: Received request to transfer leadership to TS ea3facf0f98e4c44b1ad6312505ce23a
I20260709 12:31:44.426484  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:31:44.427361  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:44.436034 13771 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e: soft_deleted_table [id=69452db7bc3c41caa5ed36daab15f35f] alter complete (version 1)
I20260709 12:31:44.444123 13771 catalog_manager.cc:5697] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a reported cstate change: term changed from 2 to 3, leader changed from 0ed90780da7b4996a1250b953d170468 (127.2.157.1) to ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3). New cstate: current_term: 3 leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:44.713330 14243 raft_consensus.cc:993] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4: : Instructing follower ea3facf0f98e4c44b1ad6312505ce23a to start an election
I20260709 12:31:44.713898 14174 raft_consensus.cc:1081] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 2 LEADER]: Signalling peer ea3facf0f98e4c44b1ad6312505ce23a to start an election
I20260709 12:31:44.715372 14020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76e1aba068f04178b14344347c5dfb76"
dest_uuid: "ea3facf0f98e4c44b1ad6312505ce23a"
 from {username='slave'} at 127.0.0.1:37858
I20260709 12:31:44.715924 14020 raft_consensus.cc:493] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:44.716243 14020 raft_consensus.cc:3060] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:44.721859 14020 raft_consensus.cc:515] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:44.723940 14020 leader_election.cc:290] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 3 election: Requested vote from peers 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287), 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327)
I20260709 12:31:44.724561 13872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e1aba068f04178b14344347c5dfb76" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ed90780da7b4996a1250b953d170468"
I20260709 12:31:44.725008 13949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76e1aba068f04178b14344347c5dfb76" candidate_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85c975ef2dcf437e915b054ae37788d4"
I20260709 12:31:44.725210 13872 raft_consensus.cc:3060] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:44.725594 13949 raft_consensus.cc:3055] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:31:44.725860 13949 raft_consensus.cc:740] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85c975ef2dcf437e915b054ae37788d4, State: Running, Role: LEADER
I20260709 12:31:44.726560 13949 consensus_queue.cc:260] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:44.727423 13949 raft_consensus.cc:3060] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:44.730764 13872 raft_consensus.cc:2468] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 3.
I20260709 12:31:44.731828 13987 leader_election.cc:304] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed90780da7b4996a1250b953d170468, ea3facf0f98e4c44b1ad6312505ce23a; no voters: 
I20260709 12:31:44.732659 14308 raft_consensus.cc:2804] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:31:44.733109 14308 raft_consensus.cc:697] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 3 LEADER]: Becoming Leader. State: Replica: ea3facf0f98e4c44b1ad6312505ce23a, State: Running, Role: LEADER
I20260709 12:31:44.733673 13949 raft_consensus.cc:2468] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3facf0f98e4c44b1ad6312505ce23a in term 3.
I20260709 12:31:44.733960 14308 consensus_queue.cc:237] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } }
I20260709 12:31:44.741945 13771 catalog_manager.cc:5697] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a reported cstate change: term changed from 2 to 3, leader changed from 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2) to ea3facf0f98e4c44b1ad6312505ce23a (127.2.157.3). New cstate: current_term: 3 leader_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3facf0f98e4c44b1ad6312505ce23a" member_type: VOTER last_known_addr { host: "127.2.157.3" port: 38003 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:44.868482 13949 raft_consensus.cc:1275] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [term 3 FOLLOWER]: Refusing update from remote peer ea3facf0f98e4c44b1ad6312505ce23a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:44.869774 14308 consensus_queue.cc:1048] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:44.881436 13872 raft_consensus.cc:1275] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 3 FOLLOWER]: Refusing update from remote peer ea3facf0f98e4c44b1ad6312505ce23a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:44.885444 14308 consensus_queue.cc:1048] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:31:45.287241 13949 raft_consensus.cc:1275] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 3 FOLLOWER]: Refusing update from remote peer ea3facf0f98e4c44b1ad6312505ce23a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:45.288482 14308 consensus_queue.cc:1048] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c975ef2dcf437e915b054ae37788d4" member_type: VOTER last_known_addr { host: "127.2.157.2" port: 34327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:45.297770 13872 raft_consensus.cc:1275] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 3 FOLLOWER]: Refusing update from remote peer ea3facf0f98e4c44b1ad6312505ce23a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:45.300163 14319 consensus_queue.cc:1048] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed90780da7b4996a1250b953d170468" member_type: VOTER last_known_addr { host: "127.2.157.1" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:45.428511  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:45.434360  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:45.434787  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:46.435703  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:46.440683  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:46.441138  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:47.442235  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:47.447922  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:47.448451  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:48.449509  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:48.454716  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:48.455193  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:49.456369  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:49.462775  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:49.463284  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:50.464720  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:50.475032  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:50.475697  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:51.476979  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:51.482173  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:51.482613  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:52.483558  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:52.490157  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:52.490607  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:53.491588  2676 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:53.496687  2676 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:53.497112  2676 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:755: Failure
Expected: (leader.second) != (3), actual: 3 vs 3
I20260709 12:31:54.557302  2676 tablet_server.cc:179] TabletServer@127.2.157.1:0 shutting down...
W20260709 12:31:54.593289 13987 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
W20260709 12:31:54.600818 13987 consensus_peers.cc:597] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a -> Peer 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287): Couldn't send request to peer 0ed90780da7b4996a1250b953d170468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:54.603113  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:54.604291  2676 tablet_replica.cc:333] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
W20260709 12:31:54.604699 13987 consensus_peers.cc:597] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a -> Peer 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287): Couldn't send request to peer 0ed90780da7b4996a1250b953d170468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:54.605300  2676 raft_consensus.cc:2243] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.606113  2676 raft_consensus.cc:2272] T d76a08c1200d4ca3aad288d6495fcd94 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.608788  2676 tablet_replica.cc:333] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.609373  2676 raft_consensus.cc:2243] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.609982  2676 raft_consensus.cc:2272] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.612515  2676 tablet_replica.cc:333] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.613284  2676 raft_consensus.cc:2243] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.614035  2676 raft_consensus.cc:2272] T 7a825b7ff3a84b0386e22a8cffce199b P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.616551  2676 tablet_replica.cc:333] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.617172  2676 raft_consensus.cc:2243] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.617790  2676 raft_consensus.cc:2272] T ea651d088c394fd3bbeb8e692d9e4a63 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.620384  2676 tablet_replica.cc:333] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.621125  2676 raft_consensus.cc:2243] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:54.622345  2676 raft_consensus.cc:2272] T 2585b1ca60964e6e805c60801722e038 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.626312  2676 tablet_replica.cc:333] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.627029  2676 raft_consensus.cc:2243] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:54.628352  2676 raft_consensus.cc:2272] T 341b167d476f4e3287bcf5131f86a201 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.631057  2676 tablet_replica.cc:333] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.631644  2676 raft_consensus.cc:2243] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:54.632555  2676 raft_consensus.cc:2272] T 6797ce9ec8834f56b4d65f9b4d88dfde P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.635270  2676 tablet_replica.cc:333] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.635869  2676 raft_consensus.cc:2243] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.636364  2676 raft_consensus.cc:2272] T 1658e4cbe8044907b3d5647dcd259b67 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.639729  2676 tablet_replica.cc:333] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.640635  2676 raft_consensus.cc:2243] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:54.642023  2676 raft_consensus.cc:2272] T 563f5d371b2049ecade2ef7486c53a9f P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:54.643541 13987 consensus_peers.cc:597] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a -> Peer 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287): Couldn't send request to peer 0ed90780da7b4996a1250b953d170468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:54.645040  2676 tablet_replica.cc:333] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.645843  2676 raft_consensus.cc:2243] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.646346  2676 raft_consensus.cc:2272] T 62790f7879ea41aea075792ee44812f9 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.648875  2676 tablet_replica.cc:333] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.649657  2676 raft_consensus.cc:2243] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.650333  2676 raft_consensus.cc:2272] T 90355a851e704b64a0aa6a90d217bc01 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.653187  2676 tablet_replica.cc:333] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.653851  2676 raft_consensus.cc:2243] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:54.654918  2676 raft_consensus.cc:2272] T f7cf75a7a6b24af4a2024bd1d286ca31 P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.657620  2676 tablet_replica.cc:333] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.658337  2676 raft_consensus.cc:2243] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.658903  2676 raft_consensus.cc:2272] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 0ed90780da7b4996a1250b953d170468 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.661617  2676 tablet_replica.cc:333] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.662285  2676 raft_consensus.cc:2243] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.663007  2676 raft_consensus.cc:2272] T 76e1aba068f04178b14344347c5dfb76 P 0ed90780da7b4996a1250b953d170468 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.666756  2676 tablet_replica.cc:333] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.667630  2676 raft_consensus.cc:2243] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:31:54.668308 13913 consensus_peers.cc:597] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 -> Peer 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287): Couldn't send request to peer 0ed90780da7b4996a1250b953d170468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:54.668442  2676 raft_consensus.cc:2272] T 8c18b0d870cc438494c105baec4e94c7 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:54.670004 13913 consensus_peers.cc:597] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 -> Peer 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287): Couldn't send request to peer 0ed90780da7b4996a1250b953d170468. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:54.673089  2676 tablet_replica.cc:333] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.674048  2676 raft_consensus.cc:2243] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:54.675460  2676 raft_consensus.cc:2272] T a40b7f3daaab49a68fee491d7e00094e P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.678630  2676 tablet_replica.cc:333] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.679170  2676 raft_consensus.cc:2243] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.679705  2676 raft_consensus.cc:2272] T da0b8f59e5b8449888f11eb6bcbdee34 P 0ed90780da7b4996a1250b953d170468 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.684396  2676 tablet_replica.cc:333] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468: stopping tablet replica
I20260709 12:31:54.685029  2676 raft_consensus.cc:2243] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:54.686127  2676 raft_consensus.cc:2272] T d3131b2fc314427ba539da38cde592ea P 0ed90780da7b4996a1250b953d170468 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:54.735821 13913 consensus_peers.cc:597] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 -> Peer 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287): Couldn't send request to peer 0ed90780da7b4996a1250b953d170468. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:39287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:54.738339  2676 tablet_server.cc:196] TabletServer@127.2.157.1:0 shutdown complete.
I20260709 12:31:54.783836  2676 tablet_server.cc:179] TabletServer@127.2.157.2:0 shutting down...
W20260709 12:31:54.795845 13913 consensus_peers.cc:597] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 -> Peer 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287): Couldn't send request to peer 0ed90780da7b4996a1250b953d170468. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:39287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:31:54.797468 13987 consensus_peers.cc:597] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a -> Peer 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287): Couldn't send request to peer 0ed90780da7b4996a1250b953d170468. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:39287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:54.822311  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:54.823376  2676 tablet_replica.cc:333] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.824748  2676 raft_consensus.cc:2243] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.825587  2676 raft_consensus.cc:2272] T d76a08c1200d4ca3aad288d6495fcd94 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.828260  2676 tablet_replica.cc:333] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.828863  2676 raft_consensus.cc:2243] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:54.829792  2676 raft_consensus.cc:2272] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.832392  2676 tablet_replica.cc:333] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.833065  2676 raft_consensus.cc:2243] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.833670  2676 raft_consensus.cc:2272] T 7a825b7ff3a84b0386e22a8cffce199b P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.836300  2676 tablet_replica.cc:333] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.836892  2676 raft_consensus.cc:2243] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:54.837795  2676 raft_consensus.cc:2272] T ea651d088c394fd3bbeb8e692d9e4a63 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.840412  2676 tablet_replica.cc:333] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.841089  2676 raft_consensus.cc:2243] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.841581  2676 raft_consensus.cc:2272] T 2585b1ca60964e6e805c60801722e038 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.844107  2676 tablet_replica.cc:333] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.844681  2676 raft_consensus.cc:2243] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.845204  2676 raft_consensus.cc:2272] T 341b167d476f4e3287bcf5131f86a201 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.847796  2676 tablet_replica.cc:333] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.848380  2676 raft_consensus.cc:2243] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.848917  2676 raft_consensus.cc:2272] T 6797ce9ec8834f56b4d65f9b4d88dfde P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.851320  2676 tablet_replica.cc:333] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.852020  2676 raft_consensus.cc:2243] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:54.852895  2676 raft_consensus.cc:2272] T 1658e4cbe8044907b3d5647dcd259b67 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.855782  2676 tablet_replica.cc:333] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.856401  2676 raft_consensus.cc:2243] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:54.857396  2676 raft_consensus.cc:2272] T 8c18b0d870cc438494c105baec4e94c7 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.860285  2676 tablet_replica.cc:333] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.860900  2676 raft_consensus.cc:2243] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.861493  2676 raft_consensus.cc:2272] T a40b7f3daaab49a68fee491d7e00094e P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.864033  2676 tablet_replica.cc:333] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.864609  2676 raft_consensus.cc:2243] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.865207  2676 raft_consensus.cc:2272] T da0b8f59e5b8449888f11eb6bcbdee34 P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.868399  2676 tablet_replica.cc:333] T d3131b2fc314427ba539da38cde592ea P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.869047  2676 raft_consensus.cc:2243] T d3131b2fc314427ba539da38cde592ea P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.869588  2676 raft_consensus.cc:2272] T d3131b2fc314427ba539da38cde592ea P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.872116  2676 tablet_replica.cc:333] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.872725  2676 raft_consensus.cc:2243] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.873323  2676 raft_consensus.cc:2272] T 563f5d371b2049ecade2ef7486c53a9f P 85c975ef2dcf437e915b054ae37788d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.875774  2676 tablet_replica.cc:333] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.876367  2676 raft_consensus.cc:2243] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:54.877408  2676 raft_consensus.cc:2272] T 62790f7879ea41aea075792ee44812f9 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.879827  2676 tablet_replica.cc:333] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.880481  2676 raft_consensus.cc:2243] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:54.881805  2676 raft_consensus.cc:2272] T 90355a851e704b64a0aa6a90d217bc01 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.884634  2676 tablet_replica.cc:333] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.885285  2676 raft_consensus.cc:2243] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.885761  2676 raft_consensus.cc:2272] T f7cf75a7a6b24af4a2024bd1d286ca31 P 85c975ef2dcf437e915b054ae37788d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.888389  2676 tablet_replica.cc:333] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.888971  2676 raft_consensus.cc:2243] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.889478  2676 raft_consensus.cc:2272] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P 85c975ef2dcf437e915b054ae37788d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:54.891952  2676 tablet_replica.cc:333] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4: stopping tablet replica
I20260709 12:31:54.892472  2676 raft_consensus.cc:2243] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:54.892910  2676 raft_consensus.cc:2272] T 76e1aba068f04178b14344347c5dfb76 P 85c975ef2dcf437e915b054ae37788d4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:54.908871 13987 consensus_peers.cc:597] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a -> Peer 85c975ef2dcf437e915b054ae37788d4 (127.2.157.2:34327): Couldn't send request to peer 85c975ef2dcf437e915b054ae37788d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:54.939886  2676 tablet_server.cc:196] TabletServer@127.2.157.2:0 shutdown complete.
I20260709 12:31:54.986111  2676 tablet_server.cc:179] TabletServer@127.2.157.3:0 shutting down...
W20260709 12:31:54.992709 13987 consensus_peers.cc:597] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a -> Peer 0ed90780da7b4996a1250b953d170468 (127.2.157.1:39287): Couldn't send request to peer 0ed90780da7b4996a1250b953d170468. Status: Network error: Client connection negotiation failed: client connection to 127.2.157.1:39287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:55.028658  2676 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:55.029615  2676 tablet_replica.cc:333] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.030934  2676 raft_consensus.cc:2243] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:55.031971  2676 raft_consensus.cc:2272] T 7a825b7ff3a84b0386e22a8cffce199b P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.034572  2676 tablet_replica.cc:333] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.035224  2676 raft_consensus.cc:2243] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:55.036108  2676 raft_consensus.cc:2272] T d76a08c1200d4ca3aad288d6495fcd94 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.038676  2676 tablet_replica.cc:333] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.039289  2676 raft_consensus.cc:2243] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:55.039796  2676 raft_consensus.cc:2272] T ea651d088c394fd3bbeb8e692d9e4a63 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.042294  2676 tablet_replica.cc:333] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.042964  2676 raft_consensus.cc:2243] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:55.043521  2676 raft_consensus.cc:2272] T 2585b1ca60964e6e805c60801722e038 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.046236  2676 tablet_replica.cc:333] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.046975  2676 raft_consensus.cc:2243] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:55.047466  2676 raft_consensus.cc:2272] T d3ad87e1cfd94ac1a0cdf44540e5fa21 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.049867  2676 tablet_replica.cc:333] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.050519  2676 raft_consensus.cc:2243] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:55.051092  2676 raft_consensus.cc:2272] T 563f5d371b2049ecade2ef7486c53a9f P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.053494  2676 tablet_replica.cc:333] T 62790f7879ea41aea075792ee44812f9 P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.054103  2676 raft_consensus.cc:2243] T 62790f7879ea41aea075792ee44812f9 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:55.054554  2676 raft_consensus.cc:2272] T 62790f7879ea41aea075792ee44812f9 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.056672  2676 tablet_replica.cc:333] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.057272  2676 raft_consensus.cc:2243] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:55.057757  2676 raft_consensus.cc:2272] T 8c18b0d870cc438494c105baec4e94c7 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.059847  2676 tablet_replica.cc:333] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.060397  2676 raft_consensus.cc:2243] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:55.060895  2676 raft_consensus.cc:2272] T a40b7f3daaab49a68fee491d7e00094e P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.062947  2676 tablet_replica.cc:333] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.063483  2676 raft_consensus.cc:2243] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:55.064329  2676 raft_consensus.cc:2272] T da0b8f59e5b8449888f11eb6bcbdee34 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.066385  2676 tablet_replica.cc:333] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.066977  2676 raft_consensus.cc:2243] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:55.067471  2676 raft_consensus.cc:2272] T 6797ce9ec8834f56b4d65f9b4d88dfde P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.069552  2676 tablet_replica.cc:333] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.070142  2676 raft_consensus.cc:2243] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:55.070622  2676 raft_consensus.cc:2272] T 341b167d476f4e3287bcf5131f86a201 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.072741  2676 tablet_replica.cc:333] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.073263  2676 raft_consensus.cc:2243] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:55.073707  2676 raft_consensus.cc:2272] T 90355a851e704b64a0aa6a90d217bc01 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.075940  2676 tablet_replica.cc:333] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.076622  2676 raft_consensus.cc:2243] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:31:55.077678  2676 raft_consensus.cc:2272] T 210b05f6d0bd4fb6bae9f5ae09ec4ea1 P ea3facf0f98e4c44b1ad6312505ce23a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.080725  2676 tablet_replica.cc:333] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.081300  2676 raft_consensus.cc:2243] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:55.081750  2676 raft_consensus.cc:2272] T f7cf75a7a6b24af4a2024bd1d286ca31 P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.083950  2676 tablet_replica.cc:333] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.084471  2676 raft_consensus.cc:2243] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:55.084914  2676 raft_consensus.cc:2272] T d3131b2fc314427ba539da38cde592ea P ea3facf0f98e4c44b1ad6312505ce23a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.087173  2676 tablet_replica.cc:333] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.087657  2676 raft_consensus.cc:2243] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:31:55.088589  2676 raft_consensus.cc:2272] T 76e1aba068f04178b14344347c5dfb76 P ea3facf0f98e4c44b1ad6312505ce23a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.090915  2676 tablet_replica.cc:333] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a: stopping tablet replica
I20260709 12:31:55.091416  2676 raft_consensus.cc:2243] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:55.091907  2676 raft_consensus.cc:2272] T 1658e4cbe8044907b3d5647dcd259b67 P ea3facf0f98e4c44b1ad6312505ce23a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.135186  2676 tablet_server.cc:196] TabletServer@127.2.157.3:0 shutdown complete.
I20260709 12:31:55.174742  2676 master.cc:562] Master@127.2.157.62:42309 shutting down...
I20260709 12:31:55.200007  2676 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:55.200706  2676 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:55.201069  2676 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2f5622bd8b494d8e9f8838b6f59b077e: stopping tablet replica
I20260709 12:31:55.221568  2676 master.cc:584] Master@127.2.157.62:42309 shutdown complete.
I20260709 12:31:55.257827  2676 test_util.cc:182] -----------------------------------------------
I20260709 12:31:55.258116  2676 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskGkOjm6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599939977835-2676-0
[  FAILED  ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true (20600 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41134 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (375118 ms total)
[  PASSED  ] 6 tests.
[  FAILED  ] 2 tests, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver
[  FAILED  ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true

 2 FAILED TESTS
I20260709 12:31:55.265820  2676 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2238 messages since previous log ~31 seconds ago
I20260709 12:31:55.266227  2676 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2245 messages since previous log ~31 seconds ago
I20260709 12:31:55.266422  2676 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2244 messages since previous log ~32 seconds ago
I20260709 12:31:55.266702  2676 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:31:55.266877  2676 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:31:55.267110  2676 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~150 seconds ago
I20260709 12:31:55.267432  2676 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 11 messages since previous log ~0 seconds ago
I20260709 12:31:55.267779  2676 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 45 messages since previous log ~19 seconds ago
